2023-06-22T10:28:21.610 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb 2023-06-22T10:28:21.611 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/vshankar-2023-06-22_10:13:08-fs-wip-vshankar-testing-20230620.052303-testing-default-smithi/7311271 --verbose --name vshankar-2023-06-22_10:13:08-fs-wip-vshankar-testing-20230620.052303-testing-default-smithi --owner scheduled_vshankar@teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} -- /home/teuthworker/archive/vshankar-2023-06-22_10:13:08-fs-wip-vshankar-testing-20230620.052303-testing-default-smithi/7311271/orig.config.yaml 2023-06-22T10:28:21.656 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-22T10:28:21.794 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2023-06-22_10:13:08-fs-wip-vshankar-testing-20230620.052303-testing-default-smithi/7311271 branch: wip-vshankar-testing-20230620.052303 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} email: vshankar@redhat.com first_in_suite: false job_id: '7311271' kernel: client: branch: testing flavor: default kdb: true sha1: 1c622d92b6f18ce44a7c33802686ff61c3c273ab ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2023-06-22_10:13:08-fs-wip-vshankar-testing-20230620.052303-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-vshankar-testing-20230620.052303 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 2016e3af238feea2bbee7eb0e99c925a041afbfb ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 2016e3af238feea2bbee7eb0e99c925a041afbfb kclient: syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20230620.052303 sha1: dc76074c5388e1a03fbcea1abab06ce902f6af4a owner: scheduled_vshankar@teuthology priority: 30 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 sha1: 2016e3af238feea2bbee7eb0e99c925a041afbfb sleep_before_teardown: 0 suite: fs suite_branch: wip-vshankar-testing-20230620.052303 suite_path: /home/teuthworker/src/github.com_vshankar_ceph_dc76074c5388e1a03fbcea1abab06ce902f6af4a/qa suite_relpath: qa suite_repo: https://github.com/vshankar/ceph.git suite_sha1: dc76074c5388e1a03fbcea1abab06ce902f6af4a syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi040.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBH+2/SFRmzytbl/enmdJQUiPQ1GN7EolS/0G5tmh+gIe1jYoNjtMZ6t17OK8vcOecfiDJcQSJHDMOWvWQL3EPA= smithi045.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcCLkfl52x2rp+0mfAP8oVnhMavNoxb4gVeCj1vfkX0Y6DfJbcmGMiU7UYwZL3+LP82e2LirMINjuFzNwzslQ6haSy7LHx2hBlQnVGA/Whbpr2ATWyzBqqLKQxymcjsH34E1AEKIZcwEqKDS+3wxh4YGBVugMGv/TDd8PAruqJI23UzHQbjRXSqCGoNLEEETAQkVv7FmxqVKnCKgqfDkWj9gUQraFj7zUzf5qFJFUfm4jqShfUYm5LfQVYU9w5NeCxguXwKgA3eVEtyrYDHtEUrqpqo9JKW0xjoAv1hzmkqTN30s2hxPbU+ySCeGiK1sOyTLeEOmin57aRVjTx7X166h/b1hWTOkrRDucl4QgmXAREyG/O7KuW6C7rPWckK5CBNYsbPnBd2CsY9w6L4s5aGekyrXjyTHSi5l5UT3Upu7S+oa/bk7JuHO6z4B0np5hoVpnH9JmfEwon+OTRqzbFjsThI/YsdZLR5xIn82X7O74KlE+HUjO4NJlq1Qaexh0= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 076bbebc42a14f7d568aaa78eabb0038327bcb23 timestamp: 2023-06-22_10:13:08 tube: smithi use_shaman: true user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-06-22T10:28:21.795 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_vshankar_ceph_dc76074c5388e1a03fbcea1abab06ce902f6af4a/qa; will attempt to use it 2023-06-22T10:28:21.796 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_vshankar_ceph_dc76074c5388e1a03fbcea1abab06ce902f6af4a/qa/tasks 2023-06-22T10:28:21.796 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-06-22T10:28:21.798 INFO:teuthology.task.internal:Checking packages... 2023-06-22T10:28:21.825 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '2016e3af238feea2bbee7eb0e99c925a041afbfb' 2023-06-22T10:28:21.825 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-06-22T10:28:21.826 INFO:teuthology.packaging:ref: None 2023-06-22T10:28:21.826 INFO:teuthology.packaging:tag: None 2023-06-22T10:28:21.826 INFO:teuthology.packaging:branch: wip-vshankar-testing-20230620.052303 2023-06-22T10:28:21.826 INFO:teuthology.packaging:sha1: 2016e3af238feea2bbee7eb0e99c925a041afbfb 2023-06-22T10:28:21.827 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-vshankar-testing-20230620.052303 2023-06-22T10:28:22.042 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-4512.g2016e3af 2023-06-22T10:28:22.042 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-06-22T10:28:22.049 INFO:teuthology.task.internal:no buildpackages task found 2023-06-22T10:28:22.049 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-06-22T10:28:22.055 INFO:teuthology.task.internal:Saving configuration 2023-06-22T10:28:22.071 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-06-22T10:28:22.083 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-22T10:28:22.111 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi040.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-06-22_10:13:08-fs-wip-vshankar-testing-20230620.052303-testing-default-smithi/7311271', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-22 10:23:27.845788', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBH+2/SFRmzytbl/enmdJQUiPQ1GN7EolS/0G5tmh+gIe1jYoNjtMZ6t17OK8vcOecfiDJcQSJHDMOWvWQL3EPA='} 2023-06-22T10:28:22.139 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi045.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-06-22_10:13:08-fs-wip-vshankar-testing-20230620.052303-testing-default-smithi/7311271', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-22 10:23:27.847333', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOPEPdthZPdyygAaVMbQuiY04/T8St3geEHlU4rBr+FUn9YazbgF+J00J2Z/aXYzwjCLGCW0vwxHHmLdcB/yuCo='} 2023-06-22T10:28:22.140 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-06-22T10:28:22.148 INFO:teuthology.task.internal:roles: ubuntu@smithi040.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-06-22T10:28:22.148 INFO:teuthology.task.internal:roles: ubuntu@smithi045.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-06-22T10:28:22.149 INFO:teuthology.run_tasks:Running task console_log... 2023-06-22T10:28:22.279 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1f5adacf70>, signals=[15]) 2023-06-22T10:28:22.281 INFO:teuthology.run_tasks:Running task internal.connect... 2023-06-22T10:28:22.290 INFO:teuthology.task.internal:Opening connections... 2023-06-22T10:28:22.290 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi040.front.sepia.ceph.com 2023-06-22T10:28:22.292 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T10:28:22.362 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi045.front.sepia.ceph.com 2023-06-22T10:28:22.363 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T10:28:22.432 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-06-22T10:28:22.439 DEBUG:teuthology.orchestra.run.smithi040:> uname -m 2023-06-22T10:28:22.462 INFO:teuthology.orchestra.run.smithi040.stdout:x86_64 2023-06-22T10:28:22.463 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release 2023-06-22T10:28:22.525 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="CentOS Stream" 2023-06-22T10:28:22.526 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="8" 2023-06-22T10:28:22.526 INFO:teuthology.orchestra.run.smithi040.stdout:ID="centos" 2023-06-22T10:28:22.526 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE="rhel fedora" 2023-06-22T10:28:22.527 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="8" 2023-06-22T10:28:22.527 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM_ID="platform:el8" 2023-06-22T10:28:22.527 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-22T10:28:22.528 INFO:teuthology.orchestra.run.smithi040.stdout:ANSI_COLOR="0;31" 2023-06-22T10:28:22.528 INFO:teuthology.orchestra.run.smithi040.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-22T10:28:22.528 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://centos.org/" 2023-06-22T10:28:22.528 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-22T10:28:22.529 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-22T10:28:22.529 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-22T10:28:22.530 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server 2023-06-22T10:28:22.562 DEBUG:teuthology.orchestra.run.smithi045:> uname -m 2023-06-22T10:28:22.585 INFO:teuthology.orchestra.run.smithi045.stdout:x86_64 2023-06-22T10:28:22.585 DEBUG:teuthology.orchestra.run.smithi045:> cat /etc/os-release 2023-06-22T10:28:22.647 INFO:teuthology.orchestra.run.smithi045.stdout:NAME="CentOS Stream" 2023-06-22T10:28:22.647 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION="8" 2023-06-22T10:28:22.647 INFO:teuthology.orchestra.run.smithi045.stdout:ID="centos" 2023-06-22T10:28:22.647 INFO:teuthology.orchestra.run.smithi045.stdout:ID_LIKE="rhel fedora" 2023-06-22T10:28:22.648 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_ID="8" 2023-06-22T10:28:22.648 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM_ID="platform:el8" 2023-06-22T10:28:22.648 INFO:teuthology.orchestra.run.smithi045.stdout:PRETTY_NAME="CentOS Stream 8" 2023-06-22T10:28:22.648 INFO:teuthology.orchestra.run.smithi045.stdout:ANSI_COLOR="0;31" 2023-06-22T10:28:22.648 INFO:teuthology.orchestra.run.smithi045.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-06-22T10:28:22.648 INFO:teuthology.orchestra.run.smithi045.stdout:HOME_URL="https://centos.org/" 2023-06-22T10:28:22.648 INFO:teuthology.orchestra.run.smithi045.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-22T10:28:22.649 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-22T10:28:22.649 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-06-22T10:28:22.649 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server 2023-06-22T10:28:22.670 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-06-22T10:28:22.682 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-06-22T10:28:22.741 INFO:teuthology.task.internal:Checking for old test directory... 2023-06-22T10:28:22.742 DEBUG:teuthology.orchestra.run.smithi040:> test '!' -e /home/ubuntu/cephtest 2023-06-22T10:28:22.745 DEBUG:teuthology.orchestra.run.smithi045:> test '!' -e /home/ubuntu/cephtest 2023-06-22T10:28:22.765 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-06-22T10:28:22.772 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-06-22T10:28:22.772 DEBUG:teuthology.orchestra.run.smithi040:> test -z $(ls -A /var/lib/ceph) 2023-06-22T10:28:22.807 DEBUG:teuthology.orchestra.run.smithi045:> test -z $(ls -A /var/lib/ceph) 2023-06-22T10:28:22.838 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-06-22T10:28:22.901 INFO:teuthology.run_tasks:Running task kernel... 2023-06-22T10:28:22.919 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '1c622d92b6f18ce44a7c33802686ff61c3c273ab'} 2023-06-22T10:28:22.919 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2023-06-22T10:28:22.920 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-06-22T10:28:22.920 DEBUG:teuthology.orchestra.run.smithi040:> test -f /run/.containerenv -o -f /.dockerenv 2023-06-22T10:28:22.921 DEBUG:teuthology.orchestra.run.smithi045:> test -f /run/.containerenv -o -f /.dockerenv 2023-06-22T10:28:22.940 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-22T10:28:22.941 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-06-22T10:28:22.944 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-22T10:28:22.945 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-06-22T10:28:23.176 DEBUG:teuthology.task.kernel:sha1 for client.1 is 1c622d92b6f18ce44a7c33802686ff61c3c273ab 2023-06-22T10:28:23.176 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "1c622d92b6f18ce44a7c33802686ff61c3c273ab"... 2023-06-22T10:28:23.176 DEBUG:teuthology.orchestra.run.smithi045:> uname -r 2023-06-22T10:28:23.192 DEBUG:teuthology.task.kernel:sha1 for client.0 is 1c622d92b6f18ce44a7c33802686ff61c3c273ab 2023-06-22T10:28:23.192 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "1c622d92b6f18ce44a7c33802686ff61c3c273ab"... 2023-06-22T10:28:23.192 DEBUG:teuthology.orchestra.run.smithi040:> uname -r 2023-06-22T10:28:23.199 INFO:teuthology.orchestra.run.smithi045.stdout:4.18.0-489.el8.x86_64 2023-06-22T10:28:23.199 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs 1c622d92b6f18ce44a7c33802686ff61c3c273ab 2023-06-22T10:28:23.199 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-06-22T10:28:23.200 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum upgrade -y linux-firmware 2023-06-22T10:28:23.214 INFO:teuthology.orchestra.run.smithi040.stdout:4.18.0-489.el8.x86_64 2023-06-22T10:28:23.214 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs 1c622d92b6f18ce44a7c33802686ff61c3c273ab 2023-06-22T10:28:23.215 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-06-22T10:28:23.215 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum upgrade -y linux-firmware 2023-06-22T10:28:32.104 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 8 - AppStream 4.6 MB/s | 30 MB 00:06 2023-06-22T10:28:32.885 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 8 - AppStream 4.2 MB/s | 30 MB 00:07 2023-06-22T10:28:39.196 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 8 - BaseOS 28 MB/s | 39 MB 00:01 2023-06-22T10:28:40.460 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 8 - BaseOS 21 MB/s | 39 MB 00:01 2023-06-22T10:28:45.695 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 8 - Extras 63 kB/s | 18 kB 00:00 2023-06-22T10:28:46.080 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 8 - Extras common packages 31 kB/s | 6.6 kB 00:00 2023-06-22T10:28:46.943 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 8 - Extras 42 kB/s | 18 kB 00:00 2023-06-22T10:28:47.477 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 8 - Extras common packages 18 kB/s | 6.6 kB 00:00 2023-06-22T10:28:48.715 INFO:teuthology.orchestra.run.smithi045.stdout:Copr repo for python3-asyncssh owned by ceph 1.4 kB/s | 3.5 kB 00:02 2023-06-22T10:28:49.495 INFO:teuthology.orchestra.run.smithi040.stdout:Copr repo for python3-asyncssh owned by ceph 1.9 kB/s | 3.5 kB 00:01 2023-06-22T10:28:50.090 INFO:teuthology.orchestra.run.smithi045.stdout:Extra Packages for Enterprise Linux 13 MB/s | 16 MB 00:01 2023-06-22T10:28:54.048 INFO:teuthology.orchestra.run.smithi045.stdout:lab-extras 452 kB/s | 24 kB 00:00 2023-06-22T10:28:57.562 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2023-06-22T10:28:57.563 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2023-06-22T10:28:57.563 INFO:teuthology.orchestra.run.smithi045.stdout: Package Arch Version Repo Size 2023-06-22T10:28:57.563 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2023-06-22T10:28:57.563 INFO:teuthology.orchestra.run.smithi045.stdout:Upgrading: 2023-06-22T10:28:57.563 INFO:teuthology.orchestra.run.smithi045.stdout: linux-firmware noarch 20230515-115.gitd1962891.el8 baseos 266 M 2023-06-22T10:28:57.564 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-22T10:28:57.564 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction Summary 2023-06-22T10:28:57.564 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2023-06-22T10:28:57.564 INFO:teuthology.orchestra.run.smithi045.stdout:Upgrade 1 Package 2023-06-22T10:28:57.564 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-22T10:28:57.565 INFO:teuthology.orchestra.run.smithi045.stdout:Total download size: 266 M 2023-06-22T10:28:57.565 INFO:teuthology.orchestra.run.smithi045.stdout:Downloading Packages: 2023-06-22T10:29:04.724 INFO:teuthology.orchestra.run.smithi045.stdout:linux-firmware-20230515-115.gitd1962891.el8.noa 37 MB/s | 266 MB 00:07 2023-06-22T10:29:04.724 INFO:teuthology.orchestra.run.smithi045.stdout:-------------------------------------------------------------------------------- 2023-06-22T10:29:04.724 INFO:teuthology.orchestra.run.smithi045.stdout:Total 37 MB/s | 266 MB 00:07 2023-06-22T10:29:06.386 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction check 2023-06-22T10:29:06.463 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction check succeeded. 2023-06-22T10:29:06.464 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction test 2023-06-22T10:29:08.200 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction test succeeded. 2023-06-22T10:29:08.234 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction 2023-06-22T10:29:26.877 INFO:teuthology.orchestra.run.smithi045.stdout: Preparing : 1/1 2023-06-22T10:29:27.231 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : linux-firmware-20230515-115.gitd1962891.el8.noarch 1/2 2023-06-22T10:29:27.486 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-06-22T10:29:27.738 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-06-22T10:29:27.738 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : linux-firmware-20230515-115.gitd1962891.el8.noarch 1/2 2023-06-22T10:29:28.772 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-06-22T10:29:28.772 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-22T10:29:28.772 INFO:teuthology.orchestra.run.smithi045.stdout:Upgraded: 2023-06-22T10:29:28.773 INFO:teuthology.orchestra.run.smithi045.stdout: linux-firmware-20230515-115.gitd1962891.el8.noarch 2023-06-22T10:29:28.773 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-22T10:29:28.773 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2023-06-22T10:29:28.956 INFO:teuthology.task.kernel:Downloading kernel 1c622d92b6f18ce44a7c33802686ff61c3c273ab on client.1... 2023-06-22T10:29:28.956 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=1c622d92b6f18ce44a7c33802686ff61c3c273ab 2023-06-22T10:29:29.097 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/1c622d92b6f18ce44a7c33802686ff61c3c273ab/centos/8/flavors/default/x86_64/ 2023-06-22T10:29:29.097 DEBUG:teuthology.orchestra.run.smithi045:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.4.0_rc5_g1c622d92b6f1-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/1c622d92b6f18ce44a7c33802686ff61c3c273ab/centos/8/flavors/default/x86_64/ --input-file=- 2023-06-22T10:29:29.100 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi045.front.sepia.ceph.com to complete... 2023-06-22T10:29:49.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22 10:29:49 URL:https://2.chacra.ceph.com/r/kernel/testing/1c622d92b6f18ce44a7c33802686ff61c3c273ab/centos/8/flavors/default/x86_64/kernel-6.4.0_rc5_g1c622d92b6f1-1.x86_64.rpm [379883408/379883408] -> "/tmp/kernel.x86_64.rpm" [1] 2023-06-22T10:29:49.022 INFO:teuthology.orchestra.run.smithi045.stderr:FINISHED --2023-06-22 10:29:49-- 2023-06-22T10:29:49.023 INFO:teuthology.orchestra.run.smithi045.stderr:Total wall clock time: 20s 2023-06-22T10:29:49.023 INFO:teuthology.orchestra.run.smithi045.stderr:Downloaded: 1 files, 362M in 20s (18.5 MB/s) 2023-06-22T10:29:49.025 INFO:teuthology.task.kernel:Installing kernel 1c622d92b6f18ce44a7c33802686ff61c3c273ab on client.1... 2023-06-22T10:29:49.025 DEBUG:teuthology.orchestra.run.smithi045:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-06-22T10:29:50.774 INFO:teuthology.orchestra.run.smithi045.stdout:Verifying... ######################################## 2023-06-22T10:29:50.820 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing... ######################################## 2023-06-22T10:29:50.937 INFO:teuthology.orchestra.run.smithi045.stdout:Updating / installing... 2023-06-22T10:30:31.392 INFO:teuthology.orchestra.run.smithi045.stdout:kernel-6.4.0_rc5_g1c622d92b6f1-1 ######################################## 2023-06-22T10:30:56.247 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi045.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-06-22T10:30:56.247 DEBUG:teuthology.orchestra.run.smithi045:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-06-22T10:30:56.301 INFO:teuthology.orchestra.run.smithi045.stdout:/boot/System.map-6.4.0-rc5-g1c622d92b6f1 2023-06-22T10:30:56.301 INFO:teuthology.orchestra.run.smithi045.stdout:/boot/config-6.4.0-rc5-g1c622d92b6f1 2023-06-22T10:30:56.301 INFO:teuthology.orchestra.run.smithi045.stdout:/boot/vmlinuz-6.4.0-rc5-g1c622d92b6f1 2023-06-22T10:30:56.301 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1 2023-06-22T10:30:56.301 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel 2023-06-22T10:30:56.301 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch 2023-06-22T10:30:56.302 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86 2023-06-22T10:30:56.302 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto 2023-06-22T10:30:56.302 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-06-22T10:30:56.302 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-06-22T10:30:56.302 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-06-22T10:30:56.302 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-06-22T10:30:56.302 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-06-22T10:30:56.303 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-06-22T10:30:56.303 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-06-22T10:30:56.303 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/crc32c-intel.ko 2023-06-22T10:30:56.303 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-06-22T10:30:56.303 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-06-22T10:30:56.303 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-06-22T10:30:56.303 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-06-22T10:30:56.303 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/serpent-avx2.ko 2023-06-22T10:30:56.304 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-06-22T10:30:56.304 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-06-22T10:30:56.304 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-06-22T10:30:56.304 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-06-22T10:30:56.304 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-06-22T10:30:56.304 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-06-22T10:30:56.304 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-06-22T10:30:56.305 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/kernel 2023-06-22T10:30:56.305 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/kernel/cpu 2023-06-22T10:30:56.305 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/kernel/cpu/mce 2023-06-22T10:30:56.305 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-06-22T10:30:56.305 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/kvm 2023-06-22T10:30:56.305 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/kvm/kvm-amd.ko 2023-06-22T10:30:56.305 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/kvm/kvm-intel.ko 2023-06-22T10:30:56.305 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/kvm/kvm.ko 2023-06-22T10:30:56.306 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto 2023-06-22T10:30:56.306 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/ansi_cprng.ko 2023-06-22T10:30:56.306 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/anubis.ko 2023-06-22T10:30:56.306 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/arc4.ko 2023-06-22T10:30:56.306 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/async_tx 2023-06-22T10:30:56.306 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/async_tx/async_memcpy.ko 2023-06-22T10:30:56.306 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/async_tx/async_pq.ko 2023-06-22T10:30:56.306 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/async_tx/async_raid6_recov.ko 2023-06-22T10:30:56.307 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/async_tx/async_tx.ko 2023-06-22T10:30:56.307 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/async_tx/async_xor.ko 2023-06-22T10:30:56.307 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/async_tx/raid6test.ko 2023-06-22T10:30:56.307 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/authenc.ko 2023-06-22T10:30:56.307 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/authencesn.ko 2023-06-22T10:30:56.307 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/blake2b_generic.ko 2023-06-22T10:30:56.307 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/blowfish_common.ko 2023-06-22T10:30:56.308 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/blowfish_generic.ko 2023-06-22T10:30:56.308 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/camellia_generic.ko 2023-06-22T10:30:56.308 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/cast5_generic.ko 2023-06-22T10:30:56.308 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/cast6_generic.ko 2023-06-22T10:30:56.308 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/cast_common.ko 2023-06-22T10:30:56.308 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/ccm.ko 2023-06-22T10:30:56.308 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/cmac.ko 2023-06-22T10:30:56.309 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/crc32_generic.ko 2023-06-22T10:30:56.309 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/crypto_engine.ko 2023-06-22T10:30:56.309 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/crypto_user.ko 2023-06-22T10:30:56.309 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/cts.ko 2023-06-22T10:30:56.309 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/des_generic.ko 2023-06-22T10:30:56.309 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/dh_generic.ko 2023-06-22T10:30:56.309 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/echainiv.ko 2023-06-22T10:30:56.309 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/essiv.ko 2023-06-22T10:30:56.310 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/fcrypt.ko 2023-06-22T10:30:56.310 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/khazad.ko 2023-06-22T10:30:56.310 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/lz4.ko 2023-06-22T10:30:56.310 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/lz4hc.ko 2023-06-22T10:30:56.310 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/md4.ko 2023-06-22T10:30:56.310 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/michael_mic.ko 2023-06-22T10:30:56.310 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/pcbc.ko 2023-06-22T10:30:56.310 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/pcrypt.ko 2023-06-22T10:30:56.311 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/rmd160.ko 2023-06-22T10:30:56.311 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/seed.ko 2023-06-22T10:30:56.311 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/serpent_generic.ko 2023-06-22T10:30:56.311 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/tcrypt.ko 2023-06-22T10:30:56.311 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/tea.ko 2023-06-22T10:30:56.311 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/twofish_common.ko 2023-06-22T10:30:56.311 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/twofish_generic.ko 2023-06-22T10:30:56.311 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/vmac.ko 2023-06-22T10:30:56.312 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/wp512.ko 2023-06-22T10:30:56.312 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/xcbc.ko 2023-06-22T10:30:56.312 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/xor.ko 2023-06-22T10:30:56.312 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/xxhash_generic.ko 2023-06-22T10:30:56.312 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers 2023-06-22T10:30:56.312 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/acpi 2023-06-22T10:30:56.312 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/acpi/acpi_ipmi.ko 2023-06-22T10:30:56.313 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/acpi/acpi_pad.ko 2023-06-22T10:30:56.313 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/acpi/custom_method.ko 2023-06-22T10:30:56.313 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/acpi/ec_sys.ko 2023-06-22T10:30:56.313 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/acpi/platform_profile.ko 2023-06-22T10:30:56.313 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/acpi/sbs.ko 2023-06-22T10:30:56.313 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/acpi/sbshc.ko 2023-06-22T10:30:56.313 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/acpi/video.ko 2023-06-22T10:30:56.313 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata 2023-06-22T10:30:56.314 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/acard-ahci.ko 2023-06-22T10:30:56.314 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/ahci_platform.ko 2023-06-22T10:30:56.314 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/ata_generic.ko 2023-06-22T10:30:56.314 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/libahci_platform.ko 2023-06-22T10:30:56.314 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_acpi.ko 2023-06-22T10:30:56.314 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_ali.ko 2023-06-22T10:30:56.314 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_amd.ko 2023-06-22T10:30:56.314 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_artop.ko 2023-06-22T10:30:56.315 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_atiixp.ko 2023-06-22T10:30:56.315 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_atp867x.ko 2023-06-22T10:30:56.315 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_cmd640.ko 2023-06-22T10:30:56.315 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_cmd64x.ko 2023-06-22T10:30:56.315 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_cypress.ko 2023-06-22T10:30:56.315 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_efar.ko 2023-06-22T10:30:56.315 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_hpt366.ko 2023-06-22T10:30:56.315 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_hpt37x.ko 2023-06-22T10:30:56.316 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_hpt3x2n.ko 2023-06-22T10:30:56.316 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_hpt3x3.ko 2023-06-22T10:30:56.316 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_it8213.ko 2023-06-22T10:30:56.316 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_it821x.ko 2023-06-22T10:30:56.316 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_jmicron.ko 2023-06-22T10:30:56.316 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_marvell.ko 2023-06-22T10:30:56.316 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_mpiix.ko 2023-06-22T10:30:56.317 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_netcell.ko 2023-06-22T10:30:56.317 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_ninja32.ko 2023-06-22T10:30:56.317 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_ns87410.ko 2023-06-22T10:30:56.317 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_ns87415.ko 2023-06-22T10:30:56.317 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_oldpiix.ko 2023-06-22T10:30:56.317 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_opti.ko 2023-06-22T10:30:56.317 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_optidma.ko 2023-06-22T10:30:56.317 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_pcmcia.ko 2023-06-22T10:30:56.318 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_pdc2027x.ko 2023-06-22T10:30:56.318 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-06-22T10:30:56.318 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_piccolo.ko 2023-06-22T10:30:56.318 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_rdc.ko 2023-06-22T10:30:56.318 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_sch.ko 2023-06-22T10:30:56.318 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_serverworks.ko 2023-06-22T10:30:56.318 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_sil680.ko 2023-06-22T10:30:56.319 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_sis.ko 2023-06-22T10:30:56.319 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_sl82c105.ko 2023-06-22T10:30:56.319 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_triflex.ko 2023-06-22T10:30:56.319 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_via.ko 2023-06-22T10:30:56.319 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pdc_adma.ko 2023-06-22T10:30:56.319 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_inic162x.ko 2023-06-22T10:30:56.319 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_mv.ko 2023-06-22T10:30:56.319 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_nv.ko 2023-06-22T10:30:56.320 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_promise.ko 2023-06-22T10:30:56.320 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_qstor.ko 2023-06-22T10:30:56.320 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_sil.ko 2023-06-22T10:30:56.320 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_sil24.ko 2023-06-22T10:30:56.320 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_sis.ko 2023-06-22T10:30:56.320 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_svw.ko 2023-06-22T10:30:56.320 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_sx4.ko 2023-06-22T10:30:56.320 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_uli.ko 2023-06-22T10:30:56.321 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_via.ko 2023-06-22T10:30:56.321 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_vsc.ko 2023-06-22T10:30:56.321 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/auxdisplay 2023-06-22T10:30:56.321 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/auxdisplay/ks0108.ko 2023-06-22T10:30:56.321 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/base 2023-06-22T10:30:56.321 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/base/regmap 2023-06-22T10:30:56.321 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/base/regmap/regmap-i2c.ko 2023-06-22T10:30:56.322 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/bcma 2023-06-22T10:30:56.322 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/bcma/bcma.ko 2023-06-22T10:30:56.322 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block 2023-06-22T10:30:56.322 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/aoe 2023-06-22T10:30:56.322 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/aoe/aoe.ko 2023-06-22T10:30:56.322 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/brd.ko 2023-06-22T10:30:56.322 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/drbd 2023-06-22T10:30:56.322 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/drbd/drbd.ko 2023-06-22T10:30:56.323 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/floppy.ko 2023-06-22T10:30:56.323 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/loop.ko 2023-06-22T10:30:56.323 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/mtip32xx 2023-06-22T10:30:56.323 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-06-22T10:30:56.323 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/nbd.ko 2023-06-22T10:30:56.323 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/null_blk 2023-06-22T10:30:56.323 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/null_blk/null_blk.ko 2023-06-22T10:30:56.323 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/pktcdvd.ko 2023-06-22T10:30:56.324 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/rbd.ko 2023-06-22T10:30:56.324 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/virtio_blk.ko 2023-06-22T10:30:56.324 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/xen-blkback 2023-06-22T10:30:56.324 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-06-22T10:30:56.324 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/xen-blkfront.ko 2023-06-22T10:30:56.324 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/zram 2023-06-22T10:30:56.324 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/zram/zram.ko 2023-06-22T10:30:56.325 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char 2023-06-22T10:30:56.325 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/hangcheck-timer.ko 2023-06-22T10:30:56.325 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/hw_random 2023-06-22T10:30:56.325 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/hw_random/amd-rng.ko 2023-06-22T10:30:56.325 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/hw_random/intel-rng.ko 2023-06-22T10:30:56.325 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-06-22T10:30:56.325 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/hw_random/via-rng.ko 2023-06-22T10:30:56.325 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/hw_random/virtio-rng.ko 2023-06-22T10:30:56.326 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/ipmi 2023-06-22T10:30:56.326 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-06-22T10:30:56.326 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-06-22T10:30:56.326 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-06-22T10:30:56.326 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/ipmi/ipmi_si.ko 2023-06-22T10:30:56.326 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-06-22T10:30:56.326 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-06-22T10:30:56.326 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/lp.ko 2023-06-22T10:30:56.327 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/mwave 2023-06-22T10:30:56.327 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/mwave/mwave.ko 2023-06-22T10:30:56.327 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/ppdev.ko 2023-06-22T10:30:56.327 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/tlclk.ko 2023-06-22T10:30:56.327 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/tpm 2023-06-22T10:30:56.327 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/tpm/tpm.ko 2023-06-22T10:30:56.327 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/tpm/tpm_atmel.ko 2023-06-22T10:30:56.328 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/tpm/tpm_infineon.ko 2023-06-22T10:30:56.328 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/tpm/tpm_nsc.ko 2023-06-22T10:30:56.328 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/tpm/tpm_tis.ko 2023-06-22T10:30:56.328 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-06-22T10:30:56.328 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/uv_mmtimer.ko 2023-06-22T10:30:56.328 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/virtio_console.ko 2023-06-22T10:30:56.328 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/cpufreq 2023-06-22T10:30:56.328 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-06-22T10:30:56.329 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-06-22T10:30:56.329 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/cpufreq/p4-clockmod.ko 2023-06-22T10:30:56.329 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-06-22T10:30:56.329 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/cpufreq/powernow-k8.ko 2023-06-22T10:30:56.329 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/cpufreq/speedstep-lib.ko 2023-06-22T10:30:56.329 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto 2023-06-22T10:30:56.329 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/ccp 2023-06-22T10:30:56.329 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-06-22T10:30:56.330 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/ccp/ccp.ko 2023-06-22T10:30:56.330 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/intel 2023-06-22T10:30:56.330 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/intel/qat 2023-06-22T10:30:56.330 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/intel/qat/qat_common 2023-06-22T10:30:56.330 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-06-22T10:30:56.330 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-06-22T10:30:56.330 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-06-22T10:30:56.330 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/padlock-aes.ko 2023-06-22T10:30:56.331 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/padlock-sha.ko 2023-06-22T10:30:56.331 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/virtio 2023-06-22T10:30:56.331 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-06-22T10:30:56.331 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/dca 2023-06-22T10:30:56.331 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/dca/dca.ko 2023-06-22T10:30:56.331 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/devfreq 2023-06-22T10:30:56.331 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-06-22T10:30:56.331 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/dma 2023-06-22T10:30:56.332 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/dma/dw 2023-06-22T10:30:56.332 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/dma/dw/dw_dmac.ko 2023-06-22T10:30:56.332 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/dma/ioat 2023-06-22T10:30:56.332 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/dma/ioat/ioatdma.ko 2023-06-22T10:30:56.332 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac 2023-06-22T10:30:56.332 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/amd64_edac.ko 2023-06-22T10:30:56.332 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/e752x_edac.ko 2023-06-22T10:30:56.333 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/edac_mce_amd.ko 2023-06-22T10:30:56.333 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/i3000_edac.ko 2023-06-22T10:30:56.333 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/i3200_edac.ko 2023-06-22T10:30:56.333 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/i5100_edac.ko 2023-06-22T10:30:56.333 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/i5400_edac.ko 2023-06-22T10:30:56.333 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/i7300_edac.ko 2023-06-22T10:30:56.333 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/i7core_edac.ko 2023-06-22T10:30:56.333 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/i82975x_edac.ko 2023-06-22T10:30:56.334 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/ie31200_edac.ko 2023-06-22T10:30:56.334 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/sb_edac.ko 2023-06-22T10:30:56.334 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/x38_edac.ko 2023-06-22T10:30:56.334 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/firmware 2023-06-22T10:30:56.334 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/firmware/edd.ko 2023-06-22T10:30:56.334 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/firmware/iscsi_ibft.ko 2023-06-22T10:30:56.334 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/gpio 2023-06-22T10:30:56.335 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/gpio/gpio-ich.ko 2023-06-22T10:30:56.335 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/gpio/gpio-viperboard.ko 2023-06-22T10:30:56.335 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid 2023-06-22T10:30:56.335 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-appleir.ko 2023-06-22T10:30:56.335 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-aureal.ko 2023-06-22T10:30:56.335 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-axff.ko 2023-06-22T10:30:56.335 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-dr.ko 2023-06-22T10:30:56.335 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-elecom.ko 2023-06-22T10:30:56.336 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-elo.ko 2023-06-22T10:30:56.336 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-emsff.ko 2023-06-22T10:30:56.336 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-gaff.ko 2023-06-22T10:30:56.336 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-gt683r.ko 2023-06-22T10:30:56.336 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-gyration.ko 2023-06-22T10:30:56.336 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-holtek-kbd.ko 2023-06-22T10:30:56.336 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-holtek-mouse.ko 2023-06-22T10:30:56.336 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-holtekff.ko 2023-06-22T10:30:56.337 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-hyperv.ko 2023-06-22T10:30:56.337 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-icade.ko 2023-06-22T10:30:56.337 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-keytouch.ko 2023-06-22T10:30:56.337 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-kye.ko 2023-06-22T10:30:56.337 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-lcpower.ko 2023-06-22T10:30:56.337 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-led.ko 2023-06-22T10:30:56.337 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-lenovo.ko 2023-06-22T10:30:56.337 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-logitech-dj.ko 2023-06-22T10:30:56.338 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-06-22T10:30:56.338 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-multitouch.ko 2023-06-22T10:30:56.338 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-ortek.ko 2023-06-22T10:30:56.338 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-penmount.ko 2023-06-22T10:30:56.338 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-petalynx.ko 2023-06-22T10:30:56.338 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-picolcd.ko 2023-06-22T10:30:56.338 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-pl.ko 2023-06-22T10:30:56.338 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-plantronics.ko 2023-06-22T10:30:56.339 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-primax.ko 2023-06-22T10:30:56.339 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-rmi.ko 2023-06-22T10:30:56.339 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-arvo.ko 2023-06-22T10:30:56.339 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-common.ko 2023-06-22T10:30:56.339 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-isku.ko 2023-06-22T10:30:56.339 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-kone.ko 2023-06-22T10:30:56.339 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-06-22T10:30:56.340 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-konepure.ko 2023-06-22T10:30:56.340 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-06-22T10:30:56.340 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-lua.ko 2023-06-22T10:30:56.340 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-pyra.ko 2023-06-22T10:30:56.340 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-ryos.ko 2023-06-22T10:30:56.340 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-savu.ko 2023-06-22T10:30:56.340 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat.ko 2023-06-22T10:30:56.340 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-saitek.ko 2023-06-22T10:30:56.341 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-samsung.ko 2023-06-22T10:30:56.341 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-sensor-hub.ko 2023-06-22T10:30:56.341 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-sjoy.ko 2023-06-22T10:30:56.341 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-sony.ko 2023-06-22T10:30:56.341 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-speedlink.ko 2023-06-22T10:30:56.341 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-steelseries.ko 2023-06-22T10:30:56.341 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-sunplus.ko 2023-06-22T10:30:56.342 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-thrustmaster.ko 2023-06-22T10:30:56.342 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-tivo.ko 2023-06-22T10:30:56.342 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-tmff.ko 2023-06-22T10:30:56.342 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-topseed.ko 2023-06-22T10:30:56.342 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-twinhan.ko 2023-06-22T10:30:56.343 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-uclogic.ko 2023-06-22T10:30:56.343 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-waltop.ko 2023-06-22T10:30:56.343 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-wiimote.ko 2023-06-22T10:30:56.343 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-xinmo.ko 2023-06-22T10:30:56.343 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-zpff.ko 2023-06-22T10:30:56.343 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-zydacron.ko 2023-06-22T10:30:56.343 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/uhid.ko 2023-06-22T10:30:56.343 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/wacom.ko 2023-06-22T10:30:56.344 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hv 2023-06-22T10:30:56.344 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hv/hv_balloon.ko 2023-06-22T10:30:56.344 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hv/hv_utils.ko 2023-06-22T10:30:56.344 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hv/hv_vmbus.ko 2023-06-22T10:30:56.344 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon 2023-06-22T10:30:56.345 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/abituguru.ko 2023-06-22T10:30:56.345 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/abituguru3.ko 2023-06-22T10:30:56.345 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/acpi_power_meter.ko 2023-06-22T10:30:56.345 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ad7414.ko 2023-06-22T10:30:56.345 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ad7418.ko 2023-06-22T10:30:56.345 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adc128d818.ko 2023-06-22T10:30:56.345 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adm1025.ko 2023-06-22T10:30:56.345 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adm1026.ko 2023-06-22T10:30:56.346 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adm1029.ko 2023-06-22T10:30:56.346 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adm1031.ko 2023-06-22T10:30:56.346 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adm9240.ko 2023-06-22T10:30:56.346 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ads7828.ko 2023-06-22T10:30:56.346 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adt7410.ko 2023-06-22T10:30:56.346 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adt7411.ko 2023-06-22T10:30:56.346 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adt7462.ko 2023-06-22T10:30:56.347 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adt7470.ko 2023-06-22T10:30:56.347 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adt7475.ko 2023-06-22T10:30:56.347 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adt7x10.ko 2023-06-22T10:30:56.347 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/amc6821.ko 2023-06-22T10:30:56.347 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/applesmc.ko 2023-06-22T10:30:56.347 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/asb100.ko 2023-06-22T10:30:56.347 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/asc7621.ko 2023-06-22T10:30:56.347 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/asus_atk0110.ko 2023-06-22T10:30:56.348 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/atxp1.ko 2023-06-22T10:30:56.348 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/coretemp.ko 2023-06-22T10:30:56.348 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-06-22T10:30:56.348 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/dme1737.ko 2023-06-22T10:30:56.348 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ds1621.ko 2023-06-22T10:30:56.348 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ds620.ko 2023-06-22T10:30:56.348 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/emc1403.ko 2023-06-22T10:30:56.349 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/emc6w201.ko 2023-06-22T10:30:56.349 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/f71805f.ko 2023-06-22T10:30:56.349 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/f71882fg.ko 2023-06-22T10:30:56.349 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/f75375s.ko 2023-06-22T10:30:56.349 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/fam15h_power.ko 2023-06-22T10:30:56.349 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/fschmd.ko 2023-06-22T10:30:56.349 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/g760a.ko 2023-06-22T10:30:56.349 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/g762.ko 2023-06-22T10:30:56.350 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/gl518sm.ko 2023-06-22T10:30:56.350 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/gl520sm.ko 2023-06-22T10:30:56.350 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/hwmon-vid.ko 2023-06-22T10:30:56.350 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/i5500_temp.ko 2023-06-22T10:30:56.350 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/i5k_amb.ko 2023-06-22T10:30:56.350 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ibmaem.ko 2023-06-22T10:30:56.350 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ibmpex.ko 2023-06-22T10:30:56.350 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ina209.ko 2023-06-22T10:30:56.351 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ina2xx.ko 2023-06-22T10:30:56.351 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/it87.ko 2023-06-22T10:30:56.351 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/k10temp.ko 2023-06-22T10:30:56.351 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/k8temp.ko 2023-06-22T10:30:56.351 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lineage-pem.ko 2023-06-22T10:30:56.351 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm63.ko 2023-06-22T10:30:56.351 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm73.ko 2023-06-22T10:30:56.351 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm75.ko 2023-06-22T10:30:56.352 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm77.ko 2023-06-22T10:30:56.352 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm78.ko 2023-06-22T10:30:56.352 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm80.ko 2023-06-22T10:30:56.352 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm83.ko 2023-06-22T10:30:56.352 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm85.ko 2023-06-22T10:30:56.352 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm87.ko 2023-06-22T10:30:56.352 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm90.ko 2023-06-22T10:30:56.353 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm92.ko 2023-06-22T10:30:56.353 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm93.ko 2023-06-22T10:30:56.353 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm95234.ko 2023-06-22T10:30:56.353 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm95241.ko 2023-06-22T10:30:56.353 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm95245.ko 2023-06-22T10:30:56.353 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ltc2945.ko 2023-06-22T10:30:56.353 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ltc4151.ko 2023-06-22T10:30:56.353 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ltc4215.ko 2023-06-22T10:30:56.354 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ltc4222.ko 2023-06-22T10:30:56.354 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ltc4245.ko 2023-06-22T10:30:56.354 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ltc4260.ko 2023-06-22T10:30:56.354 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ltc4261.ko 2023-06-22T10:30:56.354 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/max16065.ko 2023-06-22T10:30:56.354 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/max1619.ko 2023-06-22T10:30:56.354 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/max1668.ko 2023-06-22T10:30:56.354 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/max197.ko 2023-06-22T10:30:56.355 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/max6639.ko 2023-06-22T10:30:56.355 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/max6650.ko 2023-06-22T10:30:56.355 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/max6697.ko 2023-06-22T10:30:56.355 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/mcp3021.ko 2023-06-22T10:30:56.355 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/nct6683.ko 2023-06-22T10:30:56.355 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/nct6775-core.ko 2023-06-22T10:30:56.355 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/nct6775.ko 2023-06-22T10:30:56.355 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/nct7802.ko 2023-06-22T10:30:56.356 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pc87360.ko 2023-06-22T10:30:56.356 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pc87427.ko 2023-06-22T10:30:56.356 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pcf8591.ko 2023-06-22T10:30:56.356 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus 2023-06-22T10:30:56.356 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-06-22T10:30:56.356 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-06-22T10:30:56.356 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-06-22T10:30:56.356 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/max16064.ko 2023-06-22T10:30:56.357 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/max34440.ko 2023-06-22T10:30:56.357 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/max8688.ko 2023-06-22T10:30:56.357 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-06-22T10:30:56.357 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-06-22T10:30:56.357 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-06-22T10:30:56.357 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-06-22T10:30:56.357 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-06-22T10:30:56.357 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-06-22T10:30:56.358 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/powr1220.ko 2023-06-22T10:30:56.358 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/sch5627.ko 2023-06-22T10:30:56.358 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/sch5636.ko 2023-06-22T10:30:56.358 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/sch56xx-common.ko 2023-06-22T10:30:56.358 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/sht15.ko 2023-06-22T10:30:56.358 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/sht21.ko 2023-06-22T10:30:56.358 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/shtc1.ko 2023-06-22T10:30:56.359 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/sis5595.ko 2023-06-22T10:30:56.359 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/smsc47b397.ko 2023-06-22T10:30:56.359 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/smsc47m1.ko 2023-06-22T10:30:56.359 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/smsc47m192.ko 2023-06-22T10:30:56.359 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/thmc50.ko 2023-06-22T10:30:56.359 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/tmp102.ko 2023-06-22T10:30:56.359 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/tmp103.ko 2023-06-22T10:30:56.359 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/tmp401.ko 2023-06-22T10:30:56.360 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/tmp421.ko 2023-06-22T10:30:56.360 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/via-cputemp.ko 2023-06-22T10:30:56.360 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/via686a.ko 2023-06-22T10:30:56.360 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/vt1211.ko 2023-06-22T10:30:56.360 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/vt8231.ko 2023-06-22T10:30:56.360 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/w83627ehf.ko 2023-06-22T10:30:56.360 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/w83627hf.ko 2023-06-22T10:30:56.360 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/w83781d.ko 2023-06-22T10:30:56.361 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/w83791d.ko 2023-06-22T10:30:56.361 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/w83792d.ko 2023-06-22T10:30:56.361 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/w83793.ko 2023-06-22T10:30:56.361 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/w83795.ko 2023-06-22T10:30:56.361 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/w83l785ts.ko 2023-06-22T10:30:56.361 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/w83l786ng.ko 2023-06-22T10:30:56.361 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c 2023-06-22T10:30:56.361 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/algos 2023-06-22T10:30:56.362 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-06-22T10:30:56.362 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-06-22T10:30:56.362 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses 2023-06-22T10:30:56.362 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-06-22T10:30:56.362 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-06-22T10:30:56.362 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-06-22T10:30:56.362 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-06-22T10:30:56.362 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-06-22T10:30:56.363 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-06-22T10:30:56.363 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-06-22T10:30:56.363 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-06-22T10:30:56.363 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-i801.ko 2023-06-22T10:30:56.363 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-isch.ko 2023-06-22T10:30:56.363 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-06-22T10:30:56.363 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-06-22T10:30:56.364 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-06-22T10:30:56.364 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-parport.ko 2023-06-22T10:30:56.364 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-06-22T10:30:56.364 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-06-22T10:30:56.364 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-06-22T10:30:56.364 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-06-22T10:30:56.364 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-06-22T10:30:56.364 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-06-22T10:30:56.365 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-via.ko 2023-06-22T10:30:56.365 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-06-22T10:30:56.365 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-06-22T10:30:56.365 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/i2c-dev.ko 2023-06-22T10:30:56.365 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/i2c-mux.ko 2023-06-22T10:30:56.365 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-06-22T10:30:56.365 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/i2c-smbus.ko 2023-06-22T10:30:56.365 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/i2c-stub.ko 2023-06-22T10:30:56.366 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband 2023-06-22T10:30:56.366 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/core 2023-06-22T10:30:56.366 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/core/ib_cm.ko 2023-06-22T10:30:56.366 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/core/ib_core.ko 2023-06-22T10:30:56.366 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/core/ib_umad.ko 2023-06-22T10:30:56.366 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-06-22T10:30:56.366 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/core/iw_cm.ko 2023-06-22T10:30:56.367 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/core/rdma_cm.ko 2023-06-22T10:30:56.367 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-06-22T10:30:56.367 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/hw 2023-06-22T10:30:56.367 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/hw/cxgb4 2023-06-22T10:30:56.367 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-06-22T10:30:56.368 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/hw/mlx4 2023-06-22T10:30:56.368 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-06-22T10:30:56.368 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/hw/mlx5 2023-06-22T10:30:56.368 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-06-22T10:30:56.368 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/hw/mthca 2023-06-22T10:30:56.368 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-06-22T10:30:56.368 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp 2023-06-22T10:30:56.368 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/ipoib 2023-06-22T10:30:56.369 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-06-22T10:30:56.369 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/iser 2023-06-22T10:30:56.369 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-06-22T10:30:56.369 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/isert 2023-06-22T10:30:56.369 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-06-22T10:30:56.369 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/srp 2023-06-22T10:30:56.369 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-06-22T10:30:56.369 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/srpt 2023-06-22T10:30:56.370 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-06-22T10:30:56.370 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input 2023-06-22T10:30:56.370 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/gameport 2023-06-22T10:30:56.370 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-06-22T10:30:56.370 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/gameport/fm801-gp.ko 2023-06-22T10:30:56.370 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/gameport/gameport.ko 2023-06-22T10:30:56.370 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/gameport/lightning.ko 2023-06-22T10:30:56.371 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/gameport/ns558.ko 2023-06-22T10:30:56.371 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/joydev.ko 2023-06-22T10:30:56.371 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/keyboard 2023-06-22T10:30:56.371 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/keyboard/gpio_keys.ko 2023-06-22T10:30:56.371 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/mouse 2023-06-22T10:30:56.371 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/mouse/appletouch.ko 2023-06-22T10:30:56.371 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/mouse/bcm5974.ko 2023-06-22T10:30:56.371 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/mouse/cyapatp.ko 2023-06-22T10:30:56.372 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/mouse/elan_i2c.ko 2023-06-22T10:30:56.372 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/mouse/sermouse.ko 2023-06-22T10:30:56.372 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-06-22T10:30:56.372 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/mouse/synaptics_usb.ko 2023-06-22T10:30:56.372 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/mouse/vsxxxaa.ko 2023-06-22T10:30:56.372 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/rmi4 2023-06-22T10:30:56.372 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/rmi4/rmi_core.ko 2023-06-22T10:30:56.372 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/serio 2023-06-22T10:30:56.373 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/serio/altera_ps2.ko 2023-06-22T10:30:56.373 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/serio/arc_ps2.ko 2023-06-22T10:30:56.373 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-06-22T10:30:56.373 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/serio/serio_raw.ko 2023-06-22T10:30:56.373 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/sparse-keymap.ko 2023-06-22T10:30:56.373 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/iommu 2023-06-22T10:30:56.373 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/iommu/amd 2023-06-22T10:30:56.374 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/iommu/amd/iommu_v2.ko 2023-06-22T10:30:56.374 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds 2023-06-22T10:30:56.374 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/leds-blinkm.ko 2023-06-22T10:30:56.374 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/leds-lm3530.ko 2023-06-22T10:30:56.374 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/leds-lp3944.ko 2023-06-22T10:30:56.374 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/leds-ss4200.ko 2023-06-22T10:30:56.374 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/trigger 2023-06-22T10:30:56.374 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-06-22T10:30:56.375 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-06-22T10:30:56.375 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-06-22T10:30:56.375 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-06-22T10:30:56.375 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-06-22T10:30:56.375 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-06-22T10:30:56.375 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-06-22T10:30:56.375 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-06-22T10:30:56.375 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md 2023-06-22T10:30:56.376 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/bcache 2023-06-22T10:30:56.376 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/bcache/bcache.ko 2023-06-22T10:30:56.376 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-bio-prison.ko 2023-06-22T10:30:56.376 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-cache-smq.ko 2023-06-22T10:30:56.376 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-cache.ko 2023-06-22T10:30:56.376 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-crypt.ko 2023-06-22T10:30:56.376 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-delay.ko 2023-06-22T10:30:56.376 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-flakey.ko 2023-06-22T10:30:56.377 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-log-userspace.ko 2023-06-22T10:30:56.377 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-multipath.ko 2023-06-22T10:30:56.377 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-queue-length.ko 2023-06-22T10:30:56.377 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-raid.ko 2023-06-22T10:30:56.377 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-round-robin.ko 2023-06-22T10:30:56.377 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-service-time.ko 2023-06-22T10:30:56.377 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-switch.ko 2023-06-22T10:30:56.378 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-thin-pool.ko 2023-06-22T10:30:56.378 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-verity.ko 2023-06-22T10:30:56.378 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/faulty.ko 2023-06-22T10:30:56.378 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/linear.ko 2023-06-22T10:30:56.378 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/multipath.ko 2023-06-22T10:30:56.378 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/persistent-data 2023-06-22T10:30:56.378 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-06-22T10:30:56.378 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/raid0.ko 2023-06-22T10:30:56.379 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/raid1.ko 2023-06-22T10:30:56.379 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/raid10.ko 2023-06-22T10:30:56.379 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/raid456.ko 2023-06-22T10:30:56.379 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/message 2023-06-22T10:30:56.379 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/message/fusion 2023-06-22T10:30:56.379 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/message/fusion/mptbase.ko 2023-06-22T10:30:56.379 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/message/fusion/mptctl.ko 2023-06-22T10:30:56.379 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/message/fusion/mptfc.ko 2023-06-22T10:30:56.380 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/message/fusion/mptlan.ko 2023-06-22T10:30:56.380 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/message/fusion/mptsas.ko 2023-06-22T10:30:56.380 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/message/fusion/mptscsih.ko 2023-06-22T10:30:56.380 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/message/fusion/mptspi.ko 2023-06-22T10:30:56.380 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/mfd 2023-06-22T10:30:56.380 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/mfd/lpc_ich.ko 2023-06-22T10:30:56.380 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/mfd/lpc_sch.ko 2023-06-22T10:30:56.381 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/mfd/mfd-core.ko 2023-06-22T10:30:56.381 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/mfd/sm501.ko 2023-06-22T10:30:56.381 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/mfd/viperboard.ko 2023-06-22T10:30:56.381 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/mfd/vx855.ko 2023-06-22T10:30:56.381 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/mfd/wl1273-core.ko 2023-06-22T10:30:56.381 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc 2023-06-22T10:30:56.381 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/altera-stapl 2023-06-22T10:30:56.381 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-06-22T10:30:56.382 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/apds9802als.ko 2023-06-22T10:30:56.382 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/apds990x.ko 2023-06-22T10:30:56.382 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/bh1770glc.ko 2023-06-22T10:30:56.382 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/cb710 2023-06-22T10:30:56.382 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/cb710/cb710.ko 2023-06-22T10:30:56.382 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/eeprom 2023-06-22T10:30:56.382 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/eeprom/at24.ko 2023-06-22T10:30:56.382 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/eeprom/eeprom.ko 2023-06-22T10:30:56.383 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-06-22T10:30:56.383 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/eeprom/max6875.ko 2023-06-22T10:30:56.383 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/enclosure.ko 2023-06-22T10:30:56.383 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/hpilo.ko 2023-06-22T10:30:56.383 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/isl29003.ko 2023-06-22T10:30:56.383 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/isl29020.ko 2023-06-22T10:30:56.383 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/lis3lv02d 2023-06-22T10:30:56.383 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-06-22T10:30:56.384 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-06-22T10:30:56.384 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/mei 2023-06-22T10:30:56.384 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/mei/mei-me.ko 2023-06-22T10:30:56.384 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/mei/mei-txe.ko 2023-06-22T10:30:56.384 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/mei/mei.ko 2023-06-22T10:30:56.384 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/sgi-gru 2023-06-22T10:30:56.384 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/sgi-gru/gru.ko 2023-06-22T10:30:56.384 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/sgi-xp 2023-06-22T10:30:56.385 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/sgi-xp/xp.ko 2023-06-22T10:30:56.385 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/sgi-xp/xpc.ko 2023-06-22T10:30:56.385 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-06-22T10:30:56.385 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/tifm_7xx1.ko 2023-06-22T10:30:56.385 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/tifm_core.ko 2023-06-22T10:30:56.385 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/tsl2550.ko 2023-06-22T10:30:56.385 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/vmw_balloon.ko 2023-06-22T10:30:56.386 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/vmw_vmci 2023-06-22T10:30:56.386 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-06-22T10:30:56.386 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net 2023-06-22T10:30:56.386 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/bonding 2023-06-22T10:30:56.386 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/bonding/bonding.ko 2023-06-22T10:30:56.386 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/dsa 2023-06-22T10:30:56.386 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/dsa/b53 2023-06-22T10:30:56.386 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/dsa/b53/b53_common.ko 2023-06-22T10:30:56.387 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/dsa/bcm-sf2.ko 2023-06-22T10:30:56.387 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/dsa/mv88e6060.ko 2023-06-22T10:30:56.387 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/dsa/mv88e6xxx 2023-06-22T10:30:56.387 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-06-22T10:30:56.387 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/dummy.ko 2023-06-22T10:30:56.387 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/eql.ko 2023-06-22T10:30:56.387 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet 2023-06-22T10:30:56.387 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/3com 2023-06-22T10:30:56.388 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-06-22T10:30:56.388 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-06-22T10:30:56.388 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-06-22T10:30:56.388 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-06-22T10:30:56.388 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/8390 2023-06-22T10:30:56.388 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/8390/8390.ko 2023-06-22T10:30:56.388 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-06-22T10:30:56.388 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-06-22T10:30:56.389 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-06-22T10:30:56.389 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/adaptec 2023-06-22T10:30:56.389 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-06-22T10:30:56.389 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/agere 2023-06-22T10:30:56.389 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/agere/et131x.ko 2023-06-22T10:30:56.389 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/alteon 2023-06-22T10:30:56.389 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-06-22T10:30:56.389 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/altera 2023-06-22T10:30:56.390 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-06-22T10:30:56.390 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/amd 2023-06-22T10:30:56.390 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-06-22T10:30:56.390 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-06-22T10:30:56.390 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-06-22T10:30:56.390 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros 2023-06-22T10:30:56.390 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros/alx 2023-06-22T10:30:56.390 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-06-22T10:30:56.391 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros/atl1c 2023-06-22T10:30:56.391 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-06-22T10:30:56.391 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros/atl1e 2023-06-22T10:30:56.391 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-06-22T10:30:56.391 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros/atlx 2023-06-22T10:30:56.391 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-06-22T10:30:56.391 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-06-22T10:30:56.392 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/broadcom 2023-06-22T10:30:56.392 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-06-22T10:30:56.392 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-06-22T10:30:56.392 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-06-22T10:30:56.392 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-06-22T10:30:56.392 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-06-22T10:30:56.392 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/broadcom/genet 2023-06-22T10:30:56.392 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-06-22T10:30:56.393 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-06-22T10:30:56.393 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/brocade 2023-06-22T10:30:56.393 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/brocade/bna 2023-06-22T10:30:56.393 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-06-22T10:30:56.393 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio 2023-06-22T10:30:56.393 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/cxgb 2023-06-22T10:30:56.393 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-06-22T10:30:56.394 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-06-22T10:30:56.394 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-06-22T10:30:56.394 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-06-22T10:30:56.394 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-06-22T10:30:56.394 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-06-22T10:30:56.394 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-06-22T10:30:56.394 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-06-22T10:30:56.394 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-06-22T10:30:56.395 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/cisco 2023-06-22T10:30:56.395 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/cisco/enic 2023-06-22T10:30:56.395 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-06-22T10:30:56.395 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dec 2023-06-22T10:30:56.395 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dec/tulip 2023-06-22T10:30:56.395 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-06-22T10:30:56.395 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-06-22T10:30:56.395 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-06-22T10:30:56.396 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-06-22T10:30:56.396 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-06-22T10:30:56.396 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-06-22T10:30:56.396 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dlink 2023-06-22T10:30:56.396 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-06-22T10:30:56.396 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-06-22T10:30:56.396 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dnet.ko 2023-06-22T10:30:56.397 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/emulex 2023-06-22T10:30:56.397 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/emulex/benet 2023-06-22T10:30:56.397 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-06-22T10:30:56.397 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/ethoc.ko 2023-06-22T10:30:56.397 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/fealnx.ko 2023-06-22T10:30:56.397 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel 2023-06-22T10:30:56.397 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/e100.ko 2023-06-22T10:30:56.397 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/e1000 2023-06-22T10:30:56.398 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-06-22T10:30:56.398 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/e1000e 2023-06-22T10:30:56.398 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-06-22T10:30:56.398 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/fm10k 2023-06-22T10:30:56.398 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-06-22T10:30:56.398 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/i40e 2023-06-22T10:30:56.398 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-06-22T10:30:56.398 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/iavf 2023-06-22T10:30:56.399 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-06-22T10:30:56.399 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/igb 2023-06-22T10:30:56.399 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-06-22T10:30:56.399 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/igbvf 2023-06-22T10:30:56.399 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-06-22T10:30:56.399 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/ixgbe 2023-06-22T10:30:56.399 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-06-22T10:30:56.399 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/ixgbevf 2023-06-22T10:30:56.400 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-06-22T10:30:56.400 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/jme.ko 2023-06-22T10:30:56.400 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/marvell 2023-06-22T10:30:56.400 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-06-22T10:30:56.400 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/marvell/skge.ko 2023-06-22T10:30:56.400 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-06-22T10:30:56.400 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/mellanox 2023-06-22T10:30:56.400 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/mellanox/mlx4 2023-06-22T10:30:56.401 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-06-22T10:30:56.401 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-06-22T10:30:56.401 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/mellanox/mlx5 2023-06-22T10:30:56.401 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-06-22T10:30:56.401 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-06-22T10:30:56.401 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/micrel 2023-06-22T10:30:56.401 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-06-22T10:30:56.402 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/myricom 2023-06-22T10:30:56.402 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/myricom/myri10ge 2023-06-22T10:30:56.402 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-06-22T10:30:56.402 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/natsemi 2023-06-22T10:30:56.402 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-06-22T10:30:56.402 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-06-22T10:30:56.402 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/neterion 2023-06-22T10:30:56.402 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-06-22T10:30:56.403 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/nvidia 2023-06-22T10:30:56.403 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-06-22T10:30:56.403 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/packetengines 2023-06-22T10:30:56.403 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-06-22T10:30:56.403 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-06-22T10:30:56.403 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/qlogic 2023-06-22T10:30:56.403 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/qlogic/netxen 2023-06-22T10:30:56.403 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-06-22T10:30:56.404 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-06-22T10:30:56.404 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-06-22T10:30:56.404 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-06-22T10:30:56.404 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/rdc 2023-06-22T10:30:56.404 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-06-22T10:30:56.404 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/realtek 2023-06-22T10:30:56.404 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-06-22T10:30:56.405 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-06-22T10:30:56.405 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/realtek/atp.ko 2023-06-22T10:30:56.405 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-06-22T10:30:56.405 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/rocker 2023-06-22T10:30:56.405 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-06-22T10:30:56.405 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sfc 2023-06-22T10:30:56.405 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-06-22T10:30:56.405 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/silan 2023-06-22T10:30:56.406 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-06-22T10:30:56.406 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sis 2023-06-22T10:30:56.406 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sis/sis190.ko 2023-06-22T10:30:56.406 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sis/sis900.ko 2023-06-22T10:30:56.406 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/smsc 2023-06-22T10:30:56.406 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-06-22T10:30:56.406 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-06-22T10:30:56.407 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-06-22T10:30:56.407 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-06-22T10:30:56.407 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/stmicro 2023-06-22T10:30:56.407 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/stmicro/stmmac 2023-06-22T10:30:56.407 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-06-22T10:30:56.407 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-06-22T10:30:56.407 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sun 2023-06-22T10:30:56.407 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sun/cassini.ko 2023-06-22T10:30:56.408 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sun/niu.ko 2023-06-22T10:30:56.408 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sun/sungem.ko 2023-06-22T10:30:56.408 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-06-22T10:30:56.408 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/tehuti 2023-06-22T10:30:56.408 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-06-22T10:30:56.408 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/ti 2023-06-22T10:30:56.408 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/ti/tlan.ko 2023-06-22T10:30:56.408 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/via 2023-06-22T10:30:56.409 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-06-22T10:30:56.409 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-06-22T10:30:56.409 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/wiznet 2023-06-22T10:30:56.409 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-06-22T10:30:56.409 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-06-22T10:30:56.409 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/xircom 2023-06-22T10:30:56.409 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-06-22T10:30:56.409 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/geneve.ko 2023-06-22T10:30:56.410 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/hyperv 2023-06-22T10:30:56.410 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-06-22T10:30:56.410 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ieee802154 2023-06-22T10:30:56.410 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ieee802154/fakelb.ko 2023-06-22T10:30:56.410 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ifb.ko 2023-06-22T10:30:56.410 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ipvlan 2023-06-22T10:30:56.410 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ipvlan/ipvlan.ko 2023-06-22T10:30:56.411 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/macvlan.ko 2023-06-22T10:30:56.411 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/macvtap.ko 2023-06-22T10:30:56.411 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/mdio 2023-06-22T10:30:56.411 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/mdio.ko 2023-06-22T10:30:56.411 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-06-22T10:30:56.411 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-06-22T10:30:56.411 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/mii.ko 2023-06-22T10:30:56.411 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/net_failover.ko 2023-06-22T10:30:56.412 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/netconsole.ko 2023-06-22T10:30:56.412 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/nlmon.ko 2023-06-22T10:30:56.412 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/pcs 2023-06-22T10:30:56.412 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/pcs/pcs-altera-tse.ko 2023-06-22T10:30:56.412 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-06-22T10:30:56.412 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy 2023-06-22T10:30:56.412 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/amd.ko 2023-06-22T10:30:56.412 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-06-22T10:30:56.413 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-06-22T10:30:56.413 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/bcm7xxx.ko 2023-06-22T10:30:56.413 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/bcm87xx.ko 2023-06-22T10:30:56.413 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/broadcom.ko 2023-06-22T10:30:56.413 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/cicada.ko 2023-06-22T10:30:56.413 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/davicom.ko 2023-06-22T10:30:56.413 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/dp83640.ko 2023-06-22T10:30:56.413 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/et1011c.ko 2023-06-22T10:30:56.414 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/icplus.ko 2023-06-22T10:30:56.414 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/lxt.ko 2023-06-22T10:30:56.414 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/marvell.ko 2023-06-22T10:30:56.414 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/micrel.ko 2023-06-22T10:30:56.414 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/national.ko 2023-06-22T10:30:56.414 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/phylink.ko 2023-06-22T10:30:56.414 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/qsemi.ko 2023-06-22T10:30:56.415 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/realtek.ko 2023-06-22T10:30:56.415 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/smsc.ko 2023-06-22T10:30:56.415 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/ste10Xp.ko 2023-06-22T10:30:56.415 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/vitesse.ko 2023-06-22T10:30:56.415 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp 2023-06-22T10:30:56.415 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp/bsd_comp.ko 2023-06-22T10:30:56.415 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp/ppp_async.ko 2023-06-22T10:30:56.415 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp/ppp_deflate.ko 2023-06-22T10:30:56.416 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp/ppp_generic.ko 2023-06-22T10:30:56.416 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp/ppp_mppe.ko 2023-06-22T10:30:56.416 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp/ppp_synctty.ko 2023-06-22T10:30:56.416 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp/pppoe.ko 2023-06-22T10:30:56.416 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp/pppox.ko 2023-06-22T10:30:56.416 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp/pptp.ko 2023-06-22T10:30:56.416 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/slip 2023-06-22T10:30:56.416 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/slip/slhc.ko 2023-06-22T10:30:56.417 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/slip/slip.ko 2023-06-22T10:30:56.417 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/sungem_phy.ko 2023-06-22T10:30:56.417 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/tap.ko 2023-06-22T10:30:56.417 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/team 2023-06-22T10:30:56.417 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/team/team.ko 2023-06-22T10:30:56.417 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/team/team_mode_activebackup.ko 2023-06-22T10:30:56.417 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/team/team_mode_broadcast.ko 2023-06-22T10:30:56.417 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-06-22T10:30:56.418 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/team/team_mode_random.ko 2023-06-22T10:30:56.418 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-06-22T10:30:56.418 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/tun.ko 2023-06-22T10:30:56.418 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/veth.ko 2023-06-22T10:30:56.418 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/virtio_net.ko 2023-06-22T10:30:56.418 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/vmxnet3 2023-06-22T10:30:56.418 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-06-22T10:30:56.418 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/vxlan 2023-06-22T10:30:56.419 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/vxlan/vxlan.ko 2023-06-22T10:30:56.419 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/xen-netback 2023-06-22T10:30:56.419 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/xen-netback/xen-netback.ko 2023-06-22T10:30:56.419 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/xen-netfront.ko 2023-06-22T10:30:56.419 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ntb 2023-06-22T10:30:56.419 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ntb/ntb.ko 2023-06-22T10:30:56.419 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/nvme 2023-06-22T10:30:56.419 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/nvme/host 2023-06-22T10:30:56.420 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/nvme/host/nvme-core.ko 2023-06-22T10:30:56.420 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/nvme/host/nvme.ko 2023-06-22T10:30:56.420 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/parport 2023-06-22T10:30:56.420 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/parport/parport.ko 2023-06-22T10:30:56.420 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/parport/parport_cs.ko 2023-06-22T10:30:56.420 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/parport/parport_pc.ko 2023-06-22T10:30:56.420 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/parport/parport_serial.ko 2023-06-22T10:30:56.421 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pci 2023-06-22T10:30:56.421 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pci/hotplug 2023-06-22T10:30:56.421 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-06-22T10:30:56.421 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pci/pcie 2023-06-22T10:30:56.421 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pci/pcie/aer_inject.ko 2023-06-22T10:30:56.421 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pci/xen-pcifront.ko 2023-06-22T10:30:56.421 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pcmcia 2023-06-22T10:30:56.421 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pcmcia/i82092.ko 2023-06-22T10:30:56.422 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pcmcia/pd6729.ko 2023-06-22T10:30:56.422 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pcmcia/yenta_socket.ko 2023-06-22T10:30:56.422 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pinctrl 2023-06-22T10:30:56.422 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pinctrl/intel 2023-06-22T10:30:56.422 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-06-22T10:30:56.422 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform 2023-06-22T10:30:56.422 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86 2023-06-22T10:30:56.422 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/acer-wmi.ko 2023-06-22T10:30:56.423 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/acerhdf.ko 2023-06-22T10:30:56.423 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/apple-gmux.ko 2023-06-22T10:30:56.423 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/asus-laptop.ko 2023-06-22T10:30:56.423 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-06-22T10:30:56.423 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/asus-wmi.ko 2023-06-22T10:30:56.423 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/classmate-laptop.ko 2023-06-22T10:30:56.423 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-06-22T10:30:56.423 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-06-22T10:30:56.424 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-06-22T10:30:56.424 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-06-22T10:30:56.424 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/hdaps.ko 2023-06-22T10:30:56.424 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/intel 2023-06-22T10:30:56.424 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-06-22T10:30:56.424 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/intel_ips.ko 2023-06-22T10:30:56.424 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/msi-wmi.ko 2023-06-22T10:30:56.424 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/mxm-wmi.ko 2023-06-22T10:30:56.425 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-06-22T10:30:56.425 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/samsung-laptop.ko 2023-06-22T10:30:56.425 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/samsung-q10.ko 2023-06-22T10:30:56.425 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/topstar-laptop.ko 2023-06-22T10:30:56.425 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-06-22T10:30:56.425 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/toshiba_haps.ko 2023-06-22T10:30:56.425 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/wmi-bmof.ko 2023-06-22T10:30:56.426 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/wmi.ko 2023-06-22T10:30:56.426 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/powercap 2023-06-22T10:30:56.426 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/powercap/intel_rapl_common.ko 2023-06-22T10:30:56.426 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/powercap/intel_rapl_msr.ko 2023-06-22T10:30:56.426 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pps 2023-06-22T10:30:56.426 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pps/clients 2023-06-22T10:30:56.426 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pps/clients/pps-gpio.ko 2023-06-22T10:30:56.426 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pps/clients/pps-ldisc.ko 2023-06-22T10:30:56.427 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pps/clients/pps_parport.ko 2023-06-22T10:30:56.427 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pps/pps_core.ko 2023-06-22T10:30:56.427 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ptp 2023-06-22T10:30:56.427 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ptp/ptp.ko 2023-06-22T10:30:56.427 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ptp/ptp_kvm.ko 2023-06-22T10:30:56.427 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc 2023-06-22T10:30:56.427 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-bq32k.ko 2023-06-22T10:30:56.427 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-bq4802.ko 2023-06-22T10:30:56.428 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-ds1286.ko 2023-06-22T10:30:56.428 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-ds1307.ko 2023-06-22T10:30:56.428 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-ds1374.ko 2023-06-22T10:30:56.428 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-ds1511.ko 2023-06-22T10:30:56.428 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-ds1553.ko 2023-06-22T10:30:56.428 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-ds1672.ko 2023-06-22T10:30:56.428 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-ds1742.ko 2023-06-22T10:30:56.429 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-ds2404.ko 2023-06-22T10:30:56.429 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-ds3232.ko 2023-06-22T10:30:56.429 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-em3027.ko 2023-06-22T10:30:56.429 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-fm3130.ko 2023-06-22T10:30:56.429 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-isl12022.ko 2023-06-22T10:30:56.429 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-isl1208.ko 2023-06-22T10:30:56.429 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-m41t80.ko 2023-06-22T10:30:56.429 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-m48t35.ko 2023-06-22T10:30:56.429 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-m48t59.ko 2023-06-22T10:30:56.430 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-max6900.ko 2023-06-22T10:30:56.430 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-msm6242.ko 2023-06-22T10:30:56.430 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-pcf2127.ko 2023-06-22T10:30:56.430 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-pcf85063.ko 2023-06-22T10:30:56.430 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-pcf8523.ko 2023-06-22T10:30:56.430 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-pcf8563.ko 2023-06-22T10:30:56.430 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-pcf8583.ko 2023-06-22T10:30:56.431 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-rp5c01.ko 2023-06-22T10:30:56.431 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-rs5c372.ko 2023-06-22T10:30:56.431 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-06-22T10:30:56.431 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-rx8025.ko 2023-06-22T10:30:56.431 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-rx8581.ko 2023-06-22T10:30:56.431 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-06-22T10:30:56.431 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-x1205.ko 2023-06-22T10:30:56.431 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi 2023-06-22T10:30:56.432 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/3w-9xxx.ko 2023-06-22T10:30:56.432 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/3w-sas.ko 2023-06-22T10:30:56.432 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/3w-xxxx.ko 2023-06-22T10:30:56.432 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/BusLogic.ko 2023-06-22T10:30:56.432 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/a100u2w.ko 2023-06-22T10:30:56.432 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/aacraid 2023-06-22T10:30:56.432 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/aacraid/aacraid.ko 2023-06-22T10:30:56.432 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/advansys.ko 2023-06-22T10:30:56.433 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/aic7xxx 2023-06-22T10:30:56.433 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-06-22T10:30:56.433 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-06-22T10:30:56.433 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/am53c974.ko 2023-06-22T10:30:56.433 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/arcmsr 2023-06-22T10:30:56.433 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-06-22T10:30:56.433 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/atp870u.ko 2023-06-22T10:30:56.433 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/be2iscsi 2023-06-22T10:30:56.434 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-06-22T10:30:56.434 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/bfa 2023-06-22T10:30:56.434 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/bfa/bfa.ko 2023-06-22T10:30:56.434 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/bnx2fc 2023-06-22T10:30:56.434 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-06-22T10:30:56.434 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/bnx2i 2023-06-22T10:30:56.434 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-06-22T10:30:56.434 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/ch.ko 2023-06-22T10:30:56.435 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/csiostor 2023-06-22T10:30:56.435 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/csiostor/csiostor.ko 2023-06-22T10:30:56.435 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/cxgbi 2023-06-22T10:30:56.435 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/cxgbi/cxgb3i 2023-06-22T10:30:56.435 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-06-22T10:30:56.435 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/cxgbi/cxgb4i 2023-06-22T10:30:56.435 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-06-22T10:30:56.435 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-06-22T10:30:56.436 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/dc395x.ko 2023-06-22T10:30:56.436 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/device_handler 2023-06-22T10:30:56.436 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-06-22T10:30:56.436 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-06-22T10:30:56.436 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-06-22T10:30:56.436 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-06-22T10:30:56.436 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/dmx3191d.ko 2023-06-22T10:30:56.437 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/esas2r 2023-06-22T10:30:56.437 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/esas2r/esas2r.ko 2023-06-22T10:30:56.437 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/esp_scsi.ko 2023-06-22T10:30:56.437 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/fcoe 2023-06-22T10:30:56.437 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/fcoe/fcoe.ko 2023-06-22T10:30:56.437 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-06-22T10:30:56.437 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/fnic 2023-06-22T10:30:56.437 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/fnic/fnic.ko 2023-06-22T10:30:56.438 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/hpsa.ko 2023-06-22T10:30:56.438 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/hptiop.ko 2023-06-22T10:30:56.438 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/hv_storvsc.ko 2023-06-22T10:30:56.438 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/initio.ko 2023-06-22T10:30:56.438 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/ipr.ko 2023-06-22T10:30:56.438 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/ips.ko 2023-06-22T10:30:56.438 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/isci 2023-06-22T10:30:56.438 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/isci/isci.ko 2023-06-22T10:30:56.439 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-06-22T10:30:56.439 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/iscsi_tcp.ko 2023-06-22T10:30:56.439 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/libfc 2023-06-22T10:30:56.439 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/libfc/libfc.ko 2023-06-22T10:30:56.439 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/libiscsi.ko 2023-06-22T10:30:56.439 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/libiscsi_tcp.ko 2023-06-22T10:30:56.439 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/libsas 2023-06-22T10:30:56.439 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/libsas/libsas.ko 2023-06-22T10:30:56.440 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/lpfc 2023-06-22T10:30:56.440 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/lpfc/lpfc.ko 2023-06-22T10:30:56.440 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/megaraid 2023-06-22T10:30:56.440 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/megaraid.ko 2023-06-22T10:30:56.440 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-06-22T10:30:56.440 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-06-22T10:30:56.440 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-06-22T10:30:56.440 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/mpt3sas 2023-06-22T10:30:56.441 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-06-22T10:30:56.441 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/mvsas 2023-06-22T10:30:56.441 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/mvsas/mvsas.ko 2023-06-22T10:30:56.441 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/mvumi.ko 2023-06-22T10:30:56.441 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/pm8001 2023-06-22T10:30:56.441 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-06-22T10:30:56.441 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/pmcraid.ko 2023-06-22T10:30:56.441 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/qla1280.ko 2023-06-22T10:30:56.442 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/qla2xxx 2023-06-22T10:30:56.442 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-06-22T10:30:56.442 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-06-22T10:30:56.442 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/qla4xxx 2023-06-22T10:30:56.442 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-06-22T10:30:56.442 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/raid_class.ko 2023-06-22T10:30:56.442 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/scsi_debug.ko 2023-06-22T10:30:56.442 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/scsi_transport_fc.ko 2023-06-22T10:30:56.443 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-06-22T10:30:56.443 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/scsi_transport_sas.ko 2023-06-22T10:30:56.443 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/scsi_transport_spi.ko 2023-06-22T10:30:56.443 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/scsi_transport_srp.ko 2023-06-22T10:30:56.443 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/ses.ko 2023-06-22T10:30:56.443 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/st.ko 2023-06-22T10:30:56.443 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/stex.ko 2023-06-22T10:30:56.443 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/sym53c8xx_2 2023-06-22T10:30:56.444 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-06-22T10:30:56.444 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/virtio_scsi.ko 2023-06-22T10:30:56.444 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/vmw_pvscsi.ko 2023-06-22T10:30:56.444 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/wd719x.ko 2023-06-22T10:30:56.444 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ssb 2023-06-22T10:30:56.444 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ssb/ssb.ko 2023-06-22T10:30:56.444 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target 2023-06-22T10:30:56.444 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/iscsi 2023-06-22T10:30:56.445 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-06-22T10:30:56.445 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/loopback 2023-06-22T10:30:56.445 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/loopback/tcm_loop.ko 2023-06-22T10:30:56.445 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/target_core_file.ko 2023-06-22T10:30:56.445 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/target_core_iblock.ko 2023-06-22T10:30:56.445 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/target_core_mod.ko 2023-06-22T10:30:56.445 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/target_core_pscsi.ko 2023-06-22T10:30:56.446 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/target_core_user.ko 2023-06-22T10:30:56.446 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/tcm_fc 2023-06-22T10:30:56.446 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-06-22T10:30:56.446 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal 2023-06-22T10:30:56.446 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel 2023-06-22T10:30:56.446 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal 2023-06-22T10:30:56.446 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-06-22T10:30:56.446 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-06-22T10:30:56.447 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-06-22T10:30:56.447 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-06-22T10:30:56.447 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-06-22T10:30:56.447 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-06-22T10:30:56.447 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-06-22T10:30:56.447 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-06-22T10:30:56.447 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-06-22T10:30:56.447 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-06-22T10:30:56.448 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-06-22T10:30:56.448 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-06-22T10:30:56.448 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-06-22T10:30:56.448 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-06-22T10:30:56.448 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-06-22T10:30:56.448 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty 2023-06-22T10:30:56.448 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/ipwireless 2023-06-22T10:30:56.448 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-06-22T10:30:56.449 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/n_gsm.ko 2023-06-22T10:30:56.449 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/n_hdlc.ko 2023-06-22T10:30:56.449 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/nozomi.ko 2023-06-22T10:30:56.449 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/serial 2023-06-22T10:30:56.449 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/serial/8250 2023-06-22T10:30:56.449 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-06-22T10:30:56.449 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/serial/arc_uart.ko 2023-06-22T10:30:56.449 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/serial/jsm 2023-06-22T10:30:56.450 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/serial/jsm/jsm.ko 2023-06-22T10:30:56.450 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/synclink_gt.ko 2023-06-22T10:30:56.450 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ufs 2023-06-22T10:30:56.450 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ufs/core 2023-06-22T10:30:56.450 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ufs/core/ufshcd-core.ko 2023-06-22T10:30:56.450 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ufs/host 2023-06-22T10:30:56.450 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-06-22T10:30:56.451 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/uio 2023-06-22T10:30:56.451 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/uio/uio.ko 2023-06-22T10:30:56.451 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/uio/uio_aec.ko 2023-06-22T10:30:56.451 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/uio/uio_cif.ko 2023-06-22T10:30:56.451 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/uio/uio_pci_generic.ko 2023-06-22T10:30:56.451 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/uio/uio_sercos3.ko 2023-06-22T10:30:56.451 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb 2023-06-22T10:30:56.451 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/class 2023-06-22T10:30:56.452 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/class/cdc-acm.ko 2023-06-22T10:30:56.452 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/class/cdc-wdm.ko 2023-06-22T10:30:56.452 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/class/usblp.ko 2023-06-22T10:30:56.452 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/class/usbtmc.ko 2023-06-22T10:30:56.452 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/host 2023-06-22T10:30:56.452 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/host/sl811-hcd.ko 2023-06-22T10:30:56.452 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/image 2023-06-22T10:30:56.452 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/image/mdc800.ko 2023-06-22T10:30:56.453 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/image/microtek.ko 2023-06-22T10:30:56.453 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc 2023-06-22T10:30:56.453 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/adutux.ko 2023-06-22T10:30:56.453 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/appledisplay.ko 2023-06-22T10:30:56.453 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/emi26.ko 2023-06-22T10:30:56.453 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/emi62.ko 2023-06-22T10:30:56.453 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/ezusb.ko 2023-06-22T10:30:56.453 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/idmouse.ko 2023-06-22T10:30:56.454 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/iowarrior.ko 2023-06-22T10:30:56.454 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/isight_firmware.ko 2023-06-22T10:30:56.454 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/ldusb.ko 2023-06-22T10:30:56.454 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/legousbtower.ko 2023-06-22T10:30:56.454 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/sisusbvga 2023-06-22T10:30:56.454 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-06-22T10:30:56.454 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/trancevibrator.ko 2023-06-22T10:30:56.455 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/usb3503.ko 2023-06-22T10:30:56.455 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/usblcd.ko 2023-06-22T10:30:56.455 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/usbsevseg.ko 2023-06-22T10:30:56.455 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/uss720.ko 2023-06-22T10:30:56.455 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/yurex.ko 2023-06-22T10:30:56.455 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/phy 2023-06-22T10:30:56.455 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/phy/phy-generic.ko 2023-06-22T10:30:56.455 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial 2023-06-22T10:30:56.456 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/aircable.ko 2023-06-22T10:30:56.456 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/ark3116.ko 2023-06-22T10:30:56.456 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/belkin_sa.ko 2023-06-22T10:30:56.456 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/ch341.ko 2023-06-22T10:30:56.456 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/cp210x.ko 2023-06-22T10:30:56.456 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/cyberjack.ko 2023-06-22T10:30:56.456 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/cypress_m8.ko 2023-06-22T10:30:56.456 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/digi_acceleport.ko 2023-06-22T10:30:56.457 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/empeg.ko 2023-06-22T10:30:56.457 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/ftdi_sio.ko 2023-06-22T10:30:56.457 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/garmin_gps.ko 2023-06-22T10:30:56.457 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/io_edgeport.ko 2023-06-22T10:30:56.457 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/io_ti.ko 2023-06-22T10:30:56.457 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/ipaq.ko 2023-06-22T10:30:56.457 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/ipw.ko 2023-06-22T10:30:56.457 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/ir-usb.ko 2023-06-22T10:30:56.458 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-06-22T10:30:56.458 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/keyspan.ko 2023-06-22T10:30:56.458 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/keyspan_pda.ko 2023-06-22T10:30:56.458 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/kl5kusb105.ko 2023-06-22T10:30:56.458 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/kobil_sct.ko 2023-06-22T10:30:56.458 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/mct_u232.ko 2023-06-22T10:30:56.458 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/mos7720.ko 2023-06-22T10:30:56.458 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/mos7840.ko 2023-06-22T10:30:56.459 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/navman.ko 2023-06-22T10:30:56.459 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/omninet.ko 2023-06-22T10:30:56.459 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/opticon.ko 2023-06-22T10:30:56.459 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/option.ko 2023-06-22T10:30:56.459 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/oti6858.ko 2023-06-22T10:30:56.459 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/pl2303.ko 2023-06-22T10:30:56.459 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/qcaux.ko 2023-06-22T10:30:56.459 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/qcserial.ko 2023-06-22T10:30:56.460 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/quatech2.ko 2023-06-22T10:30:56.460 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/safe_serial.ko 2023-06-22T10:30:56.460 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/sierra.ko 2023-06-22T10:30:56.460 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/spcp8x5.ko 2023-06-22T10:30:56.460 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/ssu100.ko 2023-06-22T10:30:56.460 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/symbolserial.ko 2023-06-22T10:30:56.460 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-06-22T10:30:56.461 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-06-22T10:30:56.461 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/usb_debug.ko 2023-06-22T10:30:56.461 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/usb_wwan.ko 2023-06-22T10:30:56.461 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/visor.ko 2023-06-22T10:30:56.461 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/whiteheat.ko 2023-06-22T10:30:56.461 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/xsens_mt.ko 2023-06-22T10:30:56.461 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage 2023-06-22T10:30:56.461 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/uas.ko 2023-06-22T10:30:56.462 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-alauda.ko 2023-06-22T10:30:56.462 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-cypress.ko 2023-06-22T10:30:56.462 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-datafab.ko 2023-06-22T10:30:56.462 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-06-22T10:30:56.462 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-freecom.ko 2023-06-22T10:30:56.462 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-isd200.ko 2023-06-22T10:30:56.462 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-06-22T10:30:56.462 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-karma.ko 2023-06-22T10:30:56.463 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-onetouch.ko 2023-06-22T10:30:56.463 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-realtek.ko 2023-06-22T10:30:56.463 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-sddr09.ko 2023-06-22T10:30:56.463 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-sddr55.ko 2023-06-22T10:30:56.463 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-usbat.ko 2023-06-22T10:30:56.463 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/usb-storage.ko 2023-06-22T10:30:56.463 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/usbip 2023-06-22T10:30:56.463 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/usbip/usbip-core.ko 2023-06-22T10:30:56.464 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/usbip/usbip-host.ko 2023-06-22T10:30:56.464 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-06-22T10:30:56.464 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vfio 2023-06-22T10:30:56.464 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vfio/pci 2023-06-22T10:30:56.464 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-06-22T10:30:56.464 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vfio/pci/vfio-pci.ko 2023-06-22T10:30:56.464 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vfio/vfio.ko 2023-06-22T10:30:56.464 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-06-22T10:30:56.465 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vhost 2023-06-22T10:30:56.465 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vhost/vhost.ko 2023-06-22T10:30:56.465 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vhost/vhost_iotlb.ko 2023-06-22T10:30:56.465 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vhost/vhost_net.ko 2023-06-22T10:30:56.465 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vhost/vhost_scsi.ko 2023-06-22T10:30:56.465 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/video 2023-06-22T10:30:56.465 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/video/backlight 2023-06-22T10:30:56.465 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/video/backlight/apple_bl.ko 2023-06-22T10:30:56.466 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/video/backlight/lcd.ko 2023-06-22T10:30:56.466 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/video/backlight/platform_lcd.ko 2023-06-22T10:30:56.466 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/virtio 2023-06-22T10:30:56.466 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/virtio/virtio.ko 2023-06-22T10:30:56.466 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/virtio/virtio_balloon.ko 2023-06-22T10:30:56.466 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/virtio/virtio_mmio.ko 2023-06-22T10:30:56.466 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/virtio/virtio_pci.ko 2023-06-22T10:30:56.466 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-06-22T10:30:56.467 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-06-22T10:30:56.467 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/virtio/virtio_ring.ko 2023-06-22T10:30:56.467 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1 2023-06-22T10:30:56.467 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/masters 2023-06-22T10:30:56.467 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/masters/ds2482.ko 2023-06-22T10:30:56.467 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/masters/ds2490.ko 2023-06-22T10:30:56.467 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves 2023-06-22T10:30:56.467 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-06-22T10:30:56.468 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-06-22T10:30:56.468 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-06-22T10:30:56.468 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-06-22T10:30:56.468 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-06-22T10:30:56.468 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-06-22T10:30:56.468 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-06-22T10:30:56.468 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-06-22T10:30:56.469 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-06-22T10:30:56.469 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_smem.ko 2023-06-22T10:30:56.469 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_therm.ko 2023-06-22T10:30:56.469 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/wire.ko 2023-06-22T10:30:56.469 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog 2023-06-22T10:30:56.469 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/alim1535_wdt.ko 2023-06-22T10:30:56.469 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/alim7101_wdt.ko 2023-06-22T10:30:56.469 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/f71808e_wdt.ko 2023-06-22T10:30:56.470 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/hpwdt.ko 2023-06-22T10:30:56.470 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/i6300esb.ko 2023-06-22T10:30:56.470 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-06-22T10:30:56.470 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/iTCO_wdt.ko 2023-06-22T10:30:56.470 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/ib700wdt.ko 2023-06-22T10:30:56.470 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/ibmasr.ko 2023-06-22T10:30:56.470 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-06-22T10:30:56.470 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/it8712f_wdt.ko 2023-06-22T10:30:56.471 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/it87_wdt.ko 2023-06-22T10:30:56.471 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/machzwd.ko 2023-06-22T10:30:56.471 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/nv_tco.ko 2023-06-22T10:30:56.471 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/pcwd_pci.ko 2023-06-22T10:30:56.471 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/pcwd_usb.ko 2023-06-22T10:30:56.471 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-06-22T10:30:56.471 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/sch311x_wdt.ko 2023-06-22T10:30:56.471 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/softdog.ko 2023-06-22T10:30:56.472 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/sp5100_tco.ko 2023-06-22T10:30:56.472 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/via_wdt.ko 2023-06-22T10:30:56.472 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-06-22T10:30:56.472 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/w83877f_wdt.ko 2023-06-22T10:30:56.472 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/w83977f_wdt.ko 2023-06-22T10:30:56.472 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/wdt_pci.ko 2023-06-22T10:30:56.472 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/xen_wdt.ko 2023-06-22T10:30:56.472 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen 2023-06-22T10:30:56.473 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen/xen-acpi-processor.ko 2023-06-22T10:30:56.473 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen/xen-evtchn.ko 2023-06-22T10:30:56.473 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen/xen-gntalloc.ko 2023-06-22T10:30:56.473 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen/xen-gntdev.ko 2023-06-22T10:30:56.473 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen/xen-pciback 2023-06-22T10:30:56.473 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-06-22T10:30:56.473 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen/xen-privcmd.ko 2023-06-22T10:30:56.474 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen/xenfs 2023-06-22T10:30:56.474 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen/xenfs/xenfs.ko 2023-06-22T10:30:56.474 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs 2023-06-22T10:30:56.474 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/9p 2023-06-22T10:30:56.474 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/9p/9p.ko 2023-06-22T10:30:56.474 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/affs 2023-06-22T10:30:56.474 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/affs/affs.ko 2023-06-22T10:30:56.474 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/befs 2023-06-22T10:30:56.474 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/befs/befs.ko 2023-06-22T10:30:56.475 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/binfmt_misc.ko 2023-06-22T10:30:56.475 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/btrfs 2023-06-22T10:30:56.475 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/btrfs/btrfs.ko 2023-06-22T10:30:56.475 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/cachefiles 2023-06-22T10:30:56.475 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/cachefiles/cachefiles.ko 2023-06-22T10:30:56.475 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ceph 2023-06-22T10:30:56.475 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ceph/ceph.ko 2023-06-22T10:30:56.476 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/coda 2023-06-22T10:30:56.476 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/coda/coda.ko 2023-06-22T10:30:56.476 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/cramfs 2023-06-22T10:30:56.476 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/cramfs/cramfs.ko 2023-06-22T10:30:56.476 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/dlm 2023-06-22T10:30:56.476 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/dlm/dlm.ko 2023-06-22T10:30:56.476 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ecryptfs 2023-06-22T10:30:56.476 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ecryptfs/ecryptfs.ko 2023-06-22T10:30:56.477 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/f2fs 2023-06-22T10:30:56.477 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/f2fs/f2fs.ko 2023-06-22T10:30:56.477 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/fat 2023-06-22T10:30:56.477 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/fat/fat.ko 2023-06-22T10:30:56.477 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/fat/msdos.ko 2023-06-22T10:30:56.477 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/fat/vfat.ko 2023-06-22T10:30:56.477 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/fscache 2023-06-22T10:30:56.477 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/fscache/fscache.ko 2023-06-22T10:30:56.478 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/fuse 2023-06-22T10:30:56.478 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/fuse/cuse.ko 2023-06-22T10:30:56.478 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/fuse/fuse.ko 2023-06-22T10:30:56.478 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/gfs2 2023-06-22T10:30:56.478 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/gfs2/gfs2.ko 2023-06-22T10:30:56.478 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/hfs 2023-06-22T10:30:56.478 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/hfs/hfs.ko 2023-06-22T10:30:56.478 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/hfsplus 2023-06-22T10:30:56.479 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/hfsplus/hfsplus.ko 2023-06-22T10:30:56.479 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/isofs 2023-06-22T10:30:56.479 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/isofs/isofs.ko 2023-06-22T10:30:56.479 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/jfs 2023-06-22T10:30:56.479 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/jfs/jfs.ko 2023-06-22T10:30:56.479 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/lockd 2023-06-22T10:30:56.479 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/lockd/lockd.ko 2023-06-22T10:30:56.479 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/minix 2023-06-22T10:30:56.480 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/minix/minix.ko 2023-06-22T10:30:56.480 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/netfs 2023-06-22T10:30:56.480 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/netfs/netfs.ko 2023-06-22T10:30:56.480 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs 2023-06-22T10:30:56.480 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs/blocklayout 2023-06-22T10:30:56.480 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-06-22T10:30:56.480 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs/filelayout 2023-06-22T10:30:56.480 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-06-22T10:30:56.481 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs/flexfilelayout 2023-06-22T10:30:56.481 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-06-22T10:30:56.481 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs/nfs.ko 2023-06-22T10:30:56.481 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs/nfsv3.ko 2023-06-22T10:30:56.481 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs/nfsv4.ko 2023-06-22T10:30:56.481 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs_common 2023-06-22T10:30:56.481 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs_common/grace.ko 2023-06-22T10:30:56.481 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs_common/nfs_acl.ko 2023-06-22T10:30:56.482 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfsd 2023-06-22T10:30:56.482 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfsd/nfsd.ko 2023-06-22T10:30:56.482 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nilfs2 2023-06-22T10:30:56.482 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nilfs2/nilfs2.ko 2023-06-22T10:30:56.482 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls 2023-06-22T10:30:56.482 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-celtic.ko 2023-06-22T10:30:56.482 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-centeuro.ko 2023-06-22T10:30:56.482 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-croatian.ko 2023-06-22T10:30:56.483 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-cyrillic.ko 2023-06-22T10:30:56.483 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-gaelic.ko 2023-06-22T10:30:56.483 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-greek.ko 2023-06-22T10:30:56.483 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-iceland.ko 2023-06-22T10:30:56.483 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-inuit.ko 2023-06-22T10:30:56.483 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-roman.ko 2023-06-22T10:30:56.483 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-romanian.ko 2023-06-22T10:30:56.483 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-turkish.ko 2023-06-22T10:30:56.484 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp1250.ko 2023-06-22T10:30:56.484 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp1251.ko 2023-06-22T10:30:56.484 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp1255.ko 2023-06-22T10:30:56.484 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp737.ko 2023-06-22T10:30:56.484 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp775.ko 2023-06-22T10:30:56.484 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp850.ko 2023-06-22T10:30:56.484 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp852.ko 2023-06-22T10:30:56.485 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp855.ko 2023-06-22T10:30:56.485 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp857.ko 2023-06-22T10:30:56.485 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp860.ko 2023-06-22T10:30:56.485 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp861.ko 2023-06-22T10:30:56.485 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp862.ko 2023-06-22T10:30:56.485 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp863.ko 2023-06-22T10:30:56.485 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp864.ko 2023-06-22T10:30:56.485 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp865.ko 2023-06-22T10:30:56.486 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp866.ko 2023-06-22T10:30:56.486 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp869.ko 2023-06-22T10:30:56.486 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp874.ko 2023-06-22T10:30:56.486 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp932.ko 2023-06-22T10:30:56.486 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp936.ko 2023-06-22T10:30:56.486 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp949.ko 2023-06-22T10:30:56.486 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp950.ko 2023-06-22T10:30:56.486 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_euc-jp.ko 2023-06-22T10:30:56.487 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-1.ko 2023-06-22T10:30:56.487 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-13.ko 2023-06-22T10:30:56.487 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-14.ko 2023-06-22T10:30:56.487 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-15.ko 2023-06-22T10:30:56.487 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-2.ko 2023-06-22T10:30:56.487 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-3.ko 2023-06-22T10:30:56.487 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-4.ko 2023-06-22T10:30:56.487 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-5.ko 2023-06-22T10:30:56.488 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-6.ko 2023-06-22T10:30:56.488 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-7.ko 2023-06-22T10:30:56.488 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-9.ko 2023-06-22T10:30:56.488 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_koi8-r.ko 2023-06-22T10:30:56.488 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_koi8-ru.ko 2023-06-22T10:30:56.488 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_koi8-u.ko 2023-06-22T10:30:56.488 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_utf8.ko 2023-06-22T10:30:56.488 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2 2023-06-22T10:30:56.489 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/cluster 2023-06-22T10:30:56.489 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-06-22T10:30:56.489 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/dlm 2023-06-22T10:30:56.489 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-06-22T10:30:56.489 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/dlmfs 2023-06-22T10:30:56.489 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-06-22T10:30:56.489 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/ocfs2.ko 2023-06-22T10:30:56.489 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-06-22T10:30:56.490 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-06-22T10:30:56.490 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-06-22T10:30:56.490 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/overlayfs 2023-06-22T10:30:56.490 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/overlayfs/overlay.ko 2023-06-22T10:30:56.490 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/pstore 2023-06-22T10:30:56.490 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/pstore/ramoops.ko 2023-06-22T10:30:56.490 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/reiserfs 2023-06-22T10:30:56.490 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/reiserfs/reiserfs.ko 2023-06-22T10:30:56.491 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/romfs 2023-06-22T10:30:56.491 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/romfs/romfs.ko 2023-06-22T10:30:56.491 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/smb 2023-06-22T10:30:56.491 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/smb/client 2023-06-22T10:30:56.491 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/smb/client/cifs.ko 2023-06-22T10:30:56.491 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/smb/common 2023-06-22T10:30:56.491 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/smb/common/cifs_arc4.ko 2023-06-22T10:30:56.491 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/smb/common/cifs_md4.ko 2023-06-22T10:30:56.492 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/squashfs 2023-06-22T10:30:56.492 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/squashfs/squashfs.ko 2023-06-22T10:30:56.492 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/sysv 2023-06-22T10:30:56.492 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/sysv/sysv.ko 2023-06-22T10:30:56.492 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/udf 2023-06-22T10:30:56.492 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/udf/udf.ko 2023-06-22T10:30:56.492 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ufs 2023-06-22T10:30:56.493 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ufs/ufs.ko 2023-06-22T10:30:56.493 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/xfs 2023-06-22T10:30:56.493 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/xfs/xfs.ko 2023-06-22T10:30:56.493 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/kernel 2023-06-22T10:30:56.493 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/kernel/rcu 2023-06-22T10:30:56.493 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/kernel/rcu/rcutorture.ko 2023-06-22T10:30:56.493 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/kernel/torture.ko 2023-06-22T10:30:56.493 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/kernel/trace 2023-06-22T10:30:56.494 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-06-22T10:30:56.494 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib 2023-06-22T10:30:56.494 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/asn1_encoder.ko 2023-06-22T10:30:56.494 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/crc-itu-t.ko 2023-06-22T10:30:56.494 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/crc8.ko 2023-06-22T10:30:56.494 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/crypto 2023-06-22T10:30:56.494 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/crypto/libarc4.ko 2023-06-22T10:30:56.494 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/crypto/libdes.ko 2023-06-22T10:30:56.495 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/libcrc32c.ko 2023-06-22T10:30:56.495 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/lru_cache.ko 2023-06-22T10:30:56.495 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/lz4 2023-06-22T10:30:56.495 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/lz4/lz4_compress.ko 2023-06-22T10:30:56.495 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/lz4/lz4hc_compress.ko 2023-06-22T10:30:56.495 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/math 2023-06-22T10:30:56.495 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/math/cordic.ko 2023-06-22T10:30:56.495 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/raid6 2023-06-22T10:30:56.496 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/raid6/raid6_pq.ko 2023-06-22T10:30:56.496 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/reed_solomon 2023-06-22T10:30:56.496 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/reed_solomon/reed_solomon.ko 2023-06-22T10:30:56.496 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/ts_bm.ko 2023-06-22T10:30:56.496 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/ts_fsm.ko 2023-06-22T10:30:56.496 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/ts_kmp.ko 2023-06-22T10:30:56.496 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/zstd 2023-06-22T10:30:56.496 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/zstd/zstd_compress.ko 2023-06-22T10:30:56.497 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/mm 2023-06-22T10:30:56.497 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/mm/hwpoison-inject.ko 2023-06-22T10:30:56.497 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net 2023-06-22T10:30:56.497 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/6lowpan 2023-06-22T10:30:56.497 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/6lowpan/6lowpan.ko 2023-06-22T10:30:56.497 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/6lowpan/nhc_dest.ko 2023-06-22T10:30:56.497 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/6lowpan/nhc_fragment.ko 2023-06-22T10:30:56.497 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/6lowpan/nhc_hop.ko 2023-06-22T10:30:56.498 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/6lowpan/nhc_ipv6.ko 2023-06-22T10:30:56.498 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/6lowpan/nhc_mobility.ko 2023-06-22T10:30:56.498 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/6lowpan/nhc_routing.ko 2023-06-22T10:30:56.498 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/6lowpan/nhc_udp.ko 2023-06-22T10:30:56.498 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/802 2023-06-22T10:30:56.498 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/802/garp.ko 2023-06-22T10:30:56.499 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/802/mrp.ko 2023-06-22T10:30:56.499 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/802/p8022.ko 2023-06-22T10:30:56.499 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/802/psnap.ko 2023-06-22T10:30:56.499 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/802/stp.ko 2023-06-22T10:30:56.499 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/8021q 2023-06-22T10:30:56.499 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/8021q/8021q.ko 2023-06-22T10:30:56.499 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/9p 2023-06-22T10:30:56.499 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/9p/9pnet.ko 2023-06-22T10:30:56.500 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/9p/9pnet_fd.ko 2023-06-22T10:30:56.500 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/9p/9pnet_rdma.ko 2023-06-22T10:30:56.500 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/9p/9pnet_virtio.ko 2023-06-22T10:30:56.500 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/batman-adv 2023-06-22T10:30:56.500 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/batman-adv/batman-adv.ko 2023-06-22T10:30:56.500 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge 2023-06-22T10:30:56.500 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/br_netfilter.ko 2023-06-22T10:30:56.500 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/bridge.ko 2023-06-22T10:30:56.501 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter 2023-06-22T10:30:56.501 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-06-22T10:30:56.501 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_among.ko 2023-06-22T10:30:56.501 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_arp.ko 2023-06-22T10:30:56.501 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-06-22T10:30:56.501 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-06-22T10:30:56.501 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_ip.ko 2023-06-22T10:30:56.501 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-06-22T10:30:56.502 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_limit.ko 2023-06-22T10:30:56.502 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_log.ko 2023-06-22T10:30:56.502 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_mark.ko 2023-06-22T10:30:56.502 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-06-22T10:30:56.502 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-06-22T10:30:56.502 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-06-22T10:30:56.502 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-06-22T10:30:56.503 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_snat.ko 2023-06-22T10:30:56.503 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_stp.ko 2023-06-22T10:30:56.503 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-06-22T10:30:56.503 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-06-22T10:30:56.503 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-06-22T10:30:56.503 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-06-22T10:30:56.503 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebtables.ko 2023-06-22T10:30:56.503 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-06-22T10:30:56.504 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-06-22T10:30:56.504 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-06-22T10:30:56.504 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ceph 2023-06-22T10:30:56.504 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ceph/libceph.ko 2023-06-22T10:30:56.504 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/core 2023-06-22T10:30:56.504 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/core/failover.ko 2023-06-22T10:30:56.504 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/core/pktgen.ko 2023-06-22T10:30:56.504 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dccp 2023-06-22T10:30:56.505 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dccp/dccp.ko 2023-06-22T10:30:56.505 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dccp/dccp_diag.ko 2023-06-22T10:30:56.505 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dccp/dccp_ipv4.ko 2023-06-22T10:30:56.505 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dccp/dccp_ipv6.ko 2023-06-22T10:30:56.505 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dns_resolver 2023-06-22T10:30:56.505 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dns_resolver/dns_resolver.ko 2023-06-22T10:30:56.505 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dsa 2023-06-22T10:30:56.505 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dsa/dsa_core.ko 2023-06-22T10:30:56.506 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dsa/tag_brcm.ko 2023-06-22T10:30:56.506 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dsa/tag_dsa.ko 2023-06-22T10:30:56.506 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dsa/tag_none.ko 2023-06-22T10:30:56.506 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dsa/tag_trailer.ko 2023-06-22T10:30:56.506 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ieee802154 2023-06-22T10:30:56.506 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ieee802154/6lowpan 2023-06-22T10:30:56.506 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-06-22T10:30:56.506 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ieee802154/ieee802154.ko 2023-06-22T10:30:56.507 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ieee802154/ieee802154_socket.ko 2023-06-22T10:30:56.507 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4 2023-06-22T10:30:56.507 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/ah4.ko 2023-06-22T10:30:56.507 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/esp4.ko 2023-06-22T10:30:56.507 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/fou.ko 2023-06-22T10:30:56.507 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/gre.ko 2023-06-22T10:30:56.507 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/inet_diag.ko 2023-06-22T10:30:56.507 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/ip_gre.ko 2023-06-22T10:30:56.508 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/ip_tunnel.ko 2023-06-22T10:30:56.508 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/ip_vti.ko 2023-06-22T10:30:56.508 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/ipcomp.ko 2023-06-22T10:30:56.508 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/ipip.ko 2023-06-22T10:30:56.508 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter 2023-06-22T10:30:56.508 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/arp_tables.ko 2023-06-22T10:30:56.508 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-06-22T10:30:56.508 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-06-22T10:30:56.509 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-06-22T10:30:56.509 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-06-22T10:30:56.509 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-06-22T10:30:56.509 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-06-22T10:30:56.509 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-06-22T10:30:56.509 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-06-22T10:30:56.509 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-06-22T10:30:56.510 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/iptable_security.ko 2023-06-22T10:30:56.510 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-06-22T10:30:56.510 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-06-22T10:30:56.510 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-06-22T10:30:56.510 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-06-22T10:30:56.510 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-06-22T10:30:56.510 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-06-22T10:30:56.510 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-06-22T10:30:56.511 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-06-22T10:30:56.511 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-06-22T10:30:56.511 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-06-22T10:30:56.511 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_bic.ko 2023-06-22T10:30:56.511 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_dctcp.ko 2023-06-22T10:30:56.511 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_diag.ko 2023-06-22T10:30:56.511 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_highspeed.ko 2023-06-22T10:30:56.511 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_htcp.ko 2023-06-22T10:30:56.512 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_hybla.ko 2023-06-22T10:30:56.512 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_illinois.ko 2023-06-22T10:30:56.512 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_lp.ko 2023-06-22T10:30:56.512 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_scalable.ko 2023-06-22T10:30:56.512 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_vegas.ko 2023-06-22T10:30:56.512 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_veno.ko 2023-06-22T10:30:56.512 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_westwood.ko 2023-06-22T10:30:56.512 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_yeah.ko 2023-06-22T10:30:56.513 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tunnel4.ko 2023-06-22T10:30:56.513 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/udp_diag.ko 2023-06-22T10:30:56.513 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/udp_tunnel.ko 2023-06-22T10:30:56.513 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/xfrm4_tunnel.ko 2023-06-22T10:30:56.513 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6 2023-06-22T10:30:56.513 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/ah6.ko 2023-06-22T10:30:56.513 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/esp6.ko 2023-06-22T10:30:56.513 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/fou6.ko 2023-06-22T10:30:56.514 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/ip6_tunnel.ko 2023-06-22T10:30:56.514 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-06-22T10:30:56.514 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/ip6_vti.ko 2023-06-22T10:30:56.514 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/ipcomp6.ko 2023-06-22T10:30:56.514 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter 2023-06-22T10:30:56.514 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-06-22T10:30:56.514 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-06-22T10:30:56.515 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-06-22T10:30:56.515 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-06-22T10:30:56.515 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-06-22T10:30:56.515 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-06-22T10:30:56.515 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-06-22T10:30:56.515 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-06-22T10:30:56.515 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-06-22T10:30:56.515 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-06-22T10:30:56.516 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-06-22T10:30:56.516 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-06-22T10:30:56.516 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-06-22T10:30:56.516 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-06-22T10:30:56.516 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-06-22T10:30:56.516 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-06-22T10:30:56.516 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-06-22T10:30:56.516 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-06-22T10:30:56.517 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-06-22T10:30:56.517 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-06-22T10:30:56.517 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-06-22T10:30:56.517 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-06-22T10:30:56.518 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-06-22T10:30:56.518 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-06-22T10:30:56.518 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/sit.ko 2023-06-22T10:30:56.518 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/tunnel6.ko 2023-06-22T10:30:56.518 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/xfrm6_tunnel.ko 2023-06-22T10:30:56.519 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/key 2023-06-22T10:30:56.519 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/key/af_key.ko 2023-06-22T10:30:56.519 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/l2tp 2023-06-22T10:30:56.519 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/l2tp/l2tp_core.ko 2023-06-22T10:30:56.519 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/l2tp/l2tp_debugfs.ko 2023-06-22T10:30:56.519 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/l2tp/l2tp_eth.ko 2023-06-22T10:30:56.519 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/l2tp/l2tp_ip.ko 2023-06-22T10:30:56.519 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/l2tp/l2tp_ip6.ko 2023-06-22T10:30:56.520 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/l2tp/l2tp_netlink.ko 2023-06-22T10:30:56.520 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/l2tp/l2tp_ppp.ko 2023-06-22T10:30:56.520 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/llc 2023-06-22T10:30:56.520 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/llc/llc.ko 2023-06-22T10:30:56.520 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/mac802154 2023-06-22T10:30:56.520 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/mac802154/mac802154.ko 2023-06-22T10:30:56.520 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/mpls 2023-06-22T10:30:56.520 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/mpls/mpls_gso.ko 2023-06-22T10:30:56.521 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter 2023-06-22T10:30:56.521 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset 2023-06-22T10:30:56.521 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set.ko 2023-06-22T10:30:56.521 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-06-22T10:30:56.521 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-06-22T10:30:56.521 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-06-22T10:30:56.521 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-06-22T10:30:56.521 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-06-22T10:30:56.522 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-06-22T10:30:56.522 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-06-22T10:30:56.522 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-06-22T10:30:56.522 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-06-22T10:30:56.522 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-06-22T10:30:56.522 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-06-22T10:30:56.522 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-06-22T10:30:56.523 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-06-22T10:30:56.523 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-06-22T10:30:56.523 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-06-22T10:30:56.523 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs 2023-06-22T10:30:56.523 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs.ko 2023-06-22T10:30:56.523 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-06-22T10:30:56.523 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-06-22T10:30:56.523 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-06-22T10:30:56.524 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-06-22T10:30:56.524 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-06-22T10:30:56.524 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-06-22T10:30:56.524 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-06-22T10:30:56.524 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-06-22T10:30:56.524 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-06-22T10:30:56.524 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-06-22T10:30:56.524 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-06-22T10:30:56.525 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-06-22T10:30:56.525 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-06-22T10:30:56.525 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conncount.ko 2023-06-22T10:30:56.525 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack.ko 2023-06-22T10:30:56.525 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-06-22T10:30:56.525 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-06-22T10:30:56.525 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-06-22T10:30:56.525 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_h323.ko 2023-06-22T10:30:56.526 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_irc.ko 2023-06-22T10:30:56.526 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-06-22T10:30:56.526 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-06-22T10:30:56.526 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-06-22T10:30:56.526 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_sane.ko 2023-06-22T10:30:56.526 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_sip.ko 2023-06-22T10:30:56.526 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-06-22T10:30:56.527 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-06-22T10:30:56.527 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_dup_netdev.ko 2023-06-22T10:30:56.527 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_flow_table.ko 2023-06-22T10:30:56.527 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_flow_table_inet.ko 2023-06-22T10:30:56.527 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_log_syslog.ko 2023-06-22T10:30:56.527 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_nat.ko 2023-06-22T10:30:56.527 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_nat_amanda.ko 2023-06-22T10:30:56.527 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_nat_ftp.ko 2023-06-22T10:30:56.528 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_nat_irc.ko 2023-06-22T10:30:56.528 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_nat_sip.ko 2023-06-22T10:30:56.528 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_nat_tftp.ko 2023-06-22T10:30:56.528 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_synproxy_core.ko 2023-06-22T10:30:56.528 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_tables.ko 2023-06-22T10:30:56.528 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nfnetlink.ko 2023-06-22T10:30:56.528 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nfnetlink_acct.ko 2023-06-22T10:30:56.528 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nfnetlink_log.ko 2023-06-22T10:30:56.529 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nfnetlink_osf.ko 2023-06-22T10:30:56.529 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nfnetlink_queue.ko 2023-06-22T10:30:56.529 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_chain_nat.ko 2023-06-22T10:30:56.529 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_compat.ko 2023-06-22T10:30:56.529 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_ct.ko 2023-06-22T10:30:56.529 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_dup_netdev.ko 2023-06-22T10:30:56.529 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_fib.ko 2023-06-22T10:30:56.529 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_fwd_netdev.ko 2023-06-22T10:30:56.530 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_hash.ko 2023-06-22T10:30:56.530 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_limit.ko 2023-06-22T10:30:56.530 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_log.ko 2023-06-22T10:30:56.530 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_masq.ko 2023-06-22T10:30:56.530 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_nat.ko 2023-06-22T10:30:56.530 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_numgen.ko 2023-06-22T10:30:56.530 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_queue.ko 2023-06-22T10:30:56.530 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_quota.ko 2023-06-22T10:30:56.531 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_redir.ko 2023-06-22T10:30:56.531 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_reject.ko 2023-06-22T10:30:56.531 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_reject_inet.ko 2023-06-22T10:30:56.531 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_socket.ko 2023-06-22T10:30:56.531 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_tunnel.ko 2023-06-22T10:30:56.531 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_AUDIT.ko 2023-06-22T10:30:56.531 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_CHECKSUM.ko 2023-06-22T10:30:56.531 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_CLASSIFY.ko 2023-06-22T10:30:56.532 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-06-22T10:30:56.532 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_CT.ko 2023-06-22T10:30:56.532 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_DSCP.ko 2023-06-22T10:30:56.532 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_HL.ko 2023-06-22T10:30:56.532 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_HMARK.ko 2023-06-22T10:30:56.532 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_IDLETIMER.ko 2023-06-22T10:30:56.532 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_LED.ko 2023-06-22T10:30:56.533 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_LOG.ko 2023-06-22T10:30:56.533 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_MASQUERADE.ko 2023-06-22T10:30:56.533 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_NETMAP.ko 2023-06-22T10:30:56.533 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_NFLOG.ko 2023-06-22T10:30:56.533 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_NFQUEUE.ko 2023-06-22T10:30:56.533 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_RATEEST.ko 2023-06-22T10:30:56.533 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_REDIRECT.ko 2023-06-22T10:30:56.533 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_SECMARK.ko 2023-06-22T10:30:56.534 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_TCPMSS.ko 2023-06-22T10:30:56.534 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-06-22T10:30:56.534 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_TEE.ko 2023-06-22T10:30:56.534 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_TPROXY.ko 2023-06-22T10:30:56.534 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_TRACE.ko 2023-06-22T10:30:56.534 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_addrtype.ko 2023-06-22T10:30:56.534 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_bpf.ko 2023-06-22T10:30:56.534 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_cgroup.ko 2023-06-22T10:30:56.535 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_cluster.ko 2023-06-22T10:30:56.535 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_comment.ko 2023-06-22T10:30:56.535 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_connbytes.ko 2023-06-22T10:30:56.535 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_connlabel.ko 2023-06-22T10:30:56.535 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_connlimit.ko 2023-06-22T10:30:56.535 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_connmark.ko 2023-06-22T10:30:56.535 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_conntrack.ko 2023-06-22T10:30:56.535 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_cpu.ko 2023-06-22T10:30:56.536 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_dccp.ko 2023-06-22T10:30:56.536 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_devgroup.ko 2023-06-22T10:30:56.536 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_dscp.ko 2023-06-22T10:30:56.536 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_ecn.ko 2023-06-22T10:30:56.536 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_esp.ko 2023-06-22T10:30:56.536 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_hashlimit.ko 2023-06-22T10:30:56.536 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_helper.ko 2023-06-22T10:30:56.536 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_hl.ko 2023-06-22T10:30:56.537 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_ipcomp.ko 2023-06-22T10:30:56.537 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_iprange.ko 2023-06-22T10:30:56.537 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_ipvs.ko 2023-06-22T10:30:56.537 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_l2tp.ko 2023-06-22T10:30:56.537 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_length.ko 2023-06-22T10:30:56.537 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_limit.ko 2023-06-22T10:30:56.537 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_mac.ko 2023-06-22T10:30:56.537 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_mark.ko 2023-06-22T10:30:56.538 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_multiport.ko 2023-06-22T10:30:56.538 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_nat.ko 2023-06-22T10:30:56.538 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_nfacct.ko 2023-06-22T10:30:56.538 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_osf.ko 2023-06-22T10:30:56.538 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_owner.ko 2023-06-22T10:30:56.538 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_physdev.ko 2023-06-22T10:30:56.538 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_pkttype.ko 2023-06-22T10:30:56.538 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_policy.ko 2023-06-22T10:30:56.539 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_quota.ko 2023-06-22T10:30:56.539 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_rateest.ko 2023-06-22T10:30:56.539 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_realm.ko 2023-06-22T10:30:56.539 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_recent.ko 2023-06-22T10:30:56.539 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_sctp.ko 2023-06-22T10:30:56.539 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_set.ko 2023-06-22T10:30:56.539 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_socket.ko 2023-06-22T10:30:56.539 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_state.ko 2023-06-22T10:30:56.540 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_statistic.ko 2023-06-22T10:30:56.540 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_string.ko 2023-06-22T10:30:56.540 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_tcpmss.ko 2023-06-22T10:30:56.540 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_time.ko 2023-06-22T10:30:56.540 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_u32.ko 2023-06-22T10:30:56.540 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netlink 2023-06-22T10:30:56.540 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netlink/netlink_diag.ko 2023-06-22T10:30:56.541 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/nsh 2023-06-22T10:30:56.541 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/nsh/nsh.ko 2023-06-22T10:30:56.541 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/openvswitch 2023-06-22T10:30:56.541 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/openvswitch/openvswitch.ko 2023-06-22T10:30:56.541 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/openvswitch/vport-geneve.ko 2023-06-22T10:30:56.541 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/openvswitch/vport-gre.ko 2023-06-22T10:30:56.541 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/openvswitch/vport-vxlan.ko 2023-06-22T10:30:56.541 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/packet 2023-06-22T10:30:56.542 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/packet/af_packet_diag.ko 2023-06-22T10:30:56.542 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/rds 2023-06-22T10:30:56.542 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/rds/rds.ko 2023-06-22T10:30:56.542 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/rds/rds_rdma.ko 2023-06-22T10:30:56.542 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/rds/rds_tcp.ko 2023-06-22T10:30:56.542 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched 2023-06-22T10:30:56.542 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_csum.ko 2023-06-22T10:30:56.542 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_gact.ko 2023-06-22T10:30:56.543 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_ipt.ko 2023-06-22T10:30:56.543 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_mirred.ko 2023-06-22T10:30:56.543 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_nat.ko 2023-06-22T10:30:56.543 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_pedit.ko 2023-06-22T10:30:56.543 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_police.ko 2023-06-22T10:30:56.543 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_simple.ko 2023-06-22T10:30:56.543 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_skbedit.ko 2023-06-22T10:30:56.543 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_vlan.ko 2023-06-22T10:30:56.544 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/cls_basic.ko 2023-06-22T10:30:56.544 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/cls_bpf.ko 2023-06-22T10:30:56.544 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/cls_flow.ko 2023-06-22T10:30:56.544 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/cls_fw.ko 2023-06-22T10:30:56.544 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/cls_route.ko 2023-06-22T10:30:56.544 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/cls_u32.ko 2023-06-22T10:30:56.544 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/em_cmp.ko 2023-06-22T10:30:56.544 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/em_ipset.ko 2023-06-22T10:30:56.545 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/em_meta.ko 2023-06-22T10:30:56.545 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/em_nbyte.ko 2023-06-22T10:30:56.545 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/em_text.ko 2023-06-22T10:30:56.545 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/em_u32.ko 2023-06-22T10:30:56.545 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_choke.ko 2023-06-22T10:30:56.545 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_codel.ko 2023-06-22T10:30:56.545 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_drr.ko 2023-06-22T10:30:56.545 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_fq.ko 2023-06-22T10:30:56.546 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_gred.ko 2023-06-22T10:30:56.546 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_hfsc.ko 2023-06-22T10:30:56.546 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_hhf.ko 2023-06-22T10:30:56.546 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_htb.ko 2023-06-22T10:30:56.546 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_ingress.ko 2023-06-22T10:30:56.546 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_mqprio.ko 2023-06-22T10:30:56.546 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_mqprio_lib.ko 2023-06-22T10:30:56.546 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_multiq.ko 2023-06-22T10:30:56.547 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_netem.ko 2023-06-22T10:30:56.547 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_pie.ko 2023-06-22T10:30:56.547 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_plug.ko 2023-06-22T10:30:56.547 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_prio.ko 2023-06-22T10:30:56.547 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_qfq.ko 2023-06-22T10:30:56.547 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_red.ko 2023-06-22T10:30:56.547 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_sfb.ko 2023-06-22T10:30:56.547 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_sfq.ko 2023-06-22T10:30:56.548 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_tbf.ko 2023-06-22T10:30:56.548 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_teql.ko 2023-06-22T10:30:56.548 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sctp 2023-06-22T10:30:56.548 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sctp/sctp.ko 2023-06-22T10:30:56.548 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sctp/sctp_diag.ko 2023-06-22T10:30:56.548 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sunrpc 2023-06-22T10:30:56.548 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sunrpc/auth_gss 2023-06-22T10:30:56.549 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-06-22T10:30:56.549 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-06-22T10:30:56.549 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sunrpc/sunrpc.ko 2023-06-22T10:30:56.549 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sunrpc/xprtrdma 2023-06-22T10:30:56.549 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-06-22T10:30:56.549 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/tipc 2023-06-22T10:30:56.549 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/tipc/diag.ko 2023-06-22T10:30:56.549 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/tipc/tipc.ko 2023-06-22T10:30:56.550 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/unix 2023-06-22T10:30:56.550 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/unix/unix_diag.ko 2023-06-22T10:30:56.550 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/vmw_vsock 2023-06-22T10:30:56.550 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-06-22T10:30:56.550 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-06-22T10:30:56.550 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/vmw_vsock/vsock.ko 2023-06-22T10:30:56.550 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/vmw_vsock/vsock_diag.ko 2023-06-22T10:30:56.550 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/vmw_vsock/vsock_loopback.ko 2023-06-22T10:30:56.551 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/xfrm 2023-06-22T10:30:56.551 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/xfrm/xfrm_ipcomp.ko 2023-06-22T10:30:56.551 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/security 2023-06-22T10:30:56.551 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/security/keys 2023-06-22T10:30:56.551 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/security/keys/encrypted-keys 2023-06-22T10:30:56.551 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-06-22T10:30:56.551 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/security/keys/trusted-keys 2023-06-22T10:30:56.551 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/security/keys/trusted-keys/trusted.ko 2023-06-22T10:30:56.552 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/virt 2023-06-22T10:30:56.552 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/virt/lib 2023-06-22T10:30:56.552 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/virt/lib/irqbypass.ko 2023-06-22T10:30:56.552 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.alias 2023-06-22T10:30:56.552 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.alias.bin 2023-06-22T10:30:56.552 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.builtin 2023-06-22T10:30:56.552 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.builtin.bin 2023-06-22T10:30:56.552 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.builtin.modinfo 2023-06-22T10:30:56.553 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.dep 2023-06-22T10:30:56.553 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.dep.bin 2023-06-22T10:30:56.553 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.devname 2023-06-22T10:30:56.553 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.order 2023-06-22T10:30:56.553 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.softdep 2023-06-22T10:30:56.553 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.symbols 2023-06-22T10:30:56.553 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.symbols.bin 2023-06-22T10:30:56.554 DEBUG:teuthology.task.kernel:get_image_version: 6.4.0-rc5-g1c622d92b6f1 2023-06-22T10:30:56.554 DEBUG:teuthology.orchestra.run.smithi045:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-06-22T10:30:56.584 INFO:teuthology.orchestra.run.smithi045.stdout:postinstall scriptlet (using /bin/sh): 2023-06-22T10:30:56.584 INFO:teuthology.orchestra.run.smithi045.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.4.0-rc5-g1c622d92b6f1 -a -r /boot/System.map-6.4.0-rc5-g1c622d92b6f1 ]; then 2023-06-22T10:30:56.584 INFO:teuthology.orchestra.run.smithi045.stdout:cp /boot/vmlinuz-6.4.0-rc5-g1c622d92b6f1 /boot/.vmlinuz-6.4.0-rc5-g1c622d92b6f1-rpm 2023-06-22T10:30:56.585 INFO:teuthology.orchestra.run.smithi045.stdout:cp /boot/System.map-6.4.0-rc5-g1c622d92b6f1 /boot/.System.map-6.4.0-rc5-g1c622d92b6f1-rpm 2023-06-22T10:30:56.585 INFO:teuthology.orchestra.run.smithi045.stdout:rm -f /boot/vmlinuz-6.4.0-rc5-g1c622d92b6f1 /boot/System.map-6.4.0-rc5-g1c622d92b6f1 2023-06-22T10:30:56.585 INFO:teuthology.orchestra.run.smithi045.stdout:/sbin/installkernel 6.4.0-rc5-g1c622d92b6f1 /boot/.vmlinuz-6.4.0-rc5-g1c622d92b6f1-rpm /boot/.System.map-6.4.0-rc5-g1c622d92b6f1-rpm 2023-06-22T10:30:56.585 INFO:teuthology.orchestra.run.smithi045.stdout:rm -f /boot/.vmlinuz-6.4.0-rc5-g1c622d92b6f1-rpm /boot/.System.map-6.4.0-rc5-g1c622d92b6f1-rpm 2023-06-22T10:30:56.585 INFO:teuthology.orchestra.run.smithi045.stdout:fi 2023-06-22T10:30:56.585 INFO:teuthology.orchestra.run.smithi045.stdout:preuninstall scriptlet (using /bin/sh): 2023-06-22T10:30:56.585 INFO:teuthology.orchestra.run.smithi045.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-06-22T10:30:56.586 INFO:teuthology.orchestra.run.smithi045.stdout:new-kernel-pkg --remove 6.4.0-rc5-g1c622d92b6f1 --rminitrd --initrdfile=/boot/initramfs-6.4.0-rc5-g1c622d92b6f1.img 2023-06-22T10:30:56.586 INFO:teuthology.orchestra.run.smithi045.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-06-22T10:30:56.586 INFO:teuthology.orchestra.run.smithi045.stdout:kernel-install remove 6.4.0-rc5-g1c622d92b6f1 2023-06-22T10:30:56.586 INFO:teuthology.orchestra.run.smithi045.stdout:fi 2023-06-22T10:30:56.586 INFO:teuthology.orchestra.run.smithi045.stdout:postuninstall scriptlet (using /bin/sh): 2023-06-22T10:30:56.586 INFO:teuthology.orchestra.run.smithi045.stdout:if [ -x /sbin/update-bootloader ]; then 2023-06-22T10:30:56.586 INFO:teuthology.orchestra.run.smithi045.stdout:/sbin/update-bootloader --remove 6.4.0-rc5-g1c622d92b6f1 2023-06-22T10:30:56.586 INFO:teuthology.orchestra.run.smithi045.stdout:fi 2023-06-22T10:30:56.587 DEBUG:teuthology.orchestra.run.smithi045:> sudo rpm -qi grub2-tools 2023-06-22T10:30:56.669 INFO:teuthology.orchestra.run.smithi045.stdout:Name : grub2-tools 2023-06-22T10:30:56.670 INFO:teuthology.orchestra.run.smithi045.stdout:Epoch : 1 2023-06-22T10:30:56.670 INFO:teuthology.orchestra.run.smithi045.stdout:Version : 2.02 2023-06-22T10:30:56.670 INFO:teuthology.orchestra.run.smithi045.stdout:Release : 129.el8 2023-06-22T10:30:56.670 INFO:teuthology.orchestra.run.smithi045.stdout:Architecture: x86_64 2023-06-22T10:30:56.670 INFO:teuthology.orchestra.run.smithi045.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-06-22T10:30:56.670 INFO:teuthology.orchestra.run.smithi045.stdout:Group : System Environment/Base 2023-06-22T10:30:56.670 INFO:teuthology.orchestra.run.smithi045.stdout:Size : 9265586 2023-06-22T10:30:56.671 INFO:teuthology.orchestra.run.smithi045.stdout:License : GPLv3+ 2023-06-22T10:30:56.671 INFO:teuthology.orchestra.run.smithi045.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-06-22T10:30:56.671 INFO:teuthology.orchestra.run.smithi045.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-06-22T10:30:56.671 INFO:teuthology.orchestra.run.smithi045.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-06-22T10:30:56.671 INFO:teuthology.orchestra.run.smithi045.stdout:Build Host : kbuilder.bsys.centos.org 2023-06-22T10:30:56.671 INFO:teuthology.orchestra.run.smithi045.stdout:Relocations : (not relocatable) 2023-06-22T10:30:56.671 INFO:teuthology.orchestra.run.smithi045.stdout:Packager : CentOS BuildSystem 2023-06-22T10:30:56.671 INFO:teuthology.orchestra.run.smithi045.stdout:Vendor : CentOS 2023-06-22T10:30:56.672 INFO:teuthology.orchestra.run.smithi045.stdout:URL : http://www.gnu.org/software/grub/ 2023-06-22T10:30:56.672 INFO:teuthology.orchestra.run.smithi045.stdout:Summary : Support tools for GRUB. 2023-06-22T10:30:56.672 INFO:teuthology.orchestra.run.smithi045.stdout:Description : 2023-06-22T10:30:56.672 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-22T10:30:56.672 INFO:teuthology.orchestra.run.smithi045.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-06-22T10:30:56.672 INFO:teuthology.orchestra.run.smithi045.stdout:customizable bootloader with modular architecture. It supports a rich 2023-06-22T10:30:56.672 INFO:teuthology.orchestra.run.smithi045.stdout:variety of kernel formats, file systems, computer architectures and 2023-06-22T10:30:56.673 INFO:teuthology.orchestra.run.smithi045.stdout:hardware devices. 2023-06-22T10:30:56.673 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-22T10:30:56.673 INFO:teuthology.orchestra.run.smithi045.stdout:This subpackage provides tools for support of all platforms. 2023-06-22T10:30:56.674 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-06-22T10:30:56.674 INFO:teuthology.task.kernel:Updating grub on smithi045 to boot 6.4.0-rc5-g1c622d92b6f1 2023-06-22T10:30:56.674 DEBUG:teuthology.orchestra.run.smithi045:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-06-22T10:30:59.574 INFO:teuthology.orchestra.run.smithi045.stderr:Generating grub configuration file ... 2023-06-22T10:31:01.675 INFO:teuthology.orchestra.run.smithi045.stderr:done 2023-06-22T10:31:01.679 DEBUG:teuthology.orchestra.run.smithi045:> mktemp 2023-06-22T10:31:01.712 INFO:teuthology.orchestra.run.smithi045.stdout:/tmp/tmp.dhJ5HQS0sY 2023-06-22T10:31:01.712 DEBUG:teuthology.orchestra.run.smithi045:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.dhJ5HQS0sY 2023-06-22T10:31:01.784 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 0666 /tmp/tmp.dhJ5HQS0sY 2023-06-22T10:31:01.945 DEBUG:teuthology.orchestra.remote:smithi045:/tmp/tmp.dhJ5HQS0sY is 6KB 2023-06-22T10:31:01.994 DEBUG:teuthology.orchestra.run.smithi045:> rm -fr /tmp/tmp.dhJ5HQS0sY 2023-06-22T10:31:02.013 DEBUG:teuthology.orchestra.run.smithi045:> sudo /bin/ls /boot/loader/entries || true 2023-06-22T10:31:02.096 INFO:teuthology.orchestra.run.smithi045.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-06-22T10:31:02.096 INFO:teuthology.orchestra.run.smithi045.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-06-22T10:31:02.097 INFO:teuthology.orchestra.run.smithi045.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-06-22T10:31:02.097 INFO:teuthology.orchestra.run.smithi045.stdout:a1b29d6c289747bdb22930598d39874a-6.4.0-rc5-g1c622d92b6f1.conf 2023-06-22T10:31:02.098 DEBUG:teuthology.orchestra.run.smithi045:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.4.0-rc5-g1c622d92b6f1 2023-06-22T10:31:02.233 DEBUG:teuthology.orchestra.run.smithi045:> sudo shutdown -r now 2023-06-22T10:31:32.237 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-06-22T10:31:32.238 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-06-22T10:31:32.238 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T10:31:50.640 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.45 2023-06-22T10:32:20.642 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-06-22T10:32:20.643 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T10:32:39.024 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.45 2023-06-22T10:33:09.025 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-06-22T10:33:09.026 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T10:33:09.391 DEBUG:teuthology.orchestra.run.smithi045:> true 2023-06-22T10:33:09.795 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-06-22T10:33:09.795 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.4.0-rc5-g1c622d92b6f1"... 2023-06-22T10:33:09.795 DEBUG:teuthology.orchestra.run.smithi045:> uname -r 2023-06-22T10:33:09.841 INFO:teuthology.orchestra.run.smithi045.stdout:6.4.0-rc5-g1c622d92b6f1 2023-06-22T10:33:09.841 DEBUG:teuthology.task.kernel:current kernel version is 6.4.0-rc5-g1c622d92b6f1 vs 6.4.0-rc5-g1c622d92b6f1 2023-06-22T10:33:09.842 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-06-22T10:33:09.842 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-06-22T10:33:10.843 DEBUG:teuthology.parallel:result is None 2023-06-22T10:35:21.024 INFO:teuthology.orchestra.run.smithi040.stdout:Extra Packages for Enterprise Linux 41 kB/s | 16 MB 06:31 2023-06-22T10:35:24.982 INFO:teuthology.orchestra.run.smithi040.stdout:lab-extras 287 kB/s | 24 kB 00:00 2023-06-22T10:35:28.510 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2023-06-22T10:35:28.511 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2023-06-22T10:35:28.511 INFO:teuthology.orchestra.run.smithi040.stdout: Package Arch Version Repo Size 2023-06-22T10:35:28.511 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2023-06-22T10:35:28.511 INFO:teuthology.orchestra.run.smithi040.stdout:Upgrading: 2023-06-22T10:35:28.512 INFO:teuthology.orchestra.run.smithi040.stdout: linux-firmware noarch 20230515-115.gitd1962891.el8 baseos 266 M 2023-06-22T10:35:28.512 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:35:28.512 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction Summary 2023-06-22T10:35:28.512 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2023-06-22T10:35:28.512 INFO:teuthology.orchestra.run.smithi040.stdout:Upgrade 1 Package 2023-06-22T10:35:28.513 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:35:28.513 INFO:teuthology.orchestra.run.smithi040.stdout:Total download size: 266 M 2023-06-22T10:35:28.513 INFO:teuthology.orchestra.run.smithi040.stdout:Downloading Packages: 2023-06-22T10:35:37.863 INFO:teuthology.orchestra.run.smithi040.stdout:linux-firmware-20230515-115.gitd1962891.el8.noa 29 MB/s | 266 MB 00:09 2023-06-22T10:35:37.863 INFO:teuthology.orchestra.run.smithi040.stdout:-------------------------------------------------------------------------------- 2023-06-22T10:35:37.863 INFO:teuthology.orchestra.run.smithi040.stdout:Total 28 MB/s | 266 MB 00:09 2023-06-22T10:35:39.527 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction check 2023-06-22T10:35:39.591 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction check succeeded. 2023-06-22T10:35:39.592 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction test 2023-06-22T10:35:41.325 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction test succeeded. 2023-06-22T10:35:41.360 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction 2023-06-22T10:36:00.425 INFO:teuthology.orchestra.run.smithi040.stdout: Preparing : 1/1 2023-06-22T10:36:00.816 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : linux-firmware-20230515-115.gitd1962891.el8.noarch 1/2 2023-06-22T10:36:01.082 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-06-22T10:36:01.314 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-06-22T10:36:01.315 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : linux-firmware-20230515-115.gitd1962891.el8.noarch 1/2 2023-06-22T10:36:02.023 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-06-22T10:36:02.024 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:36:02.024 INFO:teuthology.orchestra.run.smithi040.stdout:Upgraded: 2023-06-22T10:36:02.024 INFO:teuthology.orchestra.run.smithi040.stdout: linux-firmware-20230515-115.gitd1962891.el8.noarch 2023-06-22T10:36:02.024 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:36:02.024 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2023-06-22T10:36:02.228 INFO:teuthology.task.kernel:Downloading kernel 1c622d92b6f18ce44a7c33802686ff61c3c273ab on client.0... 2023-06-22T10:36:02.229 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=1c622d92b6f18ce44a7c33802686ff61c3c273ab 2023-06-22T10:36:02.446 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/1c622d92b6f18ce44a7c33802686ff61c3c273ab/centos/8/flavors/default/x86_64/ 2023-06-22T10:36:02.446 DEBUG:teuthology.orchestra.run.smithi040:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.4.0_rc5_g1c622d92b6f1-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/1c622d92b6f18ce44a7c33802686ff61c3c273ab/centos/8/flavors/default/x86_64/ --input-file=- 2023-06-22T10:36:02.449 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi040.front.sepia.ceph.com to complete... 2023-06-22T10:36:15.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22 10:36:15 URL:https://2.chacra.ceph.com/r/kernel/testing/1c622d92b6f18ce44a7c33802686ff61c3c273ab/centos/8/flavors/default/x86_64/kernel-6.4.0_rc5_g1c622d92b6f1-1.x86_64.rpm [379883408/379883408] -> "/tmp/kernel.x86_64.rpm" [1] 2023-06-22T10:36:15.957 INFO:teuthology.orchestra.run.smithi040.stderr:FINISHED --2023-06-22 10:36:15-- 2023-06-22T10:36:15.957 INFO:teuthology.orchestra.run.smithi040.stderr:Total wall clock time: 13s 2023-06-22T10:36:15.957 INFO:teuthology.orchestra.run.smithi040.stderr:Downloaded: 1 files, 362M in 13s (27.7 MB/s) 2023-06-22T10:36:15.959 INFO:teuthology.task.kernel:Installing kernel 1c622d92b6f18ce44a7c33802686ff61c3c273ab on client.0... 2023-06-22T10:36:15.959 DEBUG:teuthology.orchestra.run.smithi040:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-06-22T10:36:17.694 INFO:teuthology.orchestra.run.smithi040.stdout:Verifying... ######################################## 2023-06-22T10:36:17.740 INFO:teuthology.orchestra.run.smithi040.stdout:Preparing... ######################################## 2023-06-22T10:36:17.856 INFO:teuthology.orchestra.run.smithi040.stdout:Updating / installing... 2023-06-22T10:36:58.304 INFO:teuthology.orchestra.run.smithi040.stdout:kernel-6.4.0_rc5_g1c622d92b6f1-1 ######################################## 2023-06-22T10:37:21.119 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi040.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-06-22T10:37:21.119 DEBUG:teuthology.orchestra.run.smithi040:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-06-22T10:37:21.176 INFO:teuthology.orchestra.run.smithi040.stdout:/boot/System.map-6.4.0-rc5-g1c622d92b6f1 2023-06-22T10:37:21.177 INFO:teuthology.orchestra.run.smithi040.stdout:/boot/config-6.4.0-rc5-g1c622d92b6f1 2023-06-22T10:37:21.177 INFO:teuthology.orchestra.run.smithi040.stdout:/boot/vmlinuz-6.4.0-rc5-g1c622d92b6f1 2023-06-22T10:37:21.177 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1 2023-06-22T10:37:21.177 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel 2023-06-22T10:37:21.177 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch 2023-06-22T10:37:21.177 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86 2023-06-22T10:37:21.177 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto 2023-06-22T10:37:21.178 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-06-22T10:37:21.178 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-06-22T10:37:21.178 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-06-22T10:37:21.178 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-06-22T10:37:21.178 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-06-22T10:37:21.178 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-06-22T10:37:21.178 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-06-22T10:37:21.179 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/crc32c-intel.ko 2023-06-22T10:37:21.179 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-06-22T10:37:21.179 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-06-22T10:37:21.179 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-06-22T10:37:21.179 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-06-22T10:37:21.179 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/serpent-avx2.ko 2023-06-22T10:37:21.179 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-06-22T10:37:21.180 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-06-22T10:37:21.180 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-06-22T10:37:21.180 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-06-22T10:37:21.180 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-06-22T10:37:21.180 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-06-22T10:37:21.180 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-06-22T10:37:21.181 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/kernel 2023-06-22T10:37:21.181 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/kernel/cpu 2023-06-22T10:37:21.181 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/kernel/cpu/mce 2023-06-22T10:37:21.181 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-06-22T10:37:21.181 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/kvm 2023-06-22T10:37:21.181 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/kvm/kvm-amd.ko 2023-06-22T10:37:21.181 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/kvm/kvm-intel.ko 2023-06-22T10:37:21.182 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/arch/x86/kvm/kvm.ko 2023-06-22T10:37:21.182 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto 2023-06-22T10:37:21.182 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/ansi_cprng.ko 2023-06-22T10:37:21.182 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/anubis.ko 2023-06-22T10:37:21.182 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/arc4.ko 2023-06-22T10:37:21.182 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/async_tx 2023-06-22T10:37:21.182 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/async_tx/async_memcpy.ko 2023-06-22T10:37:21.182 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/async_tx/async_pq.ko 2023-06-22T10:37:21.183 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/async_tx/async_raid6_recov.ko 2023-06-22T10:37:21.183 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/async_tx/async_tx.ko 2023-06-22T10:37:21.183 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/async_tx/async_xor.ko 2023-06-22T10:37:21.183 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/async_tx/raid6test.ko 2023-06-22T10:37:21.183 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/authenc.ko 2023-06-22T10:37:21.183 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/authencesn.ko 2023-06-22T10:37:21.183 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/blake2b_generic.ko 2023-06-22T10:37:21.184 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/blowfish_common.ko 2023-06-22T10:37:21.184 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/blowfish_generic.ko 2023-06-22T10:37:21.184 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/camellia_generic.ko 2023-06-22T10:37:21.184 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/cast5_generic.ko 2023-06-22T10:37:21.184 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/cast6_generic.ko 2023-06-22T10:37:21.184 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/cast_common.ko 2023-06-22T10:37:21.184 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/ccm.ko 2023-06-22T10:37:21.185 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/cmac.ko 2023-06-22T10:37:21.185 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/crc32_generic.ko 2023-06-22T10:37:21.185 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/crypto_engine.ko 2023-06-22T10:37:21.185 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/crypto_user.ko 2023-06-22T10:37:21.185 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/cts.ko 2023-06-22T10:37:21.185 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/des_generic.ko 2023-06-22T10:37:21.185 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/dh_generic.ko 2023-06-22T10:37:21.185 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/echainiv.ko 2023-06-22T10:37:21.186 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/essiv.ko 2023-06-22T10:37:21.186 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/fcrypt.ko 2023-06-22T10:37:21.186 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/khazad.ko 2023-06-22T10:37:21.186 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/lz4.ko 2023-06-22T10:37:21.186 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/lz4hc.ko 2023-06-22T10:37:21.186 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/md4.ko 2023-06-22T10:37:21.186 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/michael_mic.ko 2023-06-22T10:37:21.186 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/pcbc.ko 2023-06-22T10:37:21.187 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/pcrypt.ko 2023-06-22T10:37:21.187 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/rmd160.ko 2023-06-22T10:37:21.187 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/seed.ko 2023-06-22T10:37:21.187 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/serpent_generic.ko 2023-06-22T10:37:21.187 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/tcrypt.ko 2023-06-22T10:37:21.187 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/tea.ko 2023-06-22T10:37:21.187 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/twofish_common.ko 2023-06-22T10:37:21.188 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/twofish_generic.ko 2023-06-22T10:37:21.188 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/vmac.ko 2023-06-22T10:37:21.188 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/wp512.ko 2023-06-22T10:37:21.188 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/xcbc.ko 2023-06-22T10:37:21.188 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/xor.ko 2023-06-22T10:37:21.188 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/crypto/xxhash_generic.ko 2023-06-22T10:37:21.188 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers 2023-06-22T10:37:21.189 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/acpi 2023-06-22T10:37:21.189 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/acpi/acpi_ipmi.ko 2023-06-22T10:37:21.189 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/acpi/acpi_pad.ko 2023-06-22T10:37:21.189 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/acpi/custom_method.ko 2023-06-22T10:37:21.190 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/acpi/ec_sys.ko 2023-06-22T10:37:21.190 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/acpi/platform_profile.ko 2023-06-22T10:37:21.190 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/acpi/sbs.ko 2023-06-22T10:37:21.190 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/acpi/sbshc.ko 2023-06-22T10:37:21.190 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/acpi/video.ko 2023-06-22T10:37:21.190 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata 2023-06-22T10:37:21.190 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/acard-ahci.ko 2023-06-22T10:37:21.191 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/ahci_platform.ko 2023-06-22T10:37:21.191 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/ata_generic.ko 2023-06-22T10:37:21.191 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/libahci_platform.ko 2023-06-22T10:37:21.191 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_acpi.ko 2023-06-22T10:37:21.191 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_ali.ko 2023-06-22T10:37:21.191 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_amd.ko 2023-06-22T10:37:21.191 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_artop.ko 2023-06-22T10:37:21.192 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_atiixp.ko 2023-06-22T10:37:21.192 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_atp867x.ko 2023-06-22T10:37:21.192 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_cmd640.ko 2023-06-22T10:37:21.192 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_cmd64x.ko 2023-06-22T10:37:21.192 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_cypress.ko 2023-06-22T10:37:21.192 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_efar.ko 2023-06-22T10:37:21.192 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_hpt366.ko 2023-06-22T10:37:21.193 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_hpt37x.ko 2023-06-22T10:37:21.193 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_hpt3x2n.ko 2023-06-22T10:37:21.193 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_hpt3x3.ko 2023-06-22T10:37:21.193 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_it8213.ko 2023-06-22T10:37:21.193 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_it821x.ko 2023-06-22T10:37:21.193 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_jmicron.ko 2023-06-22T10:37:21.193 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_marvell.ko 2023-06-22T10:37:21.193 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_mpiix.ko 2023-06-22T10:37:21.194 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_netcell.ko 2023-06-22T10:37:21.194 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_ninja32.ko 2023-06-22T10:37:21.194 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_ns87410.ko 2023-06-22T10:37:21.194 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_ns87415.ko 2023-06-22T10:37:21.194 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_oldpiix.ko 2023-06-22T10:37:21.194 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_opti.ko 2023-06-22T10:37:21.194 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_optidma.ko 2023-06-22T10:37:21.195 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_pcmcia.ko 2023-06-22T10:37:21.195 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_pdc2027x.ko 2023-06-22T10:37:21.195 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-06-22T10:37:21.195 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_piccolo.ko 2023-06-22T10:37:21.195 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_rdc.ko 2023-06-22T10:37:21.195 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_sch.ko 2023-06-22T10:37:21.195 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_serverworks.ko 2023-06-22T10:37:21.195 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_sil680.ko 2023-06-22T10:37:21.196 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_sis.ko 2023-06-22T10:37:21.196 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_sl82c105.ko 2023-06-22T10:37:21.196 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_triflex.ko 2023-06-22T10:37:21.196 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pata_via.ko 2023-06-22T10:37:21.196 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/pdc_adma.ko 2023-06-22T10:37:21.196 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_inic162x.ko 2023-06-22T10:37:21.196 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_mv.ko 2023-06-22T10:37:21.197 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_nv.ko 2023-06-22T10:37:21.197 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_promise.ko 2023-06-22T10:37:21.197 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_qstor.ko 2023-06-22T10:37:21.197 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_sil.ko 2023-06-22T10:37:21.197 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_sil24.ko 2023-06-22T10:37:21.197 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_sis.ko 2023-06-22T10:37:21.197 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_svw.ko 2023-06-22T10:37:21.197 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_sx4.ko 2023-06-22T10:37:21.198 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_uli.ko 2023-06-22T10:37:21.198 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_via.ko 2023-06-22T10:37:21.198 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ata/sata_vsc.ko 2023-06-22T10:37:21.198 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/auxdisplay 2023-06-22T10:37:21.198 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/auxdisplay/ks0108.ko 2023-06-22T10:37:21.198 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/base 2023-06-22T10:37:21.198 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/base/regmap 2023-06-22T10:37:21.198 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/base/regmap/regmap-i2c.ko 2023-06-22T10:37:21.199 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/bcma 2023-06-22T10:37:21.199 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/bcma/bcma.ko 2023-06-22T10:37:21.199 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block 2023-06-22T10:37:21.199 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/aoe 2023-06-22T10:37:21.199 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/aoe/aoe.ko 2023-06-22T10:37:21.199 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/brd.ko 2023-06-22T10:37:21.199 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/drbd 2023-06-22T10:37:21.199 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/drbd/drbd.ko 2023-06-22T10:37:21.200 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/floppy.ko 2023-06-22T10:37:21.200 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/loop.ko 2023-06-22T10:37:21.200 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/mtip32xx 2023-06-22T10:37:21.200 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-06-22T10:37:21.200 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/nbd.ko 2023-06-22T10:37:21.200 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/null_blk 2023-06-22T10:37:21.200 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/null_blk/null_blk.ko 2023-06-22T10:37:21.201 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/pktcdvd.ko 2023-06-22T10:37:21.201 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/rbd.ko 2023-06-22T10:37:21.201 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/virtio_blk.ko 2023-06-22T10:37:21.201 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/xen-blkback 2023-06-22T10:37:21.201 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-06-22T10:37:21.201 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/xen-blkfront.ko 2023-06-22T10:37:21.201 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/zram 2023-06-22T10:37:21.201 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/block/zram/zram.ko 2023-06-22T10:37:21.202 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char 2023-06-22T10:37:21.202 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/hangcheck-timer.ko 2023-06-22T10:37:21.202 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/hw_random 2023-06-22T10:37:21.202 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/hw_random/amd-rng.ko 2023-06-22T10:37:21.202 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/hw_random/intel-rng.ko 2023-06-22T10:37:21.202 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-06-22T10:37:21.203 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/hw_random/via-rng.ko 2023-06-22T10:37:21.203 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/hw_random/virtio-rng.ko 2023-06-22T10:37:21.203 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/ipmi 2023-06-22T10:37:21.203 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-06-22T10:37:21.203 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-06-22T10:37:21.203 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-06-22T10:37:21.204 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/ipmi/ipmi_si.ko 2023-06-22T10:37:21.204 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-06-22T10:37:21.204 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-06-22T10:37:21.204 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/lp.ko 2023-06-22T10:37:21.204 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/mwave 2023-06-22T10:37:21.204 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/mwave/mwave.ko 2023-06-22T10:37:21.204 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/ppdev.ko 2023-06-22T10:37:21.205 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/tlclk.ko 2023-06-22T10:37:21.205 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/tpm 2023-06-22T10:37:21.205 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/tpm/tpm.ko 2023-06-22T10:37:21.205 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/tpm/tpm_atmel.ko 2023-06-22T10:37:21.205 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/tpm/tpm_infineon.ko 2023-06-22T10:37:21.205 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/tpm/tpm_nsc.ko 2023-06-22T10:37:21.205 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/tpm/tpm_tis.ko 2023-06-22T10:37:21.206 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-06-22T10:37:21.206 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/uv_mmtimer.ko 2023-06-22T10:37:21.206 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/char/virtio_console.ko 2023-06-22T10:37:21.206 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/cpufreq 2023-06-22T10:37:21.206 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-06-22T10:37:21.206 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-06-22T10:37:21.206 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/cpufreq/p4-clockmod.ko 2023-06-22T10:37:21.206 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-06-22T10:37:21.207 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/cpufreq/powernow-k8.ko 2023-06-22T10:37:21.207 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/cpufreq/speedstep-lib.ko 2023-06-22T10:37:21.207 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto 2023-06-22T10:37:21.207 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/ccp 2023-06-22T10:37:21.207 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-06-22T10:37:21.207 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/ccp/ccp.ko 2023-06-22T10:37:21.207 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/intel 2023-06-22T10:37:21.208 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/intel/qat 2023-06-22T10:37:21.208 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/intel/qat/qat_common 2023-06-22T10:37:21.208 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-06-22T10:37:21.208 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-06-22T10:37:21.208 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-06-22T10:37:21.208 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/padlock-aes.ko 2023-06-22T10:37:21.208 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/padlock-sha.ko 2023-06-22T10:37:21.209 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/virtio 2023-06-22T10:37:21.209 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-06-22T10:37:21.209 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/dca 2023-06-22T10:37:21.209 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/dca/dca.ko 2023-06-22T10:37:21.209 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/devfreq 2023-06-22T10:37:21.209 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-06-22T10:37:21.209 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/dma 2023-06-22T10:37:21.209 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/dma/dw 2023-06-22T10:37:21.210 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/dma/dw/dw_dmac.ko 2023-06-22T10:37:21.210 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/dma/ioat 2023-06-22T10:37:21.210 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/dma/ioat/ioatdma.ko 2023-06-22T10:37:21.210 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac 2023-06-22T10:37:21.210 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/amd64_edac.ko 2023-06-22T10:37:21.210 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/e752x_edac.ko 2023-06-22T10:37:21.210 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/edac_mce_amd.ko 2023-06-22T10:37:21.211 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/i3000_edac.ko 2023-06-22T10:37:21.211 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/i3200_edac.ko 2023-06-22T10:37:21.211 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/i5100_edac.ko 2023-06-22T10:37:21.211 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/i5400_edac.ko 2023-06-22T10:37:21.211 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/i7300_edac.ko 2023-06-22T10:37:21.211 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/i7core_edac.ko 2023-06-22T10:37:21.211 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/i82975x_edac.ko 2023-06-22T10:37:21.211 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/ie31200_edac.ko 2023-06-22T10:37:21.212 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/sb_edac.ko 2023-06-22T10:37:21.212 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/edac/x38_edac.ko 2023-06-22T10:37:21.212 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/firmware 2023-06-22T10:37:21.212 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/firmware/edd.ko 2023-06-22T10:37:21.212 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/firmware/iscsi_ibft.ko 2023-06-22T10:37:21.212 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/gpio 2023-06-22T10:37:21.212 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/gpio/gpio-ich.ko 2023-06-22T10:37:21.213 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/gpio/gpio-viperboard.ko 2023-06-22T10:37:21.213 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid 2023-06-22T10:37:21.213 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-appleir.ko 2023-06-22T10:37:21.213 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-aureal.ko 2023-06-22T10:37:21.213 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-axff.ko 2023-06-22T10:37:21.213 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-dr.ko 2023-06-22T10:37:21.213 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-elecom.ko 2023-06-22T10:37:21.213 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-elo.ko 2023-06-22T10:37:21.214 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-emsff.ko 2023-06-22T10:37:21.214 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-gaff.ko 2023-06-22T10:37:21.214 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-gt683r.ko 2023-06-22T10:37:21.214 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-gyration.ko 2023-06-22T10:37:21.214 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-holtek-kbd.ko 2023-06-22T10:37:21.214 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-holtek-mouse.ko 2023-06-22T10:37:21.214 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-holtekff.ko 2023-06-22T10:37:21.214 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-hyperv.ko 2023-06-22T10:37:21.215 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-icade.ko 2023-06-22T10:37:21.215 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-keytouch.ko 2023-06-22T10:37:21.215 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-kye.ko 2023-06-22T10:37:21.215 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-lcpower.ko 2023-06-22T10:37:21.215 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-led.ko 2023-06-22T10:37:21.215 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-lenovo.ko 2023-06-22T10:37:21.215 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-logitech-dj.ko 2023-06-22T10:37:21.216 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-06-22T10:37:21.216 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-multitouch.ko 2023-06-22T10:37:21.216 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-ortek.ko 2023-06-22T10:37:21.216 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-penmount.ko 2023-06-22T10:37:21.216 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-petalynx.ko 2023-06-22T10:37:21.216 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-picolcd.ko 2023-06-22T10:37:21.216 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-pl.ko 2023-06-22T10:37:21.217 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-plantronics.ko 2023-06-22T10:37:21.217 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-primax.ko 2023-06-22T10:37:21.217 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-rmi.ko 2023-06-22T10:37:21.217 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-arvo.ko 2023-06-22T10:37:21.217 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-common.ko 2023-06-22T10:37:21.217 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-isku.ko 2023-06-22T10:37:21.217 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-kone.ko 2023-06-22T10:37:21.217 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-06-22T10:37:21.218 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-konepure.ko 2023-06-22T10:37:21.218 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-06-22T10:37:21.218 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-lua.ko 2023-06-22T10:37:21.218 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-pyra.ko 2023-06-22T10:37:21.218 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-ryos.ko 2023-06-22T10:37:21.218 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat-savu.ko 2023-06-22T10:37:21.218 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-roccat.ko 2023-06-22T10:37:21.218 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-saitek.ko 2023-06-22T10:37:21.219 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-samsung.ko 2023-06-22T10:37:21.219 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-sensor-hub.ko 2023-06-22T10:37:21.219 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-sjoy.ko 2023-06-22T10:37:21.219 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-sony.ko 2023-06-22T10:37:21.219 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-speedlink.ko 2023-06-22T10:37:21.219 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-steelseries.ko 2023-06-22T10:37:21.219 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-sunplus.ko 2023-06-22T10:37:21.220 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-thrustmaster.ko 2023-06-22T10:37:21.220 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-tivo.ko 2023-06-22T10:37:21.220 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-tmff.ko 2023-06-22T10:37:21.220 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-topseed.ko 2023-06-22T10:37:21.220 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-twinhan.ko 2023-06-22T10:37:21.220 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-uclogic.ko 2023-06-22T10:37:21.220 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-waltop.ko 2023-06-22T10:37:21.221 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-wiimote.ko 2023-06-22T10:37:21.221 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-xinmo.ko 2023-06-22T10:37:21.221 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-zpff.ko 2023-06-22T10:37:21.221 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/hid-zydacron.ko 2023-06-22T10:37:21.221 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/uhid.ko 2023-06-22T10:37:21.222 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hid/wacom.ko 2023-06-22T10:37:21.222 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hv 2023-06-22T10:37:21.222 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hv/hv_balloon.ko 2023-06-22T10:37:21.222 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hv/hv_utils.ko 2023-06-22T10:37:21.222 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hv/hv_vmbus.ko 2023-06-22T10:37:21.222 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon 2023-06-22T10:37:21.222 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/abituguru.ko 2023-06-22T10:37:21.222 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/abituguru3.ko 2023-06-22T10:37:21.223 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/acpi_power_meter.ko 2023-06-22T10:37:21.223 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ad7414.ko 2023-06-22T10:37:21.223 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ad7418.ko 2023-06-22T10:37:21.223 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adc128d818.ko 2023-06-22T10:37:21.223 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adm1025.ko 2023-06-22T10:37:21.223 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adm1026.ko 2023-06-22T10:37:21.223 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adm1029.ko 2023-06-22T10:37:21.224 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adm1031.ko 2023-06-22T10:37:21.224 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adm9240.ko 2023-06-22T10:37:21.224 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ads7828.ko 2023-06-22T10:37:21.224 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adt7410.ko 2023-06-22T10:37:21.224 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adt7411.ko 2023-06-22T10:37:21.224 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adt7462.ko 2023-06-22T10:37:21.224 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adt7470.ko 2023-06-22T10:37:21.224 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adt7475.ko 2023-06-22T10:37:21.225 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/adt7x10.ko 2023-06-22T10:37:21.225 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/amc6821.ko 2023-06-22T10:37:21.225 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/applesmc.ko 2023-06-22T10:37:21.225 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/asb100.ko 2023-06-22T10:37:21.225 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/asc7621.ko 2023-06-22T10:37:21.225 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/asus_atk0110.ko 2023-06-22T10:37:21.225 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/atxp1.ko 2023-06-22T10:37:21.226 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/coretemp.ko 2023-06-22T10:37:21.226 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-06-22T10:37:21.226 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/dme1737.ko 2023-06-22T10:37:21.226 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ds1621.ko 2023-06-22T10:37:21.226 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ds620.ko 2023-06-22T10:37:21.226 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/emc1403.ko 2023-06-22T10:37:21.226 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/emc6w201.ko 2023-06-22T10:37:21.227 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/f71805f.ko 2023-06-22T10:37:21.227 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/f71882fg.ko 2023-06-22T10:37:21.227 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/f75375s.ko 2023-06-22T10:37:21.227 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/fam15h_power.ko 2023-06-22T10:37:21.227 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/fschmd.ko 2023-06-22T10:37:21.228 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/g760a.ko 2023-06-22T10:37:21.228 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/g762.ko 2023-06-22T10:37:21.228 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/gl518sm.ko 2023-06-22T10:37:21.228 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/gl520sm.ko 2023-06-22T10:37:21.228 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/hwmon-vid.ko 2023-06-22T10:37:21.229 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/i5500_temp.ko 2023-06-22T10:37:21.229 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/i5k_amb.ko 2023-06-22T10:37:21.229 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ibmaem.ko 2023-06-22T10:37:21.229 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ibmpex.ko 2023-06-22T10:37:21.229 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ina209.ko 2023-06-22T10:37:21.229 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ina2xx.ko 2023-06-22T10:37:21.229 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/it87.ko 2023-06-22T10:37:21.230 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/k10temp.ko 2023-06-22T10:37:21.230 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/k8temp.ko 2023-06-22T10:37:21.230 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lineage-pem.ko 2023-06-22T10:37:21.230 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm63.ko 2023-06-22T10:37:21.230 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm73.ko 2023-06-22T10:37:21.230 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm75.ko 2023-06-22T10:37:21.230 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm77.ko 2023-06-22T10:37:21.231 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm78.ko 2023-06-22T10:37:21.231 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm80.ko 2023-06-22T10:37:21.231 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm83.ko 2023-06-22T10:37:21.231 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm85.ko 2023-06-22T10:37:21.231 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm87.ko 2023-06-22T10:37:21.231 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm90.ko 2023-06-22T10:37:21.231 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm92.ko 2023-06-22T10:37:21.232 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm93.ko 2023-06-22T10:37:21.232 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm95234.ko 2023-06-22T10:37:21.232 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm95241.ko 2023-06-22T10:37:21.232 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/lm95245.ko 2023-06-22T10:37:21.232 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ltc2945.ko 2023-06-22T10:37:21.232 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ltc4151.ko 2023-06-22T10:37:21.232 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ltc4215.ko 2023-06-22T10:37:21.233 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ltc4222.ko 2023-06-22T10:37:21.233 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ltc4245.ko 2023-06-22T10:37:21.233 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ltc4260.ko 2023-06-22T10:37:21.233 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/ltc4261.ko 2023-06-22T10:37:21.233 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/max16065.ko 2023-06-22T10:37:21.233 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/max1619.ko 2023-06-22T10:37:21.233 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/max1668.ko 2023-06-22T10:37:21.233 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/max197.ko 2023-06-22T10:37:21.234 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/max6639.ko 2023-06-22T10:37:21.234 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/max6650.ko 2023-06-22T10:37:21.234 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/max6697.ko 2023-06-22T10:37:21.234 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/mcp3021.ko 2023-06-22T10:37:21.234 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/nct6683.ko 2023-06-22T10:37:21.235 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/nct6775-core.ko 2023-06-22T10:37:21.235 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/nct6775.ko 2023-06-22T10:37:21.235 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/nct7802.ko 2023-06-22T10:37:21.236 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pc87360.ko 2023-06-22T10:37:21.236 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pc87427.ko 2023-06-22T10:37:21.236 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pcf8591.ko 2023-06-22T10:37:21.237 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus 2023-06-22T10:37:21.237 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-06-22T10:37:21.238 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-06-22T10:37:21.238 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-06-22T10:37:21.238 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/max16064.ko 2023-06-22T10:37:21.238 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/max34440.ko 2023-06-22T10:37:21.239 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/max8688.ko 2023-06-22T10:37:21.239 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-06-22T10:37:21.239 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-06-22T10:37:21.240 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-06-22T10:37:21.240 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-06-22T10:37:21.240 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-06-22T10:37:21.240 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-06-22T10:37:21.240 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/powr1220.ko 2023-06-22T10:37:21.241 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/sch5627.ko 2023-06-22T10:37:21.241 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/sch5636.ko 2023-06-22T10:37:21.241 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/sch56xx-common.ko 2023-06-22T10:37:21.241 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/sht15.ko 2023-06-22T10:37:21.241 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/sht21.ko 2023-06-22T10:37:21.241 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/shtc1.ko 2023-06-22T10:37:21.242 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/sis5595.ko 2023-06-22T10:37:21.242 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/smsc47b397.ko 2023-06-22T10:37:21.242 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/smsc47m1.ko 2023-06-22T10:37:21.242 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/smsc47m192.ko 2023-06-22T10:37:21.242 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/thmc50.ko 2023-06-22T10:37:21.242 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/tmp102.ko 2023-06-22T10:37:21.242 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/tmp103.ko 2023-06-22T10:37:21.243 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/tmp401.ko 2023-06-22T10:37:21.243 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/tmp421.ko 2023-06-22T10:37:21.243 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/via-cputemp.ko 2023-06-22T10:37:21.243 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/via686a.ko 2023-06-22T10:37:21.243 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/vt1211.ko 2023-06-22T10:37:21.243 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/vt8231.ko 2023-06-22T10:37:21.243 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/w83627ehf.ko 2023-06-22T10:37:21.243 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/w83627hf.ko 2023-06-22T10:37:21.244 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/w83781d.ko 2023-06-22T10:37:21.244 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/w83791d.ko 2023-06-22T10:37:21.244 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/w83792d.ko 2023-06-22T10:37:21.244 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/w83793.ko 2023-06-22T10:37:21.244 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/w83795.ko 2023-06-22T10:37:21.244 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/w83l785ts.ko 2023-06-22T10:37:21.244 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/hwmon/w83l786ng.ko 2023-06-22T10:37:21.245 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c 2023-06-22T10:37:21.245 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/algos 2023-06-22T10:37:21.245 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-06-22T10:37:21.245 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-06-22T10:37:21.245 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses 2023-06-22T10:37:21.246 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-06-22T10:37:21.246 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-06-22T10:37:21.246 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-06-22T10:37:21.246 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-06-22T10:37:21.246 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-06-22T10:37:21.246 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-06-22T10:37:21.247 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-06-22T10:37:21.247 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-06-22T10:37:21.247 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-i801.ko 2023-06-22T10:37:21.247 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-isch.ko 2023-06-22T10:37:21.247 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-06-22T10:37:21.247 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-06-22T10:37:21.247 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-06-22T10:37:21.248 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-parport.ko 2023-06-22T10:37:21.248 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-06-22T10:37:21.248 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-06-22T10:37:21.248 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-06-22T10:37:21.248 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-06-22T10:37:21.248 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-06-22T10:37:21.248 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-06-22T10:37:21.249 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-via.ko 2023-06-22T10:37:21.249 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-06-22T10:37:21.249 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-06-22T10:37:21.249 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/i2c-dev.ko 2023-06-22T10:37:21.249 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/i2c-mux.ko 2023-06-22T10:37:21.249 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-06-22T10:37:21.249 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/i2c-smbus.ko 2023-06-22T10:37:21.250 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/i2c/i2c-stub.ko 2023-06-22T10:37:21.250 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband 2023-06-22T10:37:21.250 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/core 2023-06-22T10:37:21.250 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/core/ib_cm.ko 2023-06-22T10:37:21.250 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/core/ib_core.ko 2023-06-22T10:37:21.250 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/core/ib_umad.ko 2023-06-22T10:37:21.250 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-06-22T10:37:21.250 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/core/iw_cm.ko 2023-06-22T10:37:21.251 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/core/rdma_cm.ko 2023-06-22T10:37:21.251 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-06-22T10:37:21.251 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/hw 2023-06-22T10:37:21.251 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/hw/cxgb4 2023-06-22T10:37:21.251 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-06-22T10:37:21.251 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/hw/mlx4 2023-06-22T10:37:21.251 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-06-22T10:37:21.252 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/hw/mlx5 2023-06-22T10:37:21.252 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-06-22T10:37:21.252 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/hw/mthca 2023-06-22T10:37:21.252 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-06-22T10:37:21.252 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp 2023-06-22T10:37:21.252 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/ipoib 2023-06-22T10:37:21.252 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-06-22T10:37:21.253 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/iser 2023-06-22T10:37:21.253 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-06-22T10:37:21.253 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/isert 2023-06-22T10:37:21.253 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-06-22T10:37:21.253 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/srp 2023-06-22T10:37:21.253 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-06-22T10:37:21.253 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/srpt 2023-06-22T10:37:21.254 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-06-22T10:37:21.254 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input 2023-06-22T10:37:21.254 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/gameport 2023-06-22T10:37:21.254 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-06-22T10:37:21.254 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/gameport/fm801-gp.ko 2023-06-22T10:37:21.254 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/gameport/gameport.ko 2023-06-22T10:37:21.254 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/gameport/lightning.ko 2023-06-22T10:37:21.254 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/gameport/ns558.ko 2023-06-22T10:37:21.255 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/joydev.ko 2023-06-22T10:37:21.255 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/keyboard 2023-06-22T10:37:21.255 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/keyboard/gpio_keys.ko 2023-06-22T10:37:21.255 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/mouse 2023-06-22T10:37:21.255 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/mouse/appletouch.ko 2023-06-22T10:37:21.255 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/mouse/bcm5974.ko 2023-06-22T10:37:21.255 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/mouse/cyapatp.ko 2023-06-22T10:37:21.255 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/mouse/elan_i2c.ko 2023-06-22T10:37:21.256 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/mouse/sermouse.ko 2023-06-22T10:37:21.256 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-06-22T10:37:21.256 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/mouse/synaptics_usb.ko 2023-06-22T10:37:21.256 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/mouse/vsxxxaa.ko 2023-06-22T10:37:21.256 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/rmi4 2023-06-22T10:37:21.257 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/rmi4/rmi_core.ko 2023-06-22T10:37:21.257 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/serio 2023-06-22T10:37:21.257 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/serio/altera_ps2.ko 2023-06-22T10:37:21.257 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/serio/arc_ps2.ko 2023-06-22T10:37:21.257 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-06-22T10:37:21.257 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/serio/serio_raw.ko 2023-06-22T10:37:21.257 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/input/sparse-keymap.ko 2023-06-22T10:37:21.258 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/iommu 2023-06-22T10:37:21.258 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/iommu/amd 2023-06-22T10:37:21.258 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/iommu/amd/iommu_v2.ko 2023-06-22T10:37:21.258 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds 2023-06-22T10:37:21.258 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/leds-blinkm.ko 2023-06-22T10:37:21.258 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/leds-lm3530.ko 2023-06-22T10:37:21.258 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/leds-lp3944.ko 2023-06-22T10:37:21.259 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/leds-ss4200.ko 2023-06-22T10:37:21.259 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/trigger 2023-06-22T10:37:21.259 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-06-22T10:37:21.259 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-06-22T10:37:21.259 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-06-22T10:37:21.259 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-06-22T10:37:21.259 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-06-22T10:37:21.259 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-06-22T10:37:21.260 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-06-22T10:37:21.260 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-06-22T10:37:21.260 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md 2023-06-22T10:37:21.260 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/bcache 2023-06-22T10:37:21.260 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/bcache/bcache.ko 2023-06-22T10:37:21.260 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-bio-prison.ko 2023-06-22T10:37:21.260 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-cache-smq.ko 2023-06-22T10:37:21.261 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-cache.ko 2023-06-22T10:37:21.261 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-crypt.ko 2023-06-22T10:37:21.261 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-delay.ko 2023-06-22T10:37:21.261 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-flakey.ko 2023-06-22T10:37:21.261 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-log-userspace.ko 2023-06-22T10:37:21.261 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-multipath.ko 2023-06-22T10:37:21.261 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-queue-length.ko 2023-06-22T10:37:21.261 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-raid.ko 2023-06-22T10:37:21.262 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-round-robin.ko 2023-06-22T10:37:21.262 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-service-time.ko 2023-06-22T10:37:21.262 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-switch.ko 2023-06-22T10:37:21.262 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-thin-pool.ko 2023-06-22T10:37:21.262 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/dm-verity.ko 2023-06-22T10:37:21.262 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/faulty.ko 2023-06-22T10:37:21.262 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/linear.ko 2023-06-22T10:37:21.263 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/multipath.ko 2023-06-22T10:37:21.263 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/persistent-data 2023-06-22T10:37:21.263 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-06-22T10:37:21.263 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/raid0.ko 2023-06-22T10:37:21.263 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/raid1.ko 2023-06-22T10:37:21.263 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/raid10.ko 2023-06-22T10:37:21.263 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/md/raid456.ko 2023-06-22T10:37:21.263 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/message 2023-06-22T10:37:21.264 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/message/fusion 2023-06-22T10:37:21.264 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/message/fusion/mptbase.ko 2023-06-22T10:37:21.264 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/message/fusion/mptctl.ko 2023-06-22T10:37:21.264 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/message/fusion/mptfc.ko 2023-06-22T10:37:21.264 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/message/fusion/mptlan.ko 2023-06-22T10:37:21.264 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/message/fusion/mptsas.ko 2023-06-22T10:37:21.264 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/message/fusion/mptscsih.ko 2023-06-22T10:37:21.265 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/message/fusion/mptspi.ko 2023-06-22T10:37:21.265 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/mfd 2023-06-22T10:37:21.265 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/mfd/lpc_ich.ko 2023-06-22T10:37:21.265 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/mfd/lpc_sch.ko 2023-06-22T10:37:21.265 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/mfd/mfd-core.ko 2023-06-22T10:37:21.265 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/mfd/sm501.ko 2023-06-22T10:37:21.265 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/mfd/viperboard.ko 2023-06-22T10:37:21.266 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/mfd/vx855.ko 2023-06-22T10:37:21.266 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/mfd/wl1273-core.ko 2023-06-22T10:37:21.266 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc 2023-06-22T10:37:21.266 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/altera-stapl 2023-06-22T10:37:21.266 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-06-22T10:37:21.266 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/apds9802als.ko 2023-06-22T10:37:21.266 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/apds990x.ko 2023-06-22T10:37:21.266 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/bh1770glc.ko 2023-06-22T10:37:21.267 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/cb710 2023-06-22T10:37:21.267 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/cb710/cb710.ko 2023-06-22T10:37:21.267 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/eeprom 2023-06-22T10:37:21.267 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/eeprom/at24.ko 2023-06-22T10:37:21.267 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/eeprom/eeprom.ko 2023-06-22T10:37:21.267 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-06-22T10:37:21.267 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/eeprom/max6875.ko 2023-06-22T10:37:21.268 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/enclosure.ko 2023-06-22T10:37:21.268 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/hpilo.ko 2023-06-22T10:37:21.268 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/isl29003.ko 2023-06-22T10:37:21.268 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/isl29020.ko 2023-06-22T10:37:21.268 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/lis3lv02d 2023-06-22T10:37:21.268 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-06-22T10:37:21.268 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-06-22T10:37:21.269 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/mei 2023-06-22T10:37:21.269 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/mei/mei-me.ko 2023-06-22T10:37:21.269 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/mei/mei-txe.ko 2023-06-22T10:37:21.269 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/mei/mei.ko 2023-06-22T10:37:21.269 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/sgi-gru 2023-06-22T10:37:21.269 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/sgi-gru/gru.ko 2023-06-22T10:37:21.269 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/sgi-xp 2023-06-22T10:37:21.269 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/sgi-xp/xp.ko 2023-06-22T10:37:21.270 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/sgi-xp/xpc.ko 2023-06-22T10:37:21.270 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-06-22T10:37:21.270 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/tifm_7xx1.ko 2023-06-22T10:37:21.270 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/tifm_core.ko 2023-06-22T10:37:21.270 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/tsl2550.ko 2023-06-22T10:37:21.270 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/vmw_balloon.ko 2023-06-22T10:37:21.270 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/vmw_vmci 2023-06-22T10:37:21.270 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-06-22T10:37:21.271 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net 2023-06-22T10:37:21.271 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/bonding 2023-06-22T10:37:21.271 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/bonding/bonding.ko 2023-06-22T10:37:21.271 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/dsa 2023-06-22T10:37:21.271 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/dsa/b53 2023-06-22T10:37:21.271 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/dsa/b53/b53_common.ko 2023-06-22T10:37:21.271 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/dsa/bcm-sf2.ko 2023-06-22T10:37:21.272 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/dsa/mv88e6060.ko 2023-06-22T10:37:21.272 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/dsa/mv88e6xxx 2023-06-22T10:37:21.272 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-06-22T10:37:21.272 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/dummy.ko 2023-06-22T10:37:21.272 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/eql.ko 2023-06-22T10:37:21.272 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet 2023-06-22T10:37:21.272 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/3com 2023-06-22T10:37:21.273 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-06-22T10:37:21.273 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-06-22T10:37:21.273 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-06-22T10:37:21.273 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-06-22T10:37:21.273 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/8390 2023-06-22T10:37:21.273 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/8390/8390.ko 2023-06-22T10:37:21.273 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-06-22T10:37:21.273 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-06-22T10:37:21.274 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-06-22T10:37:21.274 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/adaptec 2023-06-22T10:37:21.274 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-06-22T10:37:21.274 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/agere 2023-06-22T10:37:21.274 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/agere/et131x.ko 2023-06-22T10:37:21.274 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/alteon 2023-06-22T10:37:21.274 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-06-22T10:37:21.274 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/altera 2023-06-22T10:37:21.275 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-06-22T10:37:21.275 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/amd 2023-06-22T10:37:21.275 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-06-22T10:37:21.275 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-06-22T10:37:21.275 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-06-22T10:37:21.275 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros 2023-06-22T10:37:21.275 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros/alx 2023-06-22T10:37:21.275 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-06-22T10:37:21.276 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros/atl1c 2023-06-22T10:37:21.276 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-06-22T10:37:21.276 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros/atl1e 2023-06-22T10:37:21.276 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-06-22T10:37:21.276 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros/atlx 2023-06-22T10:37:21.276 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-06-22T10:37:21.276 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-06-22T10:37:21.277 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/broadcom 2023-06-22T10:37:21.277 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-06-22T10:37:21.277 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-06-22T10:37:21.277 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-06-22T10:37:21.277 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-06-22T10:37:21.277 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-06-22T10:37:21.277 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/broadcom/genet 2023-06-22T10:37:21.278 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-06-22T10:37:21.278 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-06-22T10:37:21.278 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/brocade 2023-06-22T10:37:21.278 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/brocade/bna 2023-06-22T10:37:21.278 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-06-22T10:37:21.278 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio 2023-06-22T10:37:21.278 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/cxgb 2023-06-22T10:37:21.278 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-06-22T10:37:21.279 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-06-22T10:37:21.279 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-06-22T10:37:21.279 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-06-22T10:37:21.279 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-06-22T10:37:21.279 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-06-22T10:37:21.280 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-06-22T10:37:21.280 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-06-22T10:37:21.280 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-06-22T10:37:21.280 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/cisco 2023-06-22T10:37:21.281 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/cisco/enic 2023-06-22T10:37:21.281 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-06-22T10:37:21.281 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dec 2023-06-22T10:37:21.281 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dec/tulip 2023-06-22T10:37:21.281 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-06-22T10:37:21.281 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-06-22T10:37:21.281 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-06-22T10:37:21.282 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-06-22T10:37:21.282 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-06-22T10:37:21.282 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-06-22T10:37:21.282 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dlink 2023-06-22T10:37:21.282 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-06-22T10:37:21.282 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-06-22T10:37:21.282 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/dnet.ko 2023-06-22T10:37:21.282 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/emulex 2023-06-22T10:37:21.283 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/emulex/benet 2023-06-22T10:37:21.283 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-06-22T10:37:21.283 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/ethoc.ko 2023-06-22T10:37:21.283 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/fealnx.ko 2023-06-22T10:37:21.283 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel 2023-06-22T10:37:21.283 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/e100.ko 2023-06-22T10:37:21.283 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/e1000 2023-06-22T10:37:21.283 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-06-22T10:37:21.284 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/e1000e 2023-06-22T10:37:21.284 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-06-22T10:37:21.284 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/fm10k 2023-06-22T10:37:21.284 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-06-22T10:37:21.284 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/i40e 2023-06-22T10:37:21.284 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-06-22T10:37:21.285 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/iavf 2023-06-22T10:37:21.285 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-06-22T10:37:21.285 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/igb 2023-06-22T10:37:21.285 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-06-22T10:37:21.285 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/igbvf 2023-06-22T10:37:21.285 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-06-22T10:37:21.285 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/ixgbe 2023-06-22T10:37:21.285 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-06-22T10:37:21.286 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/ixgbevf 2023-06-22T10:37:21.286 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-06-22T10:37:21.286 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/jme.ko 2023-06-22T10:37:21.286 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/marvell 2023-06-22T10:37:21.286 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-06-22T10:37:21.286 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/marvell/skge.ko 2023-06-22T10:37:21.286 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-06-22T10:37:21.286 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/mellanox 2023-06-22T10:37:21.287 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/mellanox/mlx4 2023-06-22T10:37:21.287 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-06-22T10:37:21.287 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-06-22T10:37:21.287 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/mellanox/mlx5 2023-06-22T10:37:21.287 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-06-22T10:37:21.287 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-06-22T10:37:21.287 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/micrel 2023-06-22T10:37:21.288 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-06-22T10:37:21.288 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/myricom 2023-06-22T10:37:21.288 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/myricom/myri10ge 2023-06-22T10:37:21.288 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-06-22T10:37:21.288 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/natsemi 2023-06-22T10:37:21.288 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-06-22T10:37:21.288 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-06-22T10:37:21.289 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/neterion 2023-06-22T10:37:21.289 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-06-22T10:37:21.289 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/nvidia 2023-06-22T10:37:21.289 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-06-22T10:37:21.289 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/packetengines 2023-06-22T10:37:21.289 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-06-22T10:37:21.290 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-06-22T10:37:21.290 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/qlogic 2023-06-22T10:37:21.290 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/qlogic/netxen 2023-06-22T10:37:21.290 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-06-22T10:37:21.290 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-06-22T10:37:21.291 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-06-22T10:37:21.291 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-06-22T10:37:21.291 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/rdc 2023-06-22T10:37:21.291 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-06-22T10:37:21.291 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/realtek 2023-06-22T10:37:21.291 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-06-22T10:37:21.291 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-06-22T10:37:21.291 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/realtek/atp.ko 2023-06-22T10:37:21.292 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-06-22T10:37:21.292 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/rocker 2023-06-22T10:37:21.292 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-06-22T10:37:21.292 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sfc 2023-06-22T10:37:21.292 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-06-22T10:37:21.292 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/silan 2023-06-22T10:37:21.292 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-06-22T10:37:21.293 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sis 2023-06-22T10:37:21.293 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sis/sis190.ko 2023-06-22T10:37:21.293 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sis/sis900.ko 2023-06-22T10:37:21.293 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/smsc 2023-06-22T10:37:21.293 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-06-22T10:37:21.293 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-06-22T10:37:21.293 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-06-22T10:37:21.294 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-06-22T10:37:21.294 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/stmicro 2023-06-22T10:37:21.294 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/stmicro/stmmac 2023-06-22T10:37:21.294 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-06-22T10:37:21.294 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-06-22T10:37:21.294 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sun 2023-06-22T10:37:21.294 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sun/cassini.ko 2023-06-22T10:37:21.295 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sun/niu.ko 2023-06-22T10:37:21.295 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sun/sungem.ko 2023-06-22T10:37:21.295 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-06-22T10:37:21.295 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/tehuti 2023-06-22T10:37:21.295 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-06-22T10:37:21.295 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/ti 2023-06-22T10:37:21.295 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/ti/tlan.ko 2023-06-22T10:37:21.295 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/via 2023-06-22T10:37:21.296 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-06-22T10:37:21.296 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-06-22T10:37:21.296 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/wiznet 2023-06-22T10:37:21.296 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-06-22T10:37:21.296 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-06-22T10:37:21.296 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/xircom 2023-06-22T10:37:21.297 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-06-22T10:37:21.297 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/geneve.ko 2023-06-22T10:37:21.297 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/hyperv 2023-06-22T10:37:21.297 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-06-22T10:37:21.297 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ieee802154 2023-06-22T10:37:21.297 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ieee802154/fakelb.ko 2023-06-22T10:37:21.298 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ifb.ko 2023-06-22T10:37:21.298 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ipvlan 2023-06-22T10:37:21.298 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ipvlan/ipvlan.ko 2023-06-22T10:37:21.298 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/macvlan.ko 2023-06-22T10:37:21.298 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/macvtap.ko 2023-06-22T10:37:21.298 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/mdio 2023-06-22T10:37:21.299 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/mdio.ko 2023-06-22T10:37:21.299 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-06-22T10:37:21.299 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-06-22T10:37:21.299 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/mii.ko 2023-06-22T10:37:21.299 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/net_failover.ko 2023-06-22T10:37:21.299 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/netconsole.ko 2023-06-22T10:37:21.299 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/nlmon.ko 2023-06-22T10:37:21.300 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/pcs 2023-06-22T10:37:21.300 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/pcs/pcs-altera-tse.ko 2023-06-22T10:37:21.300 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-06-22T10:37:21.300 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy 2023-06-22T10:37:21.300 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/amd.ko 2023-06-22T10:37:21.300 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-06-22T10:37:21.300 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-06-22T10:37:21.301 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/bcm7xxx.ko 2023-06-22T10:37:21.301 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/bcm87xx.ko 2023-06-22T10:37:21.301 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/broadcom.ko 2023-06-22T10:37:21.301 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/cicada.ko 2023-06-22T10:37:21.301 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/davicom.ko 2023-06-22T10:37:21.301 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/dp83640.ko 2023-06-22T10:37:21.301 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/et1011c.ko 2023-06-22T10:37:21.302 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/icplus.ko 2023-06-22T10:37:21.302 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/lxt.ko 2023-06-22T10:37:21.302 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/marvell.ko 2023-06-22T10:37:21.302 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/micrel.ko 2023-06-22T10:37:21.302 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/national.ko 2023-06-22T10:37:21.302 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/phylink.ko 2023-06-22T10:37:21.302 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/qsemi.ko 2023-06-22T10:37:21.302 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/realtek.ko 2023-06-22T10:37:21.303 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/smsc.ko 2023-06-22T10:37:21.303 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/ste10Xp.ko 2023-06-22T10:37:21.303 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/phy/vitesse.ko 2023-06-22T10:37:21.303 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp 2023-06-22T10:37:21.303 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp/bsd_comp.ko 2023-06-22T10:37:21.303 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp/ppp_async.ko 2023-06-22T10:37:21.304 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp/ppp_deflate.ko 2023-06-22T10:37:21.304 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp/ppp_generic.ko 2023-06-22T10:37:21.304 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp/ppp_mppe.ko 2023-06-22T10:37:21.304 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp/ppp_synctty.ko 2023-06-22T10:37:21.304 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp/pppoe.ko 2023-06-22T10:37:21.304 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp/pppox.ko 2023-06-22T10:37:21.304 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/ppp/pptp.ko 2023-06-22T10:37:21.305 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/slip 2023-06-22T10:37:21.305 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/slip/slhc.ko 2023-06-22T10:37:21.305 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/slip/slip.ko 2023-06-22T10:37:21.305 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/sungem_phy.ko 2023-06-22T10:37:21.306 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/tap.ko 2023-06-22T10:37:21.306 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/team 2023-06-22T10:37:21.306 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/team/team.ko 2023-06-22T10:37:21.306 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/team/team_mode_activebackup.ko 2023-06-22T10:37:21.307 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/team/team_mode_broadcast.ko 2023-06-22T10:37:21.307 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-06-22T10:37:21.307 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/team/team_mode_random.ko 2023-06-22T10:37:21.307 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-06-22T10:37:21.307 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/tun.ko 2023-06-22T10:37:21.307 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/veth.ko 2023-06-22T10:37:21.307 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/virtio_net.ko 2023-06-22T10:37:21.307 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/vmxnet3 2023-06-22T10:37:21.308 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-06-22T10:37:21.308 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/vxlan 2023-06-22T10:37:21.308 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/vxlan/vxlan.ko 2023-06-22T10:37:21.308 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/xen-netback 2023-06-22T10:37:21.308 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/xen-netback/xen-netback.ko 2023-06-22T10:37:21.308 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/net/xen-netfront.ko 2023-06-22T10:37:21.308 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ntb 2023-06-22T10:37:21.309 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ntb/ntb.ko 2023-06-22T10:37:21.309 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/nvme 2023-06-22T10:37:21.309 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/nvme/host 2023-06-22T10:37:21.309 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/nvme/host/nvme-core.ko 2023-06-22T10:37:21.310 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/nvme/host/nvme.ko 2023-06-22T10:37:21.310 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/parport 2023-06-22T10:37:21.310 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/parport/parport.ko 2023-06-22T10:37:21.310 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/parport/parport_cs.ko 2023-06-22T10:37:21.311 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/parport/parport_pc.ko 2023-06-22T10:37:21.311 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/parport/parport_serial.ko 2023-06-22T10:37:21.311 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pci 2023-06-22T10:37:21.312 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pci/hotplug 2023-06-22T10:37:21.312 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-06-22T10:37:21.312 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pci/pcie 2023-06-22T10:37:21.312 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pci/pcie/aer_inject.ko 2023-06-22T10:37:21.313 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pci/xen-pcifront.ko 2023-06-22T10:37:21.313 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pcmcia 2023-06-22T10:37:21.313 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pcmcia/i82092.ko 2023-06-22T10:37:21.313 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pcmcia/pd6729.ko 2023-06-22T10:37:21.314 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pcmcia/yenta_socket.ko 2023-06-22T10:37:21.314 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pinctrl 2023-06-22T10:37:21.314 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pinctrl/intel 2023-06-22T10:37:21.315 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-06-22T10:37:21.315 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform 2023-06-22T10:37:21.315 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86 2023-06-22T10:37:21.315 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/acer-wmi.ko 2023-06-22T10:37:21.315 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/acerhdf.ko 2023-06-22T10:37:21.315 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/apple-gmux.ko 2023-06-22T10:37:21.316 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/asus-laptop.ko 2023-06-22T10:37:21.316 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-06-22T10:37:21.316 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/asus-wmi.ko 2023-06-22T10:37:21.316 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/classmate-laptop.ko 2023-06-22T10:37:21.316 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-06-22T10:37:21.316 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-06-22T10:37:21.316 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-06-22T10:37:21.317 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-06-22T10:37:21.317 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/hdaps.ko 2023-06-22T10:37:21.317 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/intel 2023-06-22T10:37:21.317 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-06-22T10:37:21.317 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/intel_ips.ko 2023-06-22T10:37:21.317 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/msi-wmi.ko 2023-06-22T10:37:21.318 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/mxm-wmi.ko 2023-06-22T10:37:21.318 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-06-22T10:37:21.318 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/samsung-laptop.ko 2023-06-22T10:37:21.318 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/samsung-q10.ko 2023-06-22T10:37:21.318 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/topstar-laptop.ko 2023-06-22T10:37:21.318 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-06-22T10:37:21.318 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/toshiba_haps.ko 2023-06-22T10:37:21.319 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/wmi-bmof.ko 2023-06-22T10:37:21.319 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/platform/x86/wmi.ko 2023-06-22T10:37:21.319 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/powercap 2023-06-22T10:37:21.319 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/powercap/intel_rapl_common.ko 2023-06-22T10:37:21.319 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/powercap/intel_rapl_msr.ko 2023-06-22T10:37:21.319 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pps 2023-06-22T10:37:21.319 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pps/clients 2023-06-22T10:37:21.319 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pps/clients/pps-gpio.ko 2023-06-22T10:37:21.320 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pps/clients/pps-ldisc.ko 2023-06-22T10:37:21.320 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pps/clients/pps_parport.ko 2023-06-22T10:37:21.320 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/pps/pps_core.ko 2023-06-22T10:37:21.320 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ptp 2023-06-22T10:37:21.321 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ptp/ptp.ko 2023-06-22T10:37:21.321 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ptp/ptp_kvm.ko 2023-06-22T10:37:21.321 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc 2023-06-22T10:37:21.321 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-bq32k.ko 2023-06-22T10:37:21.322 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-bq4802.ko 2023-06-22T10:37:21.322 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-ds1286.ko 2023-06-22T10:37:21.322 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-ds1307.ko 2023-06-22T10:37:21.322 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-ds1374.ko 2023-06-22T10:37:21.323 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-ds1511.ko 2023-06-22T10:37:21.323 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-ds1553.ko 2023-06-22T10:37:21.323 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-ds1672.ko 2023-06-22T10:37:21.324 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-ds1742.ko 2023-06-22T10:37:21.324 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-ds2404.ko 2023-06-22T10:37:21.324 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-ds3232.ko 2023-06-22T10:37:21.324 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-em3027.ko 2023-06-22T10:37:21.325 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-fm3130.ko 2023-06-22T10:37:21.325 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-isl12022.ko 2023-06-22T10:37:21.325 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-isl1208.ko 2023-06-22T10:37:21.325 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-m41t80.ko 2023-06-22T10:37:21.326 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-m48t35.ko 2023-06-22T10:37:21.326 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-m48t59.ko 2023-06-22T10:37:21.326 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-max6900.ko 2023-06-22T10:37:21.327 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-msm6242.ko 2023-06-22T10:37:21.327 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-pcf2127.ko 2023-06-22T10:37:21.327 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-pcf85063.ko 2023-06-22T10:37:21.327 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-pcf8523.ko 2023-06-22T10:37:21.327 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-pcf8563.ko 2023-06-22T10:37:21.327 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-pcf8583.ko 2023-06-22T10:37:21.327 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-rp5c01.ko 2023-06-22T10:37:21.328 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-rs5c372.ko 2023-06-22T10:37:21.328 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-06-22T10:37:21.328 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-rx8025.ko 2023-06-22T10:37:21.328 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-rx8581.ko 2023-06-22T10:37:21.328 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-06-22T10:37:21.328 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/rtc/rtc-x1205.ko 2023-06-22T10:37:21.328 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi 2023-06-22T10:37:21.328 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/3w-9xxx.ko 2023-06-22T10:37:21.329 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/3w-sas.ko 2023-06-22T10:37:21.329 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/3w-xxxx.ko 2023-06-22T10:37:21.329 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/BusLogic.ko 2023-06-22T10:37:21.329 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/a100u2w.ko 2023-06-22T10:37:21.329 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/aacraid 2023-06-22T10:37:21.329 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/aacraid/aacraid.ko 2023-06-22T10:37:21.329 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/advansys.ko 2023-06-22T10:37:21.330 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/aic7xxx 2023-06-22T10:37:21.330 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-06-22T10:37:21.330 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-06-22T10:37:21.330 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/am53c974.ko 2023-06-22T10:37:21.330 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/arcmsr 2023-06-22T10:37:21.330 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-06-22T10:37:21.331 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/atp870u.ko 2023-06-22T10:37:21.331 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/be2iscsi 2023-06-22T10:37:21.331 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-06-22T10:37:21.331 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/bfa 2023-06-22T10:37:21.331 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/bfa/bfa.ko 2023-06-22T10:37:21.331 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/bnx2fc 2023-06-22T10:37:21.332 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-06-22T10:37:21.332 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/bnx2i 2023-06-22T10:37:21.332 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-06-22T10:37:21.332 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/ch.ko 2023-06-22T10:37:21.333 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/csiostor 2023-06-22T10:37:21.333 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/csiostor/csiostor.ko 2023-06-22T10:37:21.333 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/cxgbi 2023-06-22T10:37:21.333 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/cxgbi/cxgb3i 2023-06-22T10:37:21.333 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-06-22T10:37:21.333 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/cxgbi/cxgb4i 2023-06-22T10:37:21.334 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-06-22T10:37:21.334 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-06-22T10:37:21.334 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/dc395x.ko 2023-06-22T10:37:21.334 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/device_handler 2023-06-22T10:37:21.334 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-06-22T10:37:21.334 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-06-22T10:37:21.334 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-06-22T10:37:21.334 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-06-22T10:37:21.335 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/dmx3191d.ko 2023-06-22T10:37:21.335 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/esas2r 2023-06-22T10:37:21.335 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/esas2r/esas2r.ko 2023-06-22T10:37:21.335 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/esp_scsi.ko 2023-06-22T10:37:21.335 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/fcoe 2023-06-22T10:37:21.335 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/fcoe/fcoe.ko 2023-06-22T10:37:21.335 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-06-22T10:37:21.336 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/fnic 2023-06-22T10:37:21.336 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/fnic/fnic.ko 2023-06-22T10:37:21.336 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/hpsa.ko 2023-06-22T10:37:21.336 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/hptiop.ko 2023-06-22T10:37:21.336 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/hv_storvsc.ko 2023-06-22T10:37:21.336 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/initio.ko 2023-06-22T10:37:21.337 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/ipr.ko 2023-06-22T10:37:21.337 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/ips.ko 2023-06-22T10:37:21.337 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/isci 2023-06-22T10:37:21.337 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/isci/isci.ko 2023-06-22T10:37:21.337 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-06-22T10:37:21.337 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/iscsi_tcp.ko 2023-06-22T10:37:21.338 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/libfc 2023-06-22T10:37:21.338 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/libfc/libfc.ko 2023-06-22T10:37:21.338 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/libiscsi.ko 2023-06-22T10:37:21.338 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/libiscsi_tcp.ko 2023-06-22T10:37:21.338 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/libsas 2023-06-22T10:37:21.338 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/libsas/libsas.ko 2023-06-22T10:37:21.338 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/lpfc 2023-06-22T10:37:21.338 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/lpfc/lpfc.ko 2023-06-22T10:37:21.339 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/megaraid 2023-06-22T10:37:21.339 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/megaraid.ko 2023-06-22T10:37:21.339 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-06-22T10:37:21.339 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-06-22T10:37:21.339 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-06-22T10:37:21.339 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/mpt3sas 2023-06-22T10:37:21.339 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-06-22T10:37:21.339 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/mvsas 2023-06-22T10:37:21.340 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/mvsas/mvsas.ko 2023-06-22T10:37:21.340 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/mvumi.ko 2023-06-22T10:37:21.340 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/pm8001 2023-06-22T10:37:21.340 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-06-22T10:37:21.340 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/pmcraid.ko 2023-06-22T10:37:21.340 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/qla1280.ko 2023-06-22T10:37:21.341 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/qla2xxx 2023-06-22T10:37:21.341 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-06-22T10:37:21.341 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-06-22T10:37:21.341 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/qla4xxx 2023-06-22T10:37:21.341 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-06-22T10:37:21.341 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/raid_class.ko 2023-06-22T10:37:21.341 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/scsi_debug.ko 2023-06-22T10:37:21.341 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/scsi_transport_fc.ko 2023-06-22T10:37:21.342 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-06-22T10:37:21.342 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/scsi_transport_sas.ko 2023-06-22T10:37:21.342 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/scsi_transport_spi.ko 2023-06-22T10:37:21.342 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/scsi_transport_srp.ko 2023-06-22T10:37:21.342 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/ses.ko 2023-06-22T10:37:21.342 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/st.ko 2023-06-22T10:37:21.342 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/stex.ko 2023-06-22T10:37:21.342 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/sym53c8xx_2 2023-06-22T10:37:21.343 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-06-22T10:37:21.343 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/virtio_scsi.ko 2023-06-22T10:37:21.343 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/vmw_pvscsi.ko 2023-06-22T10:37:21.343 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/scsi/wd719x.ko 2023-06-22T10:37:21.343 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ssb 2023-06-22T10:37:21.344 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ssb/ssb.ko 2023-06-22T10:37:21.344 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target 2023-06-22T10:37:21.344 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/iscsi 2023-06-22T10:37:21.344 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-06-22T10:37:21.344 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/loopback 2023-06-22T10:37:21.344 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/loopback/tcm_loop.ko 2023-06-22T10:37:21.345 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/target_core_file.ko 2023-06-22T10:37:21.345 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/target_core_iblock.ko 2023-06-22T10:37:21.345 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/target_core_mod.ko 2023-06-22T10:37:21.345 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/target_core_pscsi.ko 2023-06-22T10:37:21.345 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/target_core_user.ko 2023-06-22T10:37:21.345 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/tcm_fc 2023-06-22T10:37:21.345 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-06-22T10:37:21.346 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal 2023-06-22T10:37:21.346 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel 2023-06-22T10:37:21.346 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal 2023-06-22T10:37:21.346 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-06-22T10:37:21.346 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-06-22T10:37:21.346 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-06-22T10:37:21.346 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-06-22T10:37:21.346 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-06-22T10:37:21.347 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-06-22T10:37:21.347 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-06-22T10:37:21.347 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-06-22T10:37:21.347 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-06-22T10:37:21.347 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-06-22T10:37:21.347 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-06-22T10:37:21.347 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-06-22T10:37:21.348 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-06-22T10:37:21.348 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-06-22T10:37:21.348 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-06-22T10:37:21.348 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty 2023-06-22T10:37:21.348 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/ipwireless 2023-06-22T10:37:21.348 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-06-22T10:37:21.348 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/n_gsm.ko 2023-06-22T10:37:21.349 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/n_hdlc.ko 2023-06-22T10:37:21.349 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/nozomi.ko 2023-06-22T10:37:21.349 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/serial 2023-06-22T10:37:21.349 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/serial/8250 2023-06-22T10:37:21.349 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-06-22T10:37:21.349 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/serial/arc_uart.ko 2023-06-22T10:37:21.349 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/serial/jsm 2023-06-22T10:37:21.349 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/serial/jsm/jsm.ko 2023-06-22T10:37:21.350 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/tty/synclink_gt.ko 2023-06-22T10:37:21.350 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ufs 2023-06-22T10:37:21.350 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ufs/core 2023-06-22T10:37:21.350 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ufs/core/ufshcd-core.ko 2023-06-22T10:37:21.350 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ufs/host 2023-06-22T10:37:21.350 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-06-22T10:37:21.350 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/uio 2023-06-22T10:37:21.350 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/uio/uio.ko 2023-06-22T10:37:21.351 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/uio/uio_aec.ko 2023-06-22T10:37:21.351 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/uio/uio_cif.ko 2023-06-22T10:37:21.351 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/uio/uio_pci_generic.ko 2023-06-22T10:37:21.351 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/uio/uio_sercos3.ko 2023-06-22T10:37:21.351 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb 2023-06-22T10:37:21.351 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/class 2023-06-22T10:37:21.351 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/class/cdc-acm.ko 2023-06-22T10:37:21.351 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/class/cdc-wdm.ko 2023-06-22T10:37:21.352 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/class/usblp.ko 2023-06-22T10:37:21.352 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/class/usbtmc.ko 2023-06-22T10:37:21.352 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/host 2023-06-22T10:37:21.352 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/host/sl811-hcd.ko 2023-06-22T10:37:21.352 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/image 2023-06-22T10:37:21.352 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/image/mdc800.ko 2023-06-22T10:37:21.352 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/image/microtek.ko 2023-06-22T10:37:21.353 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc 2023-06-22T10:37:21.353 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/adutux.ko 2023-06-22T10:37:21.353 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/appledisplay.ko 2023-06-22T10:37:21.353 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/emi26.ko 2023-06-22T10:37:21.353 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/emi62.ko 2023-06-22T10:37:21.353 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/ezusb.ko 2023-06-22T10:37:21.354 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/idmouse.ko 2023-06-22T10:37:21.354 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/iowarrior.ko 2023-06-22T10:37:21.354 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/isight_firmware.ko 2023-06-22T10:37:21.354 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/ldusb.ko 2023-06-22T10:37:21.354 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/legousbtower.ko 2023-06-22T10:37:21.354 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/sisusbvga 2023-06-22T10:37:21.355 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-06-22T10:37:21.355 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/trancevibrator.ko 2023-06-22T10:37:21.355 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/usb3503.ko 2023-06-22T10:37:21.355 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/usblcd.ko 2023-06-22T10:37:21.355 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/usbsevseg.ko 2023-06-22T10:37:21.355 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/uss720.ko 2023-06-22T10:37:21.355 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/misc/yurex.ko 2023-06-22T10:37:21.355 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/phy 2023-06-22T10:37:21.356 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/phy/phy-generic.ko 2023-06-22T10:37:21.356 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial 2023-06-22T10:37:21.356 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/aircable.ko 2023-06-22T10:37:21.356 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/ark3116.ko 2023-06-22T10:37:21.356 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/belkin_sa.ko 2023-06-22T10:37:21.356 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/ch341.ko 2023-06-22T10:37:21.357 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/cp210x.ko 2023-06-22T10:37:21.357 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/cyberjack.ko 2023-06-22T10:37:21.357 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/cypress_m8.ko 2023-06-22T10:37:21.357 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/digi_acceleport.ko 2023-06-22T10:37:21.357 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/empeg.ko 2023-06-22T10:37:21.357 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/ftdi_sio.ko 2023-06-22T10:37:21.357 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/garmin_gps.ko 2023-06-22T10:37:21.357 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/io_edgeport.ko 2023-06-22T10:37:21.358 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/io_ti.ko 2023-06-22T10:37:21.358 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/ipaq.ko 2023-06-22T10:37:21.358 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/ipw.ko 2023-06-22T10:37:21.358 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/ir-usb.ko 2023-06-22T10:37:21.358 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-06-22T10:37:21.358 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/keyspan.ko 2023-06-22T10:37:21.358 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/keyspan_pda.ko 2023-06-22T10:37:21.359 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/kl5kusb105.ko 2023-06-22T10:37:21.359 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/kobil_sct.ko 2023-06-22T10:37:21.359 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/mct_u232.ko 2023-06-22T10:37:21.359 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/mos7720.ko 2023-06-22T10:37:21.359 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/mos7840.ko 2023-06-22T10:37:21.359 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/navman.ko 2023-06-22T10:37:21.359 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/omninet.ko 2023-06-22T10:37:21.360 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/opticon.ko 2023-06-22T10:37:21.360 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/option.ko 2023-06-22T10:37:21.360 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/oti6858.ko 2023-06-22T10:37:21.360 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/pl2303.ko 2023-06-22T10:37:21.360 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/qcaux.ko 2023-06-22T10:37:21.360 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/qcserial.ko 2023-06-22T10:37:21.360 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/quatech2.ko 2023-06-22T10:37:21.361 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/safe_serial.ko 2023-06-22T10:37:21.361 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/sierra.ko 2023-06-22T10:37:21.361 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/spcp8x5.ko 2023-06-22T10:37:21.361 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/ssu100.ko 2023-06-22T10:37:21.361 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/symbolserial.ko 2023-06-22T10:37:21.361 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-06-22T10:37:21.361 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-06-22T10:37:21.361 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/usb_debug.ko 2023-06-22T10:37:21.362 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/usb_wwan.ko 2023-06-22T10:37:21.362 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/visor.ko 2023-06-22T10:37:21.362 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/whiteheat.ko 2023-06-22T10:37:21.362 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/serial/xsens_mt.ko 2023-06-22T10:37:21.362 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage 2023-06-22T10:37:21.362 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/uas.ko 2023-06-22T10:37:21.362 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-alauda.ko 2023-06-22T10:37:21.362 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-cypress.ko 2023-06-22T10:37:21.363 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-datafab.ko 2023-06-22T10:37:21.363 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-06-22T10:37:21.363 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-freecom.ko 2023-06-22T10:37:21.363 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-isd200.ko 2023-06-22T10:37:21.363 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-06-22T10:37:21.363 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-karma.ko 2023-06-22T10:37:21.363 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-onetouch.ko 2023-06-22T10:37:21.363 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-realtek.ko 2023-06-22T10:37:21.364 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-sddr09.ko 2023-06-22T10:37:21.364 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-sddr55.ko 2023-06-22T10:37:21.364 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/ums-usbat.ko 2023-06-22T10:37:21.364 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/storage/usb-storage.ko 2023-06-22T10:37:21.364 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/usbip 2023-06-22T10:37:21.365 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/usbip/usbip-core.ko 2023-06-22T10:37:21.365 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/usbip/usbip-host.ko 2023-06-22T10:37:21.365 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-06-22T10:37:21.365 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vfio 2023-06-22T10:37:21.365 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vfio/pci 2023-06-22T10:37:21.365 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-06-22T10:37:21.365 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vfio/pci/vfio-pci.ko 2023-06-22T10:37:21.366 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vfio/vfio.ko 2023-06-22T10:37:21.366 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-06-22T10:37:21.366 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vhost 2023-06-22T10:37:21.366 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vhost/vhost.ko 2023-06-22T10:37:21.366 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vhost/vhost_iotlb.ko 2023-06-22T10:37:21.366 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vhost/vhost_net.ko 2023-06-22T10:37:21.366 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/vhost/vhost_scsi.ko 2023-06-22T10:37:21.366 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/video 2023-06-22T10:37:21.367 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/video/backlight 2023-06-22T10:37:21.367 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/video/backlight/apple_bl.ko 2023-06-22T10:37:21.367 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/video/backlight/lcd.ko 2023-06-22T10:37:21.367 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/video/backlight/platform_lcd.ko 2023-06-22T10:37:21.367 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/virtio 2023-06-22T10:37:21.367 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/virtio/virtio.ko 2023-06-22T10:37:21.367 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/virtio/virtio_balloon.ko 2023-06-22T10:37:21.367 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/virtio/virtio_mmio.ko 2023-06-22T10:37:21.368 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/virtio/virtio_pci.ko 2023-06-22T10:37:21.368 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-06-22T10:37:21.368 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-06-22T10:37:21.368 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/virtio/virtio_ring.ko 2023-06-22T10:37:21.368 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1 2023-06-22T10:37:21.368 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/masters 2023-06-22T10:37:21.368 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/masters/ds2482.ko 2023-06-22T10:37:21.369 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/masters/ds2490.ko 2023-06-22T10:37:21.369 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves 2023-06-22T10:37:21.369 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-06-22T10:37:21.369 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-06-22T10:37:21.369 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-06-22T10:37:21.369 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-06-22T10:37:21.370 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-06-22T10:37:21.370 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-06-22T10:37:21.370 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-06-22T10:37:21.370 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-06-22T10:37:21.370 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-06-22T10:37:21.370 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_smem.ko 2023-06-22T10:37:21.370 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/slaves/w1_therm.ko 2023-06-22T10:37:21.370 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/w1/wire.ko 2023-06-22T10:37:21.371 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog 2023-06-22T10:37:21.371 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/alim1535_wdt.ko 2023-06-22T10:37:21.371 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/alim7101_wdt.ko 2023-06-22T10:37:21.371 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/f71808e_wdt.ko 2023-06-22T10:37:21.371 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/hpwdt.ko 2023-06-22T10:37:21.371 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/i6300esb.ko 2023-06-22T10:37:21.371 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-06-22T10:37:21.372 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/iTCO_wdt.ko 2023-06-22T10:37:21.372 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/ib700wdt.ko 2023-06-22T10:37:21.372 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/ibmasr.ko 2023-06-22T10:37:21.372 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-06-22T10:37:21.372 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/it8712f_wdt.ko 2023-06-22T10:37:21.372 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/it87_wdt.ko 2023-06-22T10:37:21.372 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/machzwd.ko 2023-06-22T10:37:21.373 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/nv_tco.ko 2023-06-22T10:37:21.373 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/pcwd_pci.ko 2023-06-22T10:37:21.373 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/pcwd_usb.ko 2023-06-22T10:37:21.373 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-06-22T10:37:21.373 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/sch311x_wdt.ko 2023-06-22T10:37:21.373 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/softdog.ko 2023-06-22T10:37:21.373 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/sp5100_tco.ko 2023-06-22T10:37:21.373 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/via_wdt.ko 2023-06-22T10:37:21.374 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-06-22T10:37:21.374 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/w83877f_wdt.ko 2023-06-22T10:37:21.374 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/w83977f_wdt.ko 2023-06-22T10:37:21.374 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/wdt_pci.ko 2023-06-22T10:37:21.374 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/watchdog/xen_wdt.ko 2023-06-22T10:37:21.374 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen 2023-06-22T10:37:21.375 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen/xen-acpi-processor.ko 2023-06-22T10:37:21.375 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen/xen-evtchn.ko 2023-06-22T10:37:21.375 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen/xen-gntalloc.ko 2023-06-22T10:37:21.375 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen/xen-gntdev.ko 2023-06-22T10:37:21.375 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen/xen-pciback 2023-06-22T10:37:21.375 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-06-22T10:37:21.375 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen/xen-privcmd.ko 2023-06-22T10:37:21.376 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen/xenfs 2023-06-22T10:37:21.376 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/drivers/xen/xenfs/xenfs.ko 2023-06-22T10:37:21.376 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs 2023-06-22T10:37:21.376 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/9p 2023-06-22T10:37:21.377 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/9p/9p.ko 2023-06-22T10:37:21.377 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/affs 2023-06-22T10:37:21.377 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/affs/affs.ko 2023-06-22T10:37:21.377 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/befs 2023-06-22T10:37:21.378 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/befs/befs.ko 2023-06-22T10:37:21.378 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/binfmt_misc.ko 2023-06-22T10:37:21.378 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/btrfs 2023-06-22T10:37:21.379 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/btrfs/btrfs.ko 2023-06-22T10:37:21.379 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/cachefiles 2023-06-22T10:37:21.379 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/cachefiles/cachefiles.ko 2023-06-22T10:37:21.379 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ceph 2023-06-22T10:37:21.380 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ceph/ceph.ko 2023-06-22T10:37:21.380 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/coda 2023-06-22T10:37:21.380 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/coda/coda.ko 2023-06-22T10:37:21.380 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/cramfs 2023-06-22T10:37:21.381 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/cramfs/cramfs.ko 2023-06-22T10:37:21.381 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/dlm 2023-06-22T10:37:21.381 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/dlm/dlm.ko 2023-06-22T10:37:21.382 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ecryptfs 2023-06-22T10:37:21.382 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ecryptfs/ecryptfs.ko 2023-06-22T10:37:21.382 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/f2fs 2023-06-22T10:37:21.382 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/f2fs/f2fs.ko 2023-06-22T10:37:21.382 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/fat 2023-06-22T10:37:21.383 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/fat/fat.ko 2023-06-22T10:37:21.383 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/fat/msdos.ko 2023-06-22T10:37:21.383 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/fat/vfat.ko 2023-06-22T10:37:21.383 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/fscache 2023-06-22T10:37:21.383 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/fscache/fscache.ko 2023-06-22T10:37:21.383 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/fuse 2023-06-22T10:37:21.383 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/fuse/cuse.ko 2023-06-22T10:37:21.384 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/fuse/fuse.ko 2023-06-22T10:37:21.384 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/gfs2 2023-06-22T10:37:21.384 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/gfs2/gfs2.ko 2023-06-22T10:37:21.384 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/hfs 2023-06-22T10:37:21.384 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/hfs/hfs.ko 2023-06-22T10:37:21.384 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/hfsplus 2023-06-22T10:37:21.384 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/hfsplus/hfsplus.ko 2023-06-22T10:37:21.385 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/isofs 2023-06-22T10:37:21.385 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/isofs/isofs.ko 2023-06-22T10:37:21.385 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/jfs 2023-06-22T10:37:21.385 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/jfs/jfs.ko 2023-06-22T10:37:21.385 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/lockd 2023-06-22T10:37:21.385 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/lockd/lockd.ko 2023-06-22T10:37:21.386 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/minix 2023-06-22T10:37:21.386 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/minix/minix.ko 2023-06-22T10:37:21.386 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/netfs 2023-06-22T10:37:21.386 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/netfs/netfs.ko 2023-06-22T10:37:21.386 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs 2023-06-22T10:37:21.386 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs/blocklayout 2023-06-22T10:37:21.387 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-06-22T10:37:21.387 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs/filelayout 2023-06-22T10:37:21.387 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-06-22T10:37:21.387 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs/flexfilelayout 2023-06-22T10:37:21.388 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-06-22T10:37:21.388 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs/nfs.ko 2023-06-22T10:37:21.388 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs/nfsv3.ko 2023-06-22T10:37:21.389 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs/nfsv4.ko 2023-06-22T10:37:21.389 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs_common 2023-06-22T10:37:21.389 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs_common/grace.ko 2023-06-22T10:37:21.389 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfs_common/nfs_acl.ko 2023-06-22T10:37:21.390 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfsd 2023-06-22T10:37:21.390 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nfsd/nfsd.ko 2023-06-22T10:37:21.390 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nilfs2 2023-06-22T10:37:21.390 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nilfs2/nilfs2.ko 2023-06-22T10:37:21.391 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls 2023-06-22T10:37:21.391 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-celtic.ko 2023-06-22T10:37:21.391 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-centeuro.ko 2023-06-22T10:37:21.391 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-croatian.ko 2023-06-22T10:37:21.391 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-cyrillic.ko 2023-06-22T10:37:21.392 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-gaelic.ko 2023-06-22T10:37:21.392 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-greek.ko 2023-06-22T10:37:21.392 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-iceland.ko 2023-06-22T10:37:21.392 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-inuit.ko 2023-06-22T10:37:21.392 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-roman.ko 2023-06-22T10:37:21.393 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-romanian.ko 2023-06-22T10:37:21.393 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/mac-turkish.ko 2023-06-22T10:37:21.393 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp1250.ko 2023-06-22T10:37:21.393 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp1251.ko 2023-06-22T10:37:21.393 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp1255.ko 2023-06-22T10:37:21.393 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp737.ko 2023-06-22T10:37:21.393 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp775.ko 2023-06-22T10:37:21.394 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp850.ko 2023-06-22T10:37:21.394 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp852.ko 2023-06-22T10:37:21.394 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp855.ko 2023-06-22T10:37:21.394 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp857.ko 2023-06-22T10:37:21.394 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp860.ko 2023-06-22T10:37:21.394 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp861.ko 2023-06-22T10:37:21.395 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp862.ko 2023-06-22T10:37:21.395 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp863.ko 2023-06-22T10:37:21.395 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp864.ko 2023-06-22T10:37:21.395 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp865.ko 2023-06-22T10:37:21.395 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp866.ko 2023-06-22T10:37:21.395 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp869.ko 2023-06-22T10:37:21.396 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp874.ko 2023-06-22T10:37:21.396 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp932.ko 2023-06-22T10:37:21.396 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp936.ko 2023-06-22T10:37:21.396 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp949.ko 2023-06-22T10:37:21.396 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_cp950.ko 2023-06-22T10:37:21.397 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_euc-jp.ko 2023-06-22T10:37:21.397 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-1.ko 2023-06-22T10:37:21.397 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-13.ko 2023-06-22T10:37:21.397 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-14.ko 2023-06-22T10:37:21.397 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-15.ko 2023-06-22T10:37:21.397 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-2.ko 2023-06-22T10:37:21.397 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-3.ko 2023-06-22T10:37:21.397 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-4.ko 2023-06-22T10:37:21.398 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-5.ko 2023-06-22T10:37:21.398 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-6.ko 2023-06-22T10:37:21.398 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-7.ko 2023-06-22T10:37:21.398 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_iso8859-9.ko 2023-06-22T10:37:21.398 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_koi8-r.ko 2023-06-22T10:37:21.398 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_koi8-ru.ko 2023-06-22T10:37:21.398 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_koi8-u.ko 2023-06-22T10:37:21.399 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/nls/nls_utf8.ko 2023-06-22T10:37:21.399 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2 2023-06-22T10:37:21.399 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/cluster 2023-06-22T10:37:21.399 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-06-22T10:37:21.399 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/dlm 2023-06-22T10:37:21.399 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-06-22T10:37:21.399 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/dlmfs 2023-06-22T10:37:21.399 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-06-22T10:37:21.400 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/ocfs2.ko 2023-06-22T10:37:21.400 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-06-22T10:37:21.400 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-06-22T10:37:21.400 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-06-22T10:37:21.400 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/overlayfs 2023-06-22T10:37:21.401 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/overlayfs/overlay.ko 2023-06-22T10:37:21.401 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/pstore 2023-06-22T10:37:21.401 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/pstore/ramoops.ko 2023-06-22T10:37:21.401 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/reiserfs 2023-06-22T10:37:21.401 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/reiserfs/reiserfs.ko 2023-06-22T10:37:21.401 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/romfs 2023-06-22T10:37:21.401 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/romfs/romfs.ko 2023-06-22T10:37:21.401 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/smb 2023-06-22T10:37:21.402 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/smb/client 2023-06-22T10:37:21.402 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/smb/client/cifs.ko 2023-06-22T10:37:21.402 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/smb/common 2023-06-22T10:37:21.402 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/smb/common/cifs_arc4.ko 2023-06-22T10:37:21.402 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/smb/common/cifs_md4.ko 2023-06-22T10:37:21.402 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/squashfs 2023-06-22T10:37:21.402 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/squashfs/squashfs.ko 2023-06-22T10:37:21.403 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/sysv 2023-06-22T10:37:21.403 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/sysv/sysv.ko 2023-06-22T10:37:21.403 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/udf 2023-06-22T10:37:21.403 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/udf/udf.ko 2023-06-22T10:37:21.403 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ufs 2023-06-22T10:37:21.403 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/ufs/ufs.ko 2023-06-22T10:37:21.403 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/xfs 2023-06-22T10:37:21.403 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/fs/xfs/xfs.ko 2023-06-22T10:37:21.404 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/kernel 2023-06-22T10:37:21.404 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/kernel/rcu 2023-06-22T10:37:21.404 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/kernel/rcu/rcutorture.ko 2023-06-22T10:37:21.404 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/kernel/torture.ko 2023-06-22T10:37:21.404 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/kernel/trace 2023-06-22T10:37:21.404 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-06-22T10:37:21.404 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib 2023-06-22T10:37:21.405 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/asn1_encoder.ko 2023-06-22T10:37:21.405 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/crc-itu-t.ko 2023-06-22T10:37:21.405 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/crc8.ko 2023-06-22T10:37:21.405 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/crypto 2023-06-22T10:37:21.405 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/crypto/libarc4.ko 2023-06-22T10:37:21.405 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/crypto/libdes.ko 2023-06-22T10:37:21.405 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/libcrc32c.ko 2023-06-22T10:37:21.406 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/lru_cache.ko 2023-06-22T10:37:21.406 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/lz4 2023-06-22T10:37:21.406 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/lz4/lz4_compress.ko 2023-06-22T10:37:21.406 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/lz4/lz4hc_compress.ko 2023-06-22T10:37:21.406 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/math 2023-06-22T10:37:21.407 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/math/cordic.ko 2023-06-22T10:37:21.407 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/raid6 2023-06-22T10:37:21.407 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/raid6/raid6_pq.ko 2023-06-22T10:37:21.407 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/reed_solomon 2023-06-22T10:37:21.407 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/reed_solomon/reed_solomon.ko 2023-06-22T10:37:21.407 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/ts_bm.ko 2023-06-22T10:37:21.407 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/ts_fsm.ko 2023-06-22T10:37:21.408 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/ts_kmp.ko 2023-06-22T10:37:21.408 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/zstd 2023-06-22T10:37:21.408 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/lib/zstd/zstd_compress.ko 2023-06-22T10:37:21.408 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/mm 2023-06-22T10:37:21.408 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/mm/hwpoison-inject.ko 2023-06-22T10:37:21.408 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net 2023-06-22T10:37:21.408 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/6lowpan 2023-06-22T10:37:21.409 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/6lowpan/6lowpan.ko 2023-06-22T10:37:21.409 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/6lowpan/nhc_dest.ko 2023-06-22T10:37:21.409 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/6lowpan/nhc_fragment.ko 2023-06-22T10:37:21.409 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/6lowpan/nhc_hop.ko 2023-06-22T10:37:21.409 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/6lowpan/nhc_ipv6.ko 2023-06-22T10:37:21.409 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/6lowpan/nhc_mobility.ko 2023-06-22T10:37:21.409 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/6lowpan/nhc_routing.ko 2023-06-22T10:37:21.410 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/6lowpan/nhc_udp.ko 2023-06-22T10:37:21.410 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/802 2023-06-22T10:37:21.410 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/802/garp.ko 2023-06-22T10:37:21.410 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/802/mrp.ko 2023-06-22T10:37:21.410 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/802/p8022.ko 2023-06-22T10:37:21.410 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/802/psnap.ko 2023-06-22T10:37:21.410 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/802/stp.ko 2023-06-22T10:37:21.410 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/8021q 2023-06-22T10:37:21.411 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/8021q/8021q.ko 2023-06-22T10:37:21.411 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/9p 2023-06-22T10:37:21.411 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/9p/9pnet.ko 2023-06-22T10:37:21.411 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/9p/9pnet_fd.ko 2023-06-22T10:37:21.411 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/9p/9pnet_rdma.ko 2023-06-22T10:37:21.411 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/9p/9pnet_virtio.ko 2023-06-22T10:37:21.411 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/batman-adv 2023-06-22T10:37:21.411 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/batman-adv/batman-adv.ko 2023-06-22T10:37:21.412 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge 2023-06-22T10:37:21.412 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/br_netfilter.ko 2023-06-22T10:37:21.412 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/bridge.ko 2023-06-22T10:37:21.412 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter 2023-06-22T10:37:21.412 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-06-22T10:37:21.413 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_among.ko 2023-06-22T10:37:21.413 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_arp.ko 2023-06-22T10:37:21.413 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-06-22T10:37:21.413 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-06-22T10:37:21.413 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_ip.ko 2023-06-22T10:37:21.413 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-06-22T10:37:21.414 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_limit.ko 2023-06-22T10:37:21.414 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_log.ko 2023-06-22T10:37:21.414 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_mark.ko 2023-06-22T10:37:21.414 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-06-22T10:37:21.415 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-06-22T10:37:21.415 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-06-22T10:37:21.415 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-06-22T10:37:21.415 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_snat.ko 2023-06-22T10:37:21.415 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_stp.ko 2023-06-22T10:37:21.415 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-06-22T10:37:21.415 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-06-22T10:37:21.416 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-06-22T10:37:21.416 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-06-22T10:37:21.416 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/ebtables.ko 2023-06-22T10:37:21.416 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-06-22T10:37:21.416 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-06-22T10:37:21.417 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-06-22T10:37:21.417 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ceph 2023-06-22T10:37:21.417 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ceph/libceph.ko 2023-06-22T10:37:21.417 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/core 2023-06-22T10:37:21.417 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/core/failover.ko 2023-06-22T10:37:21.417 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/core/pktgen.ko 2023-06-22T10:37:21.418 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dccp 2023-06-22T10:37:21.418 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dccp/dccp.ko 2023-06-22T10:37:21.418 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dccp/dccp_diag.ko 2023-06-22T10:37:21.418 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dccp/dccp_ipv4.ko 2023-06-22T10:37:21.418 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dccp/dccp_ipv6.ko 2023-06-22T10:37:21.418 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dns_resolver 2023-06-22T10:37:21.419 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dns_resolver/dns_resolver.ko 2023-06-22T10:37:21.419 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dsa 2023-06-22T10:37:21.419 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dsa/dsa_core.ko 2023-06-22T10:37:21.419 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dsa/tag_brcm.ko 2023-06-22T10:37:21.419 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dsa/tag_dsa.ko 2023-06-22T10:37:21.419 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dsa/tag_none.ko 2023-06-22T10:37:21.420 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/dsa/tag_trailer.ko 2023-06-22T10:37:21.420 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ieee802154 2023-06-22T10:37:21.420 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ieee802154/6lowpan 2023-06-22T10:37:21.420 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-06-22T10:37:21.420 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ieee802154/ieee802154.ko 2023-06-22T10:37:21.420 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ieee802154/ieee802154_socket.ko 2023-06-22T10:37:21.420 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4 2023-06-22T10:37:21.421 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/ah4.ko 2023-06-22T10:37:21.421 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/esp4.ko 2023-06-22T10:37:21.421 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/fou.ko 2023-06-22T10:37:21.421 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/gre.ko 2023-06-22T10:37:21.421 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/inet_diag.ko 2023-06-22T10:37:21.421 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/ip_gre.ko 2023-06-22T10:37:21.422 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/ip_tunnel.ko 2023-06-22T10:37:21.422 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/ip_vti.ko 2023-06-22T10:37:21.422 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/ipcomp.ko 2023-06-22T10:37:21.422 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/ipip.ko 2023-06-22T10:37:21.423 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter 2023-06-22T10:37:21.423 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/arp_tables.ko 2023-06-22T10:37:21.423 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-06-22T10:37:21.423 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-06-22T10:37:21.423 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-06-22T10:37:21.424 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-06-22T10:37:21.424 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-06-22T10:37:21.424 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-06-22T10:37:21.424 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-06-22T10:37:21.424 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-06-22T10:37:21.424 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-06-22T10:37:21.424 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/iptable_security.ko 2023-06-22T10:37:21.425 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-06-22T10:37:21.425 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-06-22T10:37:21.425 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-06-22T10:37:21.425 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-06-22T10:37:21.425 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-06-22T10:37:21.425 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-06-22T10:37:21.425 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-06-22T10:37:21.426 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-06-22T10:37:21.426 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-06-22T10:37:21.426 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-06-22T10:37:21.426 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_bic.ko 2023-06-22T10:37:21.426 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_dctcp.ko 2023-06-22T10:37:21.426 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_diag.ko 2023-06-22T10:37:21.426 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_highspeed.ko 2023-06-22T10:37:21.427 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_htcp.ko 2023-06-22T10:37:21.427 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_hybla.ko 2023-06-22T10:37:21.427 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_illinois.ko 2023-06-22T10:37:21.427 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_lp.ko 2023-06-22T10:37:21.427 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_scalable.ko 2023-06-22T10:37:21.428 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_vegas.ko 2023-06-22T10:37:21.428 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_veno.ko 2023-06-22T10:37:21.428 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_westwood.ko 2023-06-22T10:37:21.429 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tcp_yeah.ko 2023-06-22T10:37:21.429 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/tunnel4.ko 2023-06-22T10:37:21.429 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/udp_diag.ko 2023-06-22T10:37:21.430 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/udp_tunnel.ko 2023-06-22T10:37:21.430 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv4/xfrm4_tunnel.ko 2023-06-22T10:37:21.430 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6 2023-06-22T10:37:21.430 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/ah6.ko 2023-06-22T10:37:21.431 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/esp6.ko 2023-06-22T10:37:21.431 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/fou6.ko 2023-06-22T10:37:21.431 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/ip6_tunnel.ko 2023-06-22T10:37:21.431 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-06-22T10:37:21.432 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/ip6_vti.ko 2023-06-22T10:37:21.432 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/ipcomp6.ko 2023-06-22T10:37:21.432 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter 2023-06-22T10:37:21.433 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-06-22T10:37:21.433 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-06-22T10:37:21.433 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-06-22T10:37:21.434 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-06-22T10:37:21.434 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-06-22T10:37:21.434 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-06-22T10:37:21.434 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-06-22T10:37:21.435 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-06-22T10:37:21.435 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-06-22T10:37:21.435 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-06-22T10:37:21.436 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-06-22T10:37:21.436 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-06-22T10:37:21.436 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-06-22T10:37:21.436 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-06-22T10:37:21.436 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-06-22T10:37:21.437 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-06-22T10:37:21.437 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-06-22T10:37:21.437 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-06-22T10:37:21.437 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-06-22T10:37:21.438 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-06-22T10:37:21.438 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-06-22T10:37:21.438 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-06-22T10:37:21.439 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-06-22T10:37:21.439 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-06-22T10:37:21.439 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/sit.ko 2023-06-22T10:37:21.439 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/tunnel6.ko 2023-06-22T10:37:21.439 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/ipv6/xfrm6_tunnel.ko 2023-06-22T10:37:21.439 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/key 2023-06-22T10:37:21.440 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/key/af_key.ko 2023-06-22T10:37:21.440 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/l2tp 2023-06-22T10:37:21.440 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/l2tp/l2tp_core.ko 2023-06-22T10:37:21.440 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/l2tp/l2tp_debugfs.ko 2023-06-22T10:37:21.440 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/l2tp/l2tp_eth.ko 2023-06-22T10:37:21.441 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/l2tp/l2tp_ip.ko 2023-06-22T10:37:21.441 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/l2tp/l2tp_ip6.ko 2023-06-22T10:37:21.441 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/l2tp/l2tp_netlink.ko 2023-06-22T10:37:21.441 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/l2tp/l2tp_ppp.ko 2023-06-22T10:37:21.441 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/llc 2023-06-22T10:37:21.442 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/llc/llc.ko 2023-06-22T10:37:21.442 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/mac802154 2023-06-22T10:37:21.442 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/mac802154/mac802154.ko 2023-06-22T10:37:21.442 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/mpls 2023-06-22T10:37:21.442 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/mpls/mpls_gso.ko 2023-06-22T10:37:21.442 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter 2023-06-22T10:37:21.443 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset 2023-06-22T10:37:21.443 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set.ko 2023-06-22T10:37:21.443 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-06-22T10:37:21.443 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-06-22T10:37:21.443 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-06-22T10:37:21.444 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-06-22T10:37:21.444 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-06-22T10:37:21.444 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-06-22T10:37:21.444 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-06-22T10:37:21.444 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-06-22T10:37:21.444 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-06-22T10:37:21.445 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-06-22T10:37:21.445 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-06-22T10:37:21.445 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-06-22T10:37:21.445 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-06-22T10:37:21.445 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-06-22T10:37:21.445 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-06-22T10:37:21.445 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs 2023-06-22T10:37:21.446 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs.ko 2023-06-22T10:37:21.446 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-06-22T10:37:21.446 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-06-22T10:37:21.446 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-06-22T10:37:21.446 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-06-22T10:37:21.446 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-06-22T10:37:21.446 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-06-22T10:37:21.447 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-06-22T10:37:21.447 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-06-22T10:37:21.447 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-06-22T10:37:21.447 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-06-22T10:37:21.447 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-06-22T10:37:21.448 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-06-22T10:37:21.448 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-06-22T10:37:21.448 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conncount.ko 2023-06-22T10:37:21.448 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack.ko 2023-06-22T10:37:21.449 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-06-22T10:37:21.449 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-06-22T10:37:21.450 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-06-22T10:37:21.450 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_h323.ko 2023-06-22T10:37:21.450 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_irc.ko 2023-06-22T10:37:21.450 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-06-22T10:37:21.450 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-06-22T10:37:21.450 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-06-22T10:37:21.450 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_sane.ko 2023-06-22T10:37:21.451 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_sip.ko 2023-06-22T10:37:21.451 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-06-22T10:37:21.451 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-06-22T10:37:21.451 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_dup_netdev.ko 2023-06-22T10:37:21.451 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_flow_table.ko 2023-06-22T10:37:21.451 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_flow_table_inet.ko 2023-06-22T10:37:21.451 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_log_syslog.ko 2023-06-22T10:37:21.451 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_nat.ko 2023-06-22T10:37:21.452 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_nat_amanda.ko 2023-06-22T10:37:21.452 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_nat_ftp.ko 2023-06-22T10:37:21.452 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_nat_irc.ko 2023-06-22T10:37:21.452 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_nat_sip.ko 2023-06-22T10:37:21.452 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_nat_tftp.ko 2023-06-22T10:37:21.452 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_synproxy_core.ko 2023-06-22T10:37:21.452 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nf_tables.ko 2023-06-22T10:37:21.453 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nfnetlink.ko 2023-06-22T10:37:21.453 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nfnetlink_acct.ko 2023-06-22T10:37:21.453 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nfnetlink_log.ko 2023-06-22T10:37:21.453 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nfnetlink_osf.ko 2023-06-22T10:37:21.453 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nfnetlink_queue.ko 2023-06-22T10:37:21.453 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_chain_nat.ko 2023-06-22T10:37:21.453 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_compat.ko 2023-06-22T10:37:21.453 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_ct.ko 2023-06-22T10:37:21.454 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_dup_netdev.ko 2023-06-22T10:37:21.454 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_fib.ko 2023-06-22T10:37:21.454 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_fwd_netdev.ko 2023-06-22T10:37:21.454 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_hash.ko 2023-06-22T10:37:21.454 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_limit.ko 2023-06-22T10:37:21.455 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_log.ko 2023-06-22T10:37:21.455 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_masq.ko 2023-06-22T10:37:21.455 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_nat.ko 2023-06-22T10:37:21.455 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_numgen.ko 2023-06-22T10:37:21.455 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_queue.ko 2023-06-22T10:37:21.455 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_quota.ko 2023-06-22T10:37:21.455 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_redir.ko 2023-06-22T10:37:21.456 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_reject.ko 2023-06-22T10:37:21.456 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_reject_inet.ko 2023-06-22T10:37:21.456 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_socket.ko 2023-06-22T10:37:21.456 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/nft_tunnel.ko 2023-06-22T10:37:21.456 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_AUDIT.ko 2023-06-22T10:37:21.457 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_CHECKSUM.ko 2023-06-22T10:37:21.457 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_CLASSIFY.ko 2023-06-22T10:37:21.457 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-06-22T10:37:21.457 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_CT.ko 2023-06-22T10:37:21.457 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_DSCP.ko 2023-06-22T10:37:21.457 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_HL.ko 2023-06-22T10:37:21.458 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_HMARK.ko 2023-06-22T10:37:21.458 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_IDLETIMER.ko 2023-06-22T10:37:21.458 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_LED.ko 2023-06-22T10:37:21.458 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_LOG.ko 2023-06-22T10:37:21.459 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_MASQUERADE.ko 2023-06-22T10:37:21.459 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_NETMAP.ko 2023-06-22T10:37:21.459 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_NFLOG.ko 2023-06-22T10:37:21.459 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_NFQUEUE.ko 2023-06-22T10:37:21.460 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_RATEEST.ko 2023-06-22T10:37:21.460 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_REDIRECT.ko 2023-06-22T10:37:21.460 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_SECMARK.ko 2023-06-22T10:37:21.461 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_TCPMSS.ko 2023-06-22T10:37:21.461 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-06-22T10:37:21.461 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_TEE.ko 2023-06-22T10:37:21.461 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_TPROXY.ko 2023-06-22T10:37:21.461 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_TRACE.ko 2023-06-22T10:37:21.462 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_addrtype.ko 2023-06-22T10:37:21.462 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_bpf.ko 2023-06-22T10:37:21.462 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_cgroup.ko 2023-06-22T10:37:21.462 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_cluster.ko 2023-06-22T10:37:21.463 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_comment.ko 2023-06-22T10:37:21.463 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_connbytes.ko 2023-06-22T10:37:21.463 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_connlabel.ko 2023-06-22T10:37:21.463 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_connlimit.ko 2023-06-22T10:37:21.464 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_connmark.ko 2023-06-22T10:37:21.464 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_conntrack.ko 2023-06-22T10:37:21.464 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_cpu.ko 2023-06-22T10:37:21.465 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_dccp.ko 2023-06-22T10:37:21.465 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_devgroup.ko 2023-06-22T10:37:21.465 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_dscp.ko 2023-06-22T10:37:21.465 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_ecn.ko 2023-06-22T10:37:21.466 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_esp.ko 2023-06-22T10:37:21.466 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_hashlimit.ko 2023-06-22T10:37:21.466 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_helper.ko 2023-06-22T10:37:21.466 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_hl.ko 2023-06-22T10:37:21.467 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_ipcomp.ko 2023-06-22T10:37:21.467 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_iprange.ko 2023-06-22T10:37:21.467 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_ipvs.ko 2023-06-22T10:37:21.468 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_l2tp.ko 2023-06-22T10:37:21.468 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_length.ko 2023-06-22T10:37:21.468 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_limit.ko 2023-06-22T10:37:21.469 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_mac.ko 2023-06-22T10:37:21.469 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_mark.ko 2023-06-22T10:37:21.469 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_multiport.ko 2023-06-22T10:37:21.469 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_nat.ko 2023-06-22T10:37:21.470 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_nfacct.ko 2023-06-22T10:37:21.470 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_osf.ko 2023-06-22T10:37:21.470 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_owner.ko 2023-06-22T10:37:21.471 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_physdev.ko 2023-06-22T10:37:21.471 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_pkttype.ko 2023-06-22T10:37:21.471 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_policy.ko 2023-06-22T10:37:21.471 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_quota.ko 2023-06-22T10:37:21.472 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_rateest.ko 2023-06-22T10:37:21.472 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_realm.ko 2023-06-22T10:37:21.472 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_recent.ko 2023-06-22T10:37:21.472 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_sctp.ko 2023-06-22T10:37:21.473 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_set.ko 2023-06-22T10:37:21.473 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_socket.ko 2023-06-22T10:37:21.473 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_state.ko 2023-06-22T10:37:21.473 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_statistic.ko 2023-06-22T10:37:21.474 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_string.ko 2023-06-22T10:37:21.474 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_tcpmss.ko 2023-06-22T10:37:21.474 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_time.ko 2023-06-22T10:37:21.474 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netfilter/xt_u32.ko 2023-06-22T10:37:21.475 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netlink 2023-06-22T10:37:21.475 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/netlink/netlink_diag.ko 2023-06-22T10:37:21.475 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/nsh 2023-06-22T10:37:21.475 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/nsh/nsh.ko 2023-06-22T10:37:21.475 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/openvswitch 2023-06-22T10:37:21.475 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/openvswitch/openvswitch.ko 2023-06-22T10:37:21.475 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/openvswitch/vport-geneve.ko 2023-06-22T10:37:21.476 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/openvswitch/vport-gre.ko 2023-06-22T10:37:21.476 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/openvswitch/vport-vxlan.ko 2023-06-22T10:37:21.476 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/packet 2023-06-22T10:37:21.476 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/packet/af_packet_diag.ko 2023-06-22T10:37:21.476 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/rds 2023-06-22T10:37:21.477 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/rds/rds.ko 2023-06-22T10:37:21.477 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/rds/rds_rdma.ko 2023-06-22T10:37:21.477 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/rds/rds_tcp.ko 2023-06-22T10:37:21.477 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched 2023-06-22T10:37:21.477 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_csum.ko 2023-06-22T10:37:21.477 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_gact.ko 2023-06-22T10:37:21.477 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_ipt.ko 2023-06-22T10:37:21.478 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_mirred.ko 2023-06-22T10:37:21.478 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_nat.ko 2023-06-22T10:37:21.478 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_pedit.ko 2023-06-22T10:37:21.478 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_police.ko 2023-06-22T10:37:21.478 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_simple.ko 2023-06-22T10:37:21.478 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_skbedit.ko 2023-06-22T10:37:21.478 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/act_vlan.ko 2023-06-22T10:37:21.478 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/cls_basic.ko 2023-06-22T10:37:21.479 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/cls_bpf.ko 2023-06-22T10:37:21.479 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/cls_flow.ko 2023-06-22T10:37:21.479 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/cls_fw.ko 2023-06-22T10:37:21.479 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/cls_route.ko 2023-06-22T10:37:21.479 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/cls_u32.ko 2023-06-22T10:37:21.479 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/em_cmp.ko 2023-06-22T10:37:21.479 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/em_ipset.ko 2023-06-22T10:37:21.480 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/em_meta.ko 2023-06-22T10:37:21.480 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/em_nbyte.ko 2023-06-22T10:37:21.480 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/em_text.ko 2023-06-22T10:37:21.480 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/em_u32.ko 2023-06-22T10:37:21.480 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_choke.ko 2023-06-22T10:37:21.480 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_codel.ko 2023-06-22T10:37:21.481 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_drr.ko 2023-06-22T10:37:21.481 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_fq.ko 2023-06-22T10:37:21.481 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_gred.ko 2023-06-22T10:37:21.481 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_hfsc.ko 2023-06-22T10:37:21.481 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_hhf.ko 2023-06-22T10:37:21.481 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_htb.ko 2023-06-22T10:37:21.481 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_ingress.ko 2023-06-22T10:37:21.482 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_mqprio.ko 2023-06-22T10:37:21.482 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_mqprio_lib.ko 2023-06-22T10:37:21.482 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_multiq.ko 2023-06-22T10:37:21.482 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_netem.ko 2023-06-22T10:37:21.482 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_pie.ko 2023-06-22T10:37:21.482 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_plug.ko 2023-06-22T10:37:21.482 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_prio.ko 2023-06-22T10:37:21.482 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_qfq.ko 2023-06-22T10:37:21.483 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_red.ko 2023-06-22T10:37:21.483 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_sfb.ko 2023-06-22T10:37:21.483 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_sfq.ko 2023-06-22T10:37:21.483 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_tbf.ko 2023-06-22T10:37:21.483 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sched/sch_teql.ko 2023-06-22T10:37:21.483 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sctp 2023-06-22T10:37:21.483 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sctp/sctp.ko 2023-06-22T10:37:21.484 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sctp/sctp_diag.ko 2023-06-22T10:37:21.484 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sunrpc 2023-06-22T10:37:21.484 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sunrpc/auth_gss 2023-06-22T10:37:21.484 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-06-22T10:37:21.484 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-06-22T10:37:21.484 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sunrpc/sunrpc.ko 2023-06-22T10:37:21.484 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sunrpc/xprtrdma 2023-06-22T10:37:21.485 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-06-22T10:37:21.485 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/tipc 2023-06-22T10:37:21.485 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/tipc/diag.ko 2023-06-22T10:37:21.485 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/tipc/tipc.ko 2023-06-22T10:37:21.485 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/unix 2023-06-22T10:37:21.485 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/unix/unix_diag.ko 2023-06-22T10:37:21.485 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/vmw_vsock 2023-06-22T10:37:21.485 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-06-22T10:37:21.486 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-06-22T10:37:21.486 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/vmw_vsock/vsock.ko 2023-06-22T10:37:21.486 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/vmw_vsock/vsock_diag.ko 2023-06-22T10:37:21.486 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/vmw_vsock/vsock_loopback.ko 2023-06-22T10:37:21.486 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/xfrm 2023-06-22T10:37:21.486 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/net/xfrm/xfrm_ipcomp.ko 2023-06-22T10:37:21.486 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/security 2023-06-22T10:37:21.486 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/security/keys 2023-06-22T10:37:21.487 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/security/keys/encrypted-keys 2023-06-22T10:37:21.487 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-06-22T10:37:21.487 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/security/keys/trusted-keys 2023-06-22T10:37:21.487 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/security/keys/trusted-keys/trusted.ko 2023-06-22T10:37:21.487 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/virt 2023-06-22T10:37:21.487 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/virt/lib 2023-06-22T10:37:21.487 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/kernel/virt/lib/irqbypass.ko 2023-06-22T10:37:21.487 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.alias 2023-06-22T10:37:21.488 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.alias.bin 2023-06-22T10:37:21.488 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.builtin 2023-06-22T10:37:21.488 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.builtin.bin 2023-06-22T10:37:21.488 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.builtin.modinfo 2023-06-22T10:37:21.488 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.dep 2023-06-22T10:37:21.488 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.dep.bin 2023-06-22T10:37:21.488 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.devname 2023-06-22T10:37:21.489 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.order 2023-06-22T10:37:21.489 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.softdep 2023-06-22T10:37:21.489 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.symbols 2023-06-22T10:37:21.489 INFO:teuthology.orchestra.run.smithi040.stdout:/lib/modules/6.4.0-rc5-g1c622d92b6f1/modules.symbols.bin 2023-06-22T10:37:21.490 DEBUG:teuthology.task.kernel:get_image_version: 6.4.0-rc5-g1c622d92b6f1 2023-06-22T10:37:21.490 DEBUG:teuthology.orchestra.run.smithi040:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-06-22T10:37:21.519 INFO:teuthology.orchestra.run.smithi040.stdout:postinstall scriptlet (using /bin/sh): 2023-06-22T10:37:21.520 INFO:teuthology.orchestra.run.smithi040.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.4.0-rc5-g1c622d92b6f1 -a -r /boot/System.map-6.4.0-rc5-g1c622d92b6f1 ]; then 2023-06-22T10:37:21.520 INFO:teuthology.orchestra.run.smithi040.stdout:cp /boot/vmlinuz-6.4.0-rc5-g1c622d92b6f1 /boot/.vmlinuz-6.4.0-rc5-g1c622d92b6f1-rpm 2023-06-22T10:37:21.520 INFO:teuthology.orchestra.run.smithi040.stdout:cp /boot/System.map-6.4.0-rc5-g1c622d92b6f1 /boot/.System.map-6.4.0-rc5-g1c622d92b6f1-rpm 2023-06-22T10:37:21.520 INFO:teuthology.orchestra.run.smithi040.stdout:rm -f /boot/vmlinuz-6.4.0-rc5-g1c622d92b6f1 /boot/System.map-6.4.0-rc5-g1c622d92b6f1 2023-06-22T10:37:21.521 INFO:teuthology.orchestra.run.smithi040.stdout:/sbin/installkernel 6.4.0-rc5-g1c622d92b6f1 /boot/.vmlinuz-6.4.0-rc5-g1c622d92b6f1-rpm /boot/.System.map-6.4.0-rc5-g1c622d92b6f1-rpm 2023-06-22T10:37:21.521 INFO:teuthology.orchestra.run.smithi040.stdout:rm -f /boot/.vmlinuz-6.4.0-rc5-g1c622d92b6f1-rpm /boot/.System.map-6.4.0-rc5-g1c622d92b6f1-rpm 2023-06-22T10:37:21.521 INFO:teuthology.orchestra.run.smithi040.stdout:fi 2023-06-22T10:37:21.521 INFO:teuthology.orchestra.run.smithi040.stdout:preuninstall scriptlet (using /bin/sh): 2023-06-22T10:37:21.521 INFO:teuthology.orchestra.run.smithi040.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-06-22T10:37:21.522 INFO:teuthology.orchestra.run.smithi040.stdout:new-kernel-pkg --remove 6.4.0-rc5-g1c622d92b6f1 --rminitrd --initrdfile=/boot/initramfs-6.4.0-rc5-g1c622d92b6f1.img 2023-06-22T10:37:21.522 INFO:teuthology.orchestra.run.smithi040.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-06-22T10:37:21.522 INFO:teuthology.orchestra.run.smithi040.stdout:kernel-install remove 6.4.0-rc5-g1c622d92b6f1 2023-06-22T10:37:21.522 INFO:teuthology.orchestra.run.smithi040.stdout:fi 2023-06-22T10:37:21.523 INFO:teuthology.orchestra.run.smithi040.stdout:postuninstall scriptlet (using /bin/sh): 2023-06-22T10:37:21.523 INFO:teuthology.orchestra.run.smithi040.stdout:if [ -x /sbin/update-bootloader ]; then 2023-06-22T10:37:21.523 INFO:teuthology.orchestra.run.smithi040.stdout:/sbin/update-bootloader --remove 6.4.0-rc5-g1c622d92b6f1 2023-06-22T10:37:21.523 INFO:teuthology.orchestra.run.smithi040.stdout:fi 2023-06-22T10:37:21.524 DEBUG:teuthology.orchestra.run.smithi040:> sudo rpm -qi grub2-tools 2023-06-22T10:37:21.604 INFO:teuthology.orchestra.run.smithi040.stdout:Name : grub2-tools 2023-06-22T10:37:21.604 INFO:teuthology.orchestra.run.smithi040.stdout:Epoch : 1 2023-06-22T10:37:21.604 INFO:teuthology.orchestra.run.smithi040.stdout:Version : 2.02 2023-06-22T10:37:21.604 INFO:teuthology.orchestra.run.smithi040.stdout:Release : 129.el8 2023-06-22T10:37:21.605 INFO:teuthology.orchestra.run.smithi040.stdout:Architecture: x86_64 2023-06-22T10:37:21.605 INFO:teuthology.orchestra.run.smithi040.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-06-22T10:37:21.605 INFO:teuthology.orchestra.run.smithi040.stdout:Group : System Environment/Base 2023-06-22T10:37:21.605 INFO:teuthology.orchestra.run.smithi040.stdout:Size : 9265586 2023-06-22T10:37:21.605 INFO:teuthology.orchestra.run.smithi040.stdout:License : GPLv3+ 2023-06-22T10:37:21.605 INFO:teuthology.orchestra.run.smithi040.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-06-22T10:37:21.605 INFO:teuthology.orchestra.run.smithi040.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-06-22T10:37:21.605 INFO:teuthology.orchestra.run.smithi040.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-06-22T10:37:21.606 INFO:teuthology.orchestra.run.smithi040.stdout:Build Host : kbuilder.bsys.centos.org 2023-06-22T10:37:21.606 INFO:teuthology.orchestra.run.smithi040.stdout:Relocations : (not relocatable) 2023-06-22T10:37:21.606 INFO:teuthology.orchestra.run.smithi040.stdout:Packager : CentOS BuildSystem 2023-06-22T10:37:21.606 INFO:teuthology.orchestra.run.smithi040.stdout:Vendor : CentOS 2023-06-22T10:37:21.606 INFO:teuthology.orchestra.run.smithi040.stdout:URL : http://www.gnu.org/software/grub/ 2023-06-22T10:37:21.606 INFO:teuthology.orchestra.run.smithi040.stdout:Summary : Support tools for GRUB. 2023-06-22T10:37:21.606 INFO:teuthology.orchestra.run.smithi040.stdout:Description : 2023-06-22T10:37:21.606 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:37:21.607 INFO:teuthology.orchestra.run.smithi040.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-06-22T10:37:21.607 INFO:teuthology.orchestra.run.smithi040.stdout:customizable bootloader with modular architecture. It supports a rich 2023-06-22T10:37:21.607 INFO:teuthology.orchestra.run.smithi040.stdout:variety of kernel formats, file systems, computer architectures and 2023-06-22T10:37:21.607 INFO:teuthology.orchestra.run.smithi040.stdout:hardware devices. 2023-06-22T10:37:21.607 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:37:21.607 INFO:teuthology.orchestra.run.smithi040.stdout:This subpackage provides tools for support of all platforms. 2023-06-22T10:37:21.608 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-06-22T10:37:21.608 INFO:teuthology.task.kernel:Updating grub on smithi040 to boot 6.4.0-rc5-g1c622d92b6f1 2023-06-22T10:37:21.609 DEBUG:teuthology.orchestra.run.smithi040:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-06-22T10:37:26.038 INFO:teuthology.orchestra.run.smithi040.stderr:Generating grub configuration file ... 2023-06-22T10:37:28.597 INFO:teuthology.orchestra.run.smithi040.stderr:done 2023-06-22T10:37:28.598 DEBUG:teuthology.orchestra.run.smithi040:> mktemp 2023-06-22T10:37:28.626 INFO:teuthology.orchestra.run.smithi040.stdout:/tmp/tmp.8RAA27ikoT 2023-06-22T10:37:28.626 DEBUG:teuthology.orchestra.run.smithi040:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.8RAA27ikoT 2023-06-22T10:37:28.700 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0666 /tmp/tmp.8RAA27ikoT 2023-06-22T10:37:28.860 DEBUG:teuthology.orchestra.remote:smithi040:/tmp/tmp.8RAA27ikoT is 6KB 2023-06-22T10:37:28.909 DEBUG:teuthology.orchestra.run.smithi040:> rm -fr /tmp/tmp.8RAA27ikoT 2023-06-22T10:37:28.928 DEBUG:teuthology.orchestra.run.smithi040:> sudo /bin/ls /boot/loader/entries || true 2023-06-22T10:37:29.010 INFO:teuthology.orchestra.run.smithi040.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-06-22T10:37:29.010 INFO:teuthology.orchestra.run.smithi040.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-06-22T10:37:29.011 INFO:teuthology.orchestra.run.smithi040.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-06-22T10:37:29.011 INFO:teuthology.orchestra.run.smithi040.stdout:a1b29d6c289747bdb22930598d39874a-6.4.0-rc5-g1c622d92b6f1.conf 2023-06-22T10:37:29.011 DEBUG:teuthology.orchestra.run.smithi040:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.4.0-rc5-g1c622d92b6f1 2023-06-22T10:37:29.122 DEBUG:teuthology.orchestra.run.smithi040:> sudo shutdown -r now 2023-06-22T10:37:59.126 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-06-22T10:37:59.126 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-06-22T10:37:59.128 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T10:38:59.130 DEBUG:teuthology.orchestra.remote:timed out 2023-06-22T10:39:29.132 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-06-22T10:39:29.133 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T10:39:29.419 DEBUG:teuthology.orchestra.run.smithi040:> true 2023-06-22T10:39:29.822 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-06-22T10:39:29.822 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.4.0-rc5-g1c622d92b6f1"... 2023-06-22T10:39:29.822 DEBUG:teuthology.orchestra.run.smithi040:> uname -r 2023-06-22T10:39:29.867 INFO:teuthology.orchestra.run.smithi040.stdout:6.4.0-rc5-g1c622d92b6f1 2023-06-22T10:39:29.868 DEBUG:teuthology.task.kernel:current kernel version is 6.4.0-rc5-g1c622d92b6f1 vs 6.4.0-rc5-g1c622d92b6f1 2023-06-22T10:39:29.868 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-06-22T10:39:29.868 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-06-22T10:39:30.870 DEBUG:teuthology.parallel:result is None 2023-06-22T10:39:30.870 INFO:teuthology.run_tasks:Running task internal.base... 2023-06-22T10:39:30.878 INFO:teuthology.task.internal:Creating test directory... 2023-06-22T10:39:30.879 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-06-22T10:39:30.884 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-06-22T10:39:30.934 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-06-22T10:39:30.942 INFO:teuthology.run_tasks:Running task internal.archive... 2023-06-22T10:39:30.954 INFO:teuthology.task.internal:Creating archive directory... 2023-06-22T10:39:30.955 DEBUG:teuthology.orchestra.run.smithi040:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-06-22T10:39:30.960 DEBUG:teuthology.orchestra.run.smithi045:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-06-22T10:39:31.058 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-06-22T10:39:31.068 INFO:teuthology.task.internal:Enabling coredump saving... 2023-06-22T10:39:31.069 DEBUG:teuthology.orchestra.run.smithi040:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-06-22T10:39:31.074 DEBUG:teuthology.orchestra.run.smithi045:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-06-22T10:39:31.199 INFO:teuthology.orchestra.run.smithi040.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-22T10:39:31.228 INFO:teuthology.orchestra.run.smithi045.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-22T10:39:31.258 INFO:teuthology.orchestra.run.smithi040.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-22T10:39:31.261 INFO:teuthology.orchestra.run.smithi045.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-22T10:39:31.265 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-06-22T10:39:31.273 INFO:teuthology.task.internal:Configuring sudo... 2023-06-22T10:39:31.273 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-06-22T10:39:31.277 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-06-22T10:39:31.348 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-06-22T10:39:31.357 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-06-22T10:39:31.358 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-06-22T10:39:31.363 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-06-22T10:39:31.407 DEBUG:teuthology.orchestra.run.smithi040:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-22T10:39:31.520 DEBUG:teuthology.orchestra.run.smithi040:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-22T10:39:31.590 DEBUG:teuthology.orchestra.run.smithi040:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-22T10:39:31.666 DEBUG:teuthology.orchestra.run.smithi040:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-22T10:39:31.736 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-06-22T10:39:31.737 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-06-22T10:39:31.807 DEBUG:teuthology.orchestra.run.smithi045:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-22T10:39:31.886 DEBUG:teuthology.orchestra.run.smithi045:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-22T10:39:31.966 DEBUG:teuthology.orchestra.run.smithi045:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-22T10:39:32.043 DEBUG:teuthology.orchestra.run.smithi045:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-22T10:39:32.112 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-06-22T10:39:32.112 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-06-22T10:39:32.185 DEBUG:teuthology.orchestra.run.smithi040:> sudo service rsyslog restart 2023-06-22T10:39:32.189 DEBUG:teuthology.orchestra.run.smithi045:> sudo service rsyslog restart 2023-06-22T10:39:32.312 INFO:teuthology.orchestra.run.smithi040.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-06-22T10:39:32.358 INFO:teuthology.orchestra.run.smithi045.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-06-22T10:39:32.708 INFO:teuthology.run_tasks:Running task internal.timer... 2023-06-22T10:39:32.717 INFO:teuthology.task.internal:Starting timer... 2023-06-22T10:39:32.717 INFO:teuthology.run_tasks:Running task pcp... 2023-06-22T10:39:32.735 INFO:teuthology.run_tasks:Running task selinux... 2023-06-22T10:39:32.744 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-06-22T10:39:32.745 DEBUG:teuthology.orchestra.run.smithi040:> sudo service auditd rotate 2023-06-22T10:39:32.878 INFO:teuthology.orchestra.run.smithi040.stdout:Rotating logs: 2023-06-22T10:39:32.881 DEBUG:teuthology.orchestra.run.smithi045:> sudo service auditd rotate 2023-06-22T10:39:32.985 INFO:teuthology.orchestra.run.smithi045.stdout:Rotating logs: 2023-06-22T10:39:32.988 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-06-22T10:39:32.988 DEBUG:teuthology.orchestra.run.smithi040:> /usr/sbin/getenforce 2023-06-22T10:39:33.038 INFO:teuthology.orchestra.run.smithi040.stdout:Permissive 2023-06-22T10:39:33.038 DEBUG:teuthology.orchestra.run.smithi045:> /usr/sbin/getenforce 2023-06-22T10:39:33.086 INFO:teuthology.orchestra.run.smithi045.stdout:Permissive 2023-06-22T10:39:33.087 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi040.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi045.front.sepia.ceph.com': 'permissive'} 2023-06-22T10:39:33.087 DEBUG:teuthology.orchestra.run.smithi040:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-06-22T10:39:33.159 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-22T10:39:33.159 DEBUG:teuthology.orchestra.run.smithi045:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-06-22T10:39:33.230 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-22T10:39:33.231 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-06-22T10:39:33.231 DEBUG:teuthology.orchestra.run.smithi040:> sudo /usr/sbin/setenforce permissive 2023-06-22T10:39:33.299 DEBUG:teuthology.orchestra.run.smithi045:> sudo /usr/sbin/setenforce permissive 2023-06-22T10:39:33.367 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-06-22T10:39:33.383 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-06-22T10:39:33.390 INFO:teuthology.repo_utils:Fetching main from origin 2023-06-22T10:39:33.525 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-06-22T10:39:33.545 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-06-22T10:39:33.546 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi040.front.sepia.ceph.com,smithi045.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-06-22T10:49:30.427 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi040.front.sepia.ceph.com'), Remote(name='ubuntu@smithi045.front.sepia.ceph.com')] 2023-06-22T10:49:30.428 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-06-22T10:49:30.430 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T10:49:30.521 DEBUG:teuthology.orchestra.run.smithi040:> true 2023-06-22T10:49:30.643 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-06-22T10:49:30.644 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-22T10:49:30.731 DEBUG:teuthology.orchestra.run.smithi045:> true 2023-06-22T10:49:30.854 INFO:teuthology.run_tasks:Running task clock... 2023-06-22T10:49:30.866 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-06-22T10:49:30.866 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-06-22T10:49:30.867 DEBUG:teuthology.orchestra.run.smithi040:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-06-22T10:49:30.872 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-06-22T10:49:30.872 DEBUG:teuthology.orchestra.run.smithi045:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-06-22T10:49:30.946 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-06-22T10:49:30.969 INFO:teuthology.orchestra.run.smithi045.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-06-22T10:49:30.980 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-06-22T10:49:31.002 INFO:teuthology.orchestra.run.smithi045.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-06-22T10:49:31.070 INFO:teuthology.orchestra.run.smithi040.stderr:sudo: ntpd: command not found 2023-06-22T10:49:31.095 INFO:teuthology.orchestra.run.smithi045.stderr:sudo: ntpd: command not found 2023-06-22T10:49:31.098 INFO:teuthology.orchestra.run.smithi040.stdout:506 Cannot talk to daemon 2023-06-22T10:49:31.124 INFO:teuthology.orchestra.run.smithi045.stdout:506 Cannot talk to daemon 2023-06-22T10:49:31.132 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-06-22T10:49:31.157 INFO:teuthology.orchestra.run.smithi045.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-06-22T10:49:31.165 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-06-22T10:49:31.190 INFO:teuthology.orchestra.run.smithi045.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-06-22T10:49:31.271 INFO:teuthology.orchestra.run.smithi040.stderr:bash: ntpq: command not found 2023-06-22T10:49:31.278 INFO:teuthology.orchestra.run.smithi045.stderr:bash: ntpq: command not found 2023-06-22T10:49:31.279 INFO:teuthology.orchestra.run.smithi040.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-06-22T10:49:31.279 INFO:teuthology.orchestra.run.smithi040.stdout:=============================================================================== 2023-06-22T10:49:31.279 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-22T10:49:31.279 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-22T10:49:31.280 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-22T10:49:31.280 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-22T10:49:31.286 INFO:teuthology.orchestra.run.smithi045.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-06-22T10:49:31.286 INFO:teuthology.orchestra.run.smithi045.stdout:=============================================================================== 2023-06-22T10:49:31.286 INFO:teuthology.orchestra.run.smithi045.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-22T10:49:31.286 INFO:teuthology.orchestra.run.smithi045.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-22T10:49:31.287 INFO:teuthology.orchestra.run.smithi045.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-22T10:49:31.287 INFO:teuthology.orchestra.run.smithi045.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-06-22T10:49:31.287 INFO:teuthology.run_tasks:Running task install... 2023-06-22T10:49:31.298 DEBUG:teuthology.task.install:project ceph 2023-06-22T10:49:31.299 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '2016e3af238feea2bbee7eb0e99c925a041afbfb'}} 2023-06-22T10:49:31.299 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2016e3af238feea2bbee7eb0e99c925a041afbfb'} 2023-06-22T10:49:31.299 INFO:teuthology.task.install:Using flavor: default 2023-06-22T10:49:31.305 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-06-22T10:49:31.305 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-06-22T10:49:31.306 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2016e3af238feea2bbee7eb0e99c925a041afbfb', 'tag': None, 'wait_for_package': False} 2023-06-22T10:49:31.306 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=2016e3af238feea2bbee7eb0e99c925a041afbfb 2023-06-22T10:49:31.308 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2016e3af238feea2bbee7eb0e99c925a041afbfb', 'tag': None, 'wait_for_package': False} 2023-06-22T10:49:31.309 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=2016e3af238feea2bbee7eb0e99c925a041afbfb 2023-06-22T10:49:31.449 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230620.052303/2016e3af238feea2bbee7eb0e99c925a041afbfb/centos/8/flavors/default/ 2023-06-22T10:49:31.449 INFO:teuthology.task.install.rpm:Package version is 18.0.0-4512.g2016e3af 2023-06-22T10:49:31.455 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230620.052303/2016e3af238feea2bbee7eb0e99c925a041afbfb/centos/8/flavors/default/ 2023-06-22T10:49:31.455 INFO:teuthology.task.install.rpm:Package version is 18.0.0-4512.g2016e3af 2023-06-22T10:49:31.626 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230620.052303/2016e3af238feea2bbee7eb0e99c925a041afbfb/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230620.052303/2016e3af238feea2bbee7eb0e99c925a041afbfb/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230620.052303/2016e3af238feea2bbee7eb0e99c925a041afbfb/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-06-22T10:49:31.627 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-06-22T10:49:31.627 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-06-22T10:49:31.630 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230620.052303/2016e3af238feea2bbee7eb0e99c925a041afbfb/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230620.052303/2016e3af238feea2bbee7eb0e99c925a041afbfb/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230620.052303/2016e3af238feea2bbee7eb0e99c925a041afbfb/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-06-22T10:49:31.630 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-06-22T10:49:31.631 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-06-22T10:49:31.703 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-06-22T10:49:31.703 DEBUG:teuthology.orchestra.run.smithi040:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2016e3af238feea2bbee7eb0e99c925a041afbfb/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-06-22T10:49:31.705 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-06-22T10:49:31.705 DEBUG:teuthology.orchestra.run.smithi045:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2016e3af238feea2bbee7eb0e99c925a041afbfb/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-06-22T10:49:31.814 DEBUG:teuthology.orchestra.run.smithi040:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-06-22T10:49:31.816 DEBUG:teuthology.orchestra.run.smithi045:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-06-22T10:49:31.910 DEBUG:teuthology.orchestra.run.smithi040:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-06-22T10:49:31.911 DEBUG:teuthology.orchestra.run.smithi045:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-06-22T10:49:31.980 INFO:teuthology.orchestra.run.smithi045.stdout:check_obsoletes = 1 2023-06-22T10:49:31.980 INFO:teuthology.orchestra.run.smithi040.stdout:check_obsoletes = 1 2023-06-22T10:49:31.983 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum clean all 2023-06-22T10:49:31.984 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum clean all 2023-06-22T10:49:32.337 INFO:teuthology.orchestra.run.smithi040.stdout:67 files removed 2023-06-22T10:49:32.351 INFO:teuthology.orchestra.run.smithi045.stdout:67 files removed 2023-06-22T10:49:32.373 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-06-22T10:49:32.390 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-06-22T10:49:33.334 INFO:teuthology.orchestra.run.smithi045.stdout:ceph packages for x86_64 217 kB/s | 81 kB 00:00 2023-06-22T10:49:33.348 INFO:teuthology.orchestra.run.smithi040.stdout:ceph packages for x86_64 202 kB/s | 81 kB 00:00 2023-06-22T10:49:33.643 INFO:teuthology.orchestra.run.smithi045.stdout:ceph noarch packages 35 kB/s | 9.4 kB 00:00 2023-06-22T10:49:33.757 INFO:teuthology.orchestra.run.smithi040.stdout:ceph noarch packages 26 kB/s | 9.4 kB 00:00 2023-06-22T10:49:33.944 INFO:teuthology.orchestra.run.smithi045.stdout:ceph source packages 5.5 kB/s | 1.5 kB 00:00 2023-06-22T10:49:34.058 INFO:teuthology.orchestra.run.smithi040.stdout:ceph source packages 5.5 kB/s | 1.5 kB 00:00 2023-06-22T10:49:39.732 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 8 - AppStream 5.3 MB/s | 30 MB 00:05 2023-06-22T10:49:40.285 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 8 - AppStream 4.7 MB/s | 30 MB 00:06 2023-06-22T10:49:47.283 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 8 - BaseOS 28 MB/s | 39 MB 00:01 2023-06-22T10:49:47.743 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 8 - BaseOS 26 MB/s | 39 MB 00:01 2023-06-22T10:49:54.233 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 8 - Extras 40 kB/s | 18 kB 00:00 2023-06-22T10:49:54.469 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 8 - Extras 41 kB/s | 18 kB 00:00 2023-06-22T10:49:54.634 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 8 - Extras common packages 30 kB/s | 6.6 kB 00:00 2023-06-22T10:49:54.861 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 8 - Extras common packages 31 kB/s | 6.6 kB 00:00 2023-06-22T10:49:56.443 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 8 - PowerTools 3.6 MB/s | 6.0 MB 00:01 2023-06-22T10:49:58.337 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 8 - PowerTools 1.8 MB/s | 6.0 MB 00:03 2023-06-22T10:50:00.203 INFO:teuthology.orchestra.run.smithi040.stdout:Copr repo for python3-asyncssh owned by ceph 1.5 kB/s | 3.5 kB 00:02 2023-06-22T10:50:01.504 INFO:teuthology.orchestra.run.smithi040.stdout:Extra Packages for Enterprise Linux 14 MB/s | 16 MB 00:01 2023-06-22T10:50:01.522 INFO:teuthology.orchestra.run.smithi045.stdout:Copr repo for python3-asyncssh owned by ceph 1.9 kB/s | 3.5 kB 00:01 2023-06-22T10:50:06.112 INFO:teuthology.orchestra.run.smithi040.stdout:lab-extras 405 kB/s | 24 kB 00:00 2023-06-22T10:50:10.211 INFO:teuthology.orchestra.run.smithi040.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-06-22T10:50:10.212 INFO:teuthology.orchestra.run.smithi040.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-06-22T10:50:10.225 INFO:teuthology.orchestra.run.smithi040.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-06-22T10:50:10.226 INFO:teuthology.orchestra.run.smithi040.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-06-22T10:50:10.226 INFO:teuthology.orchestra.run.smithi040.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-06-22T10:50:10.227 INFO:teuthology.orchestra.run.smithi040.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-06-22T10:50:10.228 INFO:teuthology.orchestra.run.smithi040.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-06-22T10:50:10.231 INFO:teuthology.orchestra.run.smithi040.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-06-22T10:50:10.233 INFO:teuthology.orchestra.run.smithi040.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-06-22T10:50:10.235 INFO:teuthology.orchestra.run.smithi040.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-06-22T10:50:10.435 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2023-06-22T10:50:10.450 INFO:teuthology.orchestra.run.smithi040.stdout:==================================================================================================== 2023-06-22T10:50:10.450 INFO:teuthology.orchestra.run.smithi040.stdout: Package Arch Version Repository Size 2023-06-22T10:50:10.450 INFO:teuthology.orchestra.run.smithi040.stdout:==================================================================================================== 2023-06-22T10:50:10.450 INFO:teuthology.orchestra.run.smithi040.stdout:Installing: 2023-06-22T10:50:10.451 INFO:teuthology.orchestra.run.smithi040.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-06-22T10:50:10.451 INFO:teuthology.orchestra.run.smithi040.stdout: ceph x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 6.4 k 2023-06-22T10:50:10.451 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-base x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 5.4 M 2023-06-22T10:50:10.452 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-fuse x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 848 k 2023-06-22T10:50:10.452 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 165 k 2023-06-22T10:50:10.452 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 1.5 M 2023-06-22T10:50:10.453 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-cephadm noarch 2:18.0.0-4512.g2016e3af.el8 ceph-noarch 128 k 2023-06-22T10:50:10.453 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-dashboard noarch 2:18.0.0-4512.g2016e3af.el8 ceph-noarch 1.7 M 2023-06-22T10:50:10.453 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-4512.g2016e3af.el8 ceph-noarch 7.4 M 2023-06-22T10:50:10.453 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-rook noarch 2:18.0.0-4512.g2016e3af.el8 ceph-noarch 47 k 2023-06-22T10:50:10.454 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-radosgw x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 13 M 2023-06-22T10:50:10.454 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-test x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 48 M 2023-06-22T10:50:10.454 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-volume noarch 2:18.0.0-4512.g2016e3af.el8 ceph-noarch 258 k 2023-06-22T10:50:10.454 INFO:teuthology.orchestra.run.smithi040.stdout: cephadm noarch 2:18.0.0-4512.g2016e3af.el8 ceph-noarch 164 k 2023-06-22T10:50:10.455 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-mirror x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 258 k 2023-06-22T10:50:10.455 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-top noarch 2:18.0.0-4512.g2016e3af.el8 ceph-noarch 18 k 2023-06-22T10:50:10.455 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-libelf-devel x86_64 0.189-2.el8 baseos 61 k 2023-06-22T10:50:10.456 INFO:teuthology.orchestra.run.smithi040.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-06-22T10:50:10.456 INFO:teuthology.orchestra.run.smithi040.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-06-22T10:50:10.456 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs-devel x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 31 k 2023-06-22T10:50:10.457 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs2 x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 771 k 2023-06-22T10:50:10.457 INFO:teuthology.orchestra.run.smithi040.stdout: librados-devel x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 139 k 2023-06-22T10:50:10.457 INFO:teuthology.orchestra.run.smithi040.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-06-22T10:50:10.458 INFO:teuthology.orchestra.run.smithi040.stdout: libuuid-devel x86_64 2.32.1-42.el8 baseos 99 k 2023-06-22T10:50:10.458 INFO:teuthology.orchestra.run.smithi040.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-06-22T10:50:10.458 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql x86_64 10.23-1.module_el8+300+2c53004c appstream 1.6 M 2023-06-22T10:50:10.458 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-contrib x86_64 10.23-1.module_el8+300+2c53004c appstream 903 k 2023-06-22T10:50:10.459 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-server x86_64 10.23-1.module_el8+300+2c53004c appstream 5.1 M 2023-06-22T10:50:10.459 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cephfs x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 197 k 2023-06-22T10:50:10.459 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rados x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 371 k 2023-06-22T10:50:10.459 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rbd x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 364 k 2023-06-22T10:50:10.459 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rgw x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 106 k 2023-06-22T10:50:10.460 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-fuse x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 94 k 2023-06-22T10:50:10.460 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-mirror x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 3.4 M 2023-06-22T10:50:10.460 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-nbd x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 180 k 2023-06-22T10:50:10.460 INFO:teuthology.orchestra.run.smithi040.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2023-06-22T10:50:10.461 INFO:teuthology.orchestra.run.smithi040.stdout:Upgrading: 2023-06-22T10:50:10.461 INFO:teuthology.orchestra.run.smithi040.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-7.el8 baseos 143 k 2023-06-22T10:50:10.461 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-debuginfod-client x86_64 0.189-2.el8 baseos 76 k 2023-06-22T10:50:10.462 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-libelf x86_64 0.189-2.el8 baseos 232 k 2023-06-22T10:50:10.462 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-libs x86_64 0.189-2.el8 baseos 302 k 2023-06-22T10:50:10.462 INFO:teuthology.orchestra.run.smithi040.stdout: iproute x86_64 6.2.0-2.el8 baseos 880 k 2023-06-22T10:50:10.462 INFO:teuthology.orchestra.run.smithi040.stdout: libblkid x86_64 2.32.1-42.el8 baseos 220 k 2023-06-22T10:50:10.462 INFO:teuthology.orchestra.run.smithi040.stdout: libfdisk x86_64 2.32.1-42.el8 baseos 253 k 2023-06-22T10:50:10.462 INFO:teuthology.orchestra.run.smithi040.stdout: libmount x86_64 2.32.1-42.el8 baseos 236 k 2023-06-22T10:50:10.463 INFO:teuthology.orchestra.run.smithi040.stdout: librados2 x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 3.7 M 2023-06-22T10:50:10.463 INFO:teuthology.orchestra.run.smithi040.stdout: librbd1 x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 3.6 M 2023-06-22T10:50:10.463 INFO:teuthology.orchestra.run.smithi040.stdout: libsmartcols x86_64 2.32.1-42.el8 baseos 179 k 2023-06-22T10:50:10.463 INFO:teuthology.orchestra.run.smithi040.stdout: libuuid x86_64 2.32.1-42.el8 baseos 98 k 2023-06-22T10:50:10.463 INFO:teuthology.orchestra.run.smithi040.stdout: util-linux x86_64 2.32.1-42.el8 baseos 2.6 M 2023-06-22T10:50:10.463 INFO:teuthology.orchestra.run.smithi040.stdout: util-linux-user x86_64 2.32.1-42.el8 baseos 102 k 2023-06-22T10:50:10.463 INFO:teuthology.orchestra.run.smithi040.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2023-06-22T10:50:10.463 INFO:teuthology.orchestra.run.smithi040.stdout:Installing dependencies: 2023-06-22T10:50:10.464 INFO:teuthology.orchestra.run.smithi040.stdout: automake noarch 1.16.1-7.el8 appstream 713 k 2023-06-22T10:50:10.464 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-common x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 22 M 2023-06-22T10:50:10.464 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-grafana-dashboards noarch 2:18.0.0-4512.g2016e3af.el8 ceph-noarch 23 k 2023-06-22T10:50:10.464 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mds x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 2.3 M 2023-06-22T10:50:10.464 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-modules-core noarch 2:18.0.0-4512.g2016e3af.el8 ceph-noarch 240 k 2023-06-22T10:50:10.464 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mon x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 4.6 M 2023-06-22T10:50:10.465 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-osd x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 18 M 2023-06-22T10:50:10.465 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-prometheus-alerts noarch 2:18.0.0-4512.g2016e3af.el8 ceph-noarch 15 k 2023-06-22T10:50:10.465 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-selinux x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 24 k 2023-06-22T10:50:10.465 INFO:teuthology.orchestra.run.smithi040.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-06-22T10:50:10.465 INFO:teuthology.orchestra.run.smithi040.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-06-22T10:50:10.466 INFO:teuthology.orchestra.run.smithi040.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-06-22T10:50:10.466 INFO:teuthology.orchestra.run.smithi040.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-06-22T10:50:10.466 INFO:teuthology.orchestra.run.smithi040.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-06-22T10:50:10.466 INFO:teuthology.orchestra.run.smithi040.stdout: libcephsqlite x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 137 k 2023-06-22T10:50:10.466 INFO:teuthology.orchestra.run.smithi040.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-06-22T10:50:10.466 INFO:teuthology.orchestra.run.smithi040.stdout: libgfortran x86_64 8.5.0-19.el8 baseos 645 k 2023-06-22T10:50:10.466 INFO:teuthology.orchestra.run.smithi040.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-06-22T10:50:10.467 INFO:teuthology.orchestra.run.smithi040.stdout: libpq x86_64 13.5-1.el8 appstream 198 k 2023-06-22T10:50:10.467 INFO:teuthology.orchestra.run.smithi040.stdout: libquadmath x86_64 8.5.0-19.el8 baseos 172 k 2023-06-22T10:50:10.467 INFO:teuthology.orchestra.run.smithi040.stdout: librabbitmq x86_64 0.9.0-3.el8 baseos 47 k 2023-06-22T10:50:10.467 INFO:teuthology.orchestra.run.smithi040.stdout: libradosstriper1 x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 473 k 2023-06-22T10:50:10.467 INFO:teuthology.orchestra.run.smithi040.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-06-22T10:50:10.467 INFO:teuthology.orchestra.run.smithi040.stdout: librgw2 x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 6.7 M 2023-06-22T10:50:10.467 INFO:teuthology.orchestra.run.smithi040.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-06-22T10:50:10.467 INFO:teuthology.orchestra.run.smithi040.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-06-22T10:50:10.468 INFO:teuthology.orchestra.run.smithi040.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-06-22T10:50:10.468 INFO:teuthology.orchestra.run.smithi040.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-06-22T10:50:10.468 INFO:teuthology.orchestra.run.smithi040.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-06-22T10:50:10.468 INFO:teuthology.orchestra.run.smithi040.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-06-22T10:50:10.468 INFO:teuthology.orchestra.run.smithi040.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-06-22T10:50:10.468 INFO:teuthology.orchestra.run.smithi040.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-06-22T10:50:10.468 INFO:teuthology.orchestra.run.smithi040.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-06-22T10:50:10.469 INFO:teuthology.orchestra.run.smithi040.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-06-22T10:50:10.469 INFO:teuthology.orchestra.run.smithi040.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-06-22T10:50:10.469 INFO:teuthology.orchestra.run.smithi040.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-06-22T10:50:10.469 INFO:teuthology.orchestra.run.smithi040.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-06-22T10:50:10.469 INFO:teuthology.orchestra.run.smithi040.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-06-22T10:50:10.469 INFO:teuthology.orchestra.run.smithi040.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-06-22T10:50:10.469 INFO:teuthology.orchestra.run.smithi040.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-06-22T10:50:10.470 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-06-22T10:50:10.470 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-argparse x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 45 k 2023-06-22T10:50:10.470 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-common x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 119 k 2023-06-22T10:50:10.470 INFO:teuthology.orchestra.run.smithi040.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-06-22T10:50:10.470 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-06-22T10:50:10.470 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-06-22T10:50:10.470 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-06-22T10:50:10.471 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-06-22T10:50:10.471 INFO:teuthology.orchestra.run.smithi040.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-06-22T10:50:10.471 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-06-22T10:50:10.471 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-06-22T10:50:10.471 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-06-22T10:50:10.471 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-06-22T10:50:10.471 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-06-22T10:50:10.471 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-06-22T10:50:10.472 INFO:teuthology.orchestra.run.smithi040.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-06-22T10:50:10.472 INFO:teuthology.orchestra.run.smithi040.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-06-22T10:50:10.472 INFO:teuthology.orchestra.run.smithi040.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-06-22T10:50:10.472 INFO:teuthology.orchestra.run.smithi040.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-06-22T10:50:10.472 INFO:teuthology.orchestra.run.smithi040.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-06-22T10:50:10.472 INFO:teuthology.orchestra.run.smithi040.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-06-22T10:50:10.472 INFO:teuthology.orchestra.run.smithi040.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-06-22T10:50:10.473 INFO:teuthology.orchestra.run.smithi040.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-06-22T10:50:10.473 INFO:teuthology.orchestra.run.smithi040.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-06-22T10:50:10.473 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-06-22T10:50:10.473 INFO:teuthology.orchestra.run.smithi040.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-06-22T10:50:10.473 INFO:teuthology.orchestra.run.smithi040.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-06-22T10:50:10.473 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-06-22T10:50:10.473 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-06-22T10:50:10.473 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-06-22T10:50:10.474 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-06-22T10:50:10.474 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pytz noarch 2017.2-9.el8 appstream 54 k 2023-06-22T10:50:10.474 INFO:teuthology.orchestra.run.smithi040.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-06-22T10:50:10.474 INFO:teuthology.orchestra.run.smithi040.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-06-22T10:50:10.474 INFO:teuthology.orchestra.run.smithi040.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-06-22T10:50:10.474 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-06-22T10:50:10.474 INFO:teuthology.orchestra.run.smithi040.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-06-22T10:50:10.474 INFO:teuthology.orchestra.run.smithi040.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-06-22T10:50:10.475 INFO:teuthology.orchestra.run.smithi040.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-06-22T10:50:10.475 INFO:teuthology.orchestra.run.smithi040.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-06-22T10:50:10.475 INFO:teuthology.orchestra.run.smithi040.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-06-22T10:50:10.475 INFO:teuthology.orchestra.run.smithi040.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-06-22T10:50:10.475 INFO:teuthology.orchestra.run.smithi040.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-06-22T10:50:10.475 INFO:teuthology.orchestra.run.smithi040.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-06-22T10:50:10.475 INFO:teuthology.orchestra.run.smithi040.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-06-22T10:50:10.476 INFO:teuthology.orchestra.run.smithi040.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-06-22T10:50:10.476 INFO:teuthology.orchestra.run.smithi040.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-06-22T10:50:10.476 INFO:teuthology.orchestra.run.smithi040.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-06-22T10:50:10.476 INFO:teuthology.orchestra.run.smithi040.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-06-22T10:50:10.476 INFO:teuthology.orchestra.run.smithi040.stdout: uuid x86_64 1.6.2-43.el8 appstream 64 k 2023-06-22T10:50:10.476 INFO:teuthology.orchestra.run.smithi040.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-06-22T10:50:10.476 INFO:teuthology.orchestra.run.smithi040.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-06-22T10:50:10.476 INFO:teuthology.orchestra.run.smithi040.stdout:Enabling module streams: 2023-06-22T10:50:10.477 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql 10 2023-06-22T10:50:10.477 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:50:10.477 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction Summary 2023-06-22T10:50:10.477 INFO:teuthology.orchestra.run.smithi040.stdout:==================================================================================================== 2023-06-22T10:50:10.477 INFO:teuthology.orchestra.run.smithi040.stdout:Install 128 Packages 2023-06-22T10:50:10.477 INFO:teuthology.orchestra.run.smithi040.stdout:Upgrade 15 Packages 2023-06-22T10:50:10.477 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:50:10.478 INFO:teuthology.orchestra.run.smithi040.stdout:Total download size: 212 M 2023-06-22T10:50:10.478 INFO:teuthology.orchestra.run.smithi040.stdout:Downloading Packages: 2023-06-22T10:50:12.197 INFO:teuthology.orchestra.run.smithi040.stdout:(1/143): ceph-18.0.0-4512.g2016e3af.el8.x86_64. 49 kB/s | 6.4 kB 00:00 2023-06-22T10:50:12.464 INFO:teuthology.orchestra.run.smithi040.stdout:(2/143): ceph-fuse-18.0.0-4512.g2016e3af.el8.x8 3.1 MB/s | 848 kB 00:00 2023-06-22T10:50:12.531 INFO:teuthology.orchestra.run.smithi040.stdout:(3/143): ceph-immutable-object-cache-18.0.0-451 2.4 MB/s | 165 kB 00:00 2023-06-22T10:50:12.839 INFO:teuthology.orchestra.run.smithi040.stdout:(4/143): ceph-mds-18.0.0-4512.g2016e3af.el8.x86 7.4 MB/s | 2.3 MB 00:00 2023-06-22T10:50:12.998 INFO:teuthology.orchestra.run.smithi040.stdout:(5/143): ceph-mgr-18.0.0-4512.g2016e3af.el8.x86 9.8 MB/s | 1.5 MB 00:00 2023-06-22T10:50:13.323 INFO:teuthology.orchestra.run.smithi040.stdout:(6/143): ceph-mon-18.0.0-4512.g2016e3af.el8.x86 14 MB/s | 4.6 MB 00:00 2023-06-22T10:50:14.282 INFO:teuthology.orchestra.run.smithi040.stdout:(7/143): ceph-osd-18.0.0-4512.g2016e3af.el8.x86 19 MB/s | 18 MB 00:00 2023-06-22T10:50:14.782 INFO:teuthology.orchestra.run.smithi040.stdout:(8/143): ceph-base-18.0.0-4512.g2016e3af.el8.x8 2.0 MB/s | 5.4 MB 00:02 2023-06-22T10:50:14.991 INFO:teuthology.orchestra.run.smithi040.stdout:(9/143): ceph-radosgw-18.0.0-4512.g2016e3af.el8 19 MB/s | 13 MB 00:00 2023-06-22T10:50:15.016 INFO:teuthology.orchestra.run.smithi040.stdout:(10/143): ceph-selinux-18.0.0-4512.g2016e3af.el 104 kB/s | 24 kB 00:00 2023-06-22T10:50:15.166 INFO:teuthology.orchestra.run.smithi040.stdout:(11/143): cephfs-mirror-18.0.0-4512.g2016e3af.e 1.7 MB/s | 258 kB 00:00 2023-06-22T10:50:15.292 INFO:teuthology.orchestra.run.smithi040.stdout:(12/143): libcephfs-devel-18.0.0-4512.g2016e3af 248 kB/s | 31 kB 00:00 2023-06-22T10:50:15.642 INFO:teuthology.orchestra.run.smithi040.stdout:(13/143): libcephfs2-18.0.0-4512.g2016e3af.el8. 2.2 MB/s | 771 kB 00:00 2023-06-22T10:50:15.759 INFO:teuthology.orchestra.run.smithi040.stdout:(14/143): libcephsqlite-18.0.0-4512.g2016e3af.e 1.2 MB/s | 137 kB 00:00 2023-06-22T10:50:16.226 INFO:teuthology.orchestra.run.smithi040.stdout:(15/143): librados-devel-18.0.0-4512.g2016e3af. 298 kB/s | 139 kB 00:00 2023-06-22T10:50:16.476 INFO:teuthology.orchestra.run.smithi040.stdout:(16/143): libradosstriper1-18.0.0-4512.g2016e3a 1.9 MB/s | 473 kB 00:00 2023-06-22T10:50:17.032 INFO:teuthology.orchestra.run.smithi045.stdout:Extra Packages for Enterprise Linux 1.0 MB/s | 16 MB 00:15 2023-06-22T10:50:17.376 INFO:teuthology.orchestra.run.smithi040.stdout:(17/143): ceph-test-18.0.0-4512.g2016e3af.el8.x 20 MB/s | 48 MB 00:02 2023-06-22T10:50:17.435 INFO:teuthology.orchestra.run.smithi040.stdout:(18/143): python3-ceph-argparse-18.0.0-4512.g20 774 kB/s | 45 kB 00:00 2023-06-22T10:50:17.493 INFO:teuthology.orchestra.run.smithi040.stdout:(19/143): python3-ceph-common-18.0.0-4512.g2016 2.0 MB/s | 119 kB 00:00 2023-06-22T10:50:17.544 INFO:teuthology.orchestra.run.smithi040.stdout:(20/143): python3-cephfs-18.0.0-4512.g2016e3af. 3.9 MB/s | 197 kB 00:00 2023-06-22T10:50:17.603 INFO:teuthology.orchestra.run.smithi040.stdout:(21/143): python3-rados-18.0.0-4512.g2016e3af.e 6.2 MB/s | 371 kB 00:00 2023-06-22T10:50:17.661 INFO:teuthology.orchestra.run.smithi040.stdout:(22/143): python3-rbd-18.0.0-4512.g2016e3af.el8 6.1 MB/s | 364 kB 00:00 2023-06-22T10:50:17.711 INFO:teuthology.orchestra.run.smithi040.stdout:(23/143): python3-rgw-18.0.0-4512.g2016e3af.el8 2.1 MB/s | 106 kB 00:00 2023-06-22T10:50:17.762 INFO:teuthology.orchestra.run.smithi040.stdout:(24/143): rbd-fuse-18.0.0-4512.g2016e3af.el8.x8 1.8 MB/s | 94 kB 00:00 2023-06-22T10:50:17.987 INFO:teuthology.orchestra.run.smithi040.stdout:(25/143): rbd-mirror-18.0.0-4512.g2016e3af.el8. 15 MB/s | 3.4 MB 00:00 2023-06-22T10:50:18.054 INFO:teuthology.orchestra.run.smithi040.stdout:(26/143): rbd-nbd-18.0.0-4512.g2016e3af.el8.x86 2.6 MB/s | 180 kB 00:00 2023-06-22T10:50:18.113 INFO:teuthology.orchestra.run.smithi040.stdout:(27/143): ceph-grafana-dashboards-18.0.0-4512.g 398 kB/s | 23 kB 00:00 2023-06-22T10:50:18.163 INFO:teuthology.orchestra.run.smithi040.stdout:(28/143): ceph-mgr-cephadm-18.0.0-4512.g2016e3a 2.5 MB/s | 128 kB 00:00 2023-06-22T10:50:18.297 INFO:teuthology.orchestra.run.smithi040.stdout:(29/143): ceph-mgr-dashboard-18.0.0-4512.g2016e 13 MB/s | 1.7 MB 00:00 2023-06-22T10:50:18.380 INFO:teuthology.orchestra.run.smithi040.stdout:(30/143): librgw2-18.0.0-4512.g2016e3af.el8.x86 3.5 MB/s | 6.7 MB 00:01 2023-06-22T10:50:18.506 INFO:teuthology.orchestra.run.smithi040.stdout:(31/143): ceph-mgr-modules-core-18.0.0-4512.g20 1.9 MB/s | 240 kB 00:00 2023-06-22T10:50:18.614 INFO:teuthology.orchestra.run.smithi040.stdout:(32/143): ceph-mgr-rook-18.0.0-4512.g2016e3af.e 440 kB/s | 47 kB 00:00 2023-06-22T10:50:18.715 INFO:teuthology.orchestra.run.smithi040.stdout:(33/143): ceph-mgr-diskprediction-local-18.0.0- 18 MB/s | 7.4 MB 00:00 2023-06-22T10:50:18.740 INFO:teuthology.orchestra.run.smithi040.stdout:(34/143): ceph-prometheus-alerts-18.0.0-4512.g2 116 kB/s | 15 kB 00:00 2023-06-22T10:50:18.765 INFO:teuthology.orchestra.run.smithi040.stdout:(35/143): ceph-volume-18.0.0-4512.g2016e3af.el8 5.0 MB/s | 258 kB 00:00 2023-06-22T10:50:18.816 INFO:teuthology.orchestra.run.smithi040.stdout:(36/143): cephfs-top-18.0.0-4512.g2016e3af.el8. 361 kB/s | 18 kB 00:00 2023-06-22T10:50:18.841 INFO:teuthology.orchestra.run.smithi040.stdout:(37/143): cephadm-18.0.0-4512.g2016e3af.el8.noa 1.6 MB/s | 164 kB 00:00 2023-06-22T10:50:19.758 INFO:teuthology.orchestra.run.smithi040.stdout:(38/143): ceph-common-18.0.0-4512.g2016e3af.el8 2.9 MB/s | 22 MB 00:07 2023-06-22T10:50:19.792 INFO:teuthology.orchestra.run.smithi040.stdout:(39/143): automake-1.16.1-7.el8.noarch.rpm 732 kB/s | 713 kB 00:00 2023-06-22T10:50:19.825 INFO:teuthology.orchestra.run.smithi040.stdout:(40/143): bison-3.0.4-10.el8.x86_64.rpm 700 kB/s | 688 kB 00:00 2023-06-22T10:50:20.101 INFO:teuthology.orchestra.run.smithi040.stdout:(41/143): jq-1.6-7.el8.x86_64.rpm 737 kB/s | 202 kB 00:00 2023-06-22T10:50:20.126 INFO:teuthology.orchestra.run.smithi040.stdout:(42/143): libpq-13.5-1.el8.x86_64.rpm 659 kB/s | 198 kB 00:00 2023-06-22T10:50:20.326 INFO:teuthology.orchestra.run.smithi040.stdout:(43/143): flex-2.6.1-9.el8.x86_64.rpm 563 kB/s | 320 kB 00:00 2023-06-22T10:50:20.401 INFO:teuthology.orchestra.run.smithi040.stdout:(44/143): librdkafka-0.11.4-3.el8.x86_64.rpm 1.2 MB/s | 354 kB 00:00 2023-06-22T10:50:20.577 INFO:teuthology.orchestra.run.smithi040.stdout:(45/143): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.0 MB/s | 259 kB 00:00 2023-06-22T10:50:20.619 INFO:teuthology.orchestra.run.smithi040.stdout:(46/143): oniguruma-6.8.2-2.el8.x86_64.rpm 864 kB/s | 187 kB 00:00 2023-06-22T10:50:20.736 INFO:teuthology.orchestra.run.smithi040.stdout:(47/143): libtool-2.4.6-25.el8.x86_64.rpm 1.1 MB/s | 709 kB 00:00 2023-06-22T10:50:21.711 INFO:teuthology.orchestra.run.smithi040.stdout:(48/143): postgresql-10.23-1.module_el8+300+2c5 1.6 MB/s | 1.6 MB 00:00 2023-06-22T10:50:21.754 INFO:teuthology.orchestra.run.smithi045.stdout:lab-extras 433 kB/s | 24 kB 00:00 2023-06-22T10:50:22.203 INFO:teuthology.orchestra.run.smithi040.stdout:(49/143): postgresql-contrib-10.23-1.module_el8 1.8 MB/s | 903 kB 00:00 2023-06-22T10:50:22.761 INFO:teuthology.orchestra.run.smithi040.stdout:(50/143): openblas-0.3.15-4.el8.x86_64.rpm 2.2 MB/s | 4.7 MB 00:02 2023-06-22T10:50:22.837 INFO:teuthology.orchestra.run.smithi040.stdout:(51/143): openblas-threads-0.3.15-4.el8.x86_64. 2.2 MB/s | 4.9 MB 00:02 2023-06-22T10:50:23.070 INFO:teuthology.orchestra.run.smithi040.stdout:(52/143): python3-jinja2-2.10.1-3.el8.noarch.rp 2.3 MB/s | 538 kB 00:00 2023-06-22T10:50:23.196 INFO:teuthology.orchestra.run.smithi040.stdout:(53/143): python3-jsonpatch-1.21-2.el8.noarch.r 213 kB/s | 27 kB 00:00 2023-06-22T10:50:23.321 INFO:teuthology.orchestra.run.smithi040.stdout:(54/143): python3-jsonpointer-1.10-11.el8.noarc 159 kB/s | 20 kB 00:00 2023-06-22T10:50:23.455 INFO:teuthology.orchestra.run.smithi040.stdout:(55/143): python3-mako-1.0.6-14.el8.noarch.rpm 1.2 MB/s | 157 kB 00:00 2023-06-22T10:50:23.588 INFO:teuthology.orchestra.run.smithi040.stdout:(56/143): python3-markupsafe-0.23-19.el8.x86_64 292 kB/s | 39 kB 00:00 2023-06-22T10:50:24.047 INFO:teuthology.orchestra.run.smithi040.stdout:(57/143): postgresql-server-10.23-1.module_el8+ 2.8 MB/s | 5.1 MB 00:01 2023-06-22T10:50:24.155 INFO:teuthology.orchestra.run.smithi040.stdout:(58/143): python3-babel-2.5.1-7.el8.noarch.rpm 3.4 MB/s | 4.8 MB 00:01 2023-06-22T10:50:24.181 INFO:teuthology.orchestra.run.smithi040.stdout:(59/143): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.6 MB/s | 225 kB 00:00 2023-06-22T10:50:24.290 INFO:teuthology.orchestra.run.smithi040.stdout:(60/143): python3-prettytable-0.7.2-14.el8.noar 328 kB/s | 44 kB 00:00 2023-06-22T10:50:24.315 INFO:teuthology.orchestra.run.smithi040.stdout:(61/143): python3-pyOpenSSL-19.0.0-1.el8.noarch 774 kB/s | 103 kB 00:00 2023-06-22T10:50:24.424 INFO:teuthology.orchestra.run.smithi040.stdout:(62/143): python3-pyasn1-0.3.7-6.el8.noarch.rpm 947 kB/s | 126 kB 00:00 2023-06-22T10:50:24.449 INFO:teuthology.orchestra.run.smithi040.stdout:(63/143): python3-pyasn1-modules-0.3.7-6.el8.no 823 kB/s | 110 kB 00:00 2023-06-22T10:50:24.549 INFO:teuthology.orchestra.run.smithi040.stdout:(64/143): python3-pytz-2017.2-9.el8.noarch.rpm 433 kB/s | 54 kB 00:00 2023-06-22T10:50:24.741 INFO:teuthology.orchestra.run.smithi040.stdout:(65/143): python3-numpy-1.14.3-10.el8.x86_64.rp 3.2 MB/s | 3.7 MB 00:01 2023-06-22T10:50:24.774 INFO:teuthology.orchestra.run.smithi040.stdout:(66/143): python3-werkzeug-0.12.2-4.el8.noarch. 2.0 MB/s | 457 kB 00:00 2023-06-22T10:50:24.883 INFO:teuthology.orchestra.run.smithi040.stdout:(67/143): socat-1.7.4.1-1.el8.x86_64.rpm 2.2 MB/s | 323 kB 00:00 2023-06-22T10:50:24.908 INFO:teuthology.orchestra.run.smithi040.stdout:(68/143): uuid-1.6.2-43.el8.x86_64.rpm 479 kB/s | 64 kB 00:00 2023-06-22T10:50:25.009 INFO:teuthology.orchestra.run.smithi040.stdout:(69/143): xmlstarlet-1.6.1-20.el8.x86_64.rpm 565 kB/s | 71 kB 00:00 2023-06-22T10:50:25.101 INFO:teuthology.orchestra.run.smithi040.stdout:(70/143): elfutils-libelf-devel-0.189-2.el8.x86 320 kB/s | 61 kB 00:00 2023-06-22T10:50:25.168 INFO:teuthology.orchestra.run.smithi040.stdout:(71/143): keyutils-libs-devel-1.5.10-9.el8.x86_ 721 kB/s | 48 kB 00:00 2023-06-22T10:50:25.201 INFO:teuthology.orchestra.run.smithi040.stdout:(72/143): fuse-2.9.7-17.el8.x86_64.rpm 432 kB/s | 83 kB 00:00 2023-06-22T10:50:25.268 INFO:teuthology.orchestra.run.smithi040.stdout:(73/143): libaio-devel-0.3.112-1.el8.x86_64.rpm 280 kB/s | 19 kB 00:00 2023-06-22T10:50:25.335 INFO:teuthology.orchestra.run.smithi040.stdout:(74/143): libcom_err-devel-1.45.6-5.el8.x86_64. 584 kB/s | 39 kB 00:00 2023-06-22T10:50:25.360 INFO:teuthology.orchestra.run.smithi040.stdout:(75/143): krb5-devel-1.18.2-22.el8.x86_64.rpm 2.9 MB/s | 561 kB 00:00 2023-06-22T10:50:25.427 INFO:teuthology.orchestra.run.smithi040.stdout:(76/143): libquadmath-8.5.0-19.el8.x86_64.rpm 2.5 MB/s | 172 kB 00:00 2023-06-22T10:50:25.495 INFO:teuthology.orchestra.run.smithi040.stdout:(77/143): librabbitmq-0.9.0-3.el8.x86_64.rpm 702 kB/s | 47 kB 00:00 2023-06-22T10:50:25.536 INFO:teuthology.orchestra.run.smithi040.stdout:(78/143): libgfortran-8.5.0-19.el8.x86_64.rpm 3.1 MB/s | 645 kB 00:00 2023-06-22T10:50:25.562 INFO:teuthology.orchestra.run.smithi040.stdout:(79/143): libselinux-devel-2.9-8.el8.x86_64.rpm 2.9 MB/s | 200 kB 00:00 2023-06-22T10:50:25.604 INFO:teuthology.orchestra.run.smithi040.stdout:(80/143): libsepol-devel-2.9-3.el8.x86_64.rpm 1.3 MB/s | 87 kB 00:00 2023-06-22T10:50:25.754 INFO:teuthology.orchestra.run.smithi040.stdout:(81/143): libuuid-devel-2.32.1-42.el8.x86_64.rp 518 kB/s | 99 kB 00:00 2023-06-22T10:50:25.780 INFO:teuthology.orchestra.run.smithi040.stdout:(82/143): libverto-devel-0.3.2-2.el8.x86_64.rpm 103 kB/s | 18 kB 00:00 2023-06-22T10:50:25.821 INFO:teuthology.orchestra.run.smithi040.stdout:(83/143): libzstd-devel-1.4.4-1.el8.x86_64.rpm 656 kB/s | 44 kB 00:00 2023-06-22T10:50:25.887 INFO:teuthology.orchestra.run.smithi045.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-06-22T10:50:25.888 INFO:teuthology.orchestra.run.smithi045.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-06-22T10:50:25.902 INFO:teuthology.orchestra.run.smithi045.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-06-22T10:50:25.902 INFO:teuthology.orchestra.run.smithi045.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-06-22T10:50:25.903 INFO:teuthology.orchestra.run.smithi045.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-06-22T10:50:25.904 INFO:teuthology.orchestra.run.smithi045.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-06-22T10:50:25.905 INFO:teuthology.orchestra.run.smithi045.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-06-22T10:50:25.907 INFO:teuthology.orchestra.run.smithi045.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-06-22T10:50:25.910 INFO:teuthology.orchestra.run.smithi045.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-06-22T10:50:25.911 INFO:teuthology.orchestra.run.smithi045.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-06-22T10:50:25.922 INFO:teuthology.orchestra.run.smithi040.stdout:(84/143): pcre2-devel-10.32-3.el8.x86_64.rpm 5.9 MB/s | 605 kB 00:00 2023-06-22T10:50:25.980 INFO:teuthology.orchestra.run.smithi040.stdout:(85/143): openssl-devel-1.1.1k-9.el8.x86_64.rpm 16 MB/s | 3.2 MB 00:00 2023-06-22T10:50:25.997 INFO:teuthology.orchestra.run.smithi040.stdout:(86/143): pcre2-utf16-10.32-3.el8.x86_64.rpm 3.0 MB/s | 229 kB 00:00 2023-06-22T10:50:26.056 INFO:teuthology.orchestra.run.smithi040.stdout:(87/143): pcre2-utf32-10.32-3.el8.x86_64.rpm 2.9 MB/s | 220 kB 00:00 2023-06-22T10:50:26.115 INFO:teuthology.orchestra.run.smithi040.stdout:(88/143): python3-cffi-1.11.5-6.el8.x86_64.rpm 2.1 MB/s | 249 kB 00:00 2023-06-22T10:50:26.116 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2023-06-22T10:50:26.131 INFO:teuthology.orchestra.run.smithi045.stdout:==================================================================================================== 2023-06-22T10:50:26.132 INFO:teuthology.orchestra.run.smithi045.stdout: Package Arch Version Repository Size 2023-06-22T10:50:26.132 INFO:teuthology.orchestra.run.smithi045.stdout:==================================================================================================== 2023-06-22T10:50:26.132 INFO:teuthology.orchestra.run.smithi045.stdout:Installing: 2023-06-22T10:50:26.132 INFO:teuthology.orchestra.run.smithi045.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-06-22T10:50:26.132 INFO:teuthology.orchestra.run.smithi045.stdout: ceph x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 6.4 k 2023-06-22T10:50:26.132 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-base x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 5.4 M 2023-06-22T10:50:26.133 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-fuse x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 848 k 2023-06-22T10:50:26.133 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 165 k 2023-06-22T10:50:26.133 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 1.5 M 2023-06-22T10:50:26.133 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-cephadm noarch 2:18.0.0-4512.g2016e3af.el8 ceph-noarch 128 k 2023-06-22T10:50:26.133 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-dashboard noarch 2:18.0.0-4512.g2016e3af.el8 ceph-noarch 1.7 M 2023-06-22T10:50:26.133 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-4512.g2016e3af.el8 ceph-noarch 7.4 M 2023-06-22T10:50:26.133 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-rook noarch 2:18.0.0-4512.g2016e3af.el8 ceph-noarch 47 k 2023-06-22T10:50:26.134 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-radosgw x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 13 M 2023-06-22T10:50:26.134 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-test x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 48 M 2023-06-22T10:50:26.134 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-volume noarch 2:18.0.0-4512.g2016e3af.el8 ceph-noarch 258 k 2023-06-22T10:50:26.134 INFO:teuthology.orchestra.run.smithi045.stdout: cephadm noarch 2:18.0.0-4512.g2016e3af.el8 ceph-noarch 164 k 2023-06-22T10:50:26.134 INFO:teuthology.orchestra.run.smithi045.stdout: cephfs-mirror x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 258 k 2023-06-22T10:50:26.134 INFO:teuthology.orchestra.run.smithi045.stdout: cephfs-top noarch 2:18.0.0-4512.g2016e3af.el8 ceph-noarch 18 k 2023-06-22T10:50:26.134 INFO:teuthology.orchestra.run.smithi045.stdout: elfutils-libelf-devel x86_64 0.189-2.el8 baseos 61 k 2023-06-22T10:50:26.134 INFO:teuthology.orchestra.run.smithi045.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-06-22T10:50:26.135 INFO:teuthology.orchestra.run.smithi045.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-06-22T10:50:26.135 INFO:teuthology.orchestra.run.smithi045.stdout: libcephfs-devel x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 31 k 2023-06-22T10:50:26.135 INFO:teuthology.orchestra.run.smithi045.stdout: libcephfs2 x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 771 k 2023-06-22T10:50:26.135 INFO:teuthology.orchestra.run.smithi045.stdout: librados-devel x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 139 k 2023-06-22T10:50:26.135 INFO:teuthology.orchestra.run.smithi045.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-06-22T10:50:26.135 INFO:teuthology.orchestra.run.smithi045.stdout: libuuid-devel x86_64 2.32.1-42.el8 baseos 99 k 2023-06-22T10:50:26.135 INFO:teuthology.orchestra.run.smithi045.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-06-22T10:50:26.135 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql x86_64 10.23-1.module_el8+300+2c53004c appstream 1.6 M 2023-06-22T10:50:26.136 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-contrib x86_64 10.23-1.module_el8+300+2c53004c appstream 903 k 2023-06-22T10:50:26.136 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-server x86_64 10.23-1.module_el8+300+2c53004c appstream 5.1 M 2023-06-22T10:50:26.136 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cephfs x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 197 k 2023-06-22T10:50:26.136 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rados x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 371 k 2023-06-22T10:50:26.136 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rbd x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 364 k 2023-06-22T10:50:26.136 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rgw x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 106 k 2023-06-22T10:50:26.136 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-fuse x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 94 k 2023-06-22T10:50:26.137 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-mirror x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 3.4 M 2023-06-22T10:50:26.137 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-nbd x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 180 k 2023-06-22T10:50:26.137 INFO:teuthology.orchestra.run.smithi045.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2023-06-22T10:50:26.137 INFO:teuthology.orchestra.run.smithi045.stdout:Upgrading: 2023-06-22T10:50:26.137 INFO:teuthology.orchestra.run.smithi045.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-7.el8 baseos 143 k 2023-06-22T10:50:26.137 INFO:teuthology.orchestra.run.smithi045.stdout: elfutils-debuginfod-client x86_64 0.189-2.el8 baseos 76 k 2023-06-22T10:50:26.137 INFO:teuthology.orchestra.run.smithi045.stdout: elfutils-libelf x86_64 0.189-2.el8 baseos 232 k 2023-06-22T10:50:26.137 INFO:teuthology.orchestra.run.smithi045.stdout: elfutils-libs x86_64 0.189-2.el8 baseos 302 k 2023-06-22T10:50:26.138 INFO:teuthology.orchestra.run.smithi045.stdout: iproute x86_64 6.2.0-2.el8 baseos 880 k 2023-06-22T10:50:26.138 INFO:teuthology.orchestra.run.smithi045.stdout: libblkid x86_64 2.32.1-42.el8 baseos 220 k 2023-06-22T10:50:26.138 INFO:teuthology.orchestra.run.smithi045.stdout: libfdisk x86_64 2.32.1-42.el8 baseos 253 k 2023-06-22T10:50:26.138 INFO:teuthology.orchestra.run.smithi045.stdout: libmount x86_64 2.32.1-42.el8 baseos 236 k 2023-06-22T10:50:26.138 INFO:teuthology.orchestra.run.smithi045.stdout: librados2 x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 3.7 M 2023-06-22T10:50:26.138 INFO:teuthology.orchestra.run.smithi045.stdout: librbd1 x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 3.6 M 2023-06-22T10:50:26.138 INFO:teuthology.orchestra.run.smithi045.stdout: libsmartcols x86_64 2.32.1-42.el8 baseos 179 k 2023-06-22T10:50:26.138 INFO:teuthology.orchestra.run.smithi045.stdout: libuuid x86_64 2.32.1-42.el8 baseos 98 k 2023-06-22T10:50:26.139 INFO:teuthology.orchestra.run.smithi045.stdout: util-linux x86_64 2.32.1-42.el8 baseos 2.6 M 2023-06-22T10:50:26.139 INFO:teuthology.orchestra.run.smithi045.stdout: util-linux-user x86_64 2.32.1-42.el8 baseos 102 k 2023-06-22T10:50:26.139 INFO:teuthology.orchestra.run.smithi045.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2023-06-22T10:50:26.139 INFO:teuthology.orchestra.run.smithi045.stdout:Installing dependencies: 2023-06-22T10:50:26.139 INFO:teuthology.orchestra.run.smithi045.stdout: automake noarch 1.16.1-7.el8 appstream 713 k 2023-06-22T10:50:26.139 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-common x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 22 M 2023-06-22T10:50:26.139 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-grafana-dashboards noarch 2:18.0.0-4512.g2016e3af.el8 ceph-noarch 23 k 2023-06-22T10:50:26.139 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mds x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 2.3 M 2023-06-22T10:50:26.140 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-modules-core noarch 2:18.0.0-4512.g2016e3af.el8 ceph-noarch 240 k 2023-06-22T10:50:26.140 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mon x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 4.6 M 2023-06-22T10:50:26.140 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-osd x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 18 M 2023-06-22T10:50:26.140 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-prometheus-alerts noarch 2:18.0.0-4512.g2016e3af.el8 ceph-noarch 15 k 2023-06-22T10:50:26.140 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-selinux x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 24 k 2023-06-22T10:50:26.140 INFO:teuthology.orchestra.run.smithi045.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-06-22T10:50:26.140 INFO:teuthology.orchestra.run.smithi045.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-06-22T10:50:26.141 INFO:teuthology.orchestra.run.smithi045.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-06-22T10:50:26.141 INFO:teuthology.orchestra.run.smithi045.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-06-22T10:50:26.141 INFO:teuthology.orchestra.run.smithi045.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-06-22T10:50:26.141 INFO:teuthology.orchestra.run.smithi045.stdout: libcephsqlite x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 137 k 2023-06-22T10:50:26.141 INFO:teuthology.orchestra.run.smithi045.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-06-22T10:50:26.141 INFO:teuthology.orchestra.run.smithi045.stdout: libgfortran x86_64 8.5.0-19.el8 baseos 645 k 2023-06-22T10:50:26.141 INFO:teuthology.orchestra.run.smithi045.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-06-22T10:50:26.141 INFO:teuthology.orchestra.run.smithi045.stdout: libpq x86_64 13.5-1.el8 appstream 198 k 2023-06-22T10:50:26.142 INFO:teuthology.orchestra.run.smithi045.stdout: libquadmath x86_64 8.5.0-19.el8 baseos 172 k 2023-06-22T10:50:26.142 INFO:teuthology.orchestra.run.smithi045.stdout: librabbitmq x86_64 0.9.0-3.el8 baseos 47 k 2023-06-22T10:50:26.142 INFO:teuthology.orchestra.run.smithi045.stdout: libradosstriper1 x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 473 k 2023-06-22T10:50:26.142 INFO:teuthology.orchestra.run.smithi045.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-06-22T10:50:26.142 INFO:teuthology.orchestra.run.smithi045.stdout: librgw2 x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 6.7 M 2023-06-22T10:50:26.142 INFO:teuthology.orchestra.run.smithi045.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-06-22T10:50:26.142 INFO:teuthology.orchestra.run.smithi045.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-06-22T10:50:26.142 INFO:teuthology.orchestra.run.smithi045.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-06-22T10:50:26.143 INFO:teuthology.orchestra.run.smithi045.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-06-22T10:50:26.143 INFO:teuthology.orchestra.run.smithi045.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-06-22T10:50:26.143 INFO:teuthology.orchestra.run.smithi045.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-06-22T10:50:26.143 INFO:teuthology.orchestra.run.smithi045.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-06-22T10:50:26.143 INFO:teuthology.orchestra.run.smithi045.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-06-22T10:50:26.144 INFO:teuthology.orchestra.run.smithi045.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-06-22T10:50:26.144 INFO:teuthology.orchestra.run.smithi045.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-06-22T10:50:26.144 INFO:teuthology.orchestra.run.smithi045.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-06-22T10:50:26.144 INFO:teuthology.orchestra.run.smithi045.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-06-22T10:50:26.144 INFO:teuthology.orchestra.run.smithi045.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-06-22T10:50:26.144 INFO:teuthology.orchestra.run.smithi045.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-06-22T10:50:26.144 INFO:teuthology.orchestra.run.smithi045.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-06-22T10:50:26.144 INFO:teuthology.orchestra.run.smithi045.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-06-22T10:50:26.145 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-06-22T10:50:26.145 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ceph-argparse x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 45 k 2023-06-22T10:50:26.145 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ceph-common x86_64 2:18.0.0-4512.g2016e3af.el8 ceph 119 k 2023-06-22T10:50:26.145 INFO:teuthology.orchestra.run.smithi045.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-06-22T10:50:26.145 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-06-22T10:50:26.145 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-06-22T10:50:26.145 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-06-22T10:50:26.145 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-06-22T10:50:26.146 INFO:teuthology.orchestra.run.smithi045.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-06-22T10:50:26.146 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-06-22T10:50:26.146 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-06-22T10:50:26.146 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-06-22T10:50:26.146 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-06-22T10:50:26.146 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-06-22T10:50:26.146 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-06-22T10:50:26.146 INFO:teuthology.orchestra.run.smithi045.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-06-22T10:50:26.147 INFO:teuthology.orchestra.run.smithi045.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-06-22T10:50:26.147 INFO:teuthology.orchestra.run.smithi045.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-06-22T10:50:26.147 INFO:teuthology.orchestra.run.smithi045.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-06-22T10:50:26.147 INFO:teuthology.orchestra.run.smithi045.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-06-22T10:50:26.147 INFO:teuthology.orchestra.run.smithi045.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-06-22T10:50:26.147 INFO:teuthology.orchestra.run.smithi045.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-06-22T10:50:26.147 INFO:teuthology.orchestra.run.smithi045.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-06-22T10:50:26.147 INFO:teuthology.orchestra.run.smithi045.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-06-22T10:50:26.148 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-06-22T10:50:26.148 INFO:teuthology.orchestra.run.smithi045.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-06-22T10:50:26.148 INFO:teuthology.orchestra.run.smithi045.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-06-22T10:50:26.148 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-06-22T10:50:26.148 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-06-22T10:50:26.148 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-06-22T10:50:26.148 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-06-22T10:50:26.149 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pytz noarch 2017.2-9.el8 appstream 54 k 2023-06-22T10:50:26.149 INFO:teuthology.orchestra.run.smithi045.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-06-22T10:50:26.149 INFO:teuthology.orchestra.run.smithi045.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-06-22T10:50:26.149 INFO:teuthology.orchestra.run.smithi045.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-06-22T10:50:26.149 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-06-22T10:50:26.149 INFO:teuthology.orchestra.run.smithi045.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-06-22T10:50:26.149 INFO:teuthology.orchestra.run.smithi045.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-06-22T10:50:26.149 INFO:teuthology.orchestra.run.smithi045.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-06-22T10:50:26.150 INFO:teuthology.orchestra.run.smithi045.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-06-22T10:50:26.150 INFO:teuthology.orchestra.run.smithi045.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-06-22T10:50:26.150 INFO:teuthology.orchestra.run.smithi045.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-06-22T10:50:26.150 INFO:teuthology.orchestra.run.smithi045.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-06-22T10:50:26.150 INFO:teuthology.orchestra.run.smithi045.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-06-22T10:50:26.150 INFO:teuthology.orchestra.run.smithi045.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-06-22T10:50:26.150 INFO:teuthology.orchestra.run.smithi045.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-06-22T10:50:26.150 INFO:teuthology.orchestra.run.smithi045.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-06-22T10:50:26.151 INFO:teuthology.orchestra.run.smithi045.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-06-22T10:50:26.151 INFO:teuthology.orchestra.run.smithi045.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-06-22T10:50:26.151 INFO:teuthology.orchestra.run.smithi045.stdout: uuid x86_64 1.6.2-43.el8 appstream 64 k 2023-06-22T10:50:26.151 INFO:teuthology.orchestra.run.smithi045.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-06-22T10:50:26.151 INFO:teuthology.orchestra.run.smithi045.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-06-22T10:50:26.151 INFO:teuthology.orchestra.run.smithi045.stdout:Enabling module streams: 2023-06-22T10:50:26.151 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql 10 2023-06-22T10:50:26.151 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-22T10:50:26.152 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction Summary 2023-06-22T10:50:26.152 INFO:teuthology.orchestra.run.smithi045.stdout:==================================================================================================== 2023-06-22T10:50:26.152 INFO:teuthology.orchestra.run.smithi045.stdout:Install 128 Packages 2023-06-22T10:50:26.152 INFO:teuthology.orchestra.run.smithi045.stdout:Upgrade 15 Packages 2023-06-22T10:50:26.152 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-22T10:50:26.153 INFO:teuthology.orchestra.run.smithi040.stdout:(89/143): python3-cryptography-3.2.1-6.el8.x86_ 6.8 MB/s | 641 kB 00:00 2023-06-22T10:50:26.153 INFO:teuthology.orchestra.run.smithi045.stdout:Total download size: 212 M 2023-06-22T10:50:26.153 INFO:teuthology.orchestra.run.smithi045.stdout:Downloading Packages: 2023-06-22T10:50:26.182 INFO:teuthology.orchestra.run.smithi040.stdout:(90/143): python3-jwt-1.6.1-2.el8.noarch.rpm 638 kB/s | 43 kB 00:00 2023-06-22T10:50:26.216 INFO:teuthology.orchestra.run.smithi040.stdout:(91/143): python3-oauthlib-2.1.0-1.el8.noarch.r 2.3 MB/s | 155 kB 00:00 2023-06-22T10:50:26.250 INFO:teuthology.orchestra.run.smithi040.stdout:(92/143): python3-pycparser-2.14-14.el8.noarch. 1.6 MB/s | 109 kB 00:00 2023-06-22T10:50:26.284 INFO:teuthology.orchestra.run.smithi040.stdout:(93/143): python3-requests-oauthlib-1.0.0-1.el8 638 kB/s | 43 kB 00:00 2023-06-22T10:50:26.317 INFO:teuthology.orchestra.run.smithi040.stdout:(94/143): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 1.1 MB/s | 74 kB 00:00 2023-06-22T10:50:26.351 INFO:teuthology.orchestra.run.smithi040.stdout:(95/143): zlib-devel-1.2.11-21.el8.x86_64.rpm 867 kB/s | 58 kB 00:00 2023-06-22T10:50:26.643 INFO:teuthology.orchestra.run.smithi040.stdout:(96/143): liboath-2.6.2-3.el8.x86_64.rpm 202 kB/s | 59 kB 00:00 2023-06-22T10:50:26.818 INFO:teuthology.orchestra.run.smithi040.stdout:(97/143): libunwind-1.3.1-3.el8.x86_64.rpm 430 kB/s | 75 kB 00:00 2023-06-22T10:50:27.243 INFO:teuthology.orchestra.run.smithi040.stdout:(98/143): gperftools-libs-2.7-9.el8.x86_64.rpm 331 kB/s | 306 kB 00:00 2023-06-22T10:50:27.268 INFO:teuthology.orchestra.run.smithi040.stdout:(99/143): python3-asyncssh-2.7.0-2.el8.noarch.r 1.0 MB/s | 476 kB 00:00 2023-06-22T10:50:27.327 INFO:teuthology.orchestra.run.smithi040.stdout:(100/143): python3-bcrypt-3.1.6-2.el8.1.x86_64. 522 kB/s | 44 kB 00:00 2023-06-22T10:50:27.411 INFO:teuthology.orchestra.run.smithi040.stdout:(101/143): python3-cachetools-3.1.1-4.el8.noarc 398 kB/s | 33 kB 00:00 2023-06-22T10:50:27.461 INFO:teuthology.orchestra.run.smithi040.stdout:(102/143): python3-beautifulsoup4-4.6.3-2.el8.1 964 kB/s | 185 kB 00:00 2023-06-22T10:50:27.495 INFO:teuthology.orchestra.run.smithi040.stdout:(103/143): python3-certifi-2018.10.15-7.el8.noa 195 kB/s | 16 kB 00:00 2023-06-22T10:50:27.497 INFO:teuthology.orchestra.run.smithi045.stdout:(1/143): ceph-18.0.0-4512.g2016e3af.el8.x86_64. 52 kB/s | 6.4 kB 00:00 2023-06-22T10:50:27.645 INFO:teuthology.orchestra.run.smithi040.stdout:(104/143): python3-cherrypy-18.4.0-1.el8.noarch 2.5 MB/s | 384 kB 00:00 2023-06-22T10:50:27.756 INFO:teuthology.orchestra.run.smithi045.stdout:(2/143): ceph-fuse-18.0.0-4512.g2016e3af.el8.x8 3.2 MB/s | 848 kB 00:00 2023-06-22T10:50:27.820 INFO:teuthology.orchestra.run.smithi040.stdout:(105/143): python3-scipy-1.0.0-21.module_el8.5. 4.1 MB/s | 14 MB 00:03 2023-06-22T10:50:27.823 INFO:teuthology.orchestra.run.smithi045.stdout:(3/143): ceph-immutable-object-cache-18.0.0-451 2.4 MB/s | 165 kB 00:00 2023-06-22T10:50:27.846 INFO:teuthology.orchestra.run.smithi040.stdout:(106/143): python3-cheroot-8.5.2-1.el8.noarch.r 449 kB/s | 173 kB 00:00 2023-06-22T10:50:27.871 INFO:teuthology.orchestra.run.smithi040.stdout:(107/143): python3-google-auth-1.1.1-10.el8.noa 360 kB/s | 81 kB 00:00 2023-06-22T10:50:27.929 INFO:teuthology.orchestra.run.smithi040.stdout:(108/143): python3-jaraco-functools-2.0-4.el8.n 211 kB/s | 18 kB 00:00 2023-06-22T10:50:27.963 INFO:teuthology.orchestra.run.smithi040.stdout:(109/143): python3-jaraco-6.2-6.el8.noarch.rpm 78 kB/s | 11 kB 00:00 2023-06-22T10:50:28.022 INFO:teuthology.orchestra.run.smithi040.stdout:(110/143): python3-logutils-0.3.5-11.el8.noarch 531 kB/s | 49 kB 00:00 2023-06-22T10:50:28.105 INFO:teuthology.orchestra.run.smithi040.stdout:(111/143): python3-natsort-7.1.1-2.el8.noarch.r 723 kB/s | 60 kB 00:00 2023-06-22T10:50:28.130 INFO:teuthology.orchestra.run.smithi040.stdout:(112/143): python3-more-itertools-7.2.0-3.el8.n 351 kB/s | 59 kB 00:00 2023-06-22T10:50:28.214 INFO:teuthology.orchestra.run.smithi040.stdout:(113/143): python3-portend-2.6-1.el8.noarch.rpm 187 kB/s | 16 kB 00:00 2023-06-22T10:50:28.256 INFO:teuthology.orchestra.run.smithi040.stdout:(114/143): python3-pecan-1.3.2-9.el8.noarch.rpm 1.8 MB/s | 283 kB 00:00 2023-06-22T10:50:28.307 INFO:teuthology.orchestra.run.smithi040.stdout:(115/143): python3-repoze-lru-0.7-6.el8.noarch. 364 kB/s | 34 kB 00:00 2023-06-22T10:50:28.332 INFO:teuthology.orchestra.run.smithi045.stdout:(4/143): ceph-mds-18.0.0-4512.g2016e3af.el8.x86 4.5 MB/s | 2.3 MB 00:00 2023-06-22T10:50:28.349 INFO:teuthology.orchestra.run.smithi040.stdout:(116/143): python3-routes-2.4.1-12.el8.noarch.r 2.1 MB/s | 196 kB 00:00 2023-06-22T10:50:28.399 INFO:teuthology.orchestra.run.smithi040.stdout:(117/143): python3-rsa-4.8-1.el8.noarch.rpm 670 kB/s | 61 kB 00:00 2023-06-22T10:50:28.415 INFO:teuthology.orchestra.run.smithi045.stdout:(5/143): ceph-base-18.0.0-4512.g2016e3af.el8.x8 5.2 MB/s | 5.4 MB 00:01 2023-06-22T10:50:28.432 INFO:teuthology.orchestra.run.smithi040.stdout:(118/143): python3-simplegeneric-0.8.1-17.el8.n 224 kB/s | 19 kB 00:00 2023-06-22T10:50:28.483 INFO:teuthology.orchestra.run.smithi040.stdout:(119/143): python3-singledispatch-3.4.0.3-18.el 287 kB/s | 24 kB 00:00 2023-06-22T10:50:28.525 INFO:teuthology.orchestra.run.smithi040.stdout:(120/143): python3-tempora-1.14.1-5.el8.noarch. 318 kB/s | 29 kB 00:00 2023-06-22T10:50:28.567 INFO:teuthology.orchestra.run.smithi040.stdout:(121/143): python3-trustme-0.6.0-4.el8.noarch.r 330 kB/s | 27 kB 00:00 2023-06-22T10:50:28.675 INFO:teuthology.orchestra.run.smithi040.stdout:(122/143): python3-waitress-1.4.3-1.el8.noarch. 1.7 MB/s | 255 kB 00:00 2023-06-22T10:50:28.690 INFO:teuthology.orchestra.run.smithi045.stdout:(6/143): ceph-mgr-18.0.0-4512.g2016e3af.el8.x86 4.3 MB/s | 1.5 MB 00:00 2023-06-22T10:50:28.726 INFO:teuthology.orchestra.run.smithi040.stdout:(123/143): python3-webob-1.8.5-1.el8.1.noarch.r 1.5 MB/s | 251 kB 00:00 2023-06-22T10:50:28.759 INFO:teuthology.orchestra.run.smithi040.stdout:(124/143): python3-websocket-client-0.56.0-5.el 734 kB/s | 61 kB 00:00 2023-06-22T10:50:28.818 INFO:teuthology.orchestra.run.smithi040.stdout:(125/143): python3-webtest-2.0.33-1.el8.noarch. 929 kB/s | 85 kB 00:00 2023-06-22T10:50:28.843 INFO:teuthology.orchestra.run.smithi040.stdout:(126/143): python3-zc-lockfile-2.0-2.el8.noarch 274 kB/s | 23 kB 00:00 2023-06-22T10:50:28.941 INFO:teuthology.orchestra.run.smithi045.stdout:(7/143): ceph-mon-18.0.0-4512.g2016e3af.el8.x86 8.8 MB/s | 4.6 MB 00:00 2023-06-22T10:50:29.160 INFO:teuthology.orchestra.run.smithi040.stdout:(127/143): python3-kubernetes-11.0.0-6.el8.noar 926 kB/s | 1.2 MB 00:01 2023-06-22T10:50:29.577 INFO:teuthology.orchestra.run.smithi040.stdout:(128/143): librados2-18.0.0-4512.g2016e3af.el8. 5.0 MB/s | 3.7 MB 00:00 2023-06-22T10:50:29.619 INFO:teuthology.orchestra.run.smithi040.stdout:(129/143): thrift-0.13.0-2.el8.x86_64.rpm 2.2 MB/s | 1.7 MB 00:00 2023-06-22T10:50:29.777 INFO:teuthology.orchestra.run.smithi040.stdout:(130/143): elfutils-debuginfod-client-0.189-2.e 480 kB/s | 76 kB 00:00 2023-06-22T10:50:29.803 INFO:teuthology.orchestra.run.smithi040.stdout:(131/143): NetworkManager-initscripts-updown-1. 636 kB/s | 143 kB 00:00 2023-06-22T10:50:29.903 INFO:teuthology.orchestra.run.smithi040.stdout:(132/143): elfutils-libelf-0.189-2.el8.x86_64.r 1.8 MB/s | 232 kB 00:00 2023-06-22T10:50:29.907 INFO:teuthology.orchestra.run.smithi045.stdout:(8/143): ceph-common-18.0.0-4512.g2016e3af.el8. 8.7 MB/s | 22 MB 00:02 2023-06-22T10:50:29.979 INFO:teuthology.orchestra.run.smithi040.stdout:(133/143): elfutils-libs-0.189-2.el8.x86_64.rpm 1.7 MB/s | 302 kB 00:00 2023-06-22T10:50:29.983 INFO:teuthology.orchestra.run.smithi045.stdout:(9/143): ceph-selinux-18.0.0-4512.g2016e3af.el8 326 kB/s | 24 kB 00:00 2023-06-22T10:50:30.062 INFO:teuthology.orchestra.run.smithi040.stdout:(134/143): libblkid-2.32.1-42.el8.x86_64.rpm 2.6 MB/s | 220 kB 00:00 2023-06-22T10:50:30.137 INFO:teuthology.orchestra.run.smithi040.stdout:(135/143): iproute-6.2.0-2.el8.x86_64.rpm 3.7 MB/s | 880 kB 00:00 2023-06-22T10:50:30.163 INFO:teuthology.orchestra.run.smithi040.stdout:(136/143): libfdisk-2.32.1-42.el8.x86_64.rpm 2.5 MB/s | 253 kB 00:00 2023-06-22T10:50:30.213 INFO:teuthology.orchestra.run.smithi040.stdout:(137/143): libmount-2.32.1-42.el8.x86_64.rpm 3.1 MB/s | 236 kB 00:00 2023-06-22T10:50:30.239 INFO:teuthology.orchestra.run.smithi040.stdout:(138/143): libsmartcols-2.32.1-42.el8.x86_64.rp 2.3 MB/s | 179 kB 00:00 2023-06-22T10:50:30.281 INFO:teuthology.orchestra.run.smithi040.stdout:(139/143): libuuid-2.32.1-42.el8.x86_64.rpm 1.4 MB/s | 98 kB 00:00 2023-06-22T10:50:30.348 INFO:teuthology.orchestra.run.smithi040.stdout:(140/143): util-linux-user-2.32.1-42.el8.x86_64 1.5 MB/s | 102 kB 00:00 2023-06-22T10:50:30.456 INFO:teuthology.orchestra.run.smithi040.stdout:(141/143): util-linux-2.32.1-42.el8.x86_64.rpm 12 MB/s | 2.6 MB 00:00 2023-06-22T10:50:30.498 INFO:teuthology.orchestra.run.smithi040.stdout:(142/143): xfsprogs-5.0.0-12.el8.x86_64.rpm 7.2 MB/s | 1.1 MB 00:00 2023-06-22T10:50:30.557 INFO:teuthology.orchestra.run.smithi040.stdout:(143/143): librbd1-18.0.0-4512.g2016e3af.el8.x8 2.6 MB/s | 3.6 MB 00:01 2023-06-22T10:50:30.559 INFO:teuthology.orchestra.run.smithi040.stdout:-------------------------------------------------------------------------------- 2023-06-22T10:50:30.559 INFO:teuthology.orchestra.run.smithi040.stdout:Total 11 MB/s | 212 MB 00:20 2023-06-22T10:50:30.584 INFO:teuthology.orchestra.run.smithi045.stdout:(10/143): ceph-radosgw-18.0.0-4512.g2016e3af.el 8.2 MB/s | 13 MB 00:01 2023-06-22T10:50:30.659 INFO:teuthology.orchestra.run.smithi045.stdout:(11/143): cephfs-mirror-18.0.0-4512.g2016e3af.e 3.4 MB/s | 258 kB 00:00 2023-06-22T10:50:30.726 INFO:teuthology.orchestra.run.smithi045.stdout:(12/143): libcephfs-devel-18.0.0-4512.g2016e3af 467 kB/s | 31 kB 00:00 2023-06-22T10:50:30.859 INFO:teuthology.orchestra.run.smithi045.stdout:(13/143): libcephfs2-18.0.0-4512.g2016e3af.el8. 5.7 MB/s | 771 kB 00:00 2023-06-22T10:50:30.934 INFO:teuthology.orchestra.run.smithi045.stdout:(14/143): libcephsqlite-18.0.0-4512.g2016e3af.e 1.8 MB/s | 137 kB 00:00 2023-06-22T10:50:31.001 INFO:teuthology.orchestra.run.smithi045.stdout:(15/143): librados-devel-18.0.0-4512.g2016e3af. 2.0 MB/s | 139 kB 00:00 2023-06-22T10:50:31.094 INFO:teuthology.orchestra.run.smithi045.stdout:(16/143): libradosstriper1-18.0.0-4512.g2016e3a 5.0 MB/s | 473 kB 00:00 2023-06-22T10:50:31.902 INFO:teuthology.orchestra.run.smithi045.stdout:(17/143): ceph-osd-18.0.0-4512.g2016e3af.el8.x8 5.5 MB/s | 18 MB 00:03 2023-06-22T10:50:32.011 INFO:teuthology.orchestra.run.smithi045.stdout:(18/143): librgw2-18.0.0-4512.g2016e3af.el8.x86 7.4 MB/s | 6.7 MB 00:00 2023-06-22T10:50:32.036 INFO:teuthology.orchestra.run.smithi045.stdout:(19/143): python3-ceph-argparse-18.0.0-4512.g20 335 kB/s | 45 kB 00:00 2023-06-22T10:50:32.062 INFO:teuthology.orchestra.run.smithi045.stdout:(20/143): python3-ceph-common-18.0.0-4512.g2016 2.3 MB/s | 119 kB 00:00 2023-06-22T10:50:32.087 INFO:teuthology.orchestra.run.smithi045.stdout:(21/143): python3-cephfs-18.0.0-4512.g2016e3af. 3.8 MB/s | 197 kB 00:00 2023-06-22T10:50:32.120 INFO:teuthology.orchestra.run.smithi045.stdout:(22/143): python3-rados-18.0.0-4512.g2016e3af.e 6.2 MB/s | 371 kB 00:00 2023-06-22T10:50:32.154 INFO:teuthology.orchestra.run.smithi045.stdout:(23/143): python3-rbd-18.0.0-4512.g2016e3af.el8 5.3 MB/s | 364 kB 00:00 2023-06-22T10:50:32.179 INFO:teuthology.orchestra.run.smithi045.stdout:(24/143): python3-rgw-18.0.0-4512.g2016e3af.el8 1.8 MB/s | 106 kB 00:00 2023-06-22T10:50:32.205 INFO:teuthology.orchestra.run.smithi045.stdout:(25/143): rbd-fuse-18.0.0-4512.g2016e3af.el8.x8 1.8 MB/s | 94 kB 00:00 2023-06-22T10:50:32.264 INFO:teuthology.orchestra.run.smithi045.stdout:(26/143): rbd-nbd-18.0.0-4512.g2016e3af.el8.x86 3.0 MB/s | 180 kB 00:00 2023-06-22T10:50:32.338 INFO:teuthology.orchestra.run.smithi045.stdout:(27/143): ceph-grafana-dashboards-18.0.0-4512.g 309 kB/s | 23 kB 00:00 2023-06-22T10:50:32.407 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction check 2023-06-22T10:50:32.422 INFO:teuthology.orchestra.run.smithi045.stdout:(28/143): ceph-mgr-cephadm-18.0.0-4512.g2016e3a 1.5 MB/s | 128 kB 00:00 2023-06-22T10:50:32.531 INFO:teuthology.orchestra.run.smithi045.stdout:(29/143): rbd-mirror-18.0.0-4512.g2016e3af.el8. 9.8 MB/s | 3.4 MB 00:00 2023-06-22T10:50:32.765 INFO:teuthology.orchestra.run.smithi045.stdout:(30/143): ceph-mgr-dashboard-18.0.0-4512.g2016e 5.0 MB/s | 1.7 MB 00:00 2023-06-22T10:50:32.847 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction check succeeded. 2023-06-22T10:50:32.848 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction test 2023-06-22T10:50:32.848 INFO:teuthology.orchestra.run.smithi045.stdout:(31/143): ceph-mgr-modules-core-18.0.0-4512.g20 2.8 MB/s | 240 kB 00:00 2023-06-22T10:50:32.923 INFO:teuthology.orchestra.run.smithi045.stdout:(32/143): ceph-mgr-rook-18.0.0-4512.g2016e3af.e 633 kB/s | 47 kB 00:00 2023-06-22T10:50:32.999 INFO:teuthology.orchestra.run.smithi045.stdout:(33/143): ceph-prometheus-alerts-18.0.0-4512.g2 194 kB/s | 15 kB 00:00 2023-06-22T10:50:33.091 INFO:teuthology.orchestra.run.smithi045.stdout:(34/143): ceph-volume-18.0.0-4512.g2016e3af.el8 2.8 MB/s | 258 kB 00:00 2023-06-22T10:50:33.175 INFO:teuthology.orchestra.run.smithi045.stdout:(35/143): cephadm-18.0.0-4512.g2016e3af.el8.noa 1.9 MB/s | 164 kB 00:00 2023-06-22T10:50:33.250 INFO:teuthology.orchestra.run.smithi045.stdout:(36/143): cephfs-top-18.0.0-4512.g2016e3af.el8. 239 kB/s | 18 kB 00:00 2023-06-22T10:50:33.492 INFO:teuthology.orchestra.run.smithi045.stdout:(37/143): ceph-mgr-diskprediction-local-18.0.0- 7.7 MB/s | 7.4 MB 00:00 2023-06-22T10:50:33.934 INFO:teuthology.orchestra.run.smithi045.stdout:(38/143): ceph-test-18.0.0-4512.g2016e3af.el8.x 12 MB/s | 48 MB 00:03 2023-06-22T10:50:34.293 INFO:teuthology.orchestra.run.smithi045.stdout:(39/143): automake-1.16.1-7.el8.noarch.rpm 685 kB/s | 713 kB 00:01 2023-06-22T10:50:34.410 INFO:teuthology.orchestra.run.smithi045.stdout:(40/143): jq-1.6-7.el8.x86_64.rpm 1.7 MB/s | 202 kB 00:00 2023-06-22T10:50:34.418 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction test succeeded. 2023-06-22T10:50:34.422 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction 2023-06-22T10:50:34.518 INFO:teuthology.orchestra.run.smithi045.stdout:(41/143): libpq-13.5-1.el8.x86_64.rpm 1.8 MB/s | 198 kB 00:00 2023-06-22T10:50:34.544 INFO:teuthology.orchestra.run.smithi045.stdout:(42/143): flex-2.6.1-9.el8.x86_64.rpm 525 kB/s | 320 kB 00:00 2023-06-22T10:50:34.569 INFO:teuthology.orchestra.run.smithi045.stdout:(43/143): bison-3.0.4-10.el8.x86_64.rpm 640 kB/s | 688 kB 00:01 2023-06-22T10:50:34.620 INFO:teuthology.orchestra.run.smithi045.stdout:(44/143): librdkafka-0.11.4-3.el8.x86_64.rpm 3.4 MB/s | 354 kB 00:00 2023-06-22T10:50:34.678 INFO:teuthology.orchestra.run.smithi045.stdout:(45/143): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.3 MB/s | 259 kB 00:00 2023-06-22T10:50:34.720 INFO:teuthology.orchestra.run.smithi045.stdout:(46/143): oniguruma-6.8.2-2.el8.x86_64.rpm 1.8 MB/s | 187 kB 00:00 2023-06-22T10:50:34.754 INFO:teuthology.orchestra.run.smithi045.stdout:(47/143): libtool-2.4.6-25.el8.x86_64.rpm 3.3 MB/s | 709 kB 00:00 2023-06-22T10:50:35.138 INFO:teuthology.orchestra.run.smithi045.stdout:(48/143): postgresql-10.23-1.module_el8+300+2c5 4.1 MB/s | 1.6 MB 00:00 2023-06-22T10:50:35.355 INFO:teuthology.orchestra.run.smithi045.stdout:(49/143): postgresql-contrib-10.23-1.module_el8 4.1 MB/s | 903 kB 00:00 2023-06-22T10:50:35.671 INFO:teuthology.orchestra.run.smithi045.stdout:(50/143): openblas-0.3.15-4.el8.x86_64.rpm 4.8 MB/s | 4.7 MB 00:00 2023-06-22T10:50:35.747 INFO:teuthology.orchestra.run.smithi045.stdout:(51/143): openblas-threads-0.3.15-4.el8.x86_64. 4.7 MB/s | 4.9 MB 00:01 2023-06-22T10:50:35.930 INFO:teuthology.orchestra.run.smithi045.stdout:(52/143): python3-jinja2-2.10.1-3.el8.noarch.rp 2.9 MB/s | 538 kB 00:00 2023-06-22T10:50:36.039 INFO:teuthology.orchestra.run.smithi045.stdout:(53/143): python3-jsonpatch-1.21-2.el8.noarch.r 246 kB/s | 27 kB 00:00 2023-06-22T10:50:36.139 INFO:teuthology.orchestra.run.smithi045.stdout:(54/143): python3-jsonpointer-1.10-11.el8.noarc 200 kB/s | 20 kB 00:00 2023-06-22T10:50:36.290 INFO:teuthology.orchestra.run.smithi045.stdout:(55/143): postgresql-server-10.23-1.module_el8+ 5.5 MB/s | 5.1 MB 00:00 2023-06-22T10:50:36.315 INFO:teuthology.orchestra.run.smithi045.stdout:(56/143): python3-mako-1.0.6-14.el8.noarch.rpm 896 kB/s | 157 kB 00:00 2023-06-22T10:50:36.390 INFO:teuthology.orchestra.run.smithi045.stdout:(57/143): python3-markupsafe-0.23-19.el8.x86_64 388 kB/s | 39 kB 00:00 2023-06-22T10:50:36.457 INFO:teuthology.orchestra.run.smithi045.stdout:(58/143): python3-babel-2.5.1-7.el8.noarch.rpm 6.1 MB/s | 4.8 MB 00:00 2023-06-22T10:50:36.491 INFO:teuthology.orchestra.run.smithi045.stdout:(59/143): python3-numpy-f2py-1.14.3-10.el8.x86_ 2.2 MB/s | 225 kB 00:00 2023-06-22T10:50:36.558 INFO:teuthology.orchestra.run.smithi045.stdout:(60/143): python3-prettytable-0.7.2-14.el8.noar 436 kB/s | 44 kB 00:00 2023-06-22T10:50:36.600 INFO:teuthology.orchestra.run.smithi045.stdout:(61/143): python3-pyOpenSSL-19.0.0-1.el8.noarch 952 kB/s | 103 kB 00:00 2023-06-22T10:50:36.667 INFO:teuthology.orchestra.run.smithi045.stdout:(62/143): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.1 MB/s | 126 kB 00:00 2023-06-22T10:50:36.701 INFO:teuthology.orchestra.run.smithi045.stdout:(63/143): python3-pyasn1-modules-0.3.7-6.el8.no 1.1 MB/s | 110 kB 00:00 2023-06-22T10:50:36.768 INFO:teuthology.orchestra.run.smithi045.stdout:(64/143): python3-pytz-2017.2-9.el8.noarch.rpm 540 kB/s | 54 kB 00:00 2023-06-22T10:50:36.876 INFO:teuthology.orchestra.run.smithi045.stdout:(65/143): python3-werkzeug-0.12.2-4.el8.noarch. 4.1 MB/s | 457 kB 00:00 2023-06-22T10:50:36.951 INFO:teuthology.orchestra.run.smithi045.stdout:(66/143): python3-numpy-1.14.3-10.el8.x86_64.rp 5.9 MB/s | 3.7 MB 00:00 2023-06-22T10:50:36.985 INFO:teuthology.orchestra.run.smithi045.stdout:(67/143): socat-1.7.4.1-1.el8.x86_64.rpm 2.9 MB/s | 323 kB 00:00 2023-06-22T10:50:37.052 INFO:teuthology.orchestra.run.smithi045.stdout:(68/143): uuid-1.6.2-43.el8.x86_64.rpm 640 kB/s | 64 kB 00:00 2023-06-22T10:50:37.086 INFO:teuthology.orchestra.run.smithi045.stdout:(69/143): xmlstarlet-1.6.1-20.el8.x86_64.rpm 705 kB/s | 71 kB 00:00 2023-06-22T10:50:37.236 INFO:teuthology.orchestra.run.smithi045.stdout:(70/143): elfutils-libelf-devel-0.189-2.el8.x86 335 kB/s | 61 kB 00:00 2023-06-22T10:50:37.270 INFO:teuthology.orchestra.run.smithi045.stdout:(71/143): fuse-2.9.7-17.el8.x86_64.rpm 452 kB/s | 83 kB 00:00 2023-06-22T10:50:37.295 INFO:teuthology.orchestra.run.smithi045.stdout:(72/143): keyutils-libs-devel-1.5.10-9.el8.x86_ 820 kB/s | 48 kB 00:00 2023-06-22T10:50:37.353 INFO:teuthology.orchestra.run.smithi045.stdout:(73/143): libaio-devel-0.3.112-1.el8.x86_64.rpm 322 kB/s | 19 kB 00:00 2023-06-22T10:50:37.412 INFO:teuthology.orchestra.run.smithi045.stdout:(74/143): libcom_err-devel-1.45.6-5.el8.x86_64. 664 kB/s | 39 kB 00:00 2023-06-22T10:50:37.438 INFO:teuthology.orchestra.run.smithi045.stdout:(75/143): krb5-devel-1.18.2-22.el8.x86_64.rpm 3.3 MB/s | 561 kB 00:00 2023-06-22T10:50:37.505 INFO:teuthology.orchestra.run.smithi045.stdout:(76/143): libquadmath-8.5.0-19.el8.x86_64.rpm 2.5 MB/s | 172 kB 00:00 2023-06-22T10:50:37.572 INFO:teuthology.orchestra.run.smithi045.stdout:(77/143): librabbitmq-0.9.0-3.el8.x86_64.rpm 704 kB/s | 47 kB 00:00 2023-06-22T10:50:37.639 INFO:teuthology.orchestra.run.smithi045.stdout:(78/143): libgfortran-8.5.0-19.el8.x86_64.rpm 2.8 MB/s | 645 kB 00:00 2023-06-22T10:50:37.664 INFO:teuthology.orchestra.run.smithi045.stdout:(79/143): libselinux-devel-2.9-8.el8.x86_64.rpm 2.1 MB/s | 200 kB 00:00 2023-06-22T10:50:37.722 INFO:teuthology.orchestra.run.smithi045.stdout:(80/143): libsepol-devel-2.9-3.el8.x86_64.rpm 1.5 MB/s | 87 kB 00:00 2023-06-22T10:50:37.739 INFO:teuthology.orchestra.run.smithi045.stdout:(81/143): libuuid-devel-2.32.1-42.el8.x86_64.rp 1.3 MB/s | 99 kB 00:00 2023-06-22T10:50:37.790 INFO:teuthology.orchestra.run.smithi045.stdout:(82/143): libverto-devel-0.3.2-2.el8.x86_64.rpm 270 kB/s | 18 kB 00:00 2023-06-22T10:50:37.815 INFO:teuthology.orchestra.run.smithi045.stdout:(83/143): libzstd-devel-1.4.4-1.el8.x86_64.rpm 582 kB/s | 44 kB 00:00 2023-06-22T10:50:37.932 INFO:teuthology.orchestra.run.smithi045.stdout:(84/143): pcre2-devel-10.32-3.el8.x86_64.rpm 5.1 MB/s | 605 kB 00:00 2023-06-22T10:50:37.999 INFO:teuthology.orchestra.run.smithi045.stdout:(85/143): openssl-devel-1.1.1k-9.el8.x86_64.rpm 15 MB/s | 3.2 MB 00:00 2023-06-22T10:50:38.024 INFO:teuthology.orchestra.run.smithi045.stdout:(86/143): pcre2-utf16-10.32-3.el8.x86_64.rpm 2.4 MB/s | 229 kB 00:00 2023-06-22T10:50:38.058 INFO:teuthology.orchestra.run.smithi045.stdout:(87/143): pcre2-utf32-10.32-3.el8.x86_64.rpm 3.7 MB/s | 220 kB 00:00 2023-06-22T10:50:38.100 INFO:teuthology.orchestra.run.smithi045.stdout:(88/143): python3-cffi-1.11.5-6.el8.x86_64.rpm 3.2 MB/s | 249 kB 00:00 2023-06-22T10:50:38.134 INFO:teuthology.orchestra.run.smithi045.stdout:(89/143): python3-cryptography-3.2.1-6.el8.x86_ 8.3 MB/s | 641 kB 00:00 2023-06-22T10:50:38.167 INFO:teuthology.orchestra.run.smithi045.stdout:(90/143): python3-jwt-1.6.1-2.el8.noarch.rpm 637 kB/s | 43 kB 00:00 2023-06-22T10:50:38.193 INFO:teuthology.orchestra.run.smithi045.stdout:(91/143): python3-oauthlib-2.1.0-1.el8.noarch.r 2.6 MB/s | 155 kB 00:00 2023-06-22T10:50:38.229 INFO:teuthology.orchestra.run.smithi045.stdout:(92/143): python3-pycparser-2.14-14.el8.noarch. 1.8 MB/s | 109 kB 00:00 2023-06-22T10:50:38.260 INFO:teuthology.orchestra.run.smithi045.stdout:(93/143): python3-requests-oauthlib-1.0.0-1.el8 637 kB/s | 43 kB 00:00 2023-06-22T10:50:38.285 INFO:teuthology.orchestra.run.smithi045.stdout:(94/143): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 1.2 MB/s | 74 kB 00:00 2023-06-22T10:50:38.327 INFO:teuthology.orchestra.run.smithi045.stdout:(95/143): zlib-devel-1.2.11-21.el8.x86_64.rpm 867 kB/s | 58 kB 00:00 2023-06-22T10:50:38.452 INFO:teuthology.orchestra.run.smithi045.stdout:(96/143): liboath-2.6.2-3.el8.x86_64.rpm 471 kB/s | 59 kB 00:00 2023-06-22T10:50:38.611 INFO:teuthology.orchestra.run.smithi045.stdout:(97/143): python3-scipy-1.0.0-21.module_el8.5.0 7.2 MB/s | 14 MB 00:01 2023-06-22T10:50:38.636 INFO:teuthology.orchestra.run.smithi045.stdout:(98/143): gperftools-libs-2.7-9.el8.x86_64.rpm 873 kB/s | 306 kB 00:00 2023-06-22T10:50:38.662 INFO:teuthology.orchestra.run.smithi045.stdout:(99/143): libunwind-1.3.1-3.el8.x86_64.rpm 359 kB/s | 75 kB 00:00 2023-06-22T10:50:38.704 INFO:teuthology.orchestra.run.smithi045.stdout:(100/143): python3-bcrypt-3.1.6-2.el8.1.x86_64. 653 kB/s | 44 kB 00:00 2023-06-22T10:50:38.746 INFO:teuthology.orchestra.run.smithi045.stdout:(101/143): python3-beautifulsoup4-4.6.3-2.el8.1 2.2 MB/s | 185 kB 00:00 2023-06-22T10:50:38.771 INFO:teuthology.orchestra.run.smithi045.stdout:(102/143): python3-cachetools-3.1.1-4.el8.noarc 494 kB/s | 33 kB 00:00 2023-06-22T10:50:38.796 INFO:teuthology.orchestra.run.smithi045.stdout:(103/143): python3-certifi-2018.10.15-7.el8.noa 326 kB/s | 16 kB 00:00 2023-06-22T10:50:38.830 INFO:teuthology.orchestra.run.smithi045.stdout:(104/143): python3-asyncssh-2.7.0-2.el8.noarch. 2.1 MB/s | 476 kB 00:00 2023-06-22T10:50:38.855 INFO:teuthology.orchestra.run.smithi045.stdout:(105/143): python3-cheroot-8.5.2-1.el8.noarch.r 2.0 MB/s | 173 kB 00:00 2023-06-22T10:50:38.880 INFO:teuthology.orchestra.run.smithi045.stdout:(106/143): python3-google-auth-1.1.1-10.el8.noa 1.6 MB/s | 81 kB 00:00 2023-06-22T10:50:38.906 INFO:teuthology.orchestra.run.smithi045.stdout:(107/143): python3-jaraco-6.2-6.el8.noarch.rpm 221 kB/s | 11 kB 00:00 2023-06-22T10:50:38.923 INFO:teuthology.orchestra.run.smithi045.stdout:(108/143): python3-jaraco-functools-2.0-4.el8.n 419 kB/s | 18 kB 00:00 2023-06-22T10:50:38.948 INFO:teuthology.orchestra.run.smithi045.stdout:(109/143): python3-cherrypy-18.4.0-1.el8.noarch 2.5 MB/s | 384 kB 00:00 2023-06-22T10:50:38.973 INFO:teuthology.orchestra.run.smithi045.stdout:(110/143): python3-logutils-0.3.5-11.el8.noarch 976 kB/s | 49 kB 00:00 2023-06-22T10:50:38.998 INFO:teuthology.orchestra.run.smithi045.stdout:(111/143): python3-more-itertools-7.2.0-3.el8.n 1.1 MB/s | 59 kB 00:00 2023-06-22T10:50:39.024 INFO:teuthology.orchestra.run.smithi045.stdout:(112/143): python3-natsort-7.1.1-2.el8.noarch.r 1.2 MB/s | 60 kB 00:00 2023-06-22T10:50:39.049 INFO:teuthology.orchestra.run.smithi045.stdout:(113/143): python3-pecan-1.3.2-9.el8.noarch.rpm 5.5 MB/s | 283 kB 00:00 2023-06-22T10:50:39.075 INFO:teuthology.orchestra.run.smithi045.stdout:(114/143): python3-portend-2.6-1.el8.noarch.rpm 309 kB/s | 16 kB 00:00 2023-06-22T10:50:39.100 INFO:teuthology.orchestra.run.smithi045.stdout:(115/143): python3-repoze-lru-0.7-6.el8.noarch. 667 kB/s | 34 kB 00:00 2023-06-22T10:50:39.125 INFO:teuthology.orchestra.run.smithi045.stdout:(116/143): python3-routes-2.4.1-12.el8.noarch.r 3.8 MB/s | 196 kB 00:00 2023-06-22T10:50:39.151 INFO:teuthology.orchestra.run.smithi045.stdout:(117/143): python3-rsa-4.8-1.el8.noarch.rpm 1.2 MB/s | 61 kB 00:00 2023-06-22T10:50:39.176 INFO:teuthology.orchestra.run.smithi045.stdout:(118/143): python3-simplegeneric-0.8.1-17.el8.n 374 kB/s | 19 kB 00:00 2023-06-22T10:50:39.201 INFO:teuthology.orchestra.run.smithi045.stdout:(119/143): python3-singledispatch-3.4.0.3-18.el 477 kB/s | 24 kB 00:00 2023-06-22T10:50:39.235 INFO:teuthology.orchestra.run.smithi045.stdout:(120/143): python3-tempora-1.14.1-5.el8.noarch. 499 kB/s | 29 kB 00:00 2023-06-22T10:50:39.260 INFO:teuthology.orchestra.run.smithi045.stdout:(121/143): python3-trustme-0.6.0-4.el8.noarch.r 472 kB/s | 27 kB 00:00 2023-06-22T10:50:39.302 INFO:teuthology.orchestra.run.smithi045.stdout:(122/143): python3-kubernetes-11.0.0-6.el8.noar 2.9 MB/s | 1.2 MB 00:00 2023-06-22T10:50:39.327 INFO:teuthology.orchestra.run.smithi045.stdout:(123/143): python3-waitress-1.4.3-1.el8.noarch. 2.7 MB/s | 255 kB 00:00 2023-06-22T10:50:39.353 INFO:teuthology.orchestra.run.smithi045.stdout:(124/143): python3-websocket-client-0.56.0-5.el 1.2 MB/s | 61 kB 00:00 2023-06-22T10:50:39.378 INFO:teuthology.orchestra.run.smithi045.stdout:(125/143): python3-webob-1.8.5-1.el8.1.noarch.r 2.1 MB/s | 251 kB 00:00 2023-06-22T10:50:39.403 INFO:teuthology.orchestra.run.smithi045.stdout:(126/143): python3-zc-lockfile-2.0-2.el8.noarch 457 kB/s | 23 kB 00:00 2023-06-22T10:50:39.429 INFO:teuthology.orchestra.run.smithi045.stdout:(127/143): python3-webtest-2.0.33-1.el8.noarch. 849 kB/s | 85 kB 00:00 2023-06-22T10:50:39.496 INFO:teuthology.orchestra.run.smithi045.stdout:(128/143): thrift-0.13.0-2.el8.x86_64.rpm 15 MB/s | 1.7 MB 00:00 2023-06-22T10:50:39.613 INFO:teuthology.orchestra.run.smithi045.stdout:(129/143): NetworkManager-initscripts-updown-1. 1.2 MB/s | 143 kB 00:00 2023-06-22T10:50:39.680 INFO:teuthology.orchestra.run.smithi045.stdout:(130/143): elfutils-debuginfod-client-0.189-2.e 1.1 MB/s | 76 kB 00:00 2023-06-22T10:50:39.788 INFO:teuthology.orchestra.run.smithi045.stdout:(131/143): elfutils-libelf-0.189-2.el8.x86_64.r 2.1 MB/s | 232 kB 00:00 2023-06-22T10:50:39.837 INFO:teuthology.orchestra.run.smithi040.stdout: Preparing : 1/1 2023-06-22T10:50:39.847 INFO:teuthology.orchestra.run.smithi045.stdout:(132/143): librbd1-18.0.0-4512.g2016e3af.el8.x8 8.5 MB/s | 3.6 MB 00:00 2023-06-22T10:50:39.923 INFO:teuthology.orchestra.run.smithi045.stdout:(133/143): librados2-18.0.0-4512.g2016e3af.el8. 7.1 MB/s | 3.7 MB 00:00 2023-06-22T10:50:39.948 INFO:teuthology.orchestra.run.smithi045.stdout:(134/143): elfutils-libs-0.189-2.el8.x86_64.rpm 1.9 MB/s | 302 kB 00:00 2023-06-22T10:50:40.015 INFO:teuthology.orchestra.run.smithi045.stdout:(135/143): libfdisk-2.32.1-42.el8.x86_64.rpm 3.7 MB/s | 253 kB 00:00 2023-06-22T10:50:40.073 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: thrift-0.13.0-2.el8.x86_64 1/1 2023-06-22T10:50:40.081 INFO:teuthology.orchestra.run.smithi045.stdout:(136/143): libmount-2.32.1-42.el8.x86_64.rpm 3.5 MB/s | 236 kB 00:00 2023-06-22T10:50:40.132 INFO:teuthology.orchestra.run.smithi045.stdout:(137/143): iproute-6.2.0-2.el8.x86_64.rpm 3.0 MB/s | 880 kB 00:00 2023-06-22T10:50:40.157 INFO:teuthology.orchestra.run.smithi045.stdout:(138/143): libsmartcols-2.32.1-42.el8.x86_64.rp 2.3 MB/s | 179 kB 00:00 2023-06-22T10:50:40.208 INFO:teuthology.orchestra.run.smithi045.stdout:(139/143): libblkid-2.32.1-42.el8.x86_64.rpm 774 kB/s | 220 kB 00:00 2023-06-22T10:50:40.233 INFO:teuthology.orchestra.run.smithi045.stdout:(140/143): libuuid-2.32.1-42.el8.x86_64.rpm 982 kB/s | 98 kB 00:00 2023-06-22T10:50:40.275 INFO:teuthology.orchestra.run.smithi045.stdout:(141/143): util-linux-user-2.32.1-42.el8.x86_64 1.5 MB/s | 102 kB 00:00 2023-06-22T10:50:40.278 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/158 2023-06-22T10:50:40.375 INFO:teuthology.orchestra.run.smithi045.stdout:(142/143): util-linux-2.32.1-42.el8.x86_64.rpm 12 MB/s | 2.6 MB 00:00 2023-06-22T10:50:40.415 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : libuuid-2.32.1-42.el8.x86_64 2/158 2023-06-22T10:50:40.417 INFO:teuthology.orchestra.run.smithi045.stdout:(143/143): xfsprogs-5.0.0-12.el8.x86_64.rpm 5.9 MB/s | 1.1 MB 00:00 2023-06-22T10:50:40.420 INFO:teuthology.orchestra.run.smithi045.stdout:-------------------------------------------------------------------------------- 2023-06-22T10:50:40.421 INFO:teuthology.orchestra.run.smithi045.stdout:Total 15 MB/s | 212 MB 00:14 2023-06-22T10:50:40.527 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libuuid-2.32.1-42.el8.x86_64 2/158 2023-06-22T10:50:40.698 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : libblkid-2.32.1-42.el8.x86_64 3/158 2023-06-22T10:50:40.791 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libblkid-2.32.1-42.el8.x86_64 3/158 2023-06-22T10:50:41.087 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : liboath-2.6.2-3.el8.x86_64 4/158 2023-06-22T10:50:41.321 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : elfutils-libelf-0.189-2.el8.x86_64 5/158 2023-06-22T10:50:41.516 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 6/158 2023-06-22T10:50:41.698 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/158 2023-06-22T10:50:42.197 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/158 2023-06-22T10:50:42.241 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction check 2023-06-22T10:50:42.440 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : librados2-2:18.0.0-4512.g2016e3af.el8.x86_64 8/158 2023-06-22T10:50:42.680 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction check succeeded. 2023-06-22T10:50:42.681 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction test 2023-06-22T10:50:42.924 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librados2-2:18.0.0-4512.g2016e3af.el8.x86_64 8/158 2023-06-22T10:50:43.131 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : librbd1-2:18.0.0-4512.g2016e3af.el8.x86_64 9/158 2023-06-22T10:50:43.273 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librbd1-2:18.0.0-4512.g2016e3af.el8.x86_64 9/158 2023-06-22T10:50:43.464 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libcephfs2-2:18.0.0-4512.g2016e3af.el8.x86_64 10/158 2023-06-22T10:50:43.574 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libcephfs2-2:18.0.0-4512.g2016e3af.el8.x86_64 10/158 2023-06-22T10:50:43.777 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-rados-2:18.0.0-4512.g2016e3af.el8.x86_64 11/158 2023-06-22T10:50:43.948 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/158 2023-06-22T10:50:44.042 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/158 2023-06-22T10:50:44.236 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction test succeeded. 2023-06-22T10:50:44.240 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction 2023-06-22T10:50:44.259 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 13/158 2023-06-22T10:50:44.451 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 14/158 2023-06-22T10:50:44.888 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libpq-13.5-1.el8.x86_64 15/158 2023-06-22T10:50:45.087 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 16/158 2023-06-22T10:50:45.231 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libcephsqlite-2:18.0.0-4512.g2016e3af.el8.x86_64 17/158 2023-06-22T10:50:45.359 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libcephsqlite-2:18.0.0-4512.g2016e3af.el8.x86_64 17/158 2023-06-22T10:50:45.531 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libradosstriper1-2:18.0.0-4512.g2016e3af.el8.x86 18/158 2023-06-22T10:50:45.762 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libradosstriper1-2:18.0.0-4512.g2016e3af.el8.x86 18/158 2023-06-22T10:50:45.947 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 19/158 2023-06-22T10:50:46.095 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 19/158 2023-06-22T10:50:46.372 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 20/158 2023-06-22T10:50:46.534 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 21/158 2023-06-22T10:50:46.647 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libquadmath-8.5.0-19.el8.x86_64 22/158 2023-06-22T10:50:46.806 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libquadmath-8.5.0-19.el8.x86_64 22/158 2023-06-22T10:50:46.947 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libgfortran-8.5.0-19.el8.x86_64 23/158 2023-06-22T10:50:47.674 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libgfortran-8.5.0-19.el8.x86_64 23/158 2023-06-22T10:50:47.864 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : openblas-0.3.15-4.el8.x86_64 24/158 2023-06-22T10:50:48.622 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 24/158 2023-06-22T10:50:48.814 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 25/158 2023-06-22T10:50:49.572 INFO:teuthology.orchestra.run.smithi045.stdout: Preparing : 1/1 2023-06-22T10:50:49.693 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 25/158 2023-06-22T10:50:49.812 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: thrift-0.13.0-2.el8.x86_64 1/1 2023-06-22T10:50:49.995 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 26/158 2023-06-22T10:50:49.999 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/158 2023-06-22T10:50:50.152 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : libuuid-2.32.1-42.el8.x86_64 2/158 2023-06-22T10:50:50.165 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 27/158 2023-06-22T10:50:50.235 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libuuid-2.32.1-42.el8.x86_64 2/158 2023-06-22T10:50:50.363 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 28/158 2023-06-22T10:50:50.429 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : libblkid-2.32.1-42.el8.x86_64 3/158 2023-06-22T10:50:50.518 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libblkid-2.32.1-42.el8.x86_64 3/158 2023-06-22T10:50:50.571 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 29/158 2023-06-22T10:50:50.756 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : liboath-2.6.2-3.el8.x86_64 4/158 2023-06-22T10:50:50.780 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-ceph-common-2:18.0.0-4512.g2016e3af.el8. 30/158 2023-06-22T10:50:50.920 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-ceph-argparse-2:18.0.0-4512.g2016e3af.el 31/158 2023-06-22T10:50:51.008 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : elfutils-libelf-0.189-2.el8.x86_64 5/158 2023-06-22T10:50:51.151 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cephfs-2:18.0.0-4512.g2016e3af.el8.x86_6 32/158 2023-06-22T10:50:51.274 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 6/158 2023-06-22T10:50:51.460 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/158 2023-06-22T10:50:51.971 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/158 2023-06-22T10:50:52.168 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : librados2-2:18.0.0-4512.g2016e3af.el8.x86_64 8/158 2023-06-22T10:50:52.296 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 33/158 2023-06-22T10:50:52.651 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librados2-2:18.0.0-4512.g2016e3af.el8.x86_64 8/158 2023-06-22T10:50:52.652 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 34/158 2023-06-22T10:50:52.893 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : librbd1-2:18.0.0-4512.g2016e3af.el8.x86_64 9/158 2023-06-22T10:50:52.945 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 35/158 2023-06-22T10:50:53.040 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librbd1-2:18.0.0-4512.g2016e3af.el8.x86_64 9/158 2023-06-22T10:50:53.147 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/158 2023-06-22T10:50:53.243 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libcephfs2-2:18.0.0-4512.g2016e3af.el8.x86_64 10/158 2023-06-22T10:50:53.367 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libcephfs2-2:18.0.0-4512.g2016e3af.el8.x86_64 10/158 2023-06-22T10:50:53.580 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-rados-2:18.0.0-4512.g2016e3af.el8.x86_64 11/158 2023-06-22T10:50:53.926 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/158 2023-06-22T10:50:54.019 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/158 2023-06-22T10:50:54.242 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 13/158 2023-06-22T10:50:54.446 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 14/158 2023-06-22T10:50:54.967 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libpq-13.5-1.el8.x86_64 15/158 2023-06-22T10:50:55.216 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 16/158 2023-06-22T10:50:55.374 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/158 2023-06-22T10:50:55.393 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libcephsqlite-2:18.0.0-4512.g2016e3af.el8.x86_64 17/158 2023-06-22T10:50:55.526 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libcephsqlite-2:18.0.0-4512.g2016e3af.el8.x86_64 17/158 2023-06-22T10:50:55.653 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 37/158 2023-06-22T10:50:55.718 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libradosstriper1-2:18.0.0-4512.g2016e3af.el8.x86 18/158 2023-06-22T10:50:55.856 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 38/158 2023-06-22T10:50:55.952 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libradosstriper1-2:18.0.0-4512.g2016e3af.el8.x86 18/158 2023-06-22T10:50:56.063 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-rsa-4.8-1.el8.noarch 39/158 2023-06-22T10:50:56.151 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 19/158 2023-06-22T10:50:56.246 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-rbd-2:18.0.0-4512.g2016e3af.el8.x86_64 40/158 2023-06-22T10:50:56.288 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 19/158 2023-06-22T10:50:56.426 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : librados-devel-2:18.0.0-4512.g2016e3af.el8.x86_6 41/158 2023-06-22T10:50:56.527 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 20/158 2023-06-22T10:50:56.615 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : elfutils-libs-0.189-2.el8.x86_64 42/158 2023-06-22T10:50:56.722 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 21/158 2023-06-22T10:50:56.791 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : elfutils-debuginfod-client-0.189-2.el8.x86_64 43/158 2023-06-22T10:50:56.876 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libquadmath-8.5.0-19.el8.x86_64 22/158 2023-06-22T10:50:56.996 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : libfdisk-2.32.1-42.el8.x86_64 44/158 2023-06-22T10:50:57.023 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libquadmath-8.5.0-19.el8.x86_64 22/158 2023-06-22T10:50:57.092 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libfdisk-2.32.1-42.el8.x86_64 44/158 2023-06-22T10:50:57.167 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libgfortran-8.5.0-19.el8.x86_64 23/158 2023-06-22T10:50:57.287 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : libmount-2.32.1-42.el8.x86_64 45/158 2023-06-22T10:50:57.375 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libmount-2.32.1-42.el8.x86_64 45/158 2023-06-22T10:50:57.518 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libuuid-devel-2.32.1-42.el8.x86_64 46/158 2023-06-22T10:50:57.679 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : libsmartcols-2.32.1-42.el8.x86_64 47/158 2023-06-22T10:50:57.892 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libgfortran-8.5.0-19.el8.x86_64 23/158 2023-06-22T10:50:58.084 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : openblas-0.3.15-4.el8.x86_64 24/158 2023-06-22T10:50:58.297 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libsmartcols-2.32.1-42.el8.x86_64 47/158 2023-06-22T10:50:58.580 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : util-linux-2.32.1-42.el8.x86_64 48/158 2023-06-22T10:50:58.608 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: util-linux-2.32.1-42.el8.x86_64 48/158 2023-06-22T10:50:58.797 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/158 2023-06-22T10:50:58.823 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 24/158 2023-06-22T10:50:59.042 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 25/158 2023-06-22T10:50:59.059 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/158 2023-06-22T10:50:59.263 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/158 2023-06-22T10:50:59.393 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/158 2023-06-22T10:50:59.526 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/158 2023-06-22T10:50:59.698 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/158 2023-06-22T10:50:59.889 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/158 2023-06-22T10:50:59.937 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 25/158 2023-06-22T10:51:00.104 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 56/158 2023-06-22T10:51:00.275 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 57/158 2023-06-22T10:51:00.304 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 26/158 2023-06-22T10:51:00.429 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 58/158 2023-06-22T10:51:00.511 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 27/158 2023-06-22T10:51:00.586 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 59/158 2023-06-22T10:51:00.693 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 28/158 2023-06-22T10:51:00.787 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/158 2023-06-22T10:51:00.911 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 29/158 2023-06-22T10:51:00.958 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/158 2023-06-22T10:51:01.117 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-ceph-common-2:18.0.0-4512.g2016e3af.el8. 30/158 2023-06-22T10:51:01.127 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/158 2023-06-22T10:51:01.273 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-ceph-argparse-2:18.0.0-4512.g2016e3af.el 31/158 2023-06-22T10:51:01.379 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/158 2023-06-22T10:51:01.526 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cephfs-2:18.0.0-4512.g2016e3af.el8.x86_6 32/158 2023-06-22T10:51:01.665 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/158 2023-06-22T10:51:01.899 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/158 2023-06-22T10:51:02.257 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/158 2023-06-22T10:51:02.523 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 67/158 2023-06-22T10:51:02.694 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 33/158 2023-06-22T10:51:02.711 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 68/158 2023-06-22T10:51:03.071 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 34/158 2023-06-22T10:51:03.403 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 35/158 2023-06-22T10:51:03.584 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 69/158 2023-06-22T10:51:03.608 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/158 2023-06-22T10:51:03.762 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : librgw2-2:18.0.0-4512.g2016e3af.el8.x86_64 70/158 2023-06-22T10:51:03.846 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librgw2-2:18.0.0-4512.g2016e3af.el8.x86_64 70/158 2023-06-22T10:51:04.059 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-rgw-2:18.0.0-4512.g2016e3af.el8.x86_64 71/158 2023-06-22T10:51:04.293 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 72/158 2023-06-22T10:51:04.725 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 73/158 2023-06-22T10:51:04.979 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 74/158 2023-06-22T10:51:05.152 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 75/158 2023-06-22T10:51:05.419 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 76/158 2023-06-22T10:51:05.648 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 77/158 2023-06-22T10:51:05.855 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/158 2023-06-22T10:51:06.125 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 37/158 2023-06-22T10:51:06.345 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 38/158 2023-06-22T10:51:06.584 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-rsa-4.8-1.el8.noarch 39/158 2023-06-22T10:51:06.766 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-rbd-2:18.0.0-4512.g2016e3af.el8.x86_64 40/158 2023-06-22T10:51:06.970 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : librados-devel-2:18.0.0-4512.g2016e3af.el8.x86_6 41/158 2023-06-22T10:51:06.998 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/158 2023-06-22T10:51:07.204 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : elfutils-libs-0.189-2.el8.x86_64 42/158 2023-06-22T10:51:07.388 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/158 2023-06-22T10:51:07.408 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : elfutils-debuginfod-client-0.189-2.el8.x86_64 43/158 2023-06-22T10:51:07.596 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 80/158 2023-06-22T10:51:07.607 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : libfdisk-2.32.1-42.el8.x86_64 44/158 2023-06-22T10:51:07.702 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libfdisk-2.32.1-42.el8.x86_64 44/158 2023-06-22T10:51:07.817 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 81/158 2023-06-22T10:51:07.891 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : libmount-2.32.1-42.el8.x86_64 45/158 2023-06-22T10:51:07.979 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libmount-2.32.1-42.el8.x86_64 45/158 2023-06-22T10:51:08.129 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libuuid-devel-2.32.1-42.el8.x86_64 46/158 2023-06-22T10:51:08.133 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 82/158 2023-06-22T10:51:08.333 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : libsmartcols-2.32.1-42.el8.x86_64 47/158 2023-06-22T10:51:08.398 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 83/158 2023-06-22T10:51:08.609 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 84/158 2023-06-22T10:51:08.792 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 85/158 2023-06-22T10:51:08.955 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libsmartcols-2.32.1-42.el8.x86_64 47/158 2023-06-22T10:51:09.119 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 86/158 2023-06-22T10:51:09.225 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : util-linux-2.32.1-42.el8.x86_64 48/158 2023-06-22T10:51:09.254 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: util-linux-2.32.1-42.el8.x86_64 48/158 2023-06-22T10:51:09.359 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 87/158 2023-06-22T10:51:09.485 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/158 2023-06-22T10:51:09.518 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 88/158 2023-06-22T10:51:09.721 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 89/158 2023-06-22T10:51:09.767 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/158 2023-06-22T10:51:10.024 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/158 2023-06-22T10:51:10.047 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 90/158 2023-06-22T10:51:10.180 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/158 2023-06-22T10:51:10.249 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 91/158 2023-06-22T10:51:10.357 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/158 2023-06-22T10:51:10.386 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 92/158 2023-06-22T10:51:10.568 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/158 2023-06-22T10:51:10.633 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 93/158 2023-06-22T10:51:10.768 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/158 2023-06-22T10:51:10.859 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 94/158 2023-06-22T10:51:10.966 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 56/158 2023-06-22T10:51:11.075 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : fuse-2.9.7-17.el8.x86_64 95/158 2023-06-22T10:51:11.153 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 57/158 2023-06-22T10:51:11.258 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 96/158 2023-06-22T10:51:11.366 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 58/158 2023-06-22T10:51:11.419 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : uuid-1.6.2-43.el8.x86_64 97/158 2023-06-22T10:51:11.550 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 59/158 2023-06-22T10:51:11.552 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 97/158 2023-06-22T10:51:11.775 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/158 2023-06-22T10:51:11.805 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 98/158 2023-06-22T10:51:11.919 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 99/158 2023-06-22T10:51:11.995 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/158 2023-06-22T10:51:12.189 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/158 2023-06-22T10:51:12.434 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/158 2023-06-22T10:51:12.696 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/158 2023-06-22T10:51:12.919 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/158 2023-06-22T10:51:13.301 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/158 2023-06-22T10:51:13.560 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 67/158 2023-06-22T10:51:13.773 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 68/158 2023-06-22T10:51:14.644 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 69/158 2023-06-22T10:51:14.865 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : librgw2-2:18.0.0-4512.g2016e3af.el8.x86_64 70/158 2023-06-22T10:51:14.951 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librgw2-2:18.0.0-4512.g2016e3af.el8.x86_64 70/158 2023-06-22T10:51:15.008 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-common-2:18.0.0-4512.g2016e3af.el8.x86_64 100/158 2023-06-22T10:51:15.180 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-rgw-2:18.0.0-4512.g2016e3af.el8.x86_64 71/158 2023-06-22T10:51:15.244 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-common-2:18.0.0-4512.g2016e3af.el8.x86_64 100/158 2023-06-22T10:51:15.472 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 72/158 2023-06-22T10:51:15.912 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 73/158 2023-06-22T10:51:15.985 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-common-2:18.0.0-4512.g2016e3af.el8.x86_64 100/158 2023-06-22T10:51:16.166 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 74/158 2023-06-22T10:51:16.271 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-base-2:18.0.0-4512.g2016e3af.el8.x86_64 101/158 2023-06-22T10:51:16.349 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 75/158 2023-06-22T10:51:16.405 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-base-2:18.0.0-4512.g2016e3af.el8.x86_64 101/158 2023-06-22T10:51:16.569 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-selinux-2:18.0.0-4512.g2016e3af.el8.x86_64 102/158 2023-06-22T10:51:16.622 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 76/158 2023-06-22T10:51:16.861 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 77/158 2023-06-22T10:51:18.256 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/158 2023-06-22T10:51:18.640 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/158 2023-06-22T10:51:18.842 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 80/158 2023-06-22T10:51:19.074 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 81/158 2023-06-22T10:51:19.390 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 82/158 2023-06-22T10:51:19.644 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 83/158 2023-06-22T10:51:19.904 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 84/158 2023-06-22T10:51:20.130 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 85/158 2023-06-22T10:51:20.490 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 86/158 2023-06-22T10:51:20.729 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 87/158 2023-06-22T10:51:20.948 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 88/158 2023-06-22T10:51:21.168 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 89/158 2023-06-22T10:51:21.559 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 90/158 2023-06-22T10:51:21.786 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 91/158 2023-06-22T10:51:21.957 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 92/158 2023-06-22T10:51:22.177 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 93/158 2023-06-22T10:51:22.380 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 94/158 2023-06-22T10:51:22.593 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : fuse-2.9.7-17.el8.x86_64 95/158 2023-06-22T10:51:22.777 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 96/158 2023-06-22T10:51:22.972 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : uuid-1.6.2-43.el8.x86_64 97/158 2023-06-22T10:51:23.097 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 97/158 2023-06-22T10:51:23.283 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 98/158 2023-06-22T10:51:23.431 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 99/158 2023-06-22T10:51:26.474 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-common-2:18.0.0-4512.g2016e3af.el8.x86_64 100/158 2023-06-22T10:51:26.714 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-common-2:18.0.0-4512.g2016e3af.el8.x86_64 100/158 2023-06-22T10:51:27.454 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-common-2:18.0.0-4512.g2016e3af.el8.x86_64 100/158 2023-06-22T10:51:27.784 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-base-2:18.0.0-4512.g2016e3af.el8.x86_64 101/158 2023-06-22T10:51:27.916 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-base-2:18.0.0-4512.g2016e3af.el8.x86_64 101/158 2023-06-22T10:51:28.121 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-selinux-2:18.0.0-4512.g2016e3af.el8.x86_64 102/158 2023-06-22T10:51:38.002 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-selinux-2:18.0.0-4512.g2016e3af.el8.x86_64 102/158 2023-06-22T10:51:38.003 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /sys 2023-06-22T10:51:38.003 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /proc 2023-06-22T10:51:38.003 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /dev 2023-06-22T10:51:38.003 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /run 2023-06-22T10:51:38.003 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /mnt 2023-06-22T10:51:38.004 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /var/tmp 2023-06-22T10:51:38.004 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /home 2023-06-22T10:51:38.004 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /tmp 2023-06-22T10:51:38.004 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /dev 2023-06-22T10:51:38.004 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:51:38.408 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-volume-2:18.0.0-4512.g2016e3af.el8.noarch 103/158 2023-06-22T10:51:40.275 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-volume-2:18.0.0-4512.g2016e3af.el8.noarch 103/158 2023-06-22T10:51:40.518 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-osd-2:18.0.0-4512.g2016e3af.el8.x86_64 104/158 2023-06-22T10:51:40.804 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-osd-2:18.0.0-4512.g2016e3af.el8.x86_64 104/158 2023-06-22T10:51:41.007 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mds-2:18.0.0-4512.g2016e3af.el8.x86_64 105/158 2023-06-22T10:51:41.575 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mds-2:18.0.0-4512.g2016e3af.el8.x86_64 105/158 2023-06-22T10:51:41.793 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mon-2:18.0.0-4512.g2016e3af.el8.x86_64 106/158 2023-06-22T10:51:41.844 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mon-2:18.0.0-4512.g2016e3af.el8.x86_64 106/158 2023-06-22T10:51:42.041 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 107/158 2023-06-22T10:51:42.254 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 108/158 2023-06-22T10:51:42.398 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 109/158 2023-06-22T10:51:42.494 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 109/158 2023-06-22T10:51:42.772 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : jq-1.6-7.el8.x86_64 110/158 2023-06-22T10:51:42.998 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : automake-1.16.1-7.el8.noarch 111/158 2023-06-22T10:51:43.637 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: cephadm-2:18.0.0-4512.g2016e3af.el8.noarch 112/158 2023-06-22T10:51:43.812 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : cephadm-2:18.0.0-4512.g2016e3af.el8.noarch 112/158 2023-06-22T10:51:43.948 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-4512.g2016e3af.e 113/158 2023-06-22T10:51:44.154 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-4512.g2016e3af. 114/158 2023-06-22T10:51:44.464 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-4512.g2016e3af.el8.noa 115/158 2023-06-22T10:51:44.738 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-4512.g2016e3af.el8.noa 115/158 2023-06-22T10:51:44.967 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-4512.g2016e3af.el8.n 116/158 2023-06-22T10:51:46.159 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-4512.g2016e3af.el8.n 116/158 2023-06-22T10:51:46.339 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-4512.g201 117/158 2023-06-22T10:51:46.473 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-4512.g201 117/158 2023-06-22T10:51:46.844 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-4512.g2016e3af.el 118/158 2023-06-22T10:51:47.059 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-2:18.0.0-4512.g2016e3af.el8.x86_64 119/158 2023-06-22T10:51:47.125 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-2:18.0.0-4512.g2016e3af.el8.x86_64 119/158 2023-06-22T10:51:47.306 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-rook-2:18.0.0-4512.g2016e3af.el8.noarch 120/158 2023-06-22T10:51:47.333 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-4512.g2016e3af.el8.noarch 120/158 2023-06-22T10:51:47.552 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-2:18.0.0-4512.g2016e3af.el8.x86_64 121/158 2023-06-22T10:51:47.714 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libtool-2.4.6-25.el8.x86_64 122/158 2023-06-22T10:51:49.454 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-selinux-2:18.0.0-4512.g2016e3af.el8.x86_64 102/158 2023-06-22T10:51:49.455 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /sys 2023-06-22T10:51:49.455 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /proc 2023-06-22T10:51:49.455 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /dev 2023-06-22T10:51:49.455 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /run 2023-06-22T10:51:49.456 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /mnt 2023-06-22T10:51:49.456 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /var/tmp 2023-06-22T10:51:49.456 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /home 2023-06-22T10:51:49.457 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /tmp 2023-06-22T10:51:49.457 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /dev 2023-06-22T10:51:49.457 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-22T10:51:49.977 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-volume-2:18.0.0-4512.g2016e3af.el8.noarch 103/158 2023-06-22T10:51:51.814 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-volume-2:18.0.0-4512.g2016e3af.el8.noarch 103/158 2023-06-22T10:51:52.039 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-osd-2:18.0.0-4512.g2016e3af.el8.x86_64 104/158 2023-06-22T10:51:52.320 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-osd-2:18.0.0-4512.g2016e3af.el8.x86_64 104/158 2023-06-22T10:51:52.501 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mds-2:18.0.0-4512.g2016e3af.el8.x86_64 105/158 2023-06-22T10:51:53.060 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mds-2:18.0.0-4512.g2016e3af.el8.x86_64 105/158 2023-06-22T10:51:53.061 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 122/158 2023-06-22T10:51:53.253 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mon-2:18.0.0-4512.g2016e3af.el8.x86_64 106/158 2023-06-22T10:51:53.303 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mon-2:18.0.0-4512.g2016e3af.el8.x86_64 106/158 2023-06-22T10:51:53.501 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 107/158 2023-06-22T10:51:53.709 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 108/158 2023-06-22T10:51:53.884 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 109/158 2023-06-22T10:51:53.988 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 109/158 2023-06-22T10:51:54.286 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : jq-1.6-7.el8.x86_64 110/158 2023-06-22T10:51:54.493 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : automake-1.16.1-7.el8.noarch 111/158 2023-06-22T10:51:54.713 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-test-2:18.0.0-4512.g2016e3af.el8.x86_64 123/158 2023-06-22T10:51:54.932 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-radosgw-2:18.0.0-4512.g2016e3af.el8.x86_64 124/158 2023-06-22T10:51:54.995 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-4512.g2016e3af.el8.x86_64 124/158 2023-06-22T10:51:55.084 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: cephadm-2:18.0.0-4512.g2016e3af.el8.noarch 112/158 2023-06-22T10:51:55.232 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-4512.g2016e 125/158 2023-06-22T10:51:55.275 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : cephadm-2:18.0.0-4512.g2016e3af.el8.noarch 112/158 2023-06-22T10:51:55.305 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-4512.g2016e 125/158 2023-06-22T10:51:55.409 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-4512.g2016e3af.e 113/158 2023-06-22T10:51:55.514 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : cephfs-mirror-2:18.0.0-4512.g2016e3af.el8.x86_64 126/158 2023-06-22T10:51:55.618 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-4512.g2016e3af. 114/158 2023-06-22T10:51:55.834 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-4512.g2016e3af.el8.noa 115/158 2023-06-22T10:51:55.951 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-4512.g2016e3af.el8.x86_64 126/158 2023-06-22T10:51:56.111 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-4512.g2016e3af.el8.noa 115/158 2023-06-22T10:51:56.146 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : rbd-mirror-2:18.0.0-4512.g2016e3af.el8.x86_64 127/158 2023-06-22T10:51:56.363 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-4512.g2016e3af.el8.n 116/158 2023-06-22T10:51:56.573 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: rbd-mirror-2:18.0.0-4512.g2016e3af.el8.x86_64 127/158 2023-06-22T10:51:56.891 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : postgresql-contrib-10.23-1.module_el8+300+2c5300 128/158 2023-06-22T10:51:57.557 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-4512.g2016e3af.el8.n 116/158 2023-06-22T10:51:57.758 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-4512.g201 117/158 2023-06-22T10:51:57.896 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-4512.g201 117/158 2023-06-22T10:51:58.183 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-fuse-2:18.0.0-4512.g2016e3af.el8.x86_64 129/158 2023-06-22T10:51:58.272 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-4512.g2016e3af.el 118/158 2023-06-22T10:51:58.480 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-2:18.0.0-4512.g2016e3af.el8.x86_64 119/158 2023-06-22T10:51:58.502 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 130/158 2023-06-22T10:51:58.546 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-2:18.0.0-4512.g2016e3af.el8.x86_64 119/158 2023-06-22T10:51:58.687 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : elfutils-libelf-devel-0.189-2.el8.x86_64 131/158 2023-06-22T10:51:58.733 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-rook-2:18.0.0-4512.g2016e3af.el8.noarch 120/158 2023-06-22T10:51:58.760 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-4512.g2016e3af.el8.noarch 120/158 2023-06-22T10:51:58.869 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : util-linux-user-2.32.1-42.el8.x86_64 132/158 2023-06-22T10:51:58.990 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-2:18.0.0-4512.g2016e3af.el8.x86_64 121/158 2023-06-22T10:51:59.018 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/158 2023-06-22T10:51:59.158 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libtool-2.4.6-25.el8.x86_64 122/158 2023-06-22T10:51:59.180 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libcephfs-devel-2:18.0.0-4512.g2016e3af.el8.x86_ 134/158 2023-06-22T10:52:00.466 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 135/158 2023-06-22T10:52:00.713 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : postgresql-server-10.23-1.module_el8+300+2c53004 135/158 2023-06-22T10:52:00.748 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 135/158 2023-06-22T10:52:00.981 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : cephfs-top-2:18.0.0-4512.g2016e3af.el8.noarch 136/158 2023-06-22T10:52:01.165 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : rbd-fuse-2:18.0.0-4512.g2016e3af.el8.x86_64 137/158 2023-06-22T10:52:01.492 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : rbd-nbd-2:18.0.0-4512.g2016e3af.el8.x86_64 138/158 2023-06-22T10:52:01.739 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : iproute-6.2.0-2.el8.x86_64 139/158 2023-06-22T10:52:01.912 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-7.el 140/158 2023-06-22T10:52:01.939 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-7.el 140/158 2023-06-22T10:52:02.142 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 141/158 2023-06-22T10:52:02.353 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : flex-2.6.1-9.el8.x86_64 142/158 2023-06-22T10:52:02.459 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 142/158 2023-06-22T10:52:02.804 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : bison-3.0.4-10.el8.x86_64 143/158 2023-06-22T10:52:02.830 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 143/158 2023-06-22T10:52:02.997 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 144/158 2023-06-22T10:52:03.178 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 145/158 2023-06-22T10:52:03.178 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 146/158 2023-06-22T10:52:03.459 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 146/158 2023-06-22T10:52:03.459 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 147/158 2023-06-22T10:52:03.682 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 147/158 2023-06-22T10:52:03.699 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 148/158 2023-06-22T10:52:03.810 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 148/158 2023-06-22T10:52:03.811 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 149/158 2023-06-22T10:52:04.029 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 149/158 2023-06-22T10:52:04.200 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 150/158 2023-06-22T10:52:04.371 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 151/158 2023-06-22T10:52:04.500 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 122/158 2023-06-22T10:52:04.564 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 152/158 2023-06-22T10:52:04.564 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 153/158 2023-06-22T10:52:04.783 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 153/158 2023-06-22T10:52:04.813 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 154/158 2023-06-22T10:52:05.007 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 154/158 2023-06-22T10:52:05.007 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 155/158 2023-06-22T10:52:05.232 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 155/158 2023-06-22T10:52:05.232 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 156/158 2023-06-22T10:52:05.448 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 156/158 2023-06-22T10:52:05.449 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 157/158 2023-06-22T10:52:05.657 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 157/158 2023-06-22T10:52:05.831 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 158/158 2023-06-22T10:52:06.053 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 158/158 2023-06-22T10:52:06.053 INFO:teuthology.orchestra.run.smithi040.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-06-22T10:52:06.053 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:52:06.129 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-test-2:18.0.0-4512.g2016e3af.el8.x86_64 123/158 2023-06-22T10:52:06.320 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-radosgw-2:18.0.0-4512.g2016e3af.el8.x86_64 124/158 2023-06-22T10:52:06.384 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-4512.g2016e3af.el8.x86_64 124/158 2023-06-22T10:52:06.577 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-4512.g2016e 125/158 2023-06-22T10:52:06.649 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-4512.g2016e 125/158 2023-06-22T10:52:06.798 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-2:18.0.0-4512.g2016e3af.el8.x86_64 1/158 2023-06-22T10:52:06.798 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-base-2:18.0.0-4512.g2016e3af.el8.x86_64 2/158 2023-06-22T10:52:06.799 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-common-2:18.0.0-4512.g2016e3af.el8.x86_64 3/158 2023-06-22T10:52:06.799 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-fuse-2:18.0.0-4512.g2016e3af.el8.x86_64 4/158 2023-06-22T10:52:06.799 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-4512.g2016e 5/158 2023-06-22T10:52:06.799 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mds-2:18.0.0-4512.g2016e3af.el8.x86_64 6/158 2023-06-22T10:52:06.799 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-2:18.0.0-4512.g2016e3af.el8.x86_64 7/158 2023-06-22T10:52:06.799 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mon-2:18.0.0-4512.g2016e3af.el8.x86_64 8/158 2023-06-22T10:52:06.799 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-osd-2:18.0.0-4512.g2016e3af.el8.x86_64 9/158 2023-06-22T10:52:06.800 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-radosgw-2:18.0.0-4512.g2016e3af.el8.x86_64 10/158 2023-06-22T10:52:06.800 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-selinux-2:18.0.0-4512.g2016e3af.el8.x86_64 11/158 2023-06-22T10:52:06.800 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-test-2:18.0.0-4512.g2016e3af.el8.x86_64 12/158 2023-06-22T10:52:06.800 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : cephfs-mirror-2:18.0.0-4512.g2016e3af.el8.x86_64 13/158 2023-06-22T10:52:06.800 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcephfs-devel-2:18.0.0-4512.g2016e3af.el8.x86_ 14/158 2023-06-22T10:52:06.800 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcephfs2-2:18.0.0-4512.g2016e3af.el8.x86_64 15/158 2023-06-22T10:52:06.800 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcephsqlite-2:18.0.0-4512.g2016e3af.el8.x86_64 16/158 2023-06-22T10:52:06.801 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librados-devel-2:18.0.0-4512.g2016e3af.el8.x86_6 17/158 2023-06-22T10:52:06.801 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libradosstriper1-2:18.0.0-4512.g2016e3af.el8.x86 18/158 2023-06-22T10:52:06.801 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librgw2-2:18.0.0-4512.g2016e3af.el8.x86_64 19/158 2023-06-22T10:52:06.801 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-ceph-argparse-2:18.0.0-4512.g2016e3af.el 20/158 2023-06-22T10:52:06.801 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-ceph-common-2:18.0.0-4512.g2016e3af.el8. 21/158 2023-06-22T10:52:06.801 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cephfs-2:18.0.0-4512.g2016e3af.el8.x86_6 22/158 2023-06-22T10:52:06.801 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rados-2:18.0.0-4512.g2016e3af.el8.x86_64 23/158 2023-06-22T10:52:06.802 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rbd-2:18.0.0-4512.g2016e3af.el8.x86_64 24/158 2023-06-22T10:52:06.802 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rgw-2:18.0.0-4512.g2016e3af.el8.x86_64 25/158 2023-06-22T10:52:06.802 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rbd-fuse-2:18.0.0-4512.g2016e3af.el8.x86_64 26/158 2023-06-22T10:52:06.810 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rbd-mirror-2:18.0.0-4512.g2016e3af.el8.x86_64 27/158 2023-06-22T10:52:06.811 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rbd-nbd-2:18.0.0-4512.g2016e3af.el8.x86_64 28/158 2023-06-22T10:52:06.811 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-4512.g2016e3af. 29/158 2023-06-22T10:52:06.811 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-4512.g2016e3af.el8.noa 30/158 2023-06-22T10:52:06.811 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-4512.g2016e3af.el8.n 31/158 2023-06-22T10:52:06.811 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-4512.g201 32/158 2023-06-22T10:52:06.812 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-4512.g2016e3af.el 33/158 2023-06-22T10:52:06.812 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-rook-2:18.0.0-4512.g2016e3af.el8.noarch 34/158 2023-06-22T10:52:06.812 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-4512.g2016e3af.e 35/158 2023-06-22T10:52:06.812 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-volume-2:18.0.0-4512.g2016e3af.el8.noarch 36/158 2023-06-22T10:52:06.812 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : cephadm-2:18.0.0-4512.g2016e3af.el8.noarch 37/158 2023-06-22T10:52:06.812 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : cephfs-top-2:18.0.0-4512.g2016e3af.el8.noarch 38/158 2023-06-22T10:52:06.813 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : automake-1.16.1-7.el8.noarch 39/158 2023-06-22T10:52:06.813 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/158 2023-06-22T10:52:06.813 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/158 2023-06-22T10:52:06.813 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : jq-1.6-7.el8.x86_64 42/158 2023-06-22T10:52:06.813 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libpq-13.5-1.el8.x86_64 43/158 2023-06-22T10:52:06.813 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 44/158 2023-06-22T10:52:06.813 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 45/158 2023-06-22T10:52:06.814 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 46/158 2023-06-22T10:52:06.814 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 47/158 2023-06-22T10:52:06.814 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 48/158 2023-06-22T10:52:06.814 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 49/158 2023-06-22T10:52:06.814 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 50/158 2023-06-22T10:52:06.814 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : postgresql-contrib-10.23-1.module_el8+300+2c5300 51/158 2023-06-22T10:52:06.815 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : postgresql-server-10.23-1.module_el8+300+2c53004 52/158 2023-06-22T10:52:06.815 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 53/158 2023-06-22T10:52:06.815 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 54/158 2023-06-22T10:52:06.815 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 55/158 2023-06-22T10:52:06.815 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 56/158 2023-06-22T10:52:06.815 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 57/158 2023-06-22T10:52:06.816 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 58/158 2023-06-22T10:52:06.816 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 59/158 2023-06-22T10:52:06.816 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 60/158 2023-06-22T10:52:06.816 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 61/158 2023-06-22T10:52:06.816 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/158 2023-06-22T10:52:06.816 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 63/158 2023-06-22T10:52:06.816 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 64/158 2023-06-22T10:52:06.817 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 65/158 2023-06-22T10:52:06.817 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 66/158 2023-06-22T10:52:06.817 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 67/158 2023-06-22T10:52:06.817 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 68/158 2023-06-22T10:52:06.817 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 69/158 2023-06-22T10:52:06.817 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 70/158 2023-06-22T10:52:06.818 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : elfutils-libelf-devel-0.189-2.el8.x86_64 71/158 2023-06-22T10:52:06.818 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 72/158 2023-06-22T10:52:06.818 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 73/158 2023-06-22T10:52:06.818 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 74/158 2023-06-22T10:52:06.818 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 75/158 2023-06-22T10:52:06.819 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 76/158 2023-06-22T10:52:06.819 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libgfortran-8.5.0-19.el8.x86_64 77/158 2023-06-22T10:52:06.819 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libquadmath-8.5.0-19.el8.x86_64 78/158 2023-06-22T10:52:06.819 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 79/158 2023-06-22T10:52:06.819 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 80/158 2023-06-22T10:52:06.819 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 81/158 2023-06-22T10:52:06.819 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libuuid-devel-2.32.1-42.el8.x86_64 82/158 2023-06-22T10:52:06.820 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 83/158 2023-06-22T10:52:06.820 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 84/158 2023-06-22T10:52:06.820 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 85/158 2023-06-22T10:52:06.820 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 86/158 2023-06-22T10:52:06.820 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 87/158 2023-06-22T10:52:06.820 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 88/158 2023-06-22T10:52:06.821 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 89/158 2023-06-22T10:52:06.821 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 90/158 2023-06-22T10:52:06.821 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 91/158 2023-06-22T10:52:06.821 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 92/158 2023-06-22T10:52:06.822 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 93/158 2023-06-22T10:52:06.822 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 94/158 2023-06-22T10:52:06.822 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 95/158 2023-06-22T10:52:06.822 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 96/158 2023-06-22T10:52:06.822 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 97/158 2023-06-22T10:52:06.823 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 98/158 2023-06-22T10:52:06.823 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 99/158 2023-06-22T10:52:06.823 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 100/158 2023-06-22T10:52:06.823 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 101/158 2023-06-22T10:52:06.823 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 102/158 2023-06-22T10:52:06.823 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 103/158 2023-06-22T10:52:06.823 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 104/158 2023-06-22T10:52:06.823 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 105/158 2023-06-22T10:52:06.824 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 106/158 2023-06-22T10:52:06.824 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 107/158 2023-06-22T10:52:06.824 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 108/158 2023-06-22T10:52:06.824 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 109/158 2023-06-22T10:52:06.824 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 110/158 2023-06-22T10:52:06.824 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 111/158 2023-06-22T10:52:06.825 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 112/158 2023-06-22T10:52:06.825 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 113/158 2023-06-22T10:52:06.825 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 114/158 2023-06-22T10:52:06.825 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-portend-2.6-1.el8.noarch 115/158 2023-06-22T10:52:06.825 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 116/158 2023-06-22T10:52:06.825 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 117/158 2023-06-22T10:52:06.825 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 118/158 2023-06-22T10:52:06.825 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 119/158 2023-06-22T10:52:06.826 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 120/158 2023-06-22T10:52:06.826 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 121/158 2023-06-22T10:52:06.826 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 122/158 2023-06-22T10:52:06.826 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 123/158 2023-06-22T10:52:06.826 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 124/158 2023-06-22T10:52:06.826 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 125/158 2023-06-22T10:52:06.826 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 126/158 2023-06-22T10:52:06.827 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 127/158 2023-06-22T10:52:06.827 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 128/158 2023-06-22T10:52:06.827 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librados2-2:18.0.0-4512.g2016e3af.el8.x86_64 129/158 2023-06-22T10:52:06.827 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/158 2023-06-22T10:52:06.827 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librbd1-2:18.0.0-4512.g2016e3af.el8.x86_64 131/158 2023-06-22T10:52:06.827 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/158 2023-06-22T10:52:06.827 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-7.el 133/158 2023-06-22T10:52:06.827 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 134/158 2023-06-22T10:52:06.828 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : elfutils-debuginfod-client-0.189-2.el8.x86_64 135/158 2023-06-22T10:52:06.828 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 136/158 2023-06-22T10:52:06.828 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : elfutils-libelf-0.189-2.el8.x86_64 137/158 2023-06-22T10:52:06.828 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 138/158 2023-06-22T10:52:06.829 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : elfutils-libs-0.189-2.el8.x86_64 139/158 2023-06-22T10:52:06.829 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 140/158 2023-06-22T10:52:06.829 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : iproute-6.2.0-2.el8.x86_64 141/158 2023-06-22T10:52:06.829 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 142/158 2023-06-22T10:52:06.829 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libblkid-2.32.1-42.el8.x86_64 143/158 2023-06-22T10:52:06.829 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 144/158 2023-06-22T10:52:06.829 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libfdisk-2.32.1-42.el8.x86_64 145/158 2023-06-22T10:52:06.830 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 146/158 2023-06-22T10:52:06.830 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libmount-2.32.1-42.el8.x86_64 147/158 2023-06-22T10:52:06.830 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 148/158 2023-06-22T10:52:06.830 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libsmartcols-2.32.1-42.el8.x86_64 149/158 2023-06-22T10:52:06.830 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 150/158 2023-06-22T10:52:06.830 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libuuid-2.32.1-42.el8.x86_64 151/158 2023-06-22T10:52:06.830 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 152/158 2023-06-22T10:52:06.830 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : util-linux-2.32.1-42.el8.x86_64 153/158 2023-06-22T10:52:06.831 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 154/158 2023-06-22T10:52:06.831 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : util-linux-user-2.32.1-42.el8.x86_64 155/158 2023-06-22T10:52:06.831 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 156/158 2023-06-22T10:52:06.831 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 157/158 2023-06-22T10:52:06.849 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : cephfs-mirror-2:18.0.0-4512.g2016e3af.el8.x86_64 126/158 2023-06-22T10:52:07.281 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-4512.g2016e3af.el8.x86_64 126/158 2023-06-22T10:52:07.482 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : rbd-mirror-2:18.0.0-4512.g2016e3af.el8.x86_64 127/158 2023-06-22T10:52:07.786 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: rbd-mirror-2:18.0.0-4512.g2016e3af.el8.x86_64 127/158 2023-06-22T10:52:08.110 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : postgresql-contrib-10.23-1.module_el8+300+2c5300 128/158 2023-06-22T10:52:08.893 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 158/158 2023-06-22T10:52:08.893 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:52:08.893 INFO:teuthology.orchestra.run.smithi040.stdout:Upgraded: 2023-06-22T10:52:08.894 INFO:teuthology.orchestra.run.smithi040.stdout: NetworkManager-initscripts-updown-1:1.40.16-7.el8.noarch 2023-06-22T10:52:08.894 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-debuginfod-client-0.189-2.el8.x86_64 2023-06-22T10:52:08.894 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-libelf-0.189-2.el8.x86_64 2023-06-22T10:52:08.894 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-libs-0.189-2.el8.x86_64 2023-06-22T10:52:08.894 INFO:teuthology.orchestra.run.smithi040.stdout: iproute-6.2.0-2.el8.x86_64 2023-06-22T10:52:08.894 INFO:teuthology.orchestra.run.smithi040.stdout: libblkid-2.32.1-42.el8.x86_64 2023-06-22T10:52:08.894 INFO:teuthology.orchestra.run.smithi040.stdout: libfdisk-2.32.1-42.el8.x86_64 2023-06-22T10:52:08.895 INFO:teuthology.orchestra.run.smithi040.stdout: libmount-2.32.1-42.el8.x86_64 2023-06-22T10:52:08.895 INFO:teuthology.orchestra.run.smithi040.stdout: librados2-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-22T10:52:08.895 INFO:teuthology.orchestra.run.smithi040.stdout: librbd1-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-22T10:52:08.895 INFO:teuthology.orchestra.run.smithi040.stdout: libsmartcols-2.32.1-42.el8.x86_64 2023-06-22T10:52:08.895 INFO:teuthology.orchestra.run.smithi040.stdout: libuuid-2.32.1-42.el8.x86_64 2023-06-22T10:52:08.895 INFO:teuthology.orchestra.run.smithi040.stdout: util-linux-2.32.1-42.el8.x86_64 2023-06-22T10:52:08.895 INFO:teuthology.orchestra.run.smithi040.stdout: util-linux-user-2.32.1-42.el8.x86_64 2023-06-22T10:52:08.895 INFO:teuthology.orchestra.run.smithi040.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-06-22T10:52:08.896 INFO:teuthology.orchestra.run.smithi040.stdout:Installed: 2023-06-22T10:52:08.896 INFO:teuthology.orchestra.run.smithi040.stdout: automake-1.16.1-7.el8.noarch 2023-06-22T10:52:08.896 INFO:teuthology.orchestra.run.smithi040.stdout: bison-3.0.4-10.el8.x86_64 2023-06-22T10:52:08.896 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-22T10:52:08.896 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-base-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-22T10:52:08.896 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-common-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-22T10:52:08.896 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-fuse-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-22T10:52:08.897 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-grafana-dashboards-2:18.0.0-4512.g2016e3af.el8.noarch 2023-06-22T10:52:08.897 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-immutable-object-cache-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-22T10:52:08.897 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mds-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-22T10:52:08.897 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-22T10:52:08.897 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-cephadm-2:18.0.0-4512.g2016e3af.el8.noarch 2023-06-22T10:52:08.897 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-dashboard-2:18.0.0-4512.g2016e3af.el8.noarch 2023-06-22T10:52:08.897 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-diskprediction-local-2:18.0.0-4512.g2016e3af.el8.noarch 2023-06-22T10:52:08.898 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-modules-core-2:18.0.0-4512.g2016e3af.el8.noarch 2023-06-22T10:52:08.898 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-rook-2:18.0.0-4512.g2016e3af.el8.noarch 2023-06-22T10:52:08.898 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mon-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-22T10:52:08.898 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-osd-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-22T10:52:08.898 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-prometheus-alerts-2:18.0.0-4512.g2016e3af.el8.noarch 2023-06-22T10:52:08.899 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-radosgw-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-22T10:52:08.899 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-selinux-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-22T10:52:08.899 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-test-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-22T10:52:08.899 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-volume-2:18.0.0-4512.g2016e3af.el8.noarch 2023-06-22T10:52:08.899 INFO:teuthology.orchestra.run.smithi040.stdout: cephadm-2:18.0.0-4512.g2016e3af.el8.noarch 2023-06-22T10:52:08.899 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-mirror-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-22T10:52:08.899 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-top-2:18.0.0-4512.g2016e3af.el8.noarch 2023-06-22T10:52:08.899 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-libelf-devel-0.189-2.el8.x86_64 2023-06-22T10:52:08.900 INFO:teuthology.orchestra.run.smithi040.stdout: flex-2.6.1-9.el8.x86_64 2023-06-22T10:52:08.900 INFO:teuthology.orchestra.run.smithi040.stdout: fuse-2.9.7-17.el8.x86_64 2023-06-22T10:52:08.900 INFO:teuthology.orchestra.run.smithi040.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-06-22T10:52:08.900 INFO:teuthology.orchestra.run.smithi040.stdout: jq-1.6-7.el8.x86_64 2023-06-22T10:52:08.900 INFO:teuthology.orchestra.run.smithi040.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-06-22T10:52:08.900 INFO:teuthology.orchestra.run.smithi040.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-06-22T10:52:08.900 INFO:teuthology.orchestra.run.smithi040.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-06-22T10:52:08.901 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs-devel-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-22T10:52:08.901 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs2-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-22T10:52:08.901 INFO:teuthology.orchestra.run.smithi040.stdout: libcephsqlite-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-22T10:52:08.902 INFO:teuthology.orchestra.run.smithi040.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-06-22T10:52:08.902 INFO:teuthology.orchestra.run.smithi040.stdout: libgfortran-8.5.0-19.el8.x86_64 2023-06-22T10:52:08.902 INFO:teuthology.orchestra.run.smithi040.stdout: liboath-2.6.2-3.el8.x86_64 2023-06-22T10:52:08.902 INFO:teuthology.orchestra.run.smithi040.stdout: libpq-13.5-1.el8.x86_64 2023-06-22T10:52:08.902 INFO:teuthology.orchestra.run.smithi040.stdout: libquadmath-8.5.0-19.el8.x86_64 2023-06-22T10:52:08.902 INFO:teuthology.orchestra.run.smithi040.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-06-22T10:52:08.902 INFO:teuthology.orchestra.run.smithi040.stdout: librados-devel-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-22T10:52:08.903 INFO:teuthology.orchestra.run.smithi040.stdout: libradosstriper1-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-22T10:52:08.903 INFO:teuthology.orchestra.run.smithi040.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-06-22T10:52:08.903 INFO:teuthology.orchestra.run.smithi040.stdout: librgw2-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-22T10:52:08.903 INFO:teuthology.orchestra.run.smithi040.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-06-22T10:52:08.903 INFO:teuthology.orchestra.run.smithi040.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-06-22T10:52:08.903 INFO:teuthology.orchestra.run.smithi040.stdout: libtool-2.4.6-25.el8.x86_64 2023-06-22T10:52:08.903 INFO:teuthology.orchestra.run.smithi040.stdout: libunwind-1.3.1-3.el8.x86_64 2023-06-22T10:52:08.904 INFO:teuthology.orchestra.run.smithi040.stdout: libuuid-devel-2.32.1-42.el8.x86_64 2023-06-22T10:52:08.904 INFO:teuthology.orchestra.run.smithi040.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-06-22T10:52:08.904 INFO:teuthology.orchestra.run.smithi040.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-06-22T10:52:08.904 INFO:teuthology.orchestra.run.smithi040.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-06-22T10:52:08.904 INFO:teuthology.orchestra.run.smithi040.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-06-22T10:52:08.904 INFO:teuthology.orchestra.run.smithi040.stdout: openblas-0.3.15-4.el8.x86_64 2023-06-22T10:52:08.904 INFO:teuthology.orchestra.run.smithi040.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-06-22T10:52:08.904 INFO:teuthology.orchestra.run.smithi040.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-06-22T10:52:08.905 INFO:teuthology.orchestra.run.smithi040.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-06-22T10:52:08.905 INFO:teuthology.orchestra.run.smithi040.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-06-22T10:52:08.905 INFO:teuthology.orchestra.run.smithi040.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-06-22T10:52:08.905 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-10.23-1.module_el8+300+2c53004c.x86_64 2023-06-22T10:52:08.905 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-contrib-10.23-1.module_el8+300+2c53004c.x86_64 2023-06-22T10:52:08.905 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-server-10.23-1.module_el8+300+2c53004c.x86_64 2023-06-22T10:52:08.905 INFO:teuthology.orchestra.run.smithi040.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-06-22T10:52:08.906 INFO:teuthology.orchestra.run.smithi040.stdout: python3-babel-2.5.1-7.el8.noarch 2023-06-22T10:52:08.906 INFO:teuthology.orchestra.run.smithi040.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-06-22T10:52:08.906 INFO:teuthology.orchestra.run.smithi040.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-06-22T10:52:08.906 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-06-22T10:52:08.906 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-argparse-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-22T10:52:08.906 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-common-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-22T10:52:08.906 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cephfs-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-22T10:52:08.906 INFO:teuthology.orchestra.run.smithi040.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-06-22T10:52:08.907 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-06-22T10:52:08.907 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-06-22T10:52:08.907 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-06-22T10:52:08.907 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-06-22T10:52:08.907 INFO:teuthology.orchestra.run.smithi040.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-06-22T10:52:08.907 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-6.2-6.el8.noarch 2023-06-22T10:52:08.907 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-06-22T10:52:08.907 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-06-22T10:52:08.908 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-06-22T10:52:08.908 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-06-22T10:52:08.908 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-06-22T10:52:08.908 INFO:teuthology.orchestra.run.smithi040.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-06-22T10:52:08.908 INFO:teuthology.orchestra.run.smithi040.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-06-22T10:52:08.908 INFO:teuthology.orchestra.run.smithi040.stdout: python3-mako-1.0.6-14.el8.noarch 2023-06-22T10:52:08.908 INFO:teuthology.orchestra.run.smithi040.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-06-22T10:52:08.909 INFO:teuthology.orchestra.run.smithi040.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-06-22T10:52:08.909 INFO:teuthology.orchestra.run.smithi040.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-06-22T10:52:08.909 INFO:teuthology.orchestra.run.smithi040.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-06-22T10:52:08.909 INFO:teuthology.orchestra.run.smithi040.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-06-22T10:52:08.909 INFO:teuthology.orchestra.run.smithi040.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-06-22T10:52:08.909 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-06-22T10:52:08.909 INFO:teuthology.orchestra.run.smithi040.stdout: python3-portend-2.6-1.el8.noarch 2023-06-22T10:52:08.910 INFO:teuthology.orchestra.run.smithi040.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-06-22T10:52:08.910 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-06-22T10:52:08.910 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-06-22T10:52:08.910 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-06-22T10:52:08.910 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pycparser-2.14-14.el8.noarch 2023-06-22T10:52:08.910 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pytz-2017.2-9.el8.noarch 2023-06-22T10:52:08.910 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rados-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-22T10:52:08.910 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rbd-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-22T10:52:08.911 INFO:teuthology.orchestra.run.smithi040.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-06-22T10:52:08.911 INFO:teuthology.orchestra.run.smithi040.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-06-22T10:52:08.911 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rgw-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-22T10:52:08.911 INFO:teuthology.orchestra.run.smithi040.stdout: python3-routes-2.4.1-12.el8.noarch 2023-06-22T10:52:08.911 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rsa-4.8-1.el8.noarch 2023-06-22T10:52:08.911 INFO:teuthology.orchestra.run.smithi040.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-06-22T10:52:08.911 INFO:teuthology.orchestra.run.smithi040.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-06-22T10:52:08.912 INFO:teuthology.orchestra.run.smithi040.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-06-22T10:52:08.912 INFO:teuthology.orchestra.run.smithi040.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-06-22T10:52:08.912 INFO:teuthology.orchestra.run.smithi040.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-06-22T10:52:08.912 INFO:teuthology.orchestra.run.smithi040.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-06-22T10:52:08.913 INFO:teuthology.orchestra.run.smithi040.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-06-22T10:52:08.913 INFO:teuthology.orchestra.run.smithi040.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-06-22T10:52:08.913 INFO:teuthology.orchestra.run.smithi040.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-06-22T10:52:08.913 INFO:teuthology.orchestra.run.smithi040.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-06-22T10:52:08.913 INFO:teuthology.orchestra.run.smithi040.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-06-22T10:52:08.913 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-fuse-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-22T10:52:08.913 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-mirror-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-22T10:52:08.914 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-nbd-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-22T10:52:08.914 INFO:teuthology.orchestra.run.smithi040.stdout: socat-1.7.4.1-1.el8.x86_64 2023-06-22T10:52:08.914 INFO:teuthology.orchestra.run.smithi040.stdout: thrift-0.13.0-2.el8.x86_64 2023-06-22T10:52:08.914 INFO:teuthology.orchestra.run.smithi040.stdout: uuid-1.6.2-43.el8.x86_64 2023-06-22T10:52:08.914 INFO:teuthology.orchestra.run.smithi040.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-06-22T10:52:08.914 INFO:teuthology.orchestra.run.smithi040.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-06-22T10:52:08.915 INFO:teuthology.orchestra.run.smithi040.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-06-22T10:52:08.915 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:52:08.915 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2023-06-22T10:52:09.200 DEBUG:teuthology.parallel:result is None 2023-06-22T10:52:09.409 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-fuse-2:18.0.0-4512.g2016e3af.el8.x86_64 129/158 2023-06-22T10:52:09.729 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 130/158 2023-06-22T10:52:09.940 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : elfutils-libelf-devel-0.189-2.el8.x86_64 131/158 2023-06-22T10:52:10.122 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : util-linux-user-2.32.1-42.el8.x86_64 132/158 2023-06-22T10:52:10.271 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/158 2023-06-22T10:52:10.475 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libcephfs-devel-2:18.0.0-4512.g2016e3af.el8.x86_ 134/158 2023-06-22T10:52:11.732 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 135/158 2023-06-22T10:52:11.982 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : postgresql-server-10.23-1.module_el8+300+2c53004 135/158 2023-06-22T10:52:12.022 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 135/158 2023-06-22T10:52:12.259 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : cephfs-top-2:18.0.0-4512.g2016e3af.el8.noarch 136/158 2023-06-22T10:52:12.451 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : rbd-fuse-2:18.0.0-4512.g2016e3af.el8.x86_64 137/158 2023-06-22T10:52:12.810 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : rbd-nbd-2:18.0.0-4512.g2016e3af.el8.x86_64 138/158 2023-06-22T10:52:13.059 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : iproute-6.2.0-2.el8.x86_64 139/158 2023-06-22T10:52:13.214 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-7.el 140/158 2023-06-22T10:52:13.240 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-7.el 140/158 2023-06-22T10:52:13.466 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 141/158 2023-06-22T10:52:13.681 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : flex-2.6.1-9.el8.x86_64 142/158 2023-06-22T10:52:13.800 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 142/158 2023-06-22T10:52:14.014 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : bison-3.0.4-10.el8.x86_64 143/158 2023-06-22T10:52:14.040 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 143/158 2023-06-22T10:52:14.208 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 144/158 2023-06-22T10:52:14.399 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 145/158 2023-06-22T10:52:14.399 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 146/158 2023-06-22T10:52:14.652 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 146/158 2023-06-22T10:52:14.652 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 147/158 2023-06-22T10:52:14.926 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 147/158 2023-06-22T10:52:14.941 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 148/158 2023-06-22T10:52:15.046 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 148/158 2023-06-22T10:52:15.046 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 149/158 2023-06-22T10:52:15.314 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 149/158 2023-06-22T10:52:15.508 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 150/158 2023-06-22T10:52:15.689 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 151/158 2023-06-22T10:52:15.908 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 152/158 2023-06-22T10:52:15.909 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 153/158 2023-06-22T10:52:16.135 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 153/158 2023-06-22T10:52:16.136 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 154/158 2023-06-22T10:52:16.343 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 154/158 2023-06-22T10:52:16.343 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 155/158 2023-06-22T10:52:16.560 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 155/158 2023-06-22T10:52:16.560 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 156/158 2023-06-22T10:52:16.801 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 156/158 2023-06-22T10:52:16.801 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 157/158 2023-06-22T10:52:17.017 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 157/158 2023-06-22T10:52:17.208 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 158/158 2023-06-22T10:52:17.425 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 158/158 2023-06-22T10:52:17.425 INFO:teuthology.orchestra.run.smithi045.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-06-22T10:52:17.425 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-22T10:52:18.146 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-2:18.0.0-4512.g2016e3af.el8.x86_64 1/158 2023-06-22T10:52:18.146 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-base-2:18.0.0-4512.g2016e3af.el8.x86_64 2/158 2023-06-22T10:52:18.146 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-common-2:18.0.0-4512.g2016e3af.el8.x86_64 3/158 2023-06-22T10:52:18.146 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-fuse-2:18.0.0-4512.g2016e3af.el8.x86_64 4/158 2023-06-22T10:52:18.147 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-4512.g2016e 5/158 2023-06-22T10:52:18.147 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mds-2:18.0.0-4512.g2016e3af.el8.x86_64 6/158 2023-06-22T10:52:18.147 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-2:18.0.0-4512.g2016e3af.el8.x86_64 7/158 2023-06-22T10:52:18.147 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mon-2:18.0.0-4512.g2016e3af.el8.x86_64 8/158 2023-06-22T10:52:18.147 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-osd-2:18.0.0-4512.g2016e3af.el8.x86_64 9/158 2023-06-22T10:52:18.147 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-radosgw-2:18.0.0-4512.g2016e3af.el8.x86_64 10/158 2023-06-22T10:52:18.147 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-selinux-2:18.0.0-4512.g2016e3af.el8.x86_64 11/158 2023-06-22T10:52:18.148 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-test-2:18.0.0-4512.g2016e3af.el8.x86_64 12/158 2023-06-22T10:52:18.148 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : cephfs-mirror-2:18.0.0-4512.g2016e3af.el8.x86_64 13/158 2023-06-22T10:52:18.148 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libcephfs-devel-2:18.0.0-4512.g2016e3af.el8.x86_ 14/158 2023-06-22T10:52:18.148 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libcephfs2-2:18.0.0-4512.g2016e3af.el8.x86_64 15/158 2023-06-22T10:52:18.148 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libcephsqlite-2:18.0.0-4512.g2016e3af.el8.x86_64 16/158 2023-06-22T10:52:18.148 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librados-devel-2:18.0.0-4512.g2016e3af.el8.x86_6 17/158 2023-06-22T10:52:18.148 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libradosstriper1-2:18.0.0-4512.g2016e3af.el8.x86 18/158 2023-06-22T10:52:18.148 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librgw2-2:18.0.0-4512.g2016e3af.el8.x86_64 19/158 2023-06-22T10:52:18.149 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-ceph-argparse-2:18.0.0-4512.g2016e3af.el 20/158 2023-06-22T10:52:18.149 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-ceph-common-2:18.0.0-4512.g2016e3af.el8. 21/158 2023-06-22T10:52:18.149 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cephfs-2:18.0.0-4512.g2016e3af.el8.x86_6 22/158 2023-06-22T10:52:18.149 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-rados-2:18.0.0-4512.g2016e3af.el8.x86_64 23/158 2023-06-22T10:52:18.149 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-rbd-2:18.0.0-4512.g2016e3af.el8.x86_64 24/158 2023-06-22T10:52:18.149 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-rgw-2:18.0.0-4512.g2016e3af.el8.x86_64 25/158 2023-06-22T10:52:18.149 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : rbd-fuse-2:18.0.0-4512.g2016e3af.el8.x86_64 26/158 2023-06-22T10:52:18.150 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : rbd-mirror-2:18.0.0-4512.g2016e3af.el8.x86_64 27/158 2023-06-22T10:52:18.158 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : rbd-nbd-2:18.0.0-4512.g2016e3af.el8.x86_64 28/158 2023-06-22T10:52:18.159 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-4512.g2016e3af. 29/158 2023-06-22T10:52:18.159 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-4512.g2016e3af.el8.noa 30/158 2023-06-22T10:52:18.159 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-4512.g2016e3af.el8.n 31/158 2023-06-22T10:52:18.159 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-4512.g201 32/158 2023-06-22T10:52:18.159 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-4512.g2016e3af.el 33/158 2023-06-22T10:52:18.159 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-rook-2:18.0.0-4512.g2016e3af.el8.noarch 34/158 2023-06-22T10:52:18.159 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-4512.g2016e3af.e 35/158 2023-06-22T10:52:18.160 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-volume-2:18.0.0-4512.g2016e3af.el8.noarch 36/158 2023-06-22T10:52:18.160 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : cephadm-2:18.0.0-4512.g2016e3af.el8.noarch 37/158 2023-06-22T10:52:18.160 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : cephfs-top-2:18.0.0-4512.g2016e3af.el8.noarch 38/158 2023-06-22T10:52:18.160 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : automake-1.16.1-7.el8.noarch 39/158 2023-06-22T10:52:18.160 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/158 2023-06-22T10:52:18.160 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/158 2023-06-22T10:52:18.161 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : jq-1.6-7.el8.x86_64 42/158 2023-06-22T10:52:18.161 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libpq-13.5-1.el8.x86_64 43/158 2023-06-22T10:52:18.162 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 44/158 2023-06-22T10:52:18.163 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 45/158 2023-06-22T10:52:18.163 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 46/158 2023-06-22T10:52:18.164 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 47/158 2023-06-22T10:52:18.165 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 48/158 2023-06-22T10:52:18.165 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 49/158 2023-06-22T10:52:18.165 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 50/158 2023-06-22T10:52:18.166 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : postgresql-contrib-10.23-1.module_el8+300+2c5300 51/158 2023-06-22T10:52:18.166 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : postgresql-server-10.23-1.module_el8+300+2c53004 52/158 2023-06-22T10:52:18.166 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 53/158 2023-06-22T10:52:18.167 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 54/158 2023-06-22T10:52:18.167 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 55/158 2023-06-22T10:52:18.167 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 56/158 2023-06-22T10:52:18.167 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 57/158 2023-06-22T10:52:18.168 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 58/158 2023-06-22T10:52:18.169 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 59/158 2023-06-22T10:52:18.169 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 60/158 2023-06-22T10:52:18.169 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 61/158 2023-06-22T10:52:18.169 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/158 2023-06-22T10:52:18.169 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 63/158 2023-06-22T10:52:18.169 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 64/158 2023-06-22T10:52:18.170 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 65/158 2023-06-22T10:52:18.170 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 66/158 2023-06-22T10:52:18.170 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 67/158 2023-06-22T10:52:18.170 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 68/158 2023-06-22T10:52:18.170 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 69/158 2023-06-22T10:52:18.170 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 70/158 2023-06-22T10:52:18.170 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : elfutils-libelf-devel-0.189-2.el8.x86_64 71/158 2023-06-22T10:52:18.170 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 72/158 2023-06-22T10:52:18.171 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 73/158 2023-06-22T10:52:18.171 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 74/158 2023-06-22T10:52:18.171 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 75/158 2023-06-22T10:52:18.171 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 76/158 2023-06-22T10:52:18.171 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libgfortran-8.5.0-19.el8.x86_64 77/158 2023-06-22T10:52:18.171 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libquadmath-8.5.0-19.el8.x86_64 78/158 2023-06-22T10:52:18.171 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 79/158 2023-06-22T10:52:18.172 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 80/158 2023-06-22T10:52:18.172 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 81/158 2023-06-22T10:52:18.172 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libuuid-devel-2.32.1-42.el8.x86_64 82/158 2023-06-22T10:52:18.172 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 83/158 2023-06-22T10:52:18.172 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 84/158 2023-06-22T10:52:18.173 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 85/158 2023-06-22T10:52:18.173 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 86/158 2023-06-22T10:52:18.173 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 87/158 2023-06-22T10:52:18.173 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 88/158 2023-06-22T10:52:18.173 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 89/158 2023-06-22T10:52:18.173 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 90/158 2023-06-22T10:52:18.173 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 91/158 2023-06-22T10:52:18.173 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 92/158 2023-06-22T10:52:18.174 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 93/158 2023-06-22T10:52:18.174 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 94/158 2023-06-22T10:52:18.174 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 95/158 2023-06-22T10:52:18.174 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 96/158 2023-06-22T10:52:18.174 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 97/158 2023-06-22T10:52:18.174 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 98/158 2023-06-22T10:52:18.174 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 99/158 2023-06-22T10:52:18.175 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 100/158 2023-06-22T10:52:18.175 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 101/158 2023-06-22T10:52:18.175 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 102/158 2023-06-22T10:52:18.175 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 103/158 2023-06-22T10:52:18.175 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 104/158 2023-06-22T10:52:18.175 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 105/158 2023-06-22T10:52:18.175 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 106/158 2023-06-22T10:52:18.175 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 107/158 2023-06-22T10:52:18.176 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 108/158 2023-06-22T10:52:18.176 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 109/158 2023-06-22T10:52:18.176 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 110/158 2023-06-22T10:52:18.176 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 111/158 2023-06-22T10:52:18.176 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 112/158 2023-06-22T10:52:18.176 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 113/158 2023-06-22T10:52:18.176 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 114/158 2023-06-22T10:52:18.177 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-portend-2.6-1.el8.noarch 115/158 2023-06-22T10:52:18.177 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 116/158 2023-06-22T10:52:18.177 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 117/158 2023-06-22T10:52:18.177 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 118/158 2023-06-22T10:52:18.177 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 119/158 2023-06-22T10:52:18.177 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 120/158 2023-06-22T10:52:18.177 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 121/158 2023-06-22T10:52:18.177 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 122/158 2023-06-22T10:52:18.178 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 123/158 2023-06-22T10:52:18.178 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 124/158 2023-06-22T10:52:18.178 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 125/158 2023-06-22T10:52:18.178 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 126/158 2023-06-22T10:52:18.178 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 127/158 2023-06-22T10:52:18.178 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 128/158 2023-06-22T10:52:18.178 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librados2-2:18.0.0-4512.g2016e3af.el8.x86_64 129/158 2023-06-22T10:52:18.179 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/158 2023-06-22T10:52:18.179 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librbd1-2:18.0.0-4512.g2016e3af.el8.x86_64 131/158 2023-06-22T10:52:18.179 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/158 2023-06-22T10:52:18.179 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-7.el 133/158 2023-06-22T10:52:18.179 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 134/158 2023-06-22T10:52:18.179 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : elfutils-debuginfod-client-0.189-2.el8.x86_64 135/158 2023-06-22T10:52:18.179 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 136/158 2023-06-22T10:52:18.179 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : elfutils-libelf-0.189-2.el8.x86_64 137/158 2023-06-22T10:52:18.180 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 138/158 2023-06-22T10:52:18.180 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : elfutils-libs-0.189-2.el8.x86_64 139/158 2023-06-22T10:52:18.180 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 140/158 2023-06-22T10:52:18.180 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : iproute-6.2.0-2.el8.x86_64 141/158 2023-06-22T10:52:18.180 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 142/158 2023-06-22T10:52:18.180 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libblkid-2.32.1-42.el8.x86_64 143/158 2023-06-22T10:52:18.180 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 144/158 2023-06-22T10:52:18.180 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libfdisk-2.32.1-42.el8.x86_64 145/158 2023-06-22T10:52:18.181 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 146/158 2023-06-22T10:52:18.181 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libmount-2.32.1-42.el8.x86_64 147/158 2023-06-22T10:52:18.181 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 148/158 2023-06-22T10:52:18.181 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libsmartcols-2.32.1-42.el8.x86_64 149/158 2023-06-22T10:52:18.181 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 150/158 2023-06-22T10:52:18.181 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libuuid-2.32.1-42.el8.x86_64 151/158 2023-06-22T10:52:18.181 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 152/158 2023-06-22T10:52:18.182 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : util-linux-2.32.1-42.el8.x86_64 153/158 2023-06-22T10:52:18.182 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 154/158 2023-06-22T10:52:18.182 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : util-linux-user-2.32.1-42.el8.x86_64 155/158 2023-06-22T10:52:18.182 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 156/158 2023-06-22T10:52:18.182 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 157/158 2023-06-22T10:52:20.221 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 158/158 2023-06-22T10:52:20.222 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-22T10:52:20.222 INFO:teuthology.orchestra.run.smithi045.stdout:Upgraded: 2023-06-22T10:52:20.222 INFO:teuthology.orchestra.run.smithi045.stdout: NetworkManager-initscripts-updown-1:1.40.16-7.el8.noarch 2023-06-22T10:52:20.222 INFO:teuthology.orchestra.run.smithi045.stdout: elfutils-debuginfod-client-0.189-2.el8.x86_64 2023-06-22T10:52:20.222 INFO:teuthology.orchestra.run.smithi045.stdout: elfutils-libelf-0.189-2.el8.x86_64 2023-06-22T10:52:20.223 INFO:teuthology.orchestra.run.smithi045.stdout: elfutils-libs-0.189-2.el8.x86_64 2023-06-22T10:52:20.223 INFO:teuthology.orchestra.run.smithi045.stdout: iproute-6.2.0-2.el8.x86_64 2023-06-22T10:52:20.223 INFO:teuthology.orchestra.run.smithi045.stdout: libblkid-2.32.1-42.el8.x86_64 2023-06-22T10:52:20.223 INFO:teuthology.orchestra.run.smithi045.stdout: libfdisk-2.32.1-42.el8.x86_64 2023-06-22T10:52:20.223 INFO:teuthology.orchestra.run.smithi045.stdout: libmount-2.32.1-42.el8.x86_64 2023-06-22T10:52:20.223 INFO:teuthology.orchestra.run.smithi045.stdout: librados2-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-22T10:52:20.223 INFO:teuthology.orchestra.run.smithi045.stdout: librbd1-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-22T10:52:20.223 INFO:teuthology.orchestra.run.smithi045.stdout: libsmartcols-2.32.1-42.el8.x86_64 2023-06-22T10:52:20.224 INFO:teuthology.orchestra.run.smithi045.stdout: libuuid-2.32.1-42.el8.x86_64 2023-06-22T10:52:20.224 INFO:teuthology.orchestra.run.smithi045.stdout: util-linux-2.32.1-42.el8.x86_64 2023-06-22T10:52:20.224 INFO:teuthology.orchestra.run.smithi045.stdout: util-linux-user-2.32.1-42.el8.x86_64 2023-06-22T10:52:20.224 INFO:teuthology.orchestra.run.smithi045.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-06-22T10:52:20.224 INFO:teuthology.orchestra.run.smithi045.stdout:Installed: 2023-06-22T10:52:20.224 INFO:teuthology.orchestra.run.smithi045.stdout: automake-1.16.1-7.el8.noarch 2023-06-22T10:52:20.225 INFO:teuthology.orchestra.run.smithi045.stdout: bison-3.0.4-10.el8.x86_64 2023-06-22T10:52:20.225 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-22T10:52:20.225 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-base-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-22T10:52:20.225 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-common-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-22T10:52:20.225 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-fuse-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-22T10:52:20.225 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-grafana-dashboards-2:18.0.0-4512.g2016e3af.el8.noarch 2023-06-22T10:52:20.225 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-immutable-object-cache-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-22T10:52:20.225 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mds-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-22T10:52:20.226 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-22T10:52:20.226 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-cephadm-2:18.0.0-4512.g2016e3af.el8.noarch 2023-06-22T10:52:20.226 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-dashboard-2:18.0.0-4512.g2016e3af.el8.noarch 2023-06-22T10:52:20.226 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-diskprediction-local-2:18.0.0-4512.g2016e3af.el8.noarch 2023-06-22T10:52:20.226 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-modules-core-2:18.0.0-4512.g2016e3af.el8.noarch 2023-06-22T10:52:20.226 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-rook-2:18.0.0-4512.g2016e3af.el8.noarch 2023-06-22T10:52:20.226 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mon-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-22T10:52:20.227 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-osd-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-22T10:52:20.227 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-prometheus-alerts-2:18.0.0-4512.g2016e3af.el8.noarch 2023-06-22T10:52:20.227 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-radosgw-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-22T10:52:20.227 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-selinux-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-22T10:52:20.227 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-test-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-22T10:52:20.227 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-volume-2:18.0.0-4512.g2016e3af.el8.noarch 2023-06-22T10:52:20.227 INFO:teuthology.orchestra.run.smithi045.stdout: cephadm-2:18.0.0-4512.g2016e3af.el8.noarch 2023-06-22T10:52:20.227 INFO:teuthology.orchestra.run.smithi045.stdout: cephfs-mirror-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-22T10:52:20.228 INFO:teuthology.orchestra.run.smithi045.stdout: cephfs-top-2:18.0.0-4512.g2016e3af.el8.noarch 2023-06-22T10:52:20.228 INFO:teuthology.orchestra.run.smithi045.stdout: elfutils-libelf-devel-0.189-2.el8.x86_64 2023-06-22T10:52:20.228 INFO:teuthology.orchestra.run.smithi045.stdout: flex-2.6.1-9.el8.x86_64 2023-06-22T10:52:20.228 INFO:teuthology.orchestra.run.smithi045.stdout: fuse-2.9.7-17.el8.x86_64 2023-06-22T10:52:20.228 INFO:teuthology.orchestra.run.smithi045.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-06-22T10:52:20.228 INFO:teuthology.orchestra.run.smithi045.stdout: jq-1.6-7.el8.x86_64 2023-06-22T10:52:20.229 INFO:teuthology.orchestra.run.smithi045.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-06-22T10:52:20.229 INFO:teuthology.orchestra.run.smithi045.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-06-22T10:52:20.229 INFO:teuthology.orchestra.run.smithi045.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-06-22T10:52:20.229 INFO:teuthology.orchestra.run.smithi045.stdout: libcephfs-devel-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-22T10:52:20.229 INFO:teuthology.orchestra.run.smithi045.stdout: libcephfs2-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-22T10:52:20.229 INFO:teuthology.orchestra.run.smithi045.stdout: libcephsqlite-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-22T10:52:20.229 INFO:teuthology.orchestra.run.smithi045.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-06-22T10:52:20.230 INFO:teuthology.orchestra.run.smithi045.stdout: libgfortran-8.5.0-19.el8.x86_64 2023-06-22T10:52:20.230 INFO:teuthology.orchestra.run.smithi045.stdout: liboath-2.6.2-3.el8.x86_64 2023-06-22T10:52:20.230 INFO:teuthology.orchestra.run.smithi045.stdout: libpq-13.5-1.el8.x86_64 2023-06-22T10:52:20.230 INFO:teuthology.orchestra.run.smithi045.stdout: libquadmath-8.5.0-19.el8.x86_64 2023-06-22T10:52:20.230 INFO:teuthology.orchestra.run.smithi045.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-06-22T10:52:20.230 INFO:teuthology.orchestra.run.smithi045.stdout: librados-devel-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-22T10:52:20.231 INFO:teuthology.orchestra.run.smithi045.stdout: libradosstriper1-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-22T10:52:20.231 INFO:teuthology.orchestra.run.smithi045.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-06-22T10:52:20.231 INFO:teuthology.orchestra.run.smithi045.stdout: librgw2-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-22T10:52:20.231 INFO:teuthology.orchestra.run.smithi045.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-06-22T10:52:20.231 INFO:teuthology.orchestra.run.smithi045.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-06-22T10:52:20.231 INFO:teuthology.orchestra.run.smithi045.stdout: libtool-2.4.6-25.el8.x86_64 2023-06-22T10:52:20.231 INFO:teuthology.orchestra.run.smithi045.stdout: libunwind-1.3.1-3.el8.x86_64 2023-06-22T10:52:20.232 INFO:teuthology.orchestra.run.smithi045.stdout: libuuid-devel-2.32.1-42.el8.x86_64 2023-06-22T10:52:20.232 INFO:teuthology.orchestra.run.smithi045.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-06-22T10:52:20.232 INFO:teuthology.orchestra.run.smithi045.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-06-22T10:52:20.232 INFO:teuthology.orchestra.run.smithi045.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-06-22T10:52:20.232 INFO:teuthology.orchestra.run.smithi045.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-06-22T10:52:20.232 INFO:teuthology.orchestra.run.smithi045.stdout: openblas-0.3.15-4.el8.x86_64 2023-06-22T10:52:20.233 INFO:teuthology.orchestra.run.smithi045.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-06-22T10:52:20.233 INFO:teuthology.orchestra.run.smithi045.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-06-22T10:52:20.233 INFO:teuthology.orchestra.run.smithi045.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-06-22T10:52:20.233 INFO:teuthology.orchestra.run.smithi045.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-06-22T10:52:20.233 INFO:teuthology.orchestra.run.smithi045.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-06-22T10:52:20.233 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-10.23-1.module_el8+300+2c53004c.x86_64 2023-06-22T10:52:20.233 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-contrib-10.23-1.module_el8+300+2c53004c.x86_64 2023-06-22T10:52:20.234 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-server-10.23-1.module_el8+300+2c53004c.x86_64 2023-06-22T10:52:20.234 INFO:teuthology.orchestra.run.smithi045.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-06-22T10:52:20.234 INFO:teuthology.orchestra.run.smithi045.stdout: python3-babel-2.5.1-7.el8.noarch 2023-06-22T10:52:20.234 INFO:teuthology.orchestra.run.smithi045.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-06-22T10:52:20.234 INFO:teuthology.orchestra.run.smithi045.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-06-22T10:52:20.235 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-06-22T10:52:20.235 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ceph-argparse-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-22T10:52:20.235 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ceph-common-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-22T10:52:20.235 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cephfs-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-22T10:52:20.235 INFO:teuthology.orchestra.run.smithi045.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-06-22T10:52:20.235 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-06-22T10:52:20.235 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-06-22T10:52:20.236 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-06-22T10:52:20.236 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-06-22T10:52:20.236 INFO:teuthology.orchestra.run.smithi045.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-06-22T10:52:20.236 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-6.2-6.el8.noarch 2023-06-22T10:52:20.237 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-06-22T10:52:20.237 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-06-22T10:52:20.237 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-06-22T10:52:20.237 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-06-22T10:52:20.238 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-06-22T10:52:20.238 INFO:teuthology.orchestra.run.smithi045.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-06-22T10:52:20.238 INFO:teuthology.orchestra.run.smithi045.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-06-22T10:52:20.239 INFO:teuthology.orchestra.run.smithi045.stdout: python3-mako-1.0.6-14.el8.noarch 2023-06-22T10:52:20.239 INFO:teuthology.orchestra.run.smithi045.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-06-22T10:52:20.239 INFO:teuthology.orchestra.run.smithi045.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-06-22T10:52:20.239 INFO:teuthology.orchestra.run.smithi045.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-06-22T10:52:20.240 INFO:teuthology.orchestra.run.smithi045.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-06-22T10:52:20.240 INFO:teuthology.orchestra.run.smithi045.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-06-22T10:52:20.241 INFO:teuthology.orchestra.run.smithi045.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-06-22T10:52:20.241 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-06-22T10:52:20.241 INFO:teuthology.orchestra.run.smithi045.stdout: python3-portend-2.6-1.el8.noarch 2023-06-22T10:52:20.242 INFO:teuthology.orchestra.run.smithi045.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-06-22T10:52:20.242 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-06-22T10:52:20.242 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-06-22T10:52:20.243 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-06-22T10:52:20.243 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pycparser-2.14-14.el8.noarch 2023-06-22T10:52:20.243 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pytz-2017.2-9.el8.noarch 2023-06-22T10:52:20.244 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rados-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-22T10:52:20.244 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rbd-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-22T10:52:20.244 INFO:teuthology.orchestra.run.smithi045.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-06-22T10:52:20.244 INFO:teuthology.orchestra.run.smithi045.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-06-22T10:52:20.245 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rgw-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-22T10:52:20.245 INFO:teuthology.orchestra.run.smithi045.stdout: python3-routes-2.4.1-12.el8.noarch 2023-06-22T10:52:20.245 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rsa-4.8-1.el8.noarch 2023-06-22T10:52:20.245 INFO:teuthology.orchestra.run.smithi045.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-06-22T10:52:20.245 INFO:teuthology.orchestra.run.smithi045.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-06-22T10:52:20.246 INFO:teuthology.orchestra.run.smithi045.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-06-22T10:52:20.246 INFO:teuthology.orchestra.run.smithi045.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-06-22T10:52:20.246 INFO:teuthology.orchestra.run.smithi045.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-06-22T10:52:20.247 INFO:teuthology.orchestra.run.smithi045.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-06-22T10:52:20.247 INFO:teuthology.orchestra.run.smithi045.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-06-22T10:52:20.247 INFO:teuthology.orchestra.run.smithi045.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-06-22T10:52:20.247 INFO:teuthology.orchestra.run.smithi045.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-06-22T10:52:20.248 INFO:teuthology.orchestra.run.smithi045.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-06-22T10:52:20.248 INFO:teuthology.orchestra.run.smithi045.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-06-22T10:52:20.248 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-fuse-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-22T10:52:20.248 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-mirror-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-22T10:52:20.248 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-nbd-2:18.0.0-4512.g2016e3af.el8.x86_64 2023-06-22T10:52:20.249 INFO:teuthology.orchestra.run.smithi045.stdout: socat-1.7.4.1-1.el8.x86_64 2023-06-22T10:52:20.249 INFO:teuthology.orchestra.run.smithi045.stdout: thrift-0.13.0-2.el8.x86_64 2023-06-22T10:52:20.249 INFO:teuthology.orchestra.run.smithi045.stdout: uuid-1.6.2-43.el8.x86_64 2023-06-22T10:52:20.249 INFO:teuthology.orchestra.run.smithi045.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-06-22T10:52:20.249 INFO:teuthology.orchestra.run.smithi045.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-06-22T10:52:20.250 INFO:teuthology.orchestra.run.smithi045.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-06-22T10:52:20.250 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-22T10:52:20.250 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2023-06-22T10:52:20.549 DEBUG:teuthology.parallel:result is None 2023-06-22T10:52:20.549 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=2016e3af238feea2bbee7eb0e99c925a041afbfb 2023-06-22T10:52:20.692 DEBUG:teuthology.orchestra.run.smithi040:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-06-22T10:52:20.753 INFO:teuthology.orchestra.run.smithi040.stdout:18.0.0-4512.g2016e3af.el8 2023-06-22T10:52:20.754 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4512.g2016e3af.el8 2023-06-22T10:52:20.754 INFO:teuthology.task.install:The correct ceph version 18.0.0-4512.g2016e3af is installed. 2023-06-22T10:52:20.754 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=2016e3af238feea2bbee7eb0e99c925a041afbfb 2023-06-22T10:52:20.898 DEBUG:teuthology.orchestra.run.smithi045:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-06-22T10:52:20.954 INFO:teuthology.orchestra.run.smithi045.stdout:18.0.0-4512.g2016e3af.el8 2023-06-22T10:52:20.954 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4512.g2016e3af.el8 2023-06-22T10:52:20.955 INFO:teuthology.task.install:The correct ceph version 18.0.0-4512.g2016e3af is installed. 2023-06-22T10:52:20.956 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-06-22T10:52:20.957 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-06-22T10:52:20.957 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-06-22T10:52:21.041 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-06-22T10:52:21.042 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-06-22T10:52:21.120 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-06-22T10:52:21.121 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-06-22T10:52:21.121 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/usr/bin/daemon-helper 2023-06-22T10:52:21.193 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-06-22T10:52:21.303 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-06-22T10:52:21.303 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/usr/bin/daemon-helper 2023-06-22T10:52:21.374 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-06-22T10:52:21.486 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-06-22T10:52:21.487 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-06-22T10:52:21.487 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/usr/bin/adjust-ulimits 2023-06-22T10:52:21.556 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-06-22T10:52:21.664 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-06-22T10:52:21.664 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/usr/bin/adjust-ulimits 2023-06-22T10:52:21.738 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-06-22T10:52:21.854 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-06-22T10:52:21.855 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-06-22T10:52:21.855 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/usr/bin/stdin-killer 2023-06-22T10:52:21.931 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-06-22T10:52:22.039 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-06-22T10:52:22.040 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/usr/bin/stdin-killer 2023-06-22T10:52:22.110 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-06-22T10:52:22.220 INFO:teuthology.run_tasks:Running task ceph... 2023-06-22T10:52:22.298 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-06-22T10:52:22.299 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 777 /var/log/ceph 2023-06-22T10:52:22.305 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 777 /var/log/ceph 2023-06-22T10:52:22.377 INFO:tasks.ceph:Disabling ceph logrotate... 2023-06-22T10:52:22.377 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f -- /etc/logrotate.d/ceph 2023-06-22T10:52:22.381 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -f -- /etc/logrotate.d/ceph 2023-06-22T10:52:22.451 INFO:tasks.ceph:Creating extra log directories... 2023-06-22T10:52:22.452 DEBUG:teuthology.orchestra.run.smithi040:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-06-22T10:52:22.456 DEBUG:teuthology.orchestra.run.smithi045:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-06-22T10:52:22.559 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-06-22T10:52:22.560 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-06-22T10:52:22.560 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-06-22T10:52:22.560 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-06-22T10:52:22.561 DEBUG:teuthology.orchestra.run.smithi040:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-06-22T10:52:22.605 DEBUG:teuthology.orchestra.run.smithi040:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-06-22T10:52:23.958 DEBUG:teuthology.orchestra.run.smithi040:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-06-22T10:52:24.036 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-06-22T10:52:24.036 DEBUG:teuthology.orchestra.run.smithi045:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-06-22T10:52:24.083 DEBUG:teuthology.orchestra.run.smithi045:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-06-22T10:52:24.308 DEBUG:teuthology.orchestra.run.smithi045:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-06-22T10:52:24.387 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-06-22T10:52:24.387 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-06-22T10:52:24.388 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2023-06-22_10:13:08-fs-wip-vshankar-testing-20230620.052303-testing-default-smithi/7311271', 'branch': 'wip-vshankar-testing-20230620.052303', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7311271', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '1c622d92b6f18ce44a7c33802686ff61c3c273ab'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2023-06-22_10:13:08-fs-wip-vshankar-testing-20230620.052303-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20230620.052303'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '2016e3af238feea2bbee7eb0e99c925a041afbfb'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '2016e3af238feea2bbee7eb0e99c925a041afbfb'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20230620.052303', 'sha1': 'dc76074c5388e1a03fbcea1abab06ce902f6af4a'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 30, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'sha1': '2016e3af238feea2bbee7eb0e99c925a041afbfb', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20230620.052303', 'suite_path': '/home/teuthworker/src/github.com_vshankar_ceph_dc76074c5388e1a03fbcea1abab06ce902f6af4a/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/vshankar/ceph.git', 'suite_sha1': 'dc76074c5388e1a03fbcea1abab06ce902f6af4a', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi040.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBH+2/SFRmzytbl/enmdJQUiPQ1GN7EolS/0G5tmh+gIe1jYoNjtMZ6t17OK8vcOecfiDJcQSJHDMOWvWQL3EPA=', 'smithi045.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcCLkfl52x2rp+0mfAP8oVnhMavNoxb4gVeCj1vfkX0Y6DfJbcmGMiU7UYwZL3+LP82e2LirMINjuFzNwzslQ6haSy7LHx2hBlQnVGA/Whbpr2ATWyzBqqLKQxymcjsH34E1AEKIZcwEqKDS+3wxh4YGBVugMGv/TDd8PAruqJI23UzHQbjRXSqCGoNLEEETAQkVv7FmxqVKnCKgqfDkWj9gUQraFj7zUzf5qFJFUfm4jqShfUYm5LfQVYU9w5NeCxguXwKgA3eVEtyrYDHtEUrqpqo9JKW0xjoAv1hzmkqTN30s2hxPbU+ySCeGiK1sOyTLeEOmin57aRVjTx7X166h/b1hWTOkrRDucl4QgmXAREyG/O7KuW6C7rPWckK5CBNYsbPnBd2CsY9w6L4s5aGekyrXjyTHSi5l5UT3Upu7S+oa/bk7JuHO6z4B0np5hoVpnH9JmfEwon+OTRqzbFjsThI/YsdZLR5xIn82X7O74KlE+HUjO4NJlq1Qaexh0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '1c622d92b6f18ce44a7c33802686ff61c3c273ab'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2016e3af238feea2bbee7eb0e99c925a041afbfb'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '076bbebc42a14f7d568aaa78eabb0038327bcb23', 'timestamp': '2023-06-22_10:13:08', 'tube': 'smithi', 'use_shaman': True, 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23459'} 2023-06-22T10:52:24.389 DEBUG:teuthology.orchestra.run.smithi040:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-06-22T10:52:24.395 DEBUG:teuthology.orchestra.run.smithi045:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-06-22T10:52:24.443 DEBUG:teuthology.orchestra.run.smithi040:> sudo install -d -m0777 -- /var/run/ceph 2023-06-22T10:52:24.448 DEBUG:teuthology.orchestra.run.smithi045:> sudo install -d -m0777 -- /var/run/ceph 2023-06-22T10:52:24.522 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-06-22T10:52:24.522 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/scratch_devs of=/dev/stdout 2023-06-22T10:52:24.569 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-06-22T10:52:24.569 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_1 2023-06-22T10:52:24.654 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-06-22T10:52:24.655 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-22T10:52:24.655 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 5h/5d Inode: 448 Links: 1 2023-06-22T10:52:24.655 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-22T10:52:24.655 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:device_t:s0 2023-06-22T10:52:24.655 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2023-06-22 10:52:06.269080781 +0000 2023-06-22T10:52:24.655 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2023-06-22 10:48:48.848149249 +0000 2023-06-22T10:52:24.655 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2023-06-22 10:48:48.848149249 +0000 2023-06-22T10:52:24.656 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: 2023-06-22 10:48:48.821149583 +0000 2023-06-22T10:52:24.656 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-06-22T10:52:24.760 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2023-06-22T10:52:24.761 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2023-06-22T10:52:24.761 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000271727 s, 1.9 MB/s 2023-06-22T10:52:24.763 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-06-22T10:52:24.810 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_2 2023-06-22T10:52:24.855 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-06-22T10:52:24.855 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-22T10:52:24.856 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 5h/5d Inode: 454 Links: 1 2023-06-22T10:52:24.856 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-22T10:52:24.856 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:device_t:s0 2023-06-22T10:52:24.856 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2023-06-22 10:52:06.269080781 +0000 2023-06-22T10:52:24.856 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2023-06-22 10:48:49.699138711 +0000 2023-06-22T10:52:24.856 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2023-06-22 10:48:49.699138711 +0000 2023-06-22T10:52:24.856 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: 2023-06-22 10:48:49.671139057 +0000 2023-06-22T10:52:24.857 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-06-22T10:52:24.961 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2023-06-22T10:52:24.961 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2023-06-22T10:52:24.961 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000270793 s, 1.9 MB/s 2023-06-22T10:52:24.963 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-06-22T10:52:25.010 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_3 2023-06-22T10:52:25.055 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-06-22T10:52:25.055 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-22T10:52:25.056 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 5h/5d Inode: 460 Links: 1 2023-06-22T10:52:25.056 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-22T10:52:25.056 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:device_t:s0 2023-06-22T10:52:25.056 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2023-06-22 10:52:06.269080781 +0000 2023-06-22T10:52:25.056 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2023-06-22 10:48:50.538128321 +0000 2023-06-22T10:52:25.056 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2023-06-22 10:48:50.538128321 +0000 2023-06-22T10:52:25.056 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: 2023-06-22 10:48:50.514128618 +0000 2023-06-22T10:52:25.057 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-06-22T10:52:25.161 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2023-06-22T10:52:25.161 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2023-06-22T10:52:25.162 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000287388 s, 1.8 MB/s 2023-06-22T10:52:25.163 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-06-22T10:52:25.210 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_4 2023-06-22T10:52:25.256 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-06-22T10:52:25.256 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-22T10:52:25.256 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 5h/5d Inode: 466 Links: 1 2023-06-22T10:52:25.257 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-22T10:52:25.257 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:device_t:s0 2023-06-22T10:52:25.257 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2023-06-22 10:52:06.269080781 +0000 2023-06-22T10:52:25.257 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2023-06-22 10:48:51.388117796 +0000 2023-06-22T10:52:25.258 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2023-06-22 10:48:51.388117796 +0000 2023-06-22T10:52:25.258 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: 2023-06-22 10:48:51.361118130 +0000 2023-06-22T10:52:25.259 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-06-22T10:52:25.362 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2023-06-22T10:52:25.362 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2023-06-22T10:52:25.363 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000287914 s, 1.8 MB/s 2023-06-22T10:52:25.365 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-06-22T10:52:25.412 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-22T10:52:25.413 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-06-22T10:52:25.413 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/scratch_devs of=/dev/stdout 2023-06-22T10:52:25.461 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-06-22T10:52:25.461 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_1 2023-06-22T10:52:25.549 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-06-22T10:52:25.549 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-22T10:52:25.549 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 5h/5d Inode: 448 Links: 1 2023-06-22T10:52:25.549 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-22T10:52:25.550 INFO:teuthology.orchestra.run.smithi045.stdout:Context: system_u:object_r:device_t:s0 2023-06-22T10:52:25.550 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2023-06-22 10:52:17.638501490 +0000 2023-06-22T10:52:25.550 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2023-06-22 10:48:50.020871829 +0000 2023-06-22T10:52:25.550 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2023-06-22 10:48:50.020871829 +0000 2023-06-22T10:52:25.550 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: 2023-06-22 10:48:50.000872151 +0000 2023-06-22T10:52:25.550 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-06-22T10:52:25.620 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2023-06-22T10:52:25.620 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2023-06-22T10:52:25.620 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.000202605 s, 2.5 MB/s 2023-06-22T10:52:25.623 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-06-22T10:52:25.673 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_2 2023-06-22T10:52:25.719 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-06-22T10:52:25.719 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-22T10:52:25.719 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 5h/5d Inode: 454 Links: 1 2023-06-22T10:52:25.719 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-22T10:52:25.720 INFO:teuthology.orchestra.run.smithi045.stdout:Context: system_u:object_r:device_t:s0 2023-06-22T10:52:25.720 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2023-06-22 10:52:17.638501490 +0000 2023-06-22T10:52:25.720 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2023-06-22 10:48:50.878858019 +0000 2023-06-22T10:52:25.721 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2023-06-22 10:48:50.878858019 +0000 2023-06-22T10:52:25.721 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: 2023-06-22 10:48:50.856858373 +0000 2023-06-22T10:52:25.722 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-06-22T10:52:25.827 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2023-06-22T10:52:25.827 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2023-06-22T10:52:25.827 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.000172413 s, 3.0 MB/s 2023-06-22T10:52:25.829 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-06-22T10:52:25.880 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_3 2023-06-22T10:52:25.927 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-06-22T10:52:25.927 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-22T10:52:25.927 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 5h/5d Inode: 460 Links: 1 2023-06-22T10:52:25.927 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-22T10:52:25.927 INFO:teuthology.orchestra.run.smithi045.stdout:Context: system_u:object_r:device_t:s0 2023-06-22T10:52:25.928 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2023-06-22 10:52:17.638501490 +0000 2023-06-22T10:52:25.928 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2023-06-22 10:48:51.729844322 +0000 2023-06-22T10:52:25.928 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2023-06-22 10:48:51.729844322 +0000 2023-06-22T10:52:25.928 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: 2023-06-22 10:48:51.705844709 +0000 2023-06-22T10:52:25.928 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-06-22T10:52:26.036 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2023-06-22T10:52:26.036 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2023-06-22T10:52:26.036 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.000174529 s, 2.9 MB/s 2023-06-22T10:52:26.042 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-06-22T10:52:26.093 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_4 2023-06-22T10:52:26.141 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-06-22T10:52:26.141 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-22T10:52:26.142 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 5h/5d Inode: 466 Links: 1 2023-06-22T10:52:26.142 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-22T10:52:26.142 INFO:teuthology.orchestra.run.smithi045.stdout:Context: system_u:object_r:device_t:s0 2023-06-22T10:52:26.142 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2023-06-22 10:52:17.639501474 +0000 2023-06-22T10:52:26.142 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2023-06-22 10:48:52.566830851 +0000 2023-06-22T10:52:26.142 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2023-06-22 10:48:52.566830851 +0000 2023-06-22T10:52:26.142 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: 2023-06-22 10:48:52.543831221 +0000 2023-06-22T10:52:26.143 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-06-22T10:52:26.251 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2023-06-22T10:52:26.251 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2023-06-22T10:52:26.252 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.00015584 s, 3.3 MB/s 2023-06-22T10:52:26.254 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-06-22T10:52:26.302 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-22T10:52:26.302 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi040.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi045.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-06-22T10:52:26.303 INFO:tasks.ceph:Generating config... 2023-06-22T10:52:26.304 INFO:tasks.ceph:[client] client mount timeout = 600 2023-06-22T10:52:26.304 INFO:tasks.ceph:[client] debug client = 20 2023-06-22T10:52:26.304 INFO:tasks.ceph:[client] debug ms = 1 2023-06-22T10:52:26.305 INFO:tasks.ceph:[client] pid file = 2023-06-22T10:52:26.305 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-06-22T10:52:26.305 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-06-22T10:52:26.305 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-06-22T10:52:26.305 INFO:tasks.ceph:[mds] debug mds = 20 2023-06-22T10:52:26.306 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-06-22T10:52:26.306 INFO:tasks.ceph:[mds] debug ms = 1 2023-06-22T10:52:26.306 INFO:tasks.ceph:[mds] mds debug frag = True 2023-06-22T10:52:26.306 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-06-22T10:52:26.307 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-06-22T10:52:26.307 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-06-22T10:52:26.307 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-06-22T10:52:26.307 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-06-22T10:52:26.308 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-06-22T10:52:26.308 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-06-22T10:52:26.308 INFO:tasks.ceph:[mgr] debug ms = 1 2023-06-22T10:52:26.308 INFO:tasks.ceph:[mon] debug mon = 20 2023-06-22T10:52:26.308 INFO:tasks.ceph:[mon] debug ms = 1 2023-06-22T10:52:26.309 INFO:tasks.ceph:[mon] debug paxos = 20 2023-06-22T10:52:26.309 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-06-22T10:52:26.309 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-06-22T10:52:26.309 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-06-22T10:52:26.309 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-06-22T10:52:26.310 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-06-22T10:52:26.310 INFO:tasks.ceph:[osd] debug ms = 1 2023-06-22T10:52:26.310 INFO:tasks.ceph:[osd] debug osd = 20 2023-06-22T10:52:26.310 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-06-22T10:52:26.311 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-06-22T10:52:26.311 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-06-22T10:52:26.311 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-06-22T10:52:26.311 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-06-22T10:52:26.311 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-06-22T10:52:26.312 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-06-22T10:52:26.312 INFO:tasks.ceph:Setting up mon.a... 2023-06-22T10:52:26.313 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-06-22T10:52:26.433 INFO:teuthology.orchestra.run.smithi040.stdout:creating /etc/ceph/ceph.keyring 2023-06-22T10:52:26.441 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-06-22T10:52:26.543 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-06-22T10:52:26.611 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.40'), ('mon.b', '172.21.15.45'), ('mon.c', '[v2:172.21.15.45:3301,v1:172.21.15.45:6790]')] 2023-06-22T10:52:26.612 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.40,172.21.15.45,[v2:172.21.15.45:3301,v1:172.21.15.45:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-06-22T10:52:26.613 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-06-22T10:52:26.613 DEBUG:teuthology.orchestra.run.smithi040:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-06-22T10:52:26.658 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.40 --add b 172.21.15.45 --addv c '[v2:172.21.15.45:3301,v1:172.21.15.45:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-06-22T10:52:26.787 INFO:teuthology.orchestra.run.smithi040.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-06-22T10:52:26.787 INFO:teuthology.orchestra.run.smithi040.stdout:monmaptool: generated fsid 475560bc-1a7c-4a75-b3b6-6fc6b20bdc52 2023-06-22T10:52:26.787 INFO:teuthology.orchestra.run.smithi040.stdout:setting min_mon_release = pacific 2023-06-22T10:52:26.788 INFO:teuthology.orchestra.run.smithi040.stdout:epoch 0 2023-06-22T10:52:26.788 INFO:teuthology.orchestra.run.smithi040.stdout:fsid 475560bc-1a7c-4a75-b3b6-6fc6b20bdc52 2023-06-22T10:52:26.788 INFO:teuthology.orchestra.run.smithi040.stdout:last_changed 2023-06-22T10:52:26.785110+0000 2023-06-22T10:52:26.788 INFO:teuthology.orchestra.run.smithi040.stdout:created 2023-06-22T10:52:26.785110+0000 2023-06-22T10:52:26.788 INFO:teuthology.orchestra.run.smithi040.stdout:min_mon_release 16 (pacific) 2023-06-22T10:52:26.788 INFO:teuthology.orchestra.run.smithi040.stdout:election_strategy: 1 2023-06-22T10:52:26.788 INFO:teuthology.orchestra.run.smithi040.stdout:0: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.a 2023-06-22T10:52:26.789 INFO:teuthology.orchestra.run.smithi040.stdout:1: [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] mon.b 2023-06-22T10:52:26.789 INFO:teuthology.orchestra.run.smithi040.stdout:2: [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] mon.c 2023-06-22T10:52:26.789 INFO:teuthology.orchestra.run.smithi040.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-06-22T10:52:26.790 DEBUG:teuthology.orchestra.run.smithi040:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-06-22T10:52:26.835 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 475560bc-1a7c-4a75-b3b6-6fc6b20bdc52... 2023-06-22T10:52:26.837 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-06-22T10:52:26.881 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-06-22T10:52:26.993 INFO:teuthology.orchestra.run.smithi040.stdout:[global] 2023-06-22T10:52:26.993 INFO:teuthology.orchestra.run.smithi040.stdout: chdir = "" 2023-06-22T10:52:26.993 INFO:teuthology.orchestra.run.smithi040.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-06-22T10:52:26.993 INFO:teuthology.orchestra.run.smithi040.stdout: auth supported = cephx 2023-06-22T10:52:26.993 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:52:26.994 INFO:teuthology.orchestra.run.smithi040.stdout: filestore xattr use omap = true 2023-06-22T10:52:26.994 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:52:26.994 INFO:teuthology.orchestra.run.smithi040.stdout: mon clock drift allowed = 1.000 2023-06-22T10:52:26.994 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:52:26.994 INFO:teuthology.orchestra.run.smithi040.stdout: osd crush chooseleaf type = 0 2023-06-22T10:52:26.994 INFO:teuthology.orchestra.run.smithi040.stdout: auth debug = true 2023-06-22T10:52:26.994 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:52:26.995 INFO:teuthology.orchestra.run.smithi040.stdout: ms die on old message = true 2023-06-22T10:52:26.995 INFO:teuthology.orchestra.run.smithi040.stdout: ms die on bug = true 2023-06-22T10:52:26.995 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:52:26.995 INFO:teuthology.orchestra.run.smithi040.stdout: mon max pg per osd = 10000 # >= luminous 2023-06-22T10:52:26.995 INFO:teuthology.orchestra.run.smithi040.stdout: mon pg warn max object skew = 0 2023-06-22T10:52:26.995 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:52:26.995 INFO:teuthology.orchestra.run.smithi040.stdout: # disable pg_autoscaler by default for new pools 2023-06-22T10:52:26.995 INFO:teuthology.orchestra.run.smithi040.stdout: osd_pool_default_pg_autoscale_mode = off 2023-06-22T10:52:26.996 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:52:26.996 INFO:teuthology.orchestra.run.smithi040.stdout: osd pool default size = 2 2023-06-22T10:52:26.996 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:52:26.996 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd allow primary affinity = true 2023-06-22T10:52:26.996 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd allow pg remap = true 2023-06-22T10:52:26.996 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on legacy crush tunables = false 2023-06-22T10:52:26.996 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on crush straw calc version zero = false 2023-06-22T10:52:26.996 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on no sortbitwise = false 2023-06-22T10:52:26.997 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on osd down out interval zero = false 2023-06-22T10:52:26.997 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on too few osds = false 2023-06-22T10:52:26.997 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-06-22T10:52:26.997 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_pool_no_redundancy = false 2023-06-22T10:52:26.997 INFO:teuthology.orchestra.run.smithi040.stdout: mon_allow_pool_size_one = true 2023-06-22T10:52:26.997 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:52:26.997 INFO:teuthology.orchestra.run.smithi040.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-06-22T10:52:26.998 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:52:26.998 INFO:teuthology.orchestra.run.smithi040.stdout: osd default data pool replay window = 5 2023-06-22T10:52:26.998 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:52:26.998 INFO:teuthology.orchestra.run.smithi040.stdout: mon allow pool delete = true 2023-06-22T10:52:26.998 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:52:26.998 INFO:teuthology.orchestra.run.smithi040.stdout: mon cluster log file level = debug 2023-06-22T10:52:26.998 INFO:teuthology.orchestra.run.smithi040.stdout: debug asserts on shutdown = true 2023-06-22T10:52:26.998 INFO:teuthology.orchestra.run.smithi040.stdout: mon health detail to clog = false 2023-06-22T10:52:26.999 INFO:teuthology.orchestra.run.smithi040.stdout: mon host = "172.21.15.40,172.21.15.45,[v2:172.21.15.45:3301,v1:172.21.15.45:6790]" 2023-06-22T10:52:26.999 INFO:teuthology.orchestra.run.smithi040.stdout: ms die on skipped message = False 2023-06-22T10:52:26.999 INFO:teuthology.orchestra.run.smithi040.stdout: fsid = 475560bc-1a7c-4a75-b3b6-6fc6b20bdc52 2023-06-22T10:52:26.999 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:52:26.999 INFO:teuthology.orchestra.run.smithi040.stdout:[osd] 2023-06-22T10:52:26.999 INFO:teuthology.orchestra.run.smithi040.stdout: osd journal size = 100 2023-06-22T10:52:26.999 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:52:26.999 INFO:teuthology.orchestra.run.smithi040.stdout: osd scrub load threshold = 5.0 2023-06-22T10:52:27.000 INFO:teuthology.orchestra.run.smithi040.stdout: osd scrub max interval = 600 2023-06-22T10:52:27.000 INFO:teuthology.orchestra.run.smithi040.stdout: osd mclock profile = high_recovery_ops 2023-06-22T10:52:27.000 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:52:27.000 INFO:teuthology.orchestra.run.smithi040.stdout: osd recover clone overlap = true 2023-06-22T10:52:27.000 INFO:teuthology.orchestra.run.smithi040.stdout: osd recovery max chunk = 1048576 2023-06-22T10:52:27.000 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:52:27.000 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug shutdown = true 2023-06-22T10:52:27.000 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug op order = true 2023-06-22T10:52:27.001 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug verify stray on activate = true 2023-06-22T10:52:27.001 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:52:27.001 INFO:teuthology.orchestra.run.smithi040.stdout: osd open classes on start = true 2023-06-22T10:52:27.001 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug pg log writeout = true 2023-06-22T10:52:27.001 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:52:27.001 INFO:teuthology.orchestra.run.smithi040.stdout: osd deep scrub update digest min age = 30 2023-06-22T10:52:27.001 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:52:27.002 INFO:teuthology.orchestra.run.smithi040.stdout: osd map max advance = 10 2023-06-22T10:52:27.002 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:52:27.002 INFO:teuthology.orchestra.run.smithi040.stdout: journal zero on create = true 2023-06-22T10:52:27.002 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:52:27.002 INFO:teuthology.orchestra.run.smithi040.stdout: filestore ondisk finisher threads = 3 2023-06-22T10:52:27.002 INFO:teuthology.orchestra.run.smithi040.stdout: filestore apply finisher threads = 3 2023-06-22T10:52:27.002 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:52:27.002 INFO:teuthology.orchestra.run.smithi040.stdout: bdev debug aio = true 2023-06-22T10:52:27.003 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug misdirected ops = true 2023-06-22T10:52:27.003 INFO:teuthology.orchestra.run.smithi040.stdout: bluestore block size = 96636764160 2023-06-22T10:52:27.003 INFO:teuthology.orchestra.run.smithi040.stdout: bluestore fsck on mount = True 2023-06-22T10:52:27.003 INFO:teuthology.orchestra.run.smithi040.stdout: debug bluefs = 20 2023-06-22T10:52:27.003 INFO:teuthology.orchestra.run.smithi040.stdout: debug bluestore = 20 2023-06-22T10:52:27.003 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2023-06-22T10:52:27.003 INFO:teuthology.orchestra.run.smithi040.stdout: debug osd = 20 2023-06-22T10:52:27.003 INFO:teuthology.orchestra.run.smithi040.stdout: debug rocksdb = 10 2023-06-22T10:52:27.004 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd backfillfull_ratio = 0.85 2023-06-22T10:52:27.004 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd full ratio = 0.9 2023-06-22T10:52:27.004 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd nearfull ratio = 0.8 2023-06-22T10:52:27.004 INFO:teuthology.orchestra.run.smithi040.stdout: osd failsafe full ratio = 0.95 2023-06-22T10:52:27.004 INFO:teuthology.orchestra.run.smithi040.stdout: osd objectstore = bluestore 2023-06-22T10:52:27.004 INFO:teuthology.orchestra.run.smithi040.stdout: osd op complaint time = 180 2023-06-22T10:52:27.004 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:52:27.005 INFO:teuthology.orchestra.run.smithi040.stdout:[mgr] 2023-06-22T10:52:27.005 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2023-06-22T10:52:27.005 INFO:teuthology.orchestra.run.smithi040.stdout: debug mgr = 20 2023-06-22T10:52:27.005 INFO:teuthology.orchestra.run.smithi040.stdout: debug mon = 20 2023-06-22T10:52:27.005 INFO:teuthology.orchestra.run.smithi040.stdout: debug auth = 20 2023-06-22T10:52:27.005 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min pgs per osd = 4 2023-06-22T10:52:27.005 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min bytes per osd = 10 2023-06-22T10:52:27.005 INFO:teuthology.orchestra.run.smithi040.stdout: mgr/telemetry/nag = false 2023-06-22T10:52:27.006 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:52:27.006 INFO:teuthology.orchestra.run.smithi040.stdout:[mon] 2023-06-22T10:52:27.006 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2023-06-22T10:52:27.006 INFO:teuthology.orchestra.run.smithi040.stdout: debug mon = 20 2023-06-22T10:52:27.006 INFO:teuthology.orchestra.run.smithi040.stdout: debug paxos = 20 2023-06-22T10:52:27.006 INFO:teuthology.orchestra.run.smithi040.stdout: debug auth = 20 2023-06-22T10:52:27.006 INFO:teuthology.orchestra.run.smithi040.stdout: mon data avail warn = 5 2023-06-22T10:52:27.006 INFO:teuthology.orchestra.run.smithi040.stdout: mon mgr mkfs grace = 240 2023-06-22T10:52:27.007 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min pgs per osd = 4 2023-06-22T10:52:27.007 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd reporter subtree level = osd 2023-06-22T10:52:27.007 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd prime pg temp = true 2023-06-22T10:52:27.007 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min bytes per osd = 10 2023-06-22T10:52:27.007 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:52:27.007 INFO:teuthology.orchestra.run.smithi040.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-06-22T10:52:27.007 INFO:teuthology.orchestra.run.smithi040.stdout: auth mon ticket ttl = 660 # 11m 2023-06-22T10:52:27.007 INFO:teuthology.orchestra.run.smithi040.stdout: auth service ticket ttl = 240 # 4m 2023-06-22T10:52:27.008 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:52:27.008 INFO:teuthology.orchestra.run.smithi040.stdout: # don't complain about insecure global_id in the test suite 2023-06-22T10:52:27.008 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-06-22T10:52:27.008 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-06-22T10:52:27.008 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:52:27.008 INFO:teuthology.orchestra.run.smithi040.stdout: # 1m isn't quite enough 2023-06-22T10:52:27.008 INFO:teuthology.orchestra.run.smithi040.stdout: mon_down_mkfs_grace = 2m 2023-06-22T10:52:27.008 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:52:27.009 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_filestore_osds = false 2023-06-22T10:52:27.009 INFO:teuthology.orchestra.run.smithi040.stdout: mon op complaint time = 120 2023-06-22T10:52:27.009 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:52:27.009 INFO:teuthology.orchestra.run.smithi040.stdout:[client] 2023-06-22T10:52:27.009 INFO:teuthology.orchestra.run.smithi040.stdout: rgw cache enabled = true 2023-06-22T10:52:27.009 INFO:teuthology.orchestra.run.smithi040.stdout: rgw enable ops log = true 2023-06-22T10:52:27.009 INFO:teuthology.orchestra.run.smithi040.stdout: rgw enable usage log = true 2023-06-22T10:52:27.009 INFO:teuthology.orchestra.run.smithi040.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-06-22T10:52:27.010 INFO:teuthology.orchestra.run.smithi040.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-06-22T10:52:27.010 INFO:teuthology.orchestra.run.smithi040.stdout: client mount timeout = 600 2023-06-22T10:52:27.010 INFO:teuthology.orchestra.run.smithi040.stdout: debug client = 20 2023-06-22T10:52:27.010 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2023-06-22T10:52:27.010 INFO:teuthology.orchestra.run.smithi040.stdout: pid file = "" 2023-06-22T10:52:27.010 INFO:teuthology.orchestra.run.smithi040.stdout: rados mon op timeout = 900 2023-06-22T10:52:27.010 INFO:teuthology.orchestra.run.smithi040.stdout: rados osd op timeout = 900 2023-06-22T10:52:27.010 INFO:teuthology.orchestra.run.smithi040.stdout:[mon.a] 2023-06-22T10:52:27.011 INFO:teuthology.orchestra.run.smithi040.stdout:[mon.b] 2023-06-22T10:52:27.011 INFO:teuthology.orchestra.run.smithi040.stdout:[mon.c] 2023-06-22T10:52:27.011 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.a] 2023-06-22T10:52:27.011 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.c] 2023-06-22T10:52:27.011 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.b] 2023-06-22T10:52:27.011 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.d] 2023-06-22T10:52:27.011 INFO:teuthology.orchestra.run.smithi040.stdout:[mds] 2023-06-22T10:52:27.011 INFO:teuthology.orchestra.run.smithi040.stdout: debug mds = 20 2023-06-22T10:52:27.012 INFO:teuthology.orchestra.run.smithi040.stdout: debug mds balancer = 20 2023-06-22T10:52:27.012 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2023-06-22T10:52:27.012 INFO:teuthology.orchestra.run.smithi040.stdout: mds debug frag = True 2023-06-22T10:52:27.012 INFO:teuthology.orchestra.run.smithi040.stdout: mds debug scatterstat = True 2023-06-22T10:52:27.012 INFO:teuthology.orchestra.run.smithi040.stdout: mds op complaint time = 180 2023-06-22T10:52:27.012 INFO:teuthology.orchestra.run.smithi040.stdout: mds verify scatter = True 2023-06-22T10:52:27.012 INFO:teuthology.orchestra.run.smithi040.stdout: osd op complaint time = 180 2023-06-22T10:52:27.012 INFO:teuthology.orchestra.run.smithi040.stdout: rados mon op timeout = 900 2023-06-22T10:52:27.013 INFO:teuthology.orchestra.run.smithi040.stdout: rados osd op timeout = 900 2023-06-22T10:52:27.013 INFO:teuthology.orchestra.run.smithi045.stdout:[global] 2023-06-22T10:52:27.013 INFO:teuthology.orchestra.run.smithi045.stdout: chdir = "" 2023-06-22T10:52:27.013 INFO:teuthology.orchestra.run.smithi045.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-06-22T10:52:27.014 INFO:teuthology.orchestra.run.smithi045.stdout: auth supported = cephx 2023-06-22T10:52:27.014 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-22T10:52:27.014 INFO:teuthology.orchestra.run.smithi045.stdout: filestore xattr use omap = true 2023-06-22T10:52:27.014 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-22T10:52:27.014 INFO:teuthology.orchestra.run.smithi045.stdout: mon clock drift allowed = 1.000 2023-06-22T10:52:27.014 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-22T10:52:27.014 INFO:teuthology.orchestra.run.smithi045.stdout: osd crush chooseleaf type = 0 2023-06-22T10:52:27.014 INFO:teuthology.orchestra.run.smithi045.stdout: auth debug = true 2023-06-22T10:52:27.015 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-22T10:52:27.015 INFO:teuthology.orchestra.run.smithi045.stdout: ms die on old message = true 2023-06-22T10:52:27.015 INFO:teuthology.orchestra.run.smithi045.stdout: ms die on bug = true 2023-06-22T10:52:27.015 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-22T10:52:27.016 INFO:teuthology.orchestra.run.smithi045.stdout: mon max pg per osd = 10000 # >= luminous 2023-06-22T10:52:27.016 INFO:teuthology.orchestra.run.smithi045.stdout: mon pg warn max object skew = 0 2023-06-22T10:52:27.016 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-22T10:52:27.016 INFO:teuthology.orchestra.run.smithi045.stdout: # disable pg_autoscaler by default for new pools 2023-06-22T10:52:27.016 INFO:teuthology.orchestra.run.smithi045.stdout: osd_pool_default_pg_autoscale_mode = off 2023-06-22T10:52:27.016 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-22T10:52:27.016 INFO:teuthology.orchestra.run.smithi045.stdout: osd pool default size = 2 2023-06-22T10:52:27.017 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-22T10:52:27.017 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd allow primary affinity = true 2023-06-22T10:52:27.017 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd allow pg remap = true 2023-06-22T10:52:27.017 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on legacy crush tunables = false 2023-06-22T10:52:27.017 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on crush straw calc version zero = false 2023-06-22T10:52:27.017 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on no sortbitwise = false 2023-06-22T10:52:27.017 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on osd down out interval zero = false 2023-06-22T10:52:27.017 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on too few osds = false 2023-06-22T10:52:27.018 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-06-22T10:52:27.018 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_pool_no_redundancy = false 2023-06-22T10:52:27.018 INFO:teuthology.orchestra.run.smithi045.stdout: mon_allow_pool_size_one = true 2023-06-22T10:52:27.018 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-22T10:52:27.018 INFO:teuthology.orchestra.run.smithi045.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-06-22T10:52:27.018 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-22T10:52:27.018 INFO:teuthology.orchestra.run.smithi045.stdout: osd default data pool replay window = 5 2023-06-22T10:52:27.018 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-22T10:52:27.019 INFO:teuthology.orchestra.run.smithi045.stdout: mon allow pool delete = true 2023-06-22T10:52:27.019 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-22T10:52:27.019 INFO:teuthology.orchestra.run.smithi045.stdout: mon cluster log file level = debug 2023-06-22T10:52:27.019 INFO:teuthology.orchestra.run.smithi045.stdout: debug asserts on shutdown = true 2023-06-22T10:52:27.019 INFO:teuthology.orchestra.run.smithi045.stdout: mon health detail to clog = false 2023-06-22T10:52:27.019 INFO:teuthology.orchestra.run.smithi045.stdout: mon host = "172.21.15.40,172.21.15.45,[v2:172.21.15.45:3301,v1:172.21.15.45:6790]" 2023-06-22T10:52:27.019 INFO:teuthology.orchestra.run.smithi045.stdout: ms die on skipped message = False 2023-06-22T10:52:27.019 INFO:teuthology.orchestra.run.smithi045.stdout: fsid = 475560bc-1a7c-4a75-b3b6-6fc6b20bdc52 2023-06-22T10:52:27.020 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-22T10:52:27.020 INFO:teuthology.orchestra.run.smithi045.stdout:[osd] 2023-06-22T10:52:27.020 INFO:teuthology.orchestra.run.smithi045.stdout: osd journal size = 100 2023-06-22T10:52:27.020 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-22T10:52:27.020 INFO:teuthology.orchestra.run.smithi045.stdout: osd scrub load threshold = 5.0 2023-06-22T10:52:27.020 INFO:teuthology.orchestra.run.smithi045.stdout: osd scrub max interval = 600 2023-06-22T10:52:27.020 INFO:teuthology.orchestra.run.smithi045.stdout: osd mclock profile = high_recovery_ops 2023-06-22T10:52:27.021 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-22T10:52:27.021 INFO:teuthology.orchestra.run.smithi045.stdout: osd recover clone overlap = true 2023-06-22T10:52:27.021 INFO:teuthology.orchestra.run.smithi045.stdout: osd recovery max chunk = 1048576 2023-06-22T10:52:27.021 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-22T10:52:27.021 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug shutdown = true 2023-06-22T10:52:27.021 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug op order = true 2023-06-22T10:52:27.021 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug verify stray on activate = true 2023-06-22T10:52:27.021 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-22T10:52:27.022 INFO:teuthology.orchestra.run.smithi045.stdout: osd open classes on start = true 2023-06-22T10:52:27.022 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug pg log writeout = true 2023-06-22T10:52:27.022 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-22T10:52:27.022 INFO:teuthology.orchestra.run.smithi045.stdout: osd deep scrub update digest min age = 30 2023-06-22T10:52:27.022 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-22T10:52:27.022 INFO:teuthology.orchestra.run.smithi045.stdout: osd map max advance = 10 2023-06-22T10:52:27.022 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-22T10:52:27.022 INFO:teuthology.orchestra.run.smithi045.stdout: journal zero on create = true 2023-06-22T10:52:27.023 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-22T10:52:27.023 INFO:teuthology.orchestra.run.smithi045.stdout: filestore ondisk finisher threads = 3 2023-06-22T10:52:27.023 INFO:teuthology.orchestra.run.smithi045.stdout: filestore apply finisher threads = 3 2023-06-22T10:52:27.023 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-22T10:52:27.023 INFO:teuthology.orchestra.run.smithi045.stdout: bdev debug aio = true 2023-06-22T10:52:27.023 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug misdirected ops = true 2023-06-22T10:52:27.023 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore block size = 96636764160 2023-06-22T10:52:27.023 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore fsck on mount = True 2023-06-22T10:52:27.024 INFO:teuthology.orchestra.run.smithi045.stdout: debug bluefs = 20 2023-06-22T10:52:27.024 INFO:teuthology.orchestra.run.smithi045.stdout: debug bluestore = 20 2023-06-22T10:52:27.024 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-06-22T10:52:27.024 INFO:teuthology.orchestra.run.smithi045.stdout: debug osd = 20 2023-06-22T10:52:27.024 INFO:teuthology.orchestra.run.smithi045.stdout: debug rocksdb = 10 2023-06-22T10:52:27.024 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd backfillfull_ratio = 0.85 2023-06-22T10:52:27.024 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd full ratio = 0.9 2023-06-22T10:52:27.025 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd nearfull ratio = 0.8 2023-06-22T10:52:27.025 INFO:teuthology.orchestra.run.smithi045.stdout: osd failsafe full ratio = 0.95 2023-06-22T10:52:27.025 INFO:teuthology.orchestra.run.smithi045.stdout: osd objectstore = bluestore 2023-06-22T10:52:27.025 INFO:teuthology.orchestra.run.smithi045.stdout: osd op complaint time = 180 2023-06-22T10:52:27.025 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-22T10:52:27.025 INFO:teuthology.orchestra.run.smithi045.stdout:[mgr] 2023-06-22T10:52:27.025 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-06-22T10:52:27.025 INFO:teuthology.orchestra.run.smithi045.stdout: debug mgr = 20 2023-06-22T10:52:27.026 INFO:teuthology.orchestra.run.smithi045.stdout: debug mon = 20 2023-06-22T10:52:27.026 INFO:teuthology.orchestra.run.smithi045.stdout: debug auth = 20 2023-06-22T10:52:27.026 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min pgs per osd = 4 2023-06-22T10:52:27.026 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min bytes per osd = 10 2023-06-22T10:52:27.026 INFO:teuthology.orchestra.run.smithi045.stdout: mgr/telemetry/nag = false 2023-06-22T10:52:27.026 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-22T10:52:27.026 INFO:teuthology.orchestra.run.smithi045.stdout:[mon] 2023-06-22T10:52:27.026 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-06-22T10:52:27.027 INFO:teuthology.orchestra.run.smithi045.stdout: debug mon = 20 2023-06-22T10:52:27.027 INFO:teuthology.orchestra.run.smithi045.stdout: debug paxos = 20 2023-06-22T10:52:27.027 INFO:teuthology.orchestra.run.smithi045.stdout: debug auth = 20 2023-06-22T10:52:27.027 INFO:teuthology.orchestra.run.smithi045.stdout: mon data avail warn = 5 2023-06-22T10:52:27.027 INFO:teuthology.orchestra.run.smithi045.stdout: mon mgr mkfs grace = 240 2023-06-22T10:52:27.027 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min pgs per osd = 4 2023-06-22T10:52:27.027 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd reporter subtree level = osd 2023-06-22T10:52:27.028 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd prime pg temp = true 2023-06-22T10:52:27.028 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min bytes per osd = 10 2023-06-22T10:52:27.028 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-22T10:52:27.028 INFO:teuthology.orchestra.run.smithi045.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-06-22T10:52:27.028 INFO:teuthology.orchestra.run.smithi045.stdout: auth mon ticket ttl = 660 # 11m 2023-06-22T10:52:27.028 INFO:teuthology.orchestra.run.smithi045.stdout: auth service ticket ttl = 240 # 4m 2023-06-22T10:52:27.028 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-22T10:52:27.028 INFO:teuthology.orchestra.run.smithi045.stdout: # don't complain about insecure global_id in the test suite 2023-06-22T10:52:27.029 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-06-22T10:52:27.029 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-06-22T10:52:27.029 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-22T10:52:27.029 INFO:teuthology.orchestra.run.smithi045.stdout: # 1m isn't quite enough 2023-06-22T10:52:27.029 INFO:teuthology.orchestra.run.smithi045.stdout: mon_down_mkfs_grace = 2m 2023-06-22T10:52:27.029 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-22T10:52:27.029 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_filestore_osds = false 2023-06-22T10:52:27.029 INFO:teuthology.orchestra.run.smithi045.stdout: mon op complaint time = 120 2023-06-22T10:52:27.030 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-22T10:52:27.030 INFO:teuthology.orchestra.run.smithi045.stdout:[client] 2023-06-22T10:52:27.030 INFO:teuthology.orchestra.run.smithi045.stdout: rgw cache enabled = true 2023-06-22T10:52:27.030 INFO:teuthology.orchestra.run.smithi045.stdout: rgw enable ops log = true 2023-06-22T10:52:27.031 INFO:teuthology.orchestra.run.smithi045.stdout: rgw enable usage log = true 2023-06-22T10:52:27.031 INFO:teuthology.orchestra.run.smithi045.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-06-22T10:52:27.031 INFO:teuthology.orchestra.run.smithi045.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-06-22T10:52:27.031 INFO:teuthology.orchestra.run.smithi045.stdout: client mount timeout = 600 2023-06-22T10:52:27.031 INFO:teuthology.orchestra.run.smithi045.stdout: debug client = 20 2023-06-22T10:52:27.031 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-06-22T10:52:27.031 INFO:teuthology.orchestra.run.smithi045.stdout: pid file = "" 2023-06-22T10:52:27.031 INFO:teuthology.orchestra.run.smithi045.stdout: rados mon op timeout = 900 2023-06-22T10:52:27.032 INFO:teuthology.orchestra.run.smithi045.stdout: rados osd op timeout = 900 2023-06-22T10:52:27.032 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.a] 2023-06-22T10:52:27.032 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.b] 2023-06-22T10:52:27.032 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.c] 2023-06-22T10:52:27.032 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.a] 2023-06-22T10:52:27.032 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.c] 2023-06-22T10:52:27.032 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.b] 2023-06-22T10:52:27.033 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.d] 2023-06-22T10:52:27.033 INFO:teuthology.orchestra.run.smithi045.stdout:[mds] 2023-06-22T10:52:27.033 INFO:teuthology.orchestra.run.smithi045.stdout: debug mds = 20 2023-06-22T10:52:27.033 INFO:teuthology.orchestra.run.smithi045.stdout: debug mds balancer = 20 2023-06-22T10:52:27.033 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-06-22T10:52:27.033 INFO:teuthology.orchestra.run.smithi045.stdout: mds debug frag = True 2023-06-22T10:52:27.033 INFO:teuthology.orchestra.run.smithi045.stdout: mds debug scatterstat = True 2023-06-22T10:52:27.033 INFO:teuthology.orchestra.run.smithi045.stdout: mds op complaint time = 180 2023-06-22T10:52:27.034 INFO:teuthology.orchestra.run.smithi045.stdout: mds verify scatter = True 2023-06-22T10:52:27.034 INFO:teuthology.orchestra.run.smithi045.stdout: osd op complaint time = 180 2023-06-22T10:52:27.034 INFO:teuthology.orchestra.run.smithi045.stdout: rados mon op timeout = 900 2023-06-22T10:52:27.034 INFO:teuthology.orchestra.run.smithi045.stdout: rados osd op timeout = 900 2023-06-22T10:52:27.037 INFO:tasks.ceph:Creating admin key on mon.a... 2023-06-22T10:52:27.038 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-06-22T10:52:27.151 INFO:tasks.ceph:Copying monmap to all nodes... 2023-06-22T10:52:27.151 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-06-22T10:52:27.151 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-06-22T10:52:27.196 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-06-22T10:52:27.197 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-06-22T10:52:27.281 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi040.front.sepia.ceph.com 2023-06-22T10:52:27.281 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-06-22T10:52:27.282 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/ceph/ceph.keyring 2023-06-22T10:52:27.282 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-06-22T10:52:27.415 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-06-22T10:52:27.416 DEBUG:teuthology.orchestra.run.smithi040:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-06-22T10:52:27.501 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi045.front.sepia.ceph.com 2023-06-22T10:52:27.502 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-06-22T10:52:27.502 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/ceph/ceph.keyring 2023-06-22T10:52:27.504 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-06-22T10:52:27.600 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-06-22T10:52:27.601 DEBUG:teuthology.orchestra.run.smithi045:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-06-22T10:52:27.685 INFO:tasks.ceph:Setting up mon nodes... 2023-06-22T10:52:27.685 INFO:tasks.ceph:Setting up mgr nodes... 2023-06-22T10:52:27.686 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-06-22T10:52:27.809 INFO:teuthology.orchestra.run.smithi040.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-06-22T10:52:27.817 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-06-22T10:52:27.951 INFO:teuthology.orchestra.run.smithi045.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-06-22T10:52:27.958 INFO:tasks.ceph:Setting up mds nodes... 2023-06-22T10:52:27.959 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-06-22T10:52:28.082 INFO:teuthology.orchestra.run.smithi040.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-06-22T10:52:28.087 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-06-22T10:52:28.156 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-06-22T10:52:28.280 INFO:teuthology.orchestra.run.smithi040.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-06-22T10:52:28.285 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-06-22T10:52:28.354 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-06-22T10:52:28.488 INFO:teuthology.orchestra.run.smithi045.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-06-22T10:52:28.493 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-06-22T10:52:28.565 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-06-22T10:52:28.687 INFO:teuthology.orchestra.run.smithi045.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-06-22T10:52:28.693 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-06-22T10:52:28.762 INFO:tasks.ceph_client:Setting up client nodes... 2023-06-22T10:52:28.762 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-06-22T10:52:28.866 INFO:teuthology.orchestra.run.smithi040.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-06-22T10:52:28.896 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-06-22T10:52:28.994 INFO:teuthology.orchestra.run.smithi040.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-06-22T10:52:29.025 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-06-22T10:52:29.123 INFO:teuthology.orchestra.run.smithi045.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-06-22T10:52:29.153 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-06-22T10:52:29.251 INFO:teuthology.orchestra.run.smithi045.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-06-22T10:52:29.281 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-06-22T10:52:29.281 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi040.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi045.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-06-22T10:52:29.282 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-06-22T10:52:29.351 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-22T10:52:29.351 INFO:tasks.ceph:role: osd.0 2023-06-22T10:52:29.351 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi040.front.sepia.ceph.com 2023-06-22T10:52:29.352 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-06-22T10:52:29.428 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-06-22T10:52:29.428 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-22T10:52:29.429 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-22T10:52:29.429 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-22T10:52:29.429 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-22T10:52:29.429 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2023-06-22T10:52:29.430 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-22T10:52:29.430 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-22T10:52:29.431 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-22T10:52:29.431 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-22T10:52:29.857 INFO:teuthology.orchestra.run.smithi040.stdout:Discarding blocks...Done. 2023-06-22T10:52:29.861 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2023-06-22T10:52:29.862 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-06-22T10:52:30.067 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-06-22T10:52:30.145 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-06-22T10:52:30.215 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-22T10:52:30.216 INFO:tasks.ceph:role: osd.1 2023-06-22T10:52:30.216 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi040.front.sepia.ceph.com 2023-06-22T10:52:30.216 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-06-22T10:52:30.293 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-06-22T10:52:30.293 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-22T10:52:30.294 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-22T10:52:30.294 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-22T10:52:30.294 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-22T10:52:30.294 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2023-06-22T10:52:30.295 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-22T10:52:30.295 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-22T10:52:30.295 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-22T10:52:30.296 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-22T10:52:30.706 INFO:teuthology.orchestra.run.smithi040.stdout:Discarding blocks...Done. 2023-06-22T10:52:30.709 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2023-06-22T10:52:30.710 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-06-22T10:52:30.852 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-06-22T10:52:30.929 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-06-22T10:52:30.998 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-22T10:52:30.999 INFO:tasks.ceph:role: osd.2 2023-06-22T10:52:30.999 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi040.front.sepia.ceph.com 2023-06-22T10:52:30.999 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-06-22T10:52:31.076 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-06-22T10:52:31.076 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-22T10:52:31.076 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-22T10:52:31.076 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-22T10:52:31.077 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-22T10:52:31.077 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2023-06-22T10:52:31.077 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-22T10:52:31.077 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-22T10:52:31.077 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-22T10:52:31.077 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-22T10:52:31.518 INFO:teuthology.orchestra.run.smithi040.stdout:Discarding blocks...Done. 2023-06-22T10:52:31.522 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2023-06-22T10:52:31.523 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-06-22T10:52:31.707 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-06-22T10:52:31.787 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-06-22T10:52:31.856 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-22T10:52:31.856 INFO:tasks.ceph:role: osd.3 2023-06-22T10:52:31.856 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi040.front.sepia.ceph.com 2023-06-22T10:52:31.857 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-06-22T10:52:31.933 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-06-22T10:52:31.933 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-22T10:52:31.933 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-22T10:52:31.934 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-22T10:52:31.934 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-22T10:52:31.934 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2023-06-22T10:52:31.934 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-22T10:52:31.934 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-22T10:52:31.934 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-22T10:52:31.934 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-22T10:52:32.366 INFO:teuthology.orchestra.run.smithi040.stdout:Discarding blocks...Done. 2023-06-22T10:52:32.369 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2023-06-22T10:52:32.370 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-06-22T10:52:32.495 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-06-22T10:52:32.571 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-22T10:52:32.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:52:32.699+0000 7f06e23b7640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-06-22T10:52:32.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:52:32.700+0000 7f06e23b7640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-06-22T10:52:32.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:52:32.700+0000 7f06e23b7640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-06-22T10:52:32.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:52:32.700+0000 7f06e23b7640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-06-22T10:52:32.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:52:32.700+0000 7f06e23b7640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-06-22T10:52:32.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:52:32.702+0000 7f06e23b7640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-06-22T10:52:35.584 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-06-22T10:52:35.658 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-22T10:52:35.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:52:35.763+0000 7f1a00bfe640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-06-22T10:52:35.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:52:35.764+0000 7f1a00bfe640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-06-22T10:52:35.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:52:35.764+0000 7f1a00bfe640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-06-22T10:52:35.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:52:35.764+0000 7f1a00bfe640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-06-22T10:52:35.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:52:35.764+0000 7f1a00bfe640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-06-22T10:52:35.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:52:35.765+0000 7f1a00bfe640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-06-22T10:52:38.650 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-06-22T10:52:38.725 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-22T10:52:38.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:52:38.831+0000 7f0589a2c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-06-22T10:52:38.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:52:38.831+0000 7f0589a2c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-06-22T10:52:38.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:52:38.831+0000 7f0589a2c640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-06-22T10:52:38.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:52:38.831+0000 7f0589a2c640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-06-22T10:52:38.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:52:38.831+0000 7f0589a2c640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-06-22T10:52:38.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:52:38.832+0000 7f0589a2c640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-06-22T10:52:41.724 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-06-22T10:52:41.797 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-22T10:52:41.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:52:41.903+0000 7f54650f4640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-06-22T10:52:41.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:52:41.903+0000 7f54650f4640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-06-22T10:52:41.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:52:41.903+0000 7f54650f4640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-06-22T10:52:41.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:52:41.903+0000 7f54650f4640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-06-22T10:52:41.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:52:41.903+0000 7f54650f4640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-06-22T10:52:41.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:52:41.905+0000 7f54650f4640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-06-22T10:52:44.782 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-06-22T10:52:44.858 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-06-22T10:52:44.937 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-22T10:52:44.937 INFO:tasks.ceph:role: osd.4 2023-06-22T10:52:44.938 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi045.front.sepia.ceph.com 2023-06-22T10:52:44.938 DEBUG:teuthology.orchestra.run.smithi045:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-06-22T10:52:45.009 INFO:teuthology.orchestra.run.smithi045.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-06-22T10:52:45.010 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-22T10:52:45.010 INFO:teuthology.orchestra.run.smithi045.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-22T10:52:45.010 INFO:teuthology.orchestra.run.smithi045.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-22T10:52:45.010 INFO:teuthology.orchestra.run.smithi045.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-22T10:52:45.010 INFO:teuthology.orchestra.run.smithi045.stdout: = sunit=0 swidth=0 blks 2023-06-22T10:52:45.010 INFO:teuthology.orchestra.run.smithi045.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-22T10:52:45.011 INFO:teuthology.orchestra.run.smithi045.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-22T10:52:45.011 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-22T10:52:45.011 INFO:teuthology.orchestra.run.smithi045.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-22T10:52:45.033 INFO:teuthology.orchestra.run.smithi045.stdout:Discarding blocks...Done. 2023-06-22T10:52:45.130 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi045.front.sepia.ceph.com -o noatime 2023-06-22T10:52:45.130 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-06-22T10:52:45.235 DEBUG:teuthology.orchestra.run.smithi045:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-06-22T10:52:45.316 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-06-22T10:52:45.386 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-22T10:52:45.386 INFO:tasks.ceph:role: osd.5 2023-06-22T10:52:45.386 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi045.front.sepia.ceph.com 2023-06-22T10:52:45.386 DEBUG:teuthology.orchestra.run.smithi045:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-06-22T10:52:45.455 INFO:teuthology.orchestra.run.smithi045.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-06-22T10:52:45.455 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-22T10:52:45.455 INFO:teuthology.orchestra.run.smithi045.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-22T10:52:45.455 INFO:teuthology.orchestra.run.smithi045.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-22T10:52:45.456 INFO:teuthology.orchestra.run.smithi045.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-22T10:52:45.456 INFO:teuthology.orchestra.run.smithi045.stdout: = sunit=0 swidth=0 blks 2023-06-22T10:52:45.456 INFO:teuthology.orchestra.run.smithi045.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-22T10:52:45.456 INFO:teuthology.orchestra.run.smithi045.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-22T10:52:45.456 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-22T10:52:45.456 INFO:teuthology.orchestra.run.smithi045.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-22T10:52:45.478 INFO:teuthology.orchestra.run.smithi045.stdout:Discarding blocks...Done. 2023-06-22T10:52:45.482 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi045.front.sepia.ceph.com -o noatime 2023-06-22T10:52:45.482 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-06-22T10:52:45.588 DEBUG:teuthology.orchestra.run.smithi045:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-06-22T10:52:45.663 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-06-22T10:52:45.732 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-22T10:52:45.733 INFO:tasks.ceph:role: osd.6 2023-06-22T10:52:45.733 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi045.front.sepia.ceph.com 2023-06-22T10:52:45.734 DEBUG:teuthology.orchestra.run.smithi045:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-06-22T10:52:45.802 INFO:teuthology.orchestra.run.smithi045.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-06-22T10:52:45.803 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-22T10:52:45.803 INFO:teuthology.orchestra.run.smithi045.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-22T10:52:45.803 INFO:teuthology.orchestra.run.smithi045.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-22T10:52:45.803 INFO:teuthology.orchestra.run.smithi045.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-22T10:52:45.803 INFO:teuthology.orchestra.run.smithi045.stdout: = sunit=0 swidth=0 blks 2023-06-22T10:52:45.803 INFO:teuthology.orchestra.run.smithi045.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-22T10:52:45.804 INFO:teuthology.orchestra.run.smithi045.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-22T10:52:45.804 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-22T10:52:45.804 INFO:teuthology.orchestra.run.smithi045.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-22T10:52:45.826 INFO:teuthology.orchestra.run.smithi045.stdout:Discarding blocks...Done. 2023-06-22T10:52:45.830 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi045.front.sepia.ceph.com -o noatime 2023-06-22T10:52:45.830 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-06-22T10:52:45.934 DEBUG:teuthology.orchestra.run.smithi045:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-06-22T10:52:46.011 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-06-22T10:52:46.080 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-22T10:52:46.080 INFO:tasks.ceph:role: osd.7 2023-06-22T10:52:46.081 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi045.front.sepia.ceph.com 2023-06-22T10:52:46.081 DEBUG:teuthology.orchestra.run.smithi045:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-06-22T10:52:46.150 INFO:teuthology.orchestra.run.smithi045.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-06-22T10:52:46.150 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-22T10:52:46.150 INFO:teuthology.orchestra.run.smithi045.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-22T10:52:46.150 INFO:teuthology.orchestra.run.smithi045.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-22T10:52:46.151 INFO:teuthology.orchestra.run.smithi045.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-22T10:52:46.151 INFO:teuthology.orchestra.run.smithi045.stdout: = sunit=0 swidth=0 blks 2023-06-22T10:52:46.151 INFO:teuthology.orchestra.run.smithi045.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-22T10:52:46.151 INFO:teuthology.orchestra.run.smithi045.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-22T10:52:46.151 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-22T10:52:46.151 INFO:teuthology.orchestra.run.smithi045.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-22T10:52:46.173 INFO:teuthology.orchestra.run.smithi045.stdout:Discarding blocks...Done. 2023-06-22T10:52:46.181 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi045.front.sepia.ceph.com -o noatime 2023-06-22T10:52:46.181 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-06-22T10:52:46.287 DEBUG:teuthology.orchestra.run.smithi045:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-06-22T10:52:46.362 DEBUG:teuthology.orchestra.run.smithi045:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-22T10:52:46.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:52:46.482+0000 7f6e257c2640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-06-22T10:52:46.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:52:46.483+0000 7f6e257c2640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-06-22T10:52:46.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:52:46.483+0000 7f6e257c2640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-06-22T10:52:46.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:52:46.483+0000 7f6e257c2640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-06-22T10:52:46.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:52:46.483+0000 7f6e257c2640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-06-22T10:52:46.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:52:46.485+0000 7f6e257c2640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-06-22T10:52:49.370 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-06-22T10:52:49.442 DEBUG:teuthology.orchestra.run.smithi045:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-22T10:52:49.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:52:49.545+0000 7f732049c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-06-22T10:52:49.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:52:49.545+0000 7f732049c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-06-22T10:52:49.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:52:49.545+0000 7f732049c640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-06-22T10:52:49.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:52:49.545+0000 7f732049c640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-06-22T10:52:49.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:52:49.545+0000 7f732049c640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-06-22T10:52:49.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:52:49.546+0000 7f732049c640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-06-22T10:52:52.432 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-06-22T10:52:52.508 DEBUG:teuthology.orchestra.run.smithi045:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-22T10:52:52.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:52:52.613+0000 7f31539b9640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-06-22T10:52:52.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:52:52.613+0000 7f31539b9640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-06-22T10:52:52.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:52:52.613+0000 7f31539b9640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-06-22T10:52:52.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:52:52.614+0000 7f31539b9640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-06-22T10:52:52.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:52:52.614+0000 7f31539b9640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-06-22T10:52:52.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:52:52.615+0000 7f31539b9640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-06-22T10:52:54.391 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T10:52:54.397 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T10:52:55.504 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-06-22T10:52:55.580 DEBUG:teuthology.orchestra.run.smithi045:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-22T10:52:55.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:52:55.686+0000 7f86bd566640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-06-22T10:52:55.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:52:55.686+0000 7f86bd566640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-06-22T10:52:55.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:52:55.686+0000 7f86bd566640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-06-22T10:52:55.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:52:55.686+0000 7f86bd566640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-06-22T10:52:55.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:52:55.686+0000 7f86bd566640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-06-22T10:52:55.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:52:55.688+0000 7f86bd566640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-06-22T10:52:58.564 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-06-22T10:52:58.639 INFO:tasks.ceph:Reading keys from all nodes... 2023-06-22T10:52:58.639 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-06-22T10:52:58.640 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-06-22T10:52:58.715 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-06-22T10:52:58.716 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-06-22T10:52:58.786 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-06-22T10:52:58.787 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-06-22T10:52:58.894 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-06-22T10:52:58.895 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-06-22T10:52:59.002 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-06-22T10:52:59.003 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-06-22T10:52:59.111 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-06-22T10:52:59.111 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-06-22T10:52:59.219 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-06-22T10:52:59.219 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-06-22T10:52:59.328 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-06-22T10:52:59.329 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-06-22T10:52:59.405 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-06-22T10:52:59.406 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-06-22T10:52:59.477 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-06-22T10:52:59.477 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-06-22T10:52:59.586 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-06-22T10:52:59.587 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-06-22T10:52:59.696 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-06-22T10:52:59.696 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-06-22T10:52:59.804 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-06-22T10:52:59.804 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-06-22T10:52:59.913 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-06-22T10:52:59.913 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-06-22T10:53:00.022 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-06-22T10:53:00.022 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-06-22T10:53:00.070 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-06-22T10:53:00.071 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-06-22T10:53:00.156 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-06-22T10:53:00.157 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-06-22T10:53:00.202 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-06-22T10:53:00.203 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-06-22T10:53:00.287 INFO:tasks.ceph:Adding keys to all mons... 2023-06-22T10:53:00.288 DEBUG:teuthology.orchestra.run.smithi040:> sudo tee -a /etc/ceph/ceph.keyring 2023-06-22T10:53:00.293 DEBUG:teuthology.orchestra.run.smithi045:> sudo tee -a /etc/ceph/ceph.keyring 2023-06-22T10:53:00.355 INFO:teuthology.orchestra.run.smithi040.stdout:[mgr.y] 2023-06-22T10:53:00.355 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDrJ5RklswiMBAAKAaOShJ0Skwj4qmYxDc9ug== 2023-06-22T10:53:00.356 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.a] 2023-06-22T10:53:00.356 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDsJ5RknprOBBAA7eak8Y+1FYXPowwQpqW1kA== 2023-06-22T10:53:00.356 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.c] 2023-06-22T10:53:00.356 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDsJ5Rky/KVEBAAKG4b2cl7qpCEtMueOIk/FA== 2023-06-22T10:53:00.356 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.0] 2023-06-22T10:53:00.356 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDwJ5RkNrnFKRAAi5GAWzeXUP4qI7iKTymEWw== 2023-06-22T10:53:00.357 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.1] 2023-06-22T10:53:00.357 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDzJ5Rk+sSVLRAAmHofmM8Zp6o8rGbJvzipyg== 2023-06-22T10:53:00.357 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.2] 2023-06-22T10:53:00.357 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQD2J5RkshSaMRAA3VMwM6/DoTIHos1lG046lA== 2023-06-22T10:53:00.357 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.3] 2023-06-22T10:53:00.357 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQD5J5Rkzh7kNRAAYMwi645C8i/1HeVuEpVqQA== 2023-06-22T10:53:00.357 INFO:teuthology.orchestra.run.smithi040.stdout:[mgr.x] 2023-06-22T10:53:00.357 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDrJ5RkE9SaOBAAxeVErdKoeQGcSL+D99zG3w== 2023-06-22T10:53:00.358 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.b] 2023-06-22T10:53:00.358 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDsJ5RkRHn9HBAAOQ9h7xL+lVv84QVO6CYPEg== 2023-06-22T10:53:00.358 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.d] 2023-06-22T10:53:00.358 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDsJ5Rk+yDhKBAA0p6Uhfgn+CPz3qU2h75ENg== 2023-06-22T10:53:00.358 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.4] 2023-06-22T10:53:00.358 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQD+J5RkZDrYHBAAKNxebfeSVk7ix+jX5HUP2A== 2023-06-22T10:53:00.358 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.5] 2023-06-22T10:53:00.359 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQABKJRkc+GbIBAA1e0Y9bWsTzCbBLpHruTelQ== 2023-06-22T10:53:00.359 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.6] 2023-06-22T10:53:00.359 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQAEKJRkci+jJBAAsCxNAtk/rnjdtPaiqqnLBQ== 2023-06-22T10:53:00.359 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.7] 2023-06-22T10:53:00.359 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQAHKJRknQv6KBAA8i5HfnAIg48v0QF4mbeFbg== 2023-06-22T10:53:00.359 INFO:teuthology.orchestra.run.smithi040.stdout:[client.0] 2023-06-22T10:53:00.359 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDsJ5RkbRd/MxAAyagIUs2XwHNsZXz9Qj2VYA== 2023-06-22T10:53:00.359 INFO:teuthology.orchestra.run.smithi040.stdout:[client.2] 2023-06-22T10:53:00.360 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDsJ5Rkmw8tOxAAYuXx3UIIu22JlChCySc7gg== 2023-06-22T10:53:00.360 INFO:teuthology.orchestra.run.smithi040.stdout:[client.1] 2023-06-22T10:53:00.360 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDtJ5Rksxc4BxAAa5tBILwcRq61/4BzAbwJvg== 2023-06-22T10:53:00.360 INFO:teuthology.orchestra.run.smithi040.stdout:[client.3] 2023-06-22T10:53:00.360 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDtJ5RkaEHeDhAA6qGF/d7CpTSdCX1hNTtbwQ== 2023-06-22T10:53:00.394 INFO:teuthology.orchestra.run.smithi045.stdout:[mgr.y] 2023-06-22T10:53:00.394 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQDrJ5RklswiMBAAKAaOShJ0Skwj4qmYxDc9ug== 2023-06-22T10:53:00.395 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.a] 2023-06-22T10:53:00.395 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQDsJ5RknprOBBAA7eak8Y+1FYXPowwQpqW1kA== 2023-06-22T10:53:00.395 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.c] 2023-06-22T10:53:00.395 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQDsJ5Rky/KVEBAAKG4b2cl7qpCEtMueOIk/FA== 2023-06-22T10:53:00.395 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.0] 2023-06-22T10:53:00.395 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQDwJ5RkNrnFKRAAi5GAWzeXUP4qI7iKTymEWw== 2023-06-22T10:53:00.395 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.1] 2023-06-22T10:53:00.395 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQDzJ5Rk+sSVLRAAmHofmM8Zp6o8rGbJvzipyg== 2023-06-22T10:53:00.396 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.2] 2023-06-22T10:53:00.396 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQD2J5RkshSaMRAA3VMwM6/DoTIHos1lG046lA== 2023-06-22T10:53:00.396 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.3] 2023-06-22T10:53:00.396 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQD5J5Rkzh7kNRAAYMwi645C8i/1HeVuEpVqQA== 2023-06-22T10:53:00.396 INFO:teuthology.orchestra.run.smithi045.stdout:[mgr.x] 2023-06-22T10:53:00.396 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQDrJ5RkE9SaOBAAxeVErdKoeQGcSL+D99zG3w== 2023-06-22T10:53:00.397 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.b] 2023-06-22T10:53:00.397 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQDsJ5RkRHn9HBAAOQ9h7xL+lVv84QVO6CYPEg== 2023-06-22T10:53:00.397 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.d] 2023-06-22T10:53:00.397 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQDsJ5Rk+yDhKBAA0p6Uhfgn+CPz3qU2h75ENg== 2023-06-22T10:53:00.397 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.4] 2023-06-22T10:53:00.397 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQD+J5RkZDrYHBAAKNxebfeSVk7ix+jX5HUP2A== 2023-06-22T10:53:00.397 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.5] 2023-06-22T10:53:00.397 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQABKJRkc+GbIBAA1e0Y9bWsTzCbBLpHruTelQ== 2023-06-22T10:53:00.398 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.6] 2023-06-22T10:53:00.398 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAEKJRkci+jJBAAsCxNAtk/rnjdtPaiqqnLBQ== 2023-06-22T10:53:00.398 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.7] 2023-06-22T10:53:00.398 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAHKJRknQv6KBAA8i5HfnAIg48v0QF4mbeFbg== 2023-06-22T10:53:00.398 INFO:teuthology.orchestra.run.smithi045.stdout:[client.0] 2023-06-22T10:53:00.398 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQDsJ5RkbRd/MxAAyagIUs2XwHNsZXz9Qj2VYA== 2023-06-22T10:53:00.398 INFO:teuthology.orchestra.run.smithi045.stdout:[client.2] 2023-06-22T10:53:00.398 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQDsJ5Rkmw8tOxAAYuXx3UIIu22JlChCySc7gg== 2023-06-22T10:53:00.399 INFO:teuthology.orchestra.run.smithi045.stdout:[client.1] 2023-06-22T10:53:00.399 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQDtJ5Rksxc4BxAAa5tBILwcRq61/4BzAbwJvg== 2023-06-22T10:53:00.399 INFO:teuthology.orchestra.run.smithi045.stdout:[client.3] 2023-06-22T10:53:00.399 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQDtJ5RkaEHeDhAA6qGF/d7CpTSdCX1hNTtbwQ== 2023-06-22T10:53:00.400 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-22T10:53:00.406 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-22T10:53:00.549 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-22T10:53:00.554 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-22T10:53:00.666 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-22T10:53:00.673 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-22T10:53:00.787 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-22T10:53:00.792 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-22T10:53:00.902 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-22T10:53:00.907 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-22T10:53:01.018 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-22T10:53:01.022 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-22T10:53:01.132 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-22T10:53:01.137 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-22T10:53:01.248 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-22T10:53:01.253 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-22T10:53:01.362 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-22T10:53:01.368 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-22T10:53:01.481 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-22T10:53:01.485 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-22T10:53:01.599 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-22T10:53:01.606 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-22T10:53:01.717 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-22T10:53:01.722 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-22T10:53:01.833 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-22T10:53:01.839 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-22T10:53:01.950 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-22T10:53:01.954 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-22T10:53:02.064 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-22T10:53:02.070 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-22T10:53:02.184 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-22T10:53:02.189 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-22T10:53:02.304 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-22T10:53:02.309 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-22T10:53:02.422 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-22T10:53:02.428 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-22T10:53:02.540 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-06-22T10:53:02.541 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-06-22T10:53:02.612 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-06-22T10:53:02.738 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-06-22T10:53:02.808 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-06-22T10:53:02.879 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-06-22T10:53:03.007 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-06-22T10:53:03.076 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-06-22T10:53:03.145 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-06-22T10:53:03.270 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-06-22T10:53:03.339 DEBUG:teuthology.orchestra.run.smithi040:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-06-22T10:53:03.344 DEBUG:teuthology.orchestra.run.smithi045:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-06-22T10:53:03.389 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-06-22T10:53:03.390 INFO:tasks.ceph.mon.a:Restarting daemon 2023-06-22T10:53:03.390 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-06-22T10:53:03.395 INFO:tasks.ceph.mon.a:Started 2023-06-22T10:53:03.396 INFO:tasks.ceph.mon.b:Restarting daemon 2023-06-22T10:53:03.396 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-06-22T10:53:03.433 INFO:tasks.ceph.mon.b:Started 2023-06-22T10:53:03.434 INFO:tasks.ceph.mon.c:Restarting daemon 2023-06-22T10:53:03.435 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-06-22T10:53:03.441 INFO:tasks.ceph.mon.c:Started 2023-06-22T10:53:03.442 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-06-22T10:53:03.442 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-06-22T10:53:03.443 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-06-22T10:53:03.449 INFO:tasks.ceph.mgr.y:Started 2023-06-22T10:53:03.450 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-06-22T10:53:03.451 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-06-22T10:53:03.455 INFO:tasks.ceph.mgr.x:Started 2023-06-22T10:53:03.456 INFO:tasks.ceph:Setting crush tunables to default 2023-06-22T10:53:03.456 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph osd crush tunables default 2023-06-22T10:53:03.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.652+0000 7f85dd3ff700 1 Processor -- start 2023-06-22T10:53:03.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.653+0000 7f85dd3ff700 1 -- start start 2023-06-22T10:53:03.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.654+0000 7f85dd3ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f85d80cfb00 0x7f85d80b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:03.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.654+0000 7f85dd3ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85d8160430 con 0x7f85d80cd990 2023-06-22T10:53:03.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.654+0000 7f85dd3ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85d8160680 con 0x7f85d80cfed0 2023-06-22T10:53:03.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.654+0000 7f85dd3ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85d80cdf40 con 0x7f85d80cfb00 2023-06-22T10:53:03.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.654+0000 7f85d77fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f85d80cd990 0x7f85d80d0800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:58402/0 (socket says 172.21.15.40:58402) 2023-06-22T10:53:03.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.654+0000 7f85d77fe700 1 -- 172.21.15.40:0/2381081279 learned_addr learned my addr 172.21.15.40:0/2381081279 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:53:03.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.655+0000 7f85d6ffd700 1 --2- 172.21.15.40:0/2381081279 >> v2:172.21.15.45:3300/0 conn(0x7f85d80cfb00 0x7f85d80b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:03.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.655+0000 7f85d6ffd700 1 -- 172.21.15.40:0/2381081279 >> v2:172.21.15.45:3300/0 conn(0x7f85d80cfb00 msgr2=0x7f85d80b80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-06-22T10:53:03.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.655+0000 7f85d6ffd700 1 -- 172.21.15.40:0/2381081279 >> v2:172.21.15.45:3300/0 conn(0x7f85d80cfb00 msgr2=0x7f85d80b80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-22T10:53:03.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.655+0000 7f85d6ffd700 1 --2- 172.21.15.40:0/2381081279 >> v2:172.21.15.45:3300/0 conn(0x7f85d80cfb00 0x7f85d80b80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-22T10:53:03.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.655+0000 7f85d6ffd700 1 --2- 172.21.15.40:0/2381081279 >> v2:172.21.15.45:3300/0 conn(0x7f85d80cfb00 0x7f85d80b80d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-22T10:53:03.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.794+0000 7f85d5ffb700 1 -- 172.21.15.40:0/2381081279 <== mon.1 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3823185340 0 0) 0x7f85d8160680 con 0x7f85d80cfed0 2023-06-22T10:53:03.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.794+0000 7f85d5ffb700 1 -- 172.21.15.40:0/2381081279 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85c00035b0 con 0x7f85d80cfed0 2023-06-22T10:53:03.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.794+0000 7f85d5ffb700 1 -- 172.21.15.40:0/2381081279 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2909152731 0 0) 0x7f85d8160430 con 0x7f85d80cd990 2023-06-22T10:53:03.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.794+0000 7f85d5ffb700 1 -- 172.21.15.40:0/2381081279 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85d8160680 con 0x7f85d80cd990 2023-06-22T10:53:03.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.795+0000 7f85d5ffb700 1 -- 172.21.15.40:0/2381081279 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1233015525 0 0) 0x7f85d8160680 con 0x7f85d80cd990 2023-06-22T10:53:03.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.795+0000 7f85d5ffb700 1 -- 172.21.15.40:0/2381081279 >> v2:172.21.15.45:3300/0 conn(0x7f85d80cfb00 msgr2=0x7f85d80b80d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-22T10:53:03.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.795+0000 7f85d5ffb700 1 --2- 172.21.15.40:0/2381081279 >> v2:172.21.15.45:3300/0 conn(0x7f85d80cfb00 0x7f85d80b80d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:03.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.795+0000 7f85d5ffb700 1 -- 172.21.15.40:0/2381081279 >> v1:172.21.15.45:6789/0 conn(0x7f85d80cfed0 legacy=0x7f85d80cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:03.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.795+0000 7f85d5ffb700 1 -- 172.21.15.40:0/2381081279 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d8160960 con 0x7f85d80cd990 2023-06-22T10:53:03.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.795+0000 7f85d5ffb700 1 -- 172.21.15.40:0/2381081279 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1490606486 0 0) 0x7f85d00019f0 con 0x7f85d80cd990 2023-06-22T10:53:03.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.795+0000 7f85d5ffb700 1 -- 172.21.15.40:0/2381081279 >> v1:172.21.15.40:6789/0 conn(0x7f85d80cd990 legacy=0x7f85d80d0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:03.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.795+0000 7f85d5ffb700 1 --2- 172.21.15.40:0/2381081279 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85c0004bf0 0x7f85c0004fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:03.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.795+0000 7f85d5ffb700 1 --2- 172.21.15.40:0/2381081279 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85c00037f0 0x7f85c0003c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:03.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.795+0000 7f85d5ffb700 1 --2- 172.21.15.40:0/2381081279 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f85c00041a0 0x7f85c000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:03.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.795+0000 7f85d5ffb700 1 -- 172.21.15.40:0/2381081279 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d80cdf40 con 0x7f85c00037f0 2023-06-22T10:53:03.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.795+0000 7f85d5ffb700 1 -- 172.21.15.40:0/2381081279 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c000c060 con 0x7f85c0004bf0 2023-06-22T10:53:03.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.795+0000 7f85d5ffb700 1 -- 172.21.15.40:0/2381081279 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85c000c220 con 0x7f85c00041a0 2023-06-22T10:53:03.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.795+0000 7f85d67fc700 1 --2- 172.21.15.40:0/2381081279 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85c00037f0 0x7f85c0003c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:03.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.795+0000 7f85d77fe700 1 --2- 172.21.15.40:0/2381081279 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f85c00041a0 0x7f85c000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:03.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.796+0000 7f85d6ffd700 1 --2- 172.21.15.40:0/2381081279 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85c0004bf0 0x7f85c0004fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:03.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.796+0000 7f85d77fe700 1 -- 172.21.15.40:0/2381081279 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85c0004bf0 msgr2=0x7f85c0004fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:03.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.796+0000 7f85d77fe700 1 --2- 172.21.15.40:0/2381081279 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85c0004bf0 0x7f85c0004fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:03.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.796+0000 7f85d77fe700 1 -- 172.21.15.40:0/2381081279 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85c00037f0 msgr2=0x7f85c0003c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:03.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.796+0000 7f85d77fe700 1 --2- 172.21.15.40:0/2381081279 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85c00037f0 0x7f85c0003c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:03.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.796+0000 7f85d77fe700 1 -- 172.21.15.40:0/2381081279 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d8160680 con 0x7f85c00041a0 2023-06-22T10:53:03.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.796+0000 7f85d6ffd700 1 --2- 172.21.15.40:0/2381081279 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85c0004bf0 0x7f85c0004fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:53:03.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.796+0000 7f85d67fc700 1 --2- 172.21.15.40:0/2381081279 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85c00037f0 0x7f85c0003c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-22T10:53:03.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.796+0000 7f85d77fe700 1 -- 172.21.15.40:0/2381081279 reap_dead start 2023-06-22T10:53:03.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.796+0000 7f85d77fe700 1 --2- 172.21.15.40:0/2381081279 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f85c00041a0 0x7f85c000ba10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f85d000a780 tx=0x7f85c0005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4588e6cea7afb11d server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:03.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.796+0000 7f85d5ffb700 1 -- 172.21.15.40:0/2381081279 <== mon.2 v2:172.21.15.45:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d00072d0 con 0x7f85c00041a0 2023-06-22T10:53:03.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.797+0000 7f85d5ffb700 1 -- 172.21.15.40:0/2381081279 <== mon.2 v2:172.21.15.45:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85d0007450 con 0x7f85c00041a0 2023-06-22T10:53:03.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.797+0000 7f85d5ffb700 1 -- 172.21.15.40:0/2381081279 <== mon.2 v2:172.21.15.45:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d0007800 con 0x7f85c00041a0 2023-06-22T10:53:03.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.797+0000 7f85dd3ff700 1 -- 172.21.15.40:0/2381081279 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f85c00041a0 msgr2=0x7f85c000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:03.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.797+0000 7f85dd3ff700 1 --2- 172.21.15.40:0/2381081279 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f85c00041a0 0x7f85c000ba10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f85d000a780 tx=0x7f85c0005880 comp rx=0 tx=0).stop 2023-06-22T10:53:03.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.798+0000 7f85dd3ff700 1 -- 172.21.15.40:0/2381081279 shutdown_connections 2023-06-22T10:53:03.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.798+0000 7f85dd3ff700 1 --2- 172.21.15.40:0/2381081279 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f85c00041a0 0x7f85c000ba10 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:03.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.798+0000 7f85dd3ff700 1 -- 172.21.15.40:0/2381081279 >> 172.21.15.40:0/2381081279 conn(0x7f85d806b340 msgr2=0x7f85d806b740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:03.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.798+0000 7f85dd3ff700 1 -- 172.21.15.40:0/2381081279 shutdown_connections 2023-06-22T10:53:03.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.798+0000 7f85dd3ff700 1 -- 172.21.15.40:0/2381081279 wait complete. 2023-06-22T10:53:03.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.800+0000 7f85dd3ff700 1 Processor -- start 2023-06-22T10:53:03.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.801+0000 7f85dd3ff700 1 -- start start 2023-06-22T10:53:03.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.802+0000 7f85dd3ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f85c00041a0 0x7f85d80b2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:03.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.802+0000 7f85dd3ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85d80b6ea0 0x7f85d8156090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:03.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.802+0000 7f85dd3ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85d80b83e0 0x7f85d80b4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:03.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.802+0000 7f85dd3ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d80b23c0 con 0x7f85d80b6ea0 2023-06-22T10:53:03.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.802+0000 7f85dd3ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d80b7340 con 0x7f85d80b83e0 2023-06-22T10:53:03.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.802+0000 7f85dd3ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85d80b7620 con 0x7f85c00041a0 2023-06-22T10:53:03.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.803+0000 7f85d67fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85d80b6ea0 0x7f85d8156090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:03.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.803+0000 7f85d6ffd700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f85c00041a0 0x7f85d80b2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:03.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.803+0000 7f85d6ffd700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f85c00041a0 0x7f85d80b2f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3301/0 says I am v2:172.21.15.40:52818/0 (socket says 172.21.15.40:52818) 2023-06-22T10:53:03.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.803+0000 7f85d6ffd700 1 -- 172.21.15.40:0/3607124561 learned_addr learned my addr 172.21.15.40:0/3607124561 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:03.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.803+0000 7f85d77fe700 1 --2- 172.21.15.40:0/3607124561 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85d80b83e0 0x7f85d80b4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:03.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.803+0000 7f85d77fe700 1 -- 172.21.15.40:0/3607124561 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f85c00041a0 msgr2=0x7f85d80b2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:03.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.803+0000 7f85d77fe700 1 --2- 172.21.15.40:0/3607124561 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f85c00041a0 0x7f85d80b2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:03.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.803+0000 7f85d77fe700 1 -- 172.21.15.40:0/3607124561 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85d80b6ea0 msgr2=0x7f85d8156090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:03.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.803+0000 7f85d77fe700 1 --2- 172.21.15.40:0/3607124561 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85d80b6ea0 0x7f85d8156090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:03.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.804+0000 7f85d77fe700 1 -- 172.21.15.40:0/3607124561 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d80b7900 con 0x7f85d80b83e0 2023-06-22T10:53:03.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.804+0000 7f85d67fc700 1 --2- 172.21.15.40:0/3607124561 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85d80b6ea0 0x7f85d8156090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-22T10:53:03.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.804+0000 7f85d77fe700 1 --2- 172.21.15.40:0/3607124561 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85d80b83e0 0x7f85d80b4500 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f85d8074300 tx=0x7f85d0001360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:03.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.804+0000 7f85bf7fe700 1 -- 172.21.15.40:0/3607124561 <== mon.1 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d0012600 con 0x7f85d80b83e0 2023-06-22T10:53:03.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.804+0000 7f85dd3ff700 1 -- 172.21.15.40:0/3607124561 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85d80b7be0 con 0x7f85d80b83e0 2023-06-22T10:53:03.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.805+0000 7f85dd3ff700 1 -- 172.21.15.40:0/3607124561 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85d80b34a0 con 0x7f85d80b83e0 2023-06-22T10:53:03.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.805+0000 7f85bf7fe700 1 -- 172.21.15.40:0/3607124561 <== mon.1 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85d00019c0 con 0x7f85d80b83e0 2023-06-22T10:53:03.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.805+0000 7f85bf7fe700 1 -- 172.21.15.40:0/3607124561 <== mon.1 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d0012960 con 0x7f85d80b83e0 2023-06-22T10:53:03.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.806+0000 7f85bf7fe700 1 -- 172.21.15.40:0/3607124561 <== mon.1 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f85d001a030 con 0x7f85d80b83e0 2023-06-22T10:53:03.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.806+0000 7f85bf7fe700 1 -- 172.21.15.40:0/3607124561 <== mon.1 v2:172.21.15.45:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f85d002a500 con 0x7f85d80b83e0 2023-06-22T10:53:03.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.806+0000 7f85dd3ff700 1 -- 172.21.15.40:0/3607124561 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85b80052f0 con 0x7f85d80b83e0 2023-06-22T10:53:03.814 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.809+0000 7f85bf7fe700 1 -- 172.21.15.40:0/3607124561 <== mon.1 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f85d0018070 con 0x7f85d80b83e0 2023-06-22T10:53:03.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.889+0000 7f85dd3ff700 1 -- 172.21.15.40:0/3607124561 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f85b8005870 con 0x7f85d80b83e0 2023-06-22T10:53:03.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.893+0000 7f85bf7fe700 1 -- 172.21.15.40:0/3607124561 <== mon.1 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f85d000a3d0 con 0x7f85d80b83e0 2023-06-22T10:53:03.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.894+0000 7f85dd3ff700 1 -- 172.21.15.40:0/3607124561 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85d80b83e0 msgr2=0x7f85d80b4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:03.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.894+0000 7f85dd3ff700 1 --2- 172.21.15.40:0/3607124561 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85d80b83e0 0x7f85d80b4500 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f85d8074300 tx=0x7f85d0001360 comp rx=0 tx=0).stop 2023-06-22T10:53:03.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.894+0000 7f85dd3ff700 1 -- 172.21.15.40:0/3607124561 shutdown_connections 2023-06-22T10:53:03.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.894+0000 7f85dd3ff700 1 --2- 172.21.15.40:0/3607124561 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f85c00041a0 0x7f85d80b2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:03.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.894+0000 7f85dd3ff700 1 --2- 172.21.15.40:0/3607124561 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85d80b83e0 0x7f85d80b4500 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:03.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.894+0000 7f85dd3ff700 1 --2- 172.21.15.40:0/3607124561 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85d80b6ea0 0x7f85d8156090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:03.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.894+0000 7f85dd3ff700 1 -- 172.21.15.40:0/3607124561 >> 172.21.15.40:0/3607124561 conn(0x7f85d806b340 msgr2=0x7f85d815ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:03.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.894+0000 7f85dd3ff700 1 -- 172.21.15.40:0/3607124561 shutdown_connections 2023-06-22T10:53:03.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:03.894+0000 7f85dd3ff700 1 -- 172.21.15.40:0/3607124561 wait complete. 2023-06-22T10:53:03.899 INFO:teuthology.orchestra.run.smithi040.stderr:adjusted tunables profile to default 2023-06-22T10:53:03.915 INFO:tasks.ceph:check_enable_crimson: False 2023-06-22T10:53:03.915 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-06-22T10:53:03.915 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-06-22T10:53:03.916 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-06-22T10:53:03.970 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-06-22T10:53:03.966+0000 7f944485e200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-06-22T10:53:03.971 INFO:tasks.ceph.mgr.x.smithi045.stderr:2023-06-22T10:53:03.968+0000 7f5e5ef67200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-06-22T10:53:03.991 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-06-22T10:53:03.992 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-06-22T10:53:04.061 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-06-22T10:53:04.061 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-06-22T10:53:04.197 INFO:tasks.ceph.mgr.x.smithi045.stderr:2023-06-22T10:53:04.194+0000 7f5e5ef67200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-06-22T10:53:04.199 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-06-22T10:53:04.196+0000 7f944485e200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-06-22T10:53:04.203 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-06-22T10:53:04.203 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-06-22T10:53:04.273 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-06-22T10:53:04.274 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-06-22T10:53:04.342 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-06-22T10:53:04.343 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-06-22T10:53:04.453 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-06-22T10:53:04.453 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-06-22T10:53:04.562 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-06-22T10:53:04.563 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-06-22T10:53:04.608 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-06-22T10:53:04.604+0000 7f944485e200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-06-22T10:53:04.623 INFO:tasks.ceph.mgr.x.smithi045.stderr:2023-06-22T10:53:04.619+0000 7f5e5ef67200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-06-22T10:53:04.671 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph osd new 918db6b4-053a-46ba-976d-6e1a0104017f 0 2023-06-22T10:53:04.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:04.904+0000 7fe924dff700 1 Processor -- start 2023-06-22T10:53:04.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:04.904+0000 7fe924dff700 1 -- start start 2023-06-22T10:53:04.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:04.905+0000 7fe924dff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe9200b45d0 0x7fe9200b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:04.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:04.905+0000 7fe924dff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe9200b59a0 0x7fe9200b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:04.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:04.905+0000 7fe924dff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9200d1be0 con 0x7fe9200d2130 2023-06-22T10:53:04.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:04.905+0000 7fe924dff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9200d17f0 con 0x7fe9200b45d0 2023-06-22T10:53:04.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:04.905+0000 7fe924dff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9200d1360 con 0x7fe9200b59a0 2023-06-22T10:53:04.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:04.905+0000 7fe91dd9b700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe9200d2130 0x7fe9200cd1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:40804/0 (socket says 172.21.15.45:40804) 2023-06-22T10:53:04.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:04.905+0000 7fe91dd9b700 1 -- 172.21.15.45:0/1148395115 learned_addr learned my addr 172.21.15.45:0/1148395115 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-06-22T10:53:04.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:04.905+0000 7fe91ed9d700 1 --2- 172.21.15.45:0/1148395115 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe9200b59a0 0x7fe9200b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:04.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:04.905+0000 7fe91e59c700 1 --2- 172.21.15.45:0/1148395115 >> v2:172.21.15.40:3300/0 conn(0x7fe9200b45d0 0x7fe9200b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:04.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:04.906+0000 7fe91e59c700 1 -- 172.21.15.45:0/1148395115 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe9200b59a0 msgr2=0x7fe9200b5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:04.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:04.906+0000 7fe91e59c700 1 --2- 172.21.15.45:0/1148395115 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe9200b59a0 0x7fe9200b5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:04.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:04.906+0000 7fe91e59c700 1 -- 172.21.15.45:0/1148395115 >> v1:172.21.15.45:6789/0 conn(0x7fe9200d2130 legacy=0x7fe9200cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:04.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:04.906+0000 7fe91d59a700 1 -- 172.21.15.45:0/1148395115 <== mon.1 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4181038043 0 0) 0x7fe9200d1be0 con 0x7fe9200d2130 2023-06-22T10:53:04.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:04.906+0000 7fe91e59c700 1 -- 172.21.15.45:0/1148395115 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9200b4ee0 con 0x7fe9200b45d0 2023-06-22T10:53:04.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:04.906+0000 7fe91e59c700 1 --2- 172.21.15.45:0/1148395115 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9200b45d0 0x7fe9200b49a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe910009840 tx=0x7fe910009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b084d4a4ff53d7b server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:04.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:04.906+0000 7fe91d59a700 1 -- 172.21.15.45:0/1148395115 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe910011830 con 0x7fe9200b45d0 2023-06-22T10:53:04.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:04.906+0000 7fe91d59a700 1 -- 172.21.15.45:0/1148395115 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe910011990 con 0x7fe9200b45d0 2023-06-22T10:53:04.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:04.906+0000 7fe91d59a700 1 -- 172.21.15.45:0/1148395115 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe910011d20 con 0x7fe9200b45d0 2023-06-22T10:53:04.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:04.907+0000 7fe924dff700 1 -- 172.21.15.45:0/1148395115 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9200b45d0 msgr2=0x7fe9200b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:04.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:04.907+0000 7fe924dff700 1 --2- 172.21.15.45:0/1148395115 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9200b45d0 0x7fe9200b49a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe910009840 tx=0x7fe910009b50 comp rx=0 tx=0).stop 2023-06-22T10:53:04.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:04.907+0000 7fe924dff700 1 -- 172.21.15.45:0/1148395115 shutdown_connections 2023-06-22T10:53:04.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:04.907+0000 7fe924dff700 1 --2- 172.21.15.45:0/1148395115 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9200b45d0 0x7fe9200b49a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:04.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:04.907+0000 7fe924dff700 1 --2- 172.21.15.45:0/1148395115 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe9200b59a0 0x7fe9200b5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:04.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:04.907+0000 7fe924dff700 1 -- 172.21.15.45:0/1148395115 >> 172.21.15.45:0/1148395115 conn(0x7fe9200cf5d0 msgr2=0x7fe9200cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:04.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:04.907+0000 7fe924dff700 1 -- 172.21.15.45:0/1148395115 shutdown_connections 2023-06-22T10:53:04.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:04.907+0000 7fe924dff700 1 -- 172.21.15.45:0/1148395115 wait complete. 2023-06-22T10:53:04.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:04.909+0000 7fe924dff700 1 Processor -- start 2023-06-22T10:53:04.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:04.909+0000 7fe924dff700 1 -- start start 2023-06-22T10:53:04.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:04.910+0000 7fe924dff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9200b45d0 0x7fe920156780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:04.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:04.910+0000 7fe924dff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe9200b59a0 0x7fe9201f1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:04.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:04.910+0000 7fe924dff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9200d2130 0x7fe920154670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:04.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:04.910+0000 7fe924dff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9201f3420 con 0x7fe9200d2130 2023-06-22T10:53:04.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:04.910+0000 7fe924dff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9201f2850 con 0x7fe9200b45d0 2023-06-22T10:53:04.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:04.910+0000 7fe924dff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9201f2af0 con 0x7fe9200b59a0 2023-06-22T10:53:04.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:04.910+0000 7fe91e59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9200b45d0 0x7fe920156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:04.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:04.910+0000 7fe91dd9b700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe9200b59a0 0x7fe9201f1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:04.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:04.910+0000 7fe91e59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9200b45d0 0x7fe920156780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46906/0 (socket says 172.21.15.45:46906) 2023-06-22T10:53:04.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:04.910+0000 7fe91e59c700 1 -- 172.21.15.45:0/212065356 learned_addr learned my addr 172.21.15.45:0/212065356 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-06-22T10:53:04.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:04.910+0000 7fe91ed9d700 1 --2- 172.21.15.45:0/212065356 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9200d2130 0x7fe920154670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:04.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:04.911+0000 7fe91e59c700 1 -- 172.21.15.45:0/212065356 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe9200b59a0 msgr2=0x7fe9201f1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:04.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:04.911+0000 7fe91e59c700 1 --2- 172.21.15.45:0/212065356 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe9200b59a0 0x7fe9201f1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:04.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:04.911+0000 7fe91e59c700 1 -- 172.21.15.45:0/212065356 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9200d2130 msgr2=0x7fe920154670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:04.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:04.911+0000 7fe91e59c700 1 --2- 172.21.15.45:0/212065356 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9200d2130 0x7fe920154670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:04.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:04.911+0000 7fe91e59c700 1 -- 172.21.15.45:0/212065356 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9100094a0 con 0x7fe9200b45d0 2023-06-22T10:53:04.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:04.911+0000 7fe91e59c700 1 --2- 172.21.15.45:0/212065356 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9200b45d0 0x7fe920156780 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe910009b90 tx=0x7fe910004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:04.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:04.911+0000 7fe90effd700 1 -- 172.21.15.45:0/212065356 <== mon.1 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9100036a0 con 0x7fe9200b45d0 2023-06-22T10:53:04.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:04.911+0000 7fe90effd700 1 -- 172.21.15.45:0/212065356 <== mon.1 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe91001e070 con 0x7fe9200b45d0 2023-06-22T10:53:04.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:04.911+0000 7fe924dff700 1 -- 172.21.15.45:0/212065356 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9201f2dd0 con 0x7fe9200b45d0 2023-06-22T10:53:04.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:04.911+0000 7fe90effd700 1 -- 172.21.15.45:0/212065356 <== mon.1 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe910003a60 con 0x7fe9200b45d0 2023-06-22T10:53:04.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:04.911+0000 7fe924dff700 1 -- 172.21.15.45:0/212065356 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9200b7000 con 0x7fe9200b45d0 2023-06-22T10:53:04.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:04.912+0000 7fe90effd700 1 -- 172.21.15.45:0/212065356 <== mon.1 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe91002d450 con 0x7fe9200b45d0 2023-06-22T10:53:04.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:04.912+0000 7fe90effd700 1 -- 172.21.15.45:0/212065356 <== mon.1 v2:172.21.15.45:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fe91001a420 con 0x7fe9200b45d0 2023-06-22T10:53:04.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:04.913+0000 7fe924dff700 1 -- 172.21.15.45:0/212065356 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe920067580 con 0x7fe9200b45d0 2023-06-22T10:53:04.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:04.915+0000 7fe90effd700 1 -- 172.21.15.45:0/212065356 <== mon.1 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fe910020070 con 0x7fe9200b45d0 2023-06-22T10:53:05.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.002+0000 7fe924dff700 1 -- 172.21.15.45:0/212065356 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd new", "uuid": "918db6b4-053a-46ba-976d-6e1a0104017f", "id": 0} v 0) v1 -- 0x7fe9200d07f0 con 0x7fe9200b45d0 2023-06-22T10:53:05.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.010+0000 7fe90effd700 1 -- 172.21.15.45:0/212065356 <== mon.1 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "918db6b4-053a-46ba-976d-6e1a0104017f", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe910015020 con 0x7fe9200b45d0 2023-06-22T10:53:05.014 INFO:teuthology.orchestra.run.smithi045.stdout:0 2023-06-22T10:53:05.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.011+0000 7fe924dff700 1 -- 172.21.15.45:0/212065356 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9200b45d0 msgr2=0x7fe920156780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:05.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.011+0000 7fe924dff700 1 --2- 172.21.15.45:0/212065356 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9200b45d0 0x7fe920156780 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe910009b90 tx=0x7fe910004750 comp rx=0 tx=0).stop 2023-06-22T10:53:05.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.011+0000 7fe924dff700 1 -- 172.21.15.45:0/212065356 shutdown_connections 2023-06-22T10:53:05.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.012+0000 7fe924dff700 1 --2- 172.21.15.45:0/212065356 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9200d2130 0x7fe920154670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:05.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.012+0000 7fe924dff700 1 --2- 172.21.15.45:0/212065356 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9200b45d0 0x7fe920156780 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:05.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.012+0000 7fe924dff700 1 --2- 172.21.15.45:0/212065356 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe9200b59a0 0x7fe9201f1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:05.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.012+0000 7fe924dff700 1 -- 172.21.15.45:0/212065356 >> 172.21.15.45:0/212065356 conn(0x7fe9200cf5d0 msgr2=0x7fe9200b7ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:05.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.012+0000 7fe924dff700 1 -- 172.21.15.45:0/212065356 shutdown_connections 2023-06-22T10:53:05.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.012+0000 7fe924dff700 1 -- 172.21.15.45:0/212065356 wait complete. 2023-06-22T10:53:05.032 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph osd new 0c146e2b-1725-4dae-9b5c-38795943b9d4 1 2023-06-22T10:53:05.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.240+0000 7f087e1ff700 1 Processor -- start 2023-06-22T10:53:05.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.241+0000 7f087e1ff700 1 -- start start 2023-06-22T10:53:05.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.242+0000 7f087e1ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f08780cfb00 0x7f08780b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:05.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.242+0000 7f087e1ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0878160430 con 0x7f08780cfed0 2023-06-22T10:53:05.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.242+0000 7f087e1ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0878160680 con 0x7f08780cd990 2023-06-22T10:53:05.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.242+0000 7f087e1ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08780cdf40 con 0x7f08780cfb00 2023-06-22T10:53:05.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.242+0000 7f0877fff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f08780cd990 0x7f08780d0800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:40820/0 (socket says 172.21.15.45:40820) 2023-06-22T10:53:05.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.242+0000 7f0877fff700 1 -- 172.21.15.45:0/1123315224 learned_addr learned my addr 172.21.15.45:0/1123315224 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-06-22T10:53:05.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.242+0000 7f08777fe700 1 --2- 172.21.15.45:0/1123315224 >> v2:172.21.15.40:3300/0 conn(0x7f08780cfb00 0x7f08780b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:05.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.242+0000 7f08767fc700 1 -- 172.21.15.45:0/1123315224 <== mon.1 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2562136580 0 0) 0x7f0878160680 con 0x7f08780cd990 2023-06-22T10:53:05.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.243+0000 7f08767fc700 1 -- 172.21.15.45:0/1123315224 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08600035b0 con 0x7f08780cd990 2023-06-22T10:53:05.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.243+0000 7f08777fe700 1 -- 172.21.15.45:0/1123315224 >> v1:172.21.15.45:6789/0 conn(0x7f08780cd990 legacy=0x7f08780d0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:05.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.243+0000 7f08777fe700 1 -- 172.21.15.45:0/1123315224 >> v1:172.21.15.40:6789/0 conn(0x7f08780cfed0 legacy=0x7f08780cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:05.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.243+0000 7f08777fe700 1 -- 172.21.15.45:0/1123315224 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0878160960 con 0x7f08780cfb00 2023-06-22T10:53:05.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.243+0000 7f08777fe700 1 --2- 172.21.15.45:0/1123315224 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08780cfb00 0x7f08780b80d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0868009840 tx=0x7f0868009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff1d16a721041abd server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:05.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.243+0000 7f08767fc700 1 -- 172.21.15.45:0/1123315224 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0868011830 con 0x7f08780cfb00 2023-06-22T10:53:05.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.243+0000 7f08767fc700 1 -- 172.21.15.45:0/1123315224 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0868011990 con 0x7f08780cfb00 2023-06-22T10:53:05.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.243+0000 7f08767fc700 1 -- 172.21.15.45:0/1123315224 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0868011d20 con 0x7f08780cfb00 2023-06-22T10:53:05.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.244+0000 7f087e1ff700 1 -- 172.21.15.45:0/1123315224 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08780cfb00 msgr2=0x7f08780b80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:05.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.244+0000 7f087e1ff700 1 --2- 172.21.15.45:0/1123315224 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08780cfb00 0x7f08780b80d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0868009840 tx=0x7f0868009b50 comp rx=0 tx=0).stop 2023-06-22T10:53:05.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.244+0000 7f087e1ff700 1 -- 172.21.15.45:0/1123315224 shutdown_connections 2023-06-22T10:53:05.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.244+0000 7f087e1ff700 1 --2- 172.21.15.45:0/1123315224 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08780cfb00 0x7f08780b80d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:05.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.244+0000 7f087e1ff700 1 -- 172.21.15.45:0/1123315224 >> 172.21.15.45:0/1123315224 conn(0x7f087806b340 msgr2=0x7f087806b740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:05.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.244+0000 7f087e1ff700 1 -- 172.21.15.45:0/1123315224 shutdown_connections 2023-06-22T10:53:05.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.244+0000 7f087e1ff700 1 -- 172.21.15.45:0/1123315224 wait complete. 2023-06-22T10:53:05.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.246+0000 7f087e1ff700 1 Processor -- start 2023-06-22T10:53:05.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.246+0000 7f087e1ff700 1 -- start start 2023-06-22T10:53:05.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.247+0000 7f087e1ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08780cd990 0x7f08781f55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:05.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.247+0000 7f087e1ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f08780cfb00 0x7f08780cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:05.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.247+0000 7f087e1ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08780cfed0 0x7f08780cbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:05.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.247+0000 7f087e1ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08781f5ae0 con 0x7f08780cfed0 2023-06-22T10:53:05.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.247+0000 7f087e1ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f087815ddb0 con 0x7f08780cd990 2023-06-22T10:53:05.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.247+0000 7f087e1ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f087815e090 con 0x7f08780cfb00 2023-06-22T10:53:05.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.247+0000 7f08777fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08780cd990 0x7f08781f55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:05.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.247+0000 7f08777fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08780cd990 0x7f08781f55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46912/0 (socket says 172.21.15.45:46912) 2023-06-22T10:53:05.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.247+0000 7f08777fe700 1 -- 172.21.15.45:0/956590971 learned_addr learned my addr 172.21.15.45:0/956590971 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-06-22T10:53:05.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.247+0000 7f0876ffd700 1 --2- 172.21.15.45:0/956590971 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f08780cfb00 0x7f08780cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:05.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.247+0000 7f0877fff700 1 --2- 172.21.15.45:0/956590971 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08780cfed0 0x7f08780cbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:05.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.247+0000 7f08777fe700 1 -- 172.21.15.45:0/956590971 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f08780cfb00 msgr2=0x7f08780cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:05.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.247+0000 7f08777fe700 1 --2- 172.21.15.45:0/956590971 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f08780cfb00 0x7f08780cbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:05.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.247+0000 7f08777fe700 1 -- 172.21.15.45:0/956590971 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08780cfed0 msgr2=0x7f08780cbfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:05.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.247+0000 7f08777fe700 1 --2- 172.21.15.45:0/956590971 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08780cfed0 0x7f08780cbfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:05.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.247+0000 7f08777fe700 1 -- 172.21.15.45:0/956590971 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08680094a0 con 0x7f08780cd990 2023-06-22T10:53:05.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.248+0000 7f08777fe700 1 --2- 172.21.15.45:0/956590971 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08780cd990 0x7f08781f55a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0868009fd0 tx=0x7f0868004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:05.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.248+0000 7f085ffff700 1 -- 172.21.15.45:0/956590971 <== mon.1 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08680036a0 con 0x7f08780cd990 2023-06-22T10:53:05.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.248+0000 7f085ffff700 1 -- 172.21.15.45:0/956590971 <== mon.1 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f086801f070 con 0x7f08780cd990 2023-06-22T10:53:05.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.248+0000 7f087e1ff700 1 -- 172.21.15.45:0/956590971 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f087815e370 con 0x7f08780cd990 2023-06-22T10:53:05.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.248+0000 7f085ffff700 1 -- 172.21.15.45:0/956590971 <== mon.1 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0868003a60 con 0x7f08780cd990 2023-06-22T10:53:05.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.248+0000 7f087e1ff700 1 -- 172.21.15.45:0/956590971 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f087815e930 con 0x7f08780cd990 2023-06-22T10:53:05.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.249+0000 7f085ffff700 1 -- 172.21.15.45:0/956590971 <== mon.1 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0868026480 con 0x7f08780cd990 2023-06-22T10:53:05.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.249+0000 7f085ffff700 1 -- 172.21.15.45:0/956590971 <== mon.1 v2:172.21.15.45:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f0868021070 con 0x7f08780cd990 2023-06-22T10:53:05.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.249+0000 7f087e1ff700 1 -- 172.21.15.45:0/956590971 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08781f2760 con 0x7f08780cd990 2023-06-22T10:53:05.257 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-06-22T10:53:05.250+0000 7f944485e200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-06-22T10:53:05.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.253+0000 7f085ffff700 1 -- 172.21.15.45:0/956590971 <== mon.1 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f086802b020 con 0x7f08780cd990 2023-06-22T10:53:05.326 INFO:tasks.ceph.mgr.x.smithi045.stderr:2023-06-22T10:53:05.322+0000 7f5e5ef67200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-06-22T10:53:05.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.342+0000 7f087e1ff700 1 -- 172.21.15.45:0/956590971 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0c146e2b-1725-4dae-9b5c-38795943b9d4", "id": 1} v 0) v1 -- 0x7f0878066ac0 con 0x7f08780cd990 2023-06-22T10:53:05.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.350+0000 7f085ffff700 1 -- 172.21.15.45:0/956590971 <== mon.1 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0c146e2b-1725-4dae-9b5c-38795943b9d4", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0868015020 con 0x7f08780cd990 2023-06-22T10:53:05.354 INFO:teuthology.orchestra.run.smithi045.stdout:1 2023-06-22T10:53:05.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.351+0000 7f087e1ff700 1 -- 172.21.15.45:0/956590971 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08780cd990 msgr2=0x7f08781f55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:05.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.351+0000 7f087e1ff700 1 --2- 172.21.15.45:0/956590971 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08780cd990 0x7f08781f55a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0868009fd0 tx=0x7f0868004750 comp rx=0 tx=0).stop 2023-06-22T10:53:05.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.351+0000 7f087e1ff700 1 -- 172.21.15.45:0/956590971 shutdown_connections 2023-06-22T10:53:05.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.351+0000 7f087e1ff700 1 --2- 172.21.15.45:0/956590971 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08780cfed0 0x7f08780cbfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:05.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.351+0000 7f087e1ff700 1 --2- 172.21.15.45:0/956590971 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08780cd990 0x7f08781f55a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:05.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.351+0000 7f087e1ff700 1 --2- 172.21.15.45:0/956590971 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f08780cfb00 0x7f08780cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:05.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.351+0000 7f087e1ff700 1 -- 172.21.15.45:0/956590971 >> 172.21.15.45:0/956590971 conn(0x7f087806b340 msgr2=0x7f08780b6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:05.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.351+0000 7f087e1ff700 1 -- 172.21.15.45:0/956590971 shutdown_connections 2023-06-22T10:53:05.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.351+0000 7f087e1ff700 1 -- 172.21.15.45:0/956590971 wait complete. 2023-06-22T10:53:05.372 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph osd new 0b3727fd-f281-46d5-a675-86c8c5ab269e 2 2023-06-22T10:53:05.495 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-06-22T10:53:05.492+0000 7f944485e200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-06-22T10:53:05.572 INFO:tasks.ceph.mgr.x.smithi045.stderr:2023-06-22T10:53:05.569+0000 7f5e5ef67200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-06-22T10:53:05.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.569+0000 7fe783fff700 1 Processor -- start 2023-06-22T10:53:05.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.569+0000 7fe783fff700 1 -- start start 2023-06-22T10:53:05.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.570+0000 7fe783fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe77c0d2130 0x7fe77c0cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:05.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.571+0000 7fe783fff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe77c0d1be0 con 0x7fe77c0cd6e0 2023-06-22T10:53:05.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.571+0000 7fe783fff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe77c0d1360 con 0x7fe77c0b45d0 2023-06-22T10:53:05.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.571+0000 7fe783fff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe77c0d17f0 con 0x7fe77c0d2130 2023-06-22T10:53:05.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.571+0000 7fe78159a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe77c0d2130 0x7fe77c0cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:05.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.571+0000 7fe78159a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe77c0d2130 0x7fe77c0cd1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46928/0 (socket says 172.21.15.45:46928) 2023-06-22T10:53:05.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.571+0000 7fe78159a700 1 -- 172.21.15.45:0/1917330963 learned_addr learned my addr 172.21.15.45:0/1917330963 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-06-22T10:53:05.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.571+0000 7fe781d9b700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe77c0b45d0 0x7fe77c0b49a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:40826/0 (socket says 172.21.15.45:40826) 2023-06-22T10:53:05.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.571+0000 7fe78259c700 1 --1- 172.21.15.45:0/1917330963 >> v1:172.21.15.40:6789/0 conn(0x7fe77c0cd6e0 0x7fe77c0b59a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.45:43238/0 (socket says 172.21.15.45:43238) 2023-06-22T10:53:05.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.571+0000 7fe78159a700 1 -- 172.21.15.45:0/1917330963 >> v1:172.21.15.45:6789/0 conn(0x7fe77c0b45d0 legacy=0x7fe77c0b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:05.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.571+0000 7fe78159a700 1 -- 172.21.15.45:0/1917330963 >> v1:172.21.15.40:6789/0 conn(0x7fe77c0cd6e0 legacy=0x7fe77c0b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:05.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.571+0000 7fe78159a700 1 -- 172.21.15.45:0/1917330963 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe77c0cef40 con 0x7fe77c0d2130 2023-06-22T10:53:05.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.571+0000 7fe780d99700 1 -- 172.21.15.45:0/1917330963 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1166549403 0 0) 0x7fe77c0d1be0 con 0x7fe77c0cd6e0 2023-06-22T10:53:05.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.572+0000 7fe78159a700 1 --2- 172.21.15.45:0/1917330963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe77c0d2130 0x7fe77c0cd1a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe76c0098f0 tx=0x7fe76c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3285ffb22c94b693 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:05.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.572+0000 7fe780d99700 1 -- 172.21.15.45:0/1917330963 <== mon.1 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76c00b8a0 con 0x7fe77c0d2130 2023-06-22T10:53:05.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.572+0000 7fe780d99700 1 -- 172.21.15.45:0/1917330963 <== mon.1 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe76c00ba00 con 0x7fe77c0d2130 2023-06-22T10:53:05.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.572+0000 7fe780d99700 1 -- 172.21.15.45:0/1917330963 <== mon.1 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76c00bd90 con 0x7fe77c0d2130 2023-06-22T10:53:05.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.572+0000 7fe783fff700 1 -- 172.21.15.45:0/1917330963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe77c0d2130 msgr2=0x7fe77c0cd1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:05.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.573+0000 7fe783fff700 1 --2- 172.21.15.45:0/1917330963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe77c0d2130 0x7fe77c0cd1a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe76c0098f0 tx=0x7fe76c009c00 comp rx=0 tx=0).stop 2023-06-22T10:53:05.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.573+0000 7fe783fff700 1 -- 172.21.15.45:0/1917330963 shutdown_connections 2023-06-22T10:53:05.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.573+0000 7fe783fff700 1 --2- 172.21.15.45:0/1917330963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe77c0d2130 0x7fe77c0cd1a0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:05.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.573+0000 7fe783fff700 1 -- 172.21.15.45:0/1917330963 >> 172.21.15.45:0/1917330963 conn(0x7fe77c0cf5d0 msgr2=0x7fe77c0cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:05.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.573+0000 7fe783fff700 1 -- 172.21.15.45:0/1917330963 shutdown_connections 2023-06-22T10:53:05.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.573+0000 7fe783fff700 1 -- 172.21.15.45:0/1917330963 wait complete. 2023-06-22T10:53:05.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.575+0000 7fe783fff700 1 Processor -- start 2023-06-22T10:53:05.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.576+0000 7fe783fff700 1 -- start start 2023-06-22T10:53:05.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.577+0000 7fe783fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe77c0b45d0 0x7fe77c14f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:05.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.577+0000 7fe783fff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe77c0cd6e0 0x7fe77c15d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:05.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.577+0000 7fe783fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe77c0d2130 0x7fe77c0a9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:05.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.577+0000 7fe783fff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c15e600 con 0x7fe77c0d2130 2023-06-22T10:53:05.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.577+0000 7fe783fff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c14fe10 con 0x7fe77c0b45d0 2023-06-22T10:53:05.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.577+0000 7fe783fff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c15d9f0 con 0x7fe77c0cd6e0 2023-06-22T10:53:05.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.578+0000 7fe781d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe77c0b45d0 0x7fe77c14f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:05.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.578+0000 7fe78159a700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe77c0cd6e0 0x7fe77c15d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:05.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.578+0000 7fe781d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe77c0b45d0 0x7fe77c14f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46932/0 (socket says 172.21.15.45:46932) 2023-06-22T10:53:05.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.578+0000 7fe781d9b700 1 -- 172.21.15.45:0/3212796838 learned_addr learned my addr 172.21.15.45:0/3212796838 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-06-22T10:53:05.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.578+0000 7fe78259c700 1 --2- 172.21.15.45:0/3212796838 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe77c0d2130 0x7fe77c0a9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:05.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.578+0000 7fe781d9b700 1 -- 172.21.15.45:0/3212796838 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe77c0cd6e0 msgr2=0x7fe77c15d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:05.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.578+0000 7fe781d9b700 1 --2- 172.21.15.45:0/3212796838 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe77c0cd6e0 0x7fe77c15d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:05.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.578+0000 7fe781d9b700 1 -- 172.21.15.45:0/3212796838 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe77c0d2130 msgr2=0x7fe77c0a9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:05.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.578+0000 7fe781d9b700 1 --2- 172.21.15.45:0/3212796838 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe77c0d2130 0x7fe77c0a9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:05.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.578+0000 7fe781d9b700 1 -- 172.21.15.45:0/3212796838 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe76c009550 con 0x7fe77c0b45d0 2023-06-22T10:53:05.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.578+0000 7fe781d9b700 1 --2- 172.21.15.45:0/3212796838 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe77c0b45d0 0x7fe77c14f8d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe77800c500 tx=0x7fe77800c810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:05.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.579+0000 7fe7727fc700 1 -- 172.21.15.45:0/3212796838 <== mon.1 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe778005cb0 con 0x7fe77c0b45d0 2023-06-22T10:53:05.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.579+0000 7fe7727fc700 1 -- 172.21.15.45:0/3212796838 <== mon.1 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe778005e10 con 0x7fe77c0b45d0 2023-06-22T10:53:05.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.579+0000 7fe7727fc700 1 -- 172.21.15.45:0/3212796838 <== mon.1 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7780072d0 con 0x7fe77c0b45d0 2023-06-22T10:53:05.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.579+0000 7fe783fff700 1 -- 172.21.15.45:0/3212796838 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe77c15dcd0 con 0x7fe77c0b45d0 2023-06-22T10:53:05.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.579+0000 7fe783fff700 1 -- 172.21.15.45:0/3212796838 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe77c15e290 con 0x7fe77c0b45d0 2023-06-22T10:53:05.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.579+0000 7fe7727fc700 1 -- 172.21.15.45:0/3212796838 <== mon.1 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe77801c440 con 0x7fe77c0b45d0 2023-06-22T10:53:05.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.579+0000 7fe7727fc700 1 -- 172.21.15.45:0/3212796838 <== mon.1 v2:172.21.15.45:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fe778007730 con 0x7fe77c0b45d0 2023-06-22T10:53:05.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.580+0000 7fe783fff700 1 -- 172.21.15.45:0/3212796838 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe77c067580 con 0x7fe77c0b45d0 2023-06-22T10:53:05.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.584+0000 7fe7727fc700 1 -- 172.21.15.45:0/3212796838 <== mon.1 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fe778021060 con 0x7fe77c0b45d0 2023-06-22T10:53:05.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.673+0000 7fe783fff700 1 -- 172.21.15.45:0/3212796838 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0b3727fd-f281-46d5-a675-86c8c5ab269e", "id": 2} v 0) v1 -- 0x7fe77c0b8210 con 0x7fe77c0b45d0 2023-06-22T10:53:05.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.681+0000 7fe7727fc700 1 -- 172.21.15.45:0/3212796838 <== mon.1 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0b3727fd-f281-46d5-a675-86c8c5ab269e", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe778017070 con 0x7fe77c0b45d0 2023-06-22T10:53:05.685 INFO:teuthology.orchestra.run.smithi045.stdout:2 2023-06-22T10:53:05.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.682+0000 7fe783fff700 1 -- 172.21.15.45:0/3212796838 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe77c0b45d0 msgr2=0x7fe77c14f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:05.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.682+0000 7fe783fff700 1 --2- 172.21.15.45:0/3212796838 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe77c0b45d0 0x7fe77c14f8d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe77800c500 tx=0x7fe77800c810 comp rx=0 tx=0).stop 2023-06-22T10:53:05.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.682+0000 7fe783fff700 1 -- 172.21.15.45:0/3212796838 shutdown_connections 2023-06-22T10:53:05.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.682+0000 7fe783fff700 1 --2- 172.21.15.45:0/3212796838 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe77c0d2130 0x7fe77c0a9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:05.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.682+0000 7fe783fff700 1 --2- 172.21.15.45:0/3212796838 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe77c0b45d0 0x7fe77c14f8d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:05.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.682+0000 7fe783fff700 1 --2- 172.21.15.45:0/3212796838 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe77c0cd6e0 0x7fe77c15d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:05.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.682+0000 7fe783fff700 1 -- 172.21.15.45:0/3212796838 >> 172.21.15.45:0/3212796838 conn(0x7fe77c0cf5d0 msgr2=0x7fe77c159a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:05.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.682+0000 7fe783fff700 1 -- 172.21.15.45:0/3212796838 shutdown_connections 2023-06-22T10:53:05.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.682+0000 7fe783fff700 1 -- 172.21.15.45:0/3212796838 wait complete. 2023-06-22T10:53:05.702 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph osd new 2969c698-7039-4bbb-beda-f756f7a368a1 3 2023-06-22T10:53:05.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.901+0000 7f4bc85ff700 1 Processor -- start 2023-06-22T10:53:05.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.901+0000 7f4bc85ff700 1 -- start start 2023-06-22T10:53:05.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.902+0000 7f4bc85ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4bc00b45d0 0x7f4bc00b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:05.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.903+0000 7f4bc85ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f4bc00d2130 0x7f4bc00cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:05.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.903+0000 7f4bc85ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bc00d1be0 con 0x7f4bc00cd6e0 2023-06-22T10:53:05.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.903+0000 7f4bc85ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bc00d17f0 con 0x7f4bc00b45d0 2023-06-22T10:53:05.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.903+0000 7f4bc85ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc00d1360 con 0x7f4bc00d2130 2023-06-22T10:53:05.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.903+0000 7f4bc639b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4bc00b45d0 0x7f4bc00b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:05.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.903+0000 7f4bc5b9a700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f4bc00d2130 0x7f4bc00cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:05.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.903+0000 7f4bc639b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4bc00b45d0 0x7f4bc00b49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46940/0 (socket says 172.21.15.45:46940) 2023-06-22T10:53:05.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.903+0000 7f4bc639b700 1 -- 172.21.15.45:0/1935809567 learned_addr learned my addr 172.21.15.45:0/1935809567 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-06-22T10:53:05.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.903+0000 7f4bc5b9a700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f4bc00d2130 0x7f4bc00cd1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3301/0 says I am v2:172.21.15.45:50332/0 (socket says 172.21.15.45:50332) 2023-06-22T10:53:05.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.903+0000 7f4bc639b700 1 -- 172.21.15.45:0/1935809567 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f4bc00d2130 msgr2=0x7f4bc00cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:05.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.903+0000 7f4bc639b700 1 --2- 172.21.15.45:0/1935809567 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f4bc00d2130 0x7f4bc00cd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:05.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.903+0000 7f4bc639b700 1 -- 172.21.15.45:0/1935809567 >> v1:172.21.15.40:6789/0 conn(0x7f4bc00cd6e0 legacy=0x7f4bc00b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:05.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.903+0000 7f4bc639b700 1 -- 172.21.15.45:0/1935809567 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc00b4ee0 con 0x7f4bc00b45d0 2023-06-22T10:53:05.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.903+0000 7f4bc5399700 1 -- 172.21.15.45:0/1935809567 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3431329527 0 0) 0x7f4bc00d1be0 con 0x7f4bc00cd6e0 2023-06-22T10:53:05.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.903+0000 7f4bc5b9a700 1 --2- 172.21.15.45:0/1935809567 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f4bc00d2130 0x7f4bc00cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-22T10:53:05.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.904+0000 7f4bc639b700 1 --2- 172.21.15.45:0/1935809567 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bc00b45d0 0x7f4bc00b49a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc0098f0 tx=0x7f4bbc009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32bb5a67896bcfc1 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:05.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.904+0000 7f4bc5399700 1 -- 172.21.15.45:0/1935809567 <== mon.1 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bbc011830 con 0x7f4bc00b45d0 2023-06-22T10:53:05.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.904+0000 7f4bc5399700 1 -- 172.21.15.45:0/1935809567 <== mon.1 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bbc011990 con 0x7f4bc00b45d0 2023-06-22T10:53:05.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.904+0000 7f4bc5399700 1 -- 172.21.15.45:0/1935809567 <== mon.1 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bbc011d20 con 0x7f4bc00b45d0 2023-06-22T10:53:05.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.904+0000 7f4bc85ff700 1 -- 172.21.15.45:0/1935809567 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bc00b45d0 msgr2=0x7f4bc00b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:05.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.904+0000 7f4bc85ff700 1 --2- 172.21.15.45:0/1935809567 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bc00b45d0 0x7f4bc00b49a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc0098f0 tx=0x7f4bbc009c00 comp rx=0 tx=0).stop 2023-06-22T10:53:05.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.905+0000 7f4bc85ff700 1 -- 172.21.15.45:0/1935809567 shutdown_connections 2023-06-22T10:53:05.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.905+0000 7f4bc85ff700 1 --2- 172.21.15.45:0/1935809567 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bc00b45d0 0x7f4bc00b49a0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:05.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.905+0000 7f4bc85ff700 1 --2- 172.21.15.45:0/1935809567 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f4bc00d2130 0x7f4bc00cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:05.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.905+0000 7f4bc85ff700 1 -- 172.21.15.45:0/1935809567 >> 172.21.15.45:0/1935809567 conn(0x7f4bc00cf5d0 msgr2=0x7f4bc00cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:05.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.905+0000 7f4bc85ff700 1 -- 172.21.15.45:0/1935809567 shutdown_connections 2023-06-22T10:53:05.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.905+0000 7f4bc85ff700 1 -- 172.21.15.45:0/1935809567 wait complete. 2023-06-22T10:53:05.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.906+0000 7f4bc85ff700 1 Processor -- start 2023-06-22T10:53:05.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.907+0000 7f4bc85ff700 1 -- start start 2023-06-22T10:53:05.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.907+0000 7f4bc85ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f4bc00b45d0 0x7f4bc0156ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:05.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.907+0000 7f4bc85ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bc00cd6e0 0x7f4bc00ca630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:05.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.907+0000 7f4bc85ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4bc00d2130 0x7f4bc00cb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:05.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.907+0000 7f4bc85ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc015c660 con 0x7f4bc00d2130 2023-06-22T10:53:05.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.908+0000 7f4bc85ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc015cbe0 con 0x7f4bc00cd6e0 2023-06-22T10:53:05.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.908+0000 7f4bc85ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc00cae60 con 0x7f4bc00b45d0 2023-06-22T10:53:05.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.908+0000 7f4bc5b9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bc00cd6e0 0x7f4bc00ca630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:05.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.908+0000 7f4bc639b700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f4bc00b45d0 0x7f4bc0156ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:05.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.908+0000 7f4bc5b9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bc00cd6e0 0x7f4bc00ca630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46956/0 (socket says 172.21.15.45:46956) 2023-06-22T10:53:05.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.908+0000 7f4bc5b9a700 1 -- 172.21.15.45:0/3046718940 learned_addr learned my addr 172.21.15.45:0/3046718940 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-06-22T10:53:05.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.908+0000 7f4bc6b9c700 1 --2- 172.21.15.45:0/3046718940 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4bc00d2130 0x7f4bc00cb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:05.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.908+0000 7f4bc5b9a700 1 -- 172.21.15.45:0/3046718940 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f4bc00b45d0 msgr2=0x7f4bc0156ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:05.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.908+0000 7f4bc5b9a700 1 --2- 172.21.15.45:0/3046718940 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f4bc00b45d0 0x7f4bc0156ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:05.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.908+0000 7f4bc5b9a700 1 -- 172.21.15.45:0/3046718940 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4bc00d2130 msgr2=0x7f4bc00cb5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:05.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.908+0000 7f4bc5b9a700 1 --2- 172.21.15.45:0/3046718940 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4bc00d2130 0x7f4bc00cb5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:05.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.908+0000 7f4bc5b9a700 1 -- 172.21.15.45:0/3046718940 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb00094a0 con 0x7f4bc00cd6e0 2023-06-22T10:53:05.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.908+0000 7f4bc6b9c700 1 --2- 172.21.15.45:0/3046718940 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4bc00d2130 0x7f4bc00cb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:53:05.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.908+0000 7f4bc5b9a700 1 --2- 172.21.15.45:0/3046718940 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bc00cd6e0 0x7f4bc00ca630 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4bb000ebe0 tx=0x7f4bb000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:05.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.909+0000 7f4bb6ffd700 1 -- 172.21.15.45:0/3046718940 <== mon.1 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb0009800 con 0x7f4bc00cd6e0 2023-06-22T10:53:05.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.909+0000 7f4bb6ffd700 1 -- 172.21.15.45:0/3046718940 <== mon.1 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bb000c910 con 0x7f4bc00cd6e0 2023-06-22T10:53:05.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.909+0000 7f4bb6ffd700 1 -- 172.21.15.45:0/3046718940 <== mon.1 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb000cc80 con 0x7f4bc00cd6e0 2023-06-22T10:53:05.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.909+0000 7f4bc85ff700 1 -- 172.21.15.45:0/3046718940 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bbc009550 con 0x7f4bc00cd6e0 2023-06-22T10:53:05.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.909+0000 7f4bc85ff700 1 -- 172.21.15.45:0/3046718940 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bc015c870 con 0x7f4bc00cd6e0 2023-06-22T10:53:05.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.909+0000 7f4bb6ffd700 1 -- 172.21.15.45:0/3046718940 <== mon.1 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4bb0005d20 con 0x7f4bc00cd6e0 2023-06-22T10:53:05.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.909+0000 7f4bb6ffd700 1 -- 172.21.15.45:0/3046718940 <== mon.1 v2:172.21.15.45:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f4bb00068e0 con 0x7f4bc00cd6e0 2023-06-22T10:53:05.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.910+0000 7f4bc85ff700 1 -- 172.21.15.45:0/3046718940 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bc015cd50 con 0x7f4bc00cd6e0 2023-06-22T10:53:05.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:05.912+0000 7f4bb6ffd700 1 -- 172.21.15.45:0/3046718940 <== mon.1 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f4bb0021060 con 0x7f4bc00cd6e0 2023-06-22T10:53:05.954 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-06-22T10:53:05.951+0000 7f944485e200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-06-22T10:53:06.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.000+0000 7f4bc85ff700 1 -- 172.21.15.45:0/3046718940 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2969c698-7039-4bbb-beda-f756f7a368a1", "id": 3} v 0) v1 -- 0x7f4bc0067580 con 0x7f4bc00cd6e0 2023-06-22T10:53:06.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.006+0000 7f4bb6ffd700 1 -- 172.21.15.45:0/3046718940 <== mon.1 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2969c698-7039-4bbb-beda-f756f7a368a1", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4bb0029020 con 0x7f4bc00cd6e0 2023-06-22T10:53:06.010 INFO:teuthology.orchestra.run.smithi045.stdout:3 2023-06-22T10:53:06.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.008+0000 7f4bc85ff700 1 -- 172.21.15.45:0/3046718940 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bc00cd6e0 msgr2=0x7f4bc00ca630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:06.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.008+0000 7f4bc85ff700 1 --2- 172.21.15.45:0/3046718940 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bc00cd6e0 0x7f4bc00ca630 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4bb000ebe0 tx=0x7f4bb000eef0 comp rx=0 tx=0).stop 2023-06-22T10:53:06.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.008+0000 7f4bc85ff700 1 -- 172.21.15.45:0/3046718940 shutdown_connections 2023-06-22T10:53:06.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.008+0000 7f4bc85ff700 1 --2- 172.21.15.45:0/3046718940 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f4bc00b45d0 0x7f4bc0156ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:06.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.008+0000 7f4bc85ff700 1 --2- 172.21.15.45:0/3046718940 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4bc00d2130 0x7f4bc00cb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:06.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.008+0000 7f4bc85ff700 1 --2- 172.21.15.45:0/3046718940 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bc00cd6e0 0x7f4bc00ca630 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:06.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.008+0000 7f4bc85ff700 1 -- 172.21.15.45:0/3046718940 >> 172.21.15.45:0/3046718940 conn(0x7f4bc00cf5d0 msgr2=0x7f4bc00b39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:06.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.008+0000 7f4bc85ff700 1 -- 172.21.15.45:0/3046718940 shutdown_connections 2023-06-22T10:53:06.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.008+0000 7f4bc85ff700 1 -- 172.21.15.45:0/3046718940 wait complete. 2023-06-22T10:53:06.029 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph osd new 3bb1d9c8-8e42-4a6b-998d-04834f34be5b 4 2023-06-22T10:53:06.061 INFO:tasks.ceph.mgr.x.smithi045.stderr:2023-06-22T10:53:06.058+0000 7f5e5ef67200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-06-22T10:53:06.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.221+0000 7f2a941ff700 1 Processor -- start 2023-06-22T10:53:06.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.221+0000 7f2a941ff700 1 -- start start 2023-06-22T10:53:06.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.222+0000 7f2a941ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f2a8c0d2130 0x7f2a8c0cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:06.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.222+0000 7f2a941ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2a8c0cd6e0 0x7f2a8c0b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:06.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.222+0000 7f2a941ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a8c0d1be0 con 0x7f2a8c0b45d0 2023-06-22T10:53:06.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.222+0000 7f2a941ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a8c0d17f0 con 0x7f2a8c0cd6e0 2023-06-22T10:53:06.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.222+0000 7f2a941ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8c0d1360 con 0x7f2a8c0d2130 2023-06-22T10:53:06.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.223+0000 7f2a9179a700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f2a8c0d2130 0x7f2a8c0cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:06.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.223+0000 7f2a91f9b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f2a8c0b45d0 0x7f2a8c0b49a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.45:43256/0 (socket says 172.21.15.45:43256) 2023-06-22T10:53:06.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.223+0000 7f2a9179a700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f2a8c0d2130 0x7f2a8c0cd1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3301/0 says I am v2:172.21.15.45:50358/0 (socket says 172.21.15.45:50358) 2023-06-22T10:53:06.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.223+0000 7f2a91f9b700 1 -- 172.21.15.45:0/95382845 learned_addr learned my addr 172.21.15.45:0/95382845 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-06-22T10:53:06.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.223+0000 7f2a9279c700 1 --2- 172.21.15.45:0/95382845 >> v2:172.21.15.40:3300/0 conn(0x7f2a8c0cd6e0 0x7f2a8c0b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:06.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.223+0000 7f2a90f99700 1 -- 172.21.15.45:0/95382845 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4087798901 0 0) 0x7f2a8c0d1be0 con 0x7f2a8c0b45d0 2023-06-22T10:53:06.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.223+0000 7f2a9179a700 1 -- 172.21.15.45:0/95382845 >> v2:172.21.15.40:3300/0 conn(0x7f2a8c0cd6e0 msgr2=0x7f2a8c0b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:06.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.223+0000 7f2a9179a700 1 --2- 172.21.15.45:0/95382845 >> v2:172.21.15.40:3300/0 conn(0x7f2a8c0cd6e0 0x7f2a8c0b59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:06.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.223+0000 7f2a9179a700 1 -- 172.21.15.45:0/95382845 >> v1:172.21.15.40:6789/0 conn(0x7f2a8c0b45d0 legacy=0x7f2a8c0b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:06.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.223+0000 7f2a9179a700 1 -- 172.21.15.45:0/95382845 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a8c0cef40 con 0x7f2a8c0d2130 2023-06-22T10:53:06.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.223+0000 7f2a9179a700 1 --2- 172.21.15.45:0/95382845 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f2a8c0d2130 0x7f2a8c0cd1a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c009840 tx=0x7f2a7c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=270cb6d44b3c00a2 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:06.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.224+0000 7f2a90f99700 1 -- 172.21.15.45:0/95382845 <== mon.2 v2:172.21.15.45:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c011830 con 0x7f2a8c0d2130 2023-06-22T10:53:06.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.224+0000 7f2a90f99700 1 -- 172.21.15.45:0/95382845 <== mon.2 v2:172.21.15.45:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a7c011990 con 0x7f2a8c0d2130 2023-06-22T10:53:06.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.224+0000 7f2a90f99700 1 -- 172.21.15.45:0/95382845 <== mon.2 v2:172.21.15.45:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c011d20 con 0x7f2a8c0d2130 2023-06-22T10:53:06.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.224+0000 7f2a941ff700 1 -- 172.21.15.45:0/95382845 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f2a8c0d2130 msgr2=0x7f2a8c0cd1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:06.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.224+0000 7f2a941ff700 1 --2- 172.21.15.45:0/95382845 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f2a8c0d2130 0x7f2a8c0cd1a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c009840 tx=0x7f2a7c009b50 comp rx=0 tx=0).stop 2023-06-22T10:53:06.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.224+0000 7f2a941ff700 1 -- 172.21.15.45:0/95382845 shutdown_connections 2023-06-22T10:53:06.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.224+0000 7f2a941ff700 1 --2- 172.21.15.45:0/95382845 >> v2:172.21.15.40:3300/0 conn(0x7f2a8c0cd6e0 0x7f2a8c0b59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:06.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.224+0000 7f2a941ff700 1 --2- 172.21.15.45:0/95382845 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f2a8c0d2130 0x7f2a8c0cd1a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:06.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.224+0000 7f2a941ff700 1 -- 172.21.15.45:0/95382845 >> 172.21.15.45:0/95382845 conn(0x7f2a8c0cf5d0 msgr2=0x7f2a8c0cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:06.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.224+0000 7f2a941ff700 1 -- 172.21.15.45:0/95382845 shutdown_connections 2023-06-22T10:53:06.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.224+0000 7f2a941ff700 1 -- 172.21.15.45:0/95382845 wait complete. 2023-06-22T10:53:06.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.227+0000 7f2a941ff700 1 Processor -- start 2023-06-22T10:53:06.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.227+0000 7f2a941ff700 1 -- start start 2023-06-22T10:53:06.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.228+0000 7f2a941ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a8c0b45d0 0x7f2a8c15d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:06.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.228+0000 7f2a941ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a8c0cd6e0 0x7f2a8c14de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:06.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.228+0000 7f2a941ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f2a8c0d2130 0x7f2a8c15ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:06.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.228+0000 7f2a941ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8c0a9730 con 0x7f2a8c0cd6e0 2023-06-22T10:53:06.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.228+0000 7f2a941ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8c15c660 con 0x7f2a8c0b45d0 2023-06-22T10:53:06.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.228+0000 7f2a941ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8c15c900 con 0x7f2a8c0d2130 2023-06-22T10:53:06.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.229+0000 7f2a91f9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a8c0b45d0 0x7f2a8c15d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:06.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.229+0000 7f2a9279c700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f2a8c0d2130 0x7f2a8c15ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:06.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.229+0000 7f2a9179a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a8c0cd6e0 0x7f2a8c14de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:06.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.229+0000 7f2a9179a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a8c0cd6e0 0x7f2a8c14de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.45:35140/0 (socket says 172.21.15.45:35140) 2023-06-22T10:53:06.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.229+0000 7f2a9279c700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f2a8c0d2130 0x7f2a8c15ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3301/0 says I am v2:172.21.15.45:50364/0 (socket says 172.21.15.45:50364) 2023-06-22T10:53:06.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.229+0000 7f2a9179a700 1 -- 172.21.15.45:0/2182799820 learned_addr learned my addr 172.21.15.45:0/2182799820 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-06-22T10:53:06.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.229+0000 7f2a9179a700 1 -- 172.21.15.45:0/2182799820 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f2a8c0d2130 msgr2=0x7f2a8c15ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:06.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.229+0000 7f2a9179a700 1 --2- 172.21.15.45:0/2182799820 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f2a8c0d2130 0x7f2a8c15ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:06.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.229+0000 7f2a9179a700 1 -- 172.21.15.45:0/2182799820 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a8c0b45d0 msgr2=0x7f2a8c15d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:06.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.229+0000 7f2a9179a700 1 --2- 172.21.15.45:0/2182799820 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a8c0b45d0 0x7f2a8c15d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:06.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.229+0000 7f2a9179a700 1 -- 172.21.15.45:0/2182799820 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a7c0094a0 con 0x7f2a8c0cd6e0 2023-06-22T10:53:06.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.229+0000 7f2a91f9b700 1 --2- 172.21.15.45:0/2182799820 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a8c0b45d0 0x7f2a8c15d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-22T10:53:06.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.229+0000 7f2a9179a700 1 --2- 172.21.15.45:0/2182799820 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a8c0cd6e0 0x7f2a8c14de30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c000c00 tx=0x7f2a7c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:06.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.230+0000 7f2a827fc700 1 -- 172.21.15.45:0/2182799820 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c0045d0 con 0x7f2a8c0cd6e0 2023-06-22T10:53:06.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.230+0000 7f2a827fc700 1 -- 172.21.15.45:0/2182799820 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a7c01f070 con 0x7f2a8c0cd6e0 2023-06-22T10:53:06.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.230+0000 7f2a827fc700 1 -- 172.21.15.45:0/2182799820 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c0038c0 con 0x7f2a8c0cd6e0 2023-06-22T10:53:06.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.230+0000 7f2a941ff700 1 -- 172.21.15.45:0/2182799820 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a8c15cbe0 con 0x7f2a8c0cd6e0 2023-06-22T10:53:06.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.230+0000 7f2a941ff700 1 -- 172.21.15.45:0/2182799820 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a8c15d1a0 con 0x7f2a8c0cd6e0 2023-06-22T10:53:06.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.230+0000 7f2a827fc700 1 -- 172.21.15.45:0/2182799820 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2a7c003d20 con 0x7f2a8c0cd6e0 2023-06-22T10:53:06.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.230+0000 7f2a827fc700 1 -- 172.21.15.45:0/2182799820 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f2a7c021070 con 0x7f2a8c0cd6e0 2023-06-22T10:53:06.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.231+0000 7f2a941ff700 1 -- 172.21.15.45:0/2182799820 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a8c15dc00 con 0x7f2a8c0cd6e0 2023-06-22T10:53:06.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.234+0000 7f2a827fc700 1 -- 172.21.15.45:0/2182799820 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f2a7c02b020 con 0x7f2a8c0cd6e0 2023-06-22T10:53:06.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.321+0000 7f2a941ff700 1 -- 172.21.15.45:0/2182799820 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3bb1d9c8-8e42-4a6b-998d-04834f34be5b", "id": 4} v 0) v1 -- 0x7f2a8c067580 con 0x7f2a8c0cd6e0 2023-06-22T10:53:06.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.327+0000 7f2a827fc700 1 -- 172.21.15.45:0/2182799820 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3bb1d9c8-8e42-4a6b-998d-04834f34be5b", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2a7c015020 con 0x7f2a8c0cd6e0 2023-06-22T10:53:06.331 INFO:teuthology.orchestra.run.smithi045.stdout:4 2023-06-22T10:53:06.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.328+0000 7f2a941ff700 1 -- 172.21.15.45:0/2182799820 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a8c0cd6e0 msgr2=0x7f2a8c14de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:06.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.328+0000 7f2a941ff700 1 --2- 172.21.15.45:0/2182799820 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a8c0cd6e0 0x7f2a8c14de30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c000c00 tx=0x7f2a7c004750 comp rx=0 tx=0).stop 2023-06-22T10:53:06.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.328+0000 7f2a941ff700 1 -- 172.21.15.45:0/2182799820 shutdown_connections 2023-06-22T10:53:06.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.328+0000 7f2a941ff700 1 --2- 172.21.15.45:0/2182799820 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f2a8c0d2130 0x7f2a8c15ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:06.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.328+0000 7f2a941ff700 1 --2- 172.21.15.45:0/2182799820 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2a8c0b45d0 0x7f2a8c15d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:06.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.328+0000 7f2a941ff700 1 --2- 172.21.15.45:0/2182799820 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a8c0cd6e0 0x7f2a8c14de30 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:06.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.328+0000 7f2a941ff700 1 -- 172.21.15.45:0/2182799820 >> 172.21.15.45:0/2182799820 conn(0x7f2a8c0cf5d0 msgr2=0x7f2a8c0b3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:06.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.328+0000 7f2a941ff700 1 -- 172.21.15.45:0/2182799820 shutdown_connections 2023-06-22T10:53:06.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.328+0000 7f2a941ff700 1 -- 172.21.15.45:0/2182799820 wait complete. 2023-06-22T10:53:06.349 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph osd new f9854ee4-302c-41be-977b-bedda090a3d3 5 2023-06-22T10:53:06.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.581+0000 7f71411ff700 1 Processor -- start 2023-06-22T10:53:06.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.581+0000 7f71411ff700 1 -- start start 2023-06-22T10:53:06.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.582+0000 7f71411ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f713c0d1810 0x7f713c167760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:06.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.582+0000 7f71411ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f713c160430 con 0x7f713c0cfb00 2023-06-22T10:53:06.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.582+0000 7f71411ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f713c160680 con 0x7f713c0cfed0 2023-06-22T10:53:06.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.582+0000 7f71411ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f713c0cdf40 con 0x7f713c0d1810 2023-06-22T10:53:06.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.582+0000 7f713a59c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f713c0cfed0 0x7f713c0cd280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:40828/0 (socket says 172.21.15.45:40828) 2023-06-22T10:53:06.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.582+0000 7f713a59c700 1 -- 172.21.15.45:0/1569075488 learned_addr learned my addr 172.21.15.45:0/1569075488 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-06-22T10:53:06.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.582+0000 7f713b59e700 1 --2- 172.21.15.45:0/1569075488 >> v2:172.21.15.40:3300/0 conn(0x7f713c0d1810 0x7f713c167760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:06.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.583+0000 7f7139d9b700 1 -- 172.21.15.45:0/1569075488 <== mon.1 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4142462364 0 0) 0x7f713c160680 con 0x7f713c0cfed0 2023-06-22T10:53:06.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.583+0000 7f7139d9b700 1 -- 172.21.15.45:0/1569075488 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71240035b0 con 0x7f713c0cfed0 2023-06-22T10:53:06.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.583+0000 7f7139d9b700 1 -- 172.21.15.45:0/1569075488 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3612323409 0 0) 0x7f713c160430 con 0x7f713c0cfb00 2023-06-22T10:53:06.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.583+0000 7f7139d9b700 1 -- 172.21.15.45:0/1569075488 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f713c160680 con 0x7f713c0cfb00 2023-06-22T10:53:06.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.583+0000 7f713b59e700 1 -- 172.21.15.45:0/1569075488 >> v1:172.21.15.45:6789/0 conn(0x7f713c0cfed0 legacy=0x7f713c0cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:06.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.583+0000 7f713b59e700 1 -- 172.21.15.45:0/1569075488 >> v1:172.21.15.40:6789/0 conn(0x7f713c0cfb00 legacy=0x7f713c0b80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:06.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.583+0000 7f713b59e700 1 -- 172.21.15.45:0/1569075488 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f713c160960 con 0x7f713c0d1810 2023-06-22T10:53:06.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.583+0000 7f713b59e700 1 --2- 172.21.15.45:0/1569075488 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f713c0d1810 0x7f713c167760 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7134009d90 tx=0x7f713400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfba90e0841427f6 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:06.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.583+0000 7f7139d9b700 1 -- 172.21.15.45:0/1569075488 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713400e070 con 0x7f713c0d1810 2023-06-22T10:53:06.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.583+0000 7f7139d9b700 1 -- 172.21.15.45:0/1569075488 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f713400bb20 con 0x7f713c0d1810 2023-06-22T10:53:06.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.584+0000 7f7139d9b700 1 -- 172.21.15.45:0/1569075488 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7134012430 con 0x7f713c0d1810 2023-06-22T10:53:06.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.584+0000 7f71411ff700 1 -- 172.21.15.45:0/1569075488 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f713c0d1810 msgr2=0x7f713c167760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:06.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.584+0000 7f71411ff700 1 --2- 172.21.15.45:0/1569075488 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f713c0d1810 0x7f713c167760 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7134009d90 tx=0x7f713400b330 comp rx=0 tx=0).stop 2023-06-22T10:53:06.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.584+0000 7f71411ff700 1 -- 172.21.15.45:0/1569075488 shutdown_connections 2023-06-22T10:53:06.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.584+0000 7f71411ff700 1 --2- 172.21.15.45:0/1569075488 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f713c0d1810 0x7f713c167760 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:06.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.584+0000 7f71411ff700 1 -- 172.21.15.45:0/1569075488 >> 172.21.15.45:0/1569075488 conn(0x7f713c06b340 msgr2=0x7f713c06b740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:06.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.584+0000 7f71411ff700 1 -- 172.21.15.45:0/1569075488 shutdown_connections 2023-06-22T10:53:06.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.584+0000 7f71411ff700 1 -- 172.21.15.45:0/1569075488 wait complete. 2023-06-22T10:53:06.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.586+0000 7f71411ff700 1 Processor -- start 2023-06-22T10:53:06.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.586+0000 7f71411ff700 1 -- start start 2023-06-22T10:53:06.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.587+0000 7f71411ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f713c0cfb00 0x7f713c0b36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:06.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.587+0000 7f71411ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f713c0cfed0 0x7f713c158870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:06.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.587+0000 7f71411ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f713c157ef0 0x7f713c155de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:06.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.587+0000 7f71411ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f713c0b3f10 con 0x7f713c0cfed0 2023-06-22T10:53:06.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.587+0000 7f71411ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f713c0b41f0 con 0x7f713c157ef0 2023-06-22T10:53:06.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.587+0000 7f71411ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f713c0b44d0 con 0x7f713c0cfb00 2023-06-22T10:53:06.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.587+0000 7f713ad9d700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f713c0cfb00 0x7f713c0b36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:06.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.588+0000 7f713b59e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f713c157ef0 0x7f713c155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:06.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.588+0000 7f713ad9d700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f713c0cfb00 0x7f713c0b36e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3301/0 says I am v2:172.21.15.45:50378/0 (socket says 172.21.15.45:50378) 2023-06-22T10:53:06.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.588+0000 7f713ad9d700 1 -- 172.21.15.45:0/2844318825 learned_addr learned my addr 172.21.15.45:0/2844318825 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-06-22T10:53:06.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.588+0000 7f713a59c700 1 --2- 172.21.15.45:0/2844318825 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f713c0cfed0 0x7f713c158870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:06.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.588+0000 7f713b59e700 1 -- 172.21.15.45:0/2844318825 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f713c0cfb00 msgr2=0x7f713c0b36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:06.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.588+0000 7f713b59e700 1 --2- 172.21.15.45:0/2844318825 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f713c0cfb00 0x7f713c0b36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:06.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.588+0000 7f713b59e700 1 -- 172.21.15.45:0/2844318825 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f713c0cfed0 msgr2=0x7f713c158870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:06.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.588+0000 7f713b59e700 1 --2- 172.21.15.45:0/2844318825 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f713c0cfed0 0x7f713c158870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:06.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.588+0000 7f713b59e700 1 -- 172.21.15.45:0/2844318825 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7134009a70 con 0x7f713c157ef0 2023-06-22T10:53:06.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.588+0000 7f713ad9d700 1 --2- 172.21.15.45:0/2844318825 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f713c0cfb00 0x7f713c0b36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-22T10:53:06.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.588+0000 7f713b59e700 1 --2- 172.21.15.45:0/2844318825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f713c157ef0 0x7f713c155de0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7134016000 tx=0x7f7134004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:06.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.589+0000 7f71237fe700 1 -- 172.21.15.45:0/2844318825 <== mon.1 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7134012430 con 0x7f713c157ef0 2023-06-22T10:53:06.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.589+0000 7f71237fe700 1 -- 172.21.15.45:0/2844318825 <== mon.1 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7134020070 con 0x7f713c157ef0 2023-06-22T10:53:06.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.589+0000 7f71237fe700 1 -- 172.21.15.45:0/2844318825 <== mon.1 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713401ba70 con 0x7f713c157ef0 2023-06-22T10:53:06.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.589+0000 7f71411ff700 1 -- 172.21.15.45:0/2844318825 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f713c0b47b0 con 0x7f713c157ef0 2023-06-22T10:53:06.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.589+0000 7f71411ff700 1 -- 172.21.15.45:0/2844318825 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f713c0b3c20 con 0x7f713c157ef0 2023-06-22T10:53:06.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.589+0000 7f71237fe700 1 -- 172.21.15.45:0/2844318825 <== mon.1 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7134027480 con 0x7f713c157ef0 2023-06-22T10:53:06.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.589+0000 7f71237fe700 1 -- 172.21.15.45:0/2844318825 <== mon.1 v2:172.21.15.45:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f7134022070 con 0x7f713c157ef0 2023-06-22T10:53:06.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.590+0000 7f71411ff700 1 -- 172.21.15.45:0/2844318825 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f713c0b4cd0 con 0x7f713c157ef0 2023-06-22T10:53:06.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.592+0000 7f71237fe700 1 -- 172.21.15.45:0/2844318825 <== mon.1 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f713c0b4cd0 con 0x7f713c157ef0 2023-06-22T10:53:06.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.680+0000 7f71411ff700 1 -- 172.21.15.45:0/2844318825 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f9854ee4-302c-41be-977b-bedda090a3d3", "id": 5} v 0) v1 -- 0x7f713c066ac0 con 0x7f713c157ef0 2023-06-22T10:53:06.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.684+0000 7f71237fe700 1 -- 172.21.15.45:0/2844318825 <== mon.1 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f9854ee4-302c-41be-977b-bedda090a3d3", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f713402c060 con 0x7f713c157ef0 2023-06-22T10:53:06.688 INFO:teuthology.orchestra.run.smithi045.stdout:5 2023-06-22T10:53:06.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.685+0000 7f71411ff700 1 -- 172.21.15.45:0/2844318825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f713c157ef0 msgr2=0x7f713c155de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:06.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.685+0000 7f71411ff700 1 --2- 172.21.15.45:0/2844318825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f713c157ef0 0x7f713c155de0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7134016000 tx=0x7f7134004ad0 comp rx=0 tx=0).stop 2023-06-22T10:53:06.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.685+0000 7f71411ff700 1 -- 172.21.15.45:0/2844318825 shutdown_connections 2023-06-22T10:53:06.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.685+0000 7f71411ff700 1 --2- 172.21.15.45:0/2844318825 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f713c0cfb00 0x7f713c0b36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:06.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.685+0000 7f71411ff700 1 --2- 172.21.15.45:0/2844318825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f713c157ef0 0x7f713c155de0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:06.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.685+0000 7f71411ff700 1 --2- 172.21.15.45:0/2844318825 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f713c0cfed0 0x7f713c158870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:06.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.685+0000 7f71411ff700 1 -- 172.21.15.45:0/2844318825 >> 172.21.15.45:0/2844318825 conn(0x7f713c06b340 msgr2=0x7f713c0c6760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:06.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.685+0000 7f71411ff700 1 -- 172.21.15.45:0/2844318825 shutdown_connections 2023-06-22T10:53:06.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.686+0000 7f71411ff700 1 -- 172.21.15.45:0/2844318825 wait complete. 2023-06-22T10:53:06.707 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph osd new bbdb1989-f6ac-4954-9b85-b8b540d683c5 6 2023-06-22T10:53:06.788 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-06-22T10:53:06.785+0000 7f944485e200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-06-22T10:53:06.885 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-06-22T10:53:06.882+0000 7f944485e200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-06-22T10:53:06.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.901+0000 7f69307ff700 1 Processor -- start 2023-06-22T10:53:06.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.901+0000 7f69307ff700 1 -- start start 2023-06-22T10:53:06.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.903+0000 7f69307ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f69280d1810 0x7f6928167760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:06.907 INFO:tasks.ceph.mgr.x.smithi045.stderr:2023-06-22T10:53:06.903+0000 7f5e5ef67200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-06-22T10:53:06.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.903+0000 7f69307ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6928160430 con 0x7f69280cfed0 2023-06-22T10:53:06.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.903+0000 7f69307ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6928160680 con 0x7f69280cfb00 2023-06-22T10:53:06.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.903+0000 7f69307ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69280cdf40 con 0x7f69280d1810 2023-06-22T10:53:06.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.903+0000 7f692e59b700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f69280cfb00 0x7f69280b80d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:40830/0 (socket says 172.21.15.45:40830) 2023-06-22T10:53:06.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.903+0000 7f692ed9c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f69280d1810 0x7f6928167760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:06.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.903+0000 7f692e59b700 1 -- 172.21.15.45:0/3878006810 learned_addr learned my addr 172.21.15.45:0/3878006810 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-06-22T10:53:06.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.904+0000 7f692ed9c700 1 -- 172.21.15.45:0/3878006810 >> v1:172.21.15.45:6789/0 conn(0x7f69280cfb00 legacy=0x7f69280b80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:06.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.904+0000 7f692d599700 1 -- 172.21.15.45:0/3878006810 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 529137865 0 0) 0x7f6928160430 con 0x7f69280cfed0 2023-06-22T10:53:06.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.904+0000 7f692ed9c700 1 -- 172.21.15.45:0/3878006810 >> v1:172.21.15.40:6789/0 conn(0x7f69280cfed0 legacy=0x7f69280cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:06.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.904+0000 7f692ed9c700 1 -- 172.21.15.45:0/3878006810 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6928160960 con 0x7f69280d1810 2023-06-22T10:53:06.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.904+0000 7f692ed9c700 1 --2- 172.21.15.45:0/3878006810 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69280d1810 0x7f6928167760 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6920009d90 tx=0x7f692000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66b653ddfda089c6 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:06.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.904+0000 7f692d599700 1 -- 172.21.15.45:0/3878006810 <== mon.1 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f692000e070 con 0x7f69280d1810 2023-06-22T10:53:06.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.905+0000 7f692d599700 1 -- 172.21.15.45:0/3878006810 <== mon.1 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f692000bbd0 con 0x7f69280d1810 2023-06-22T10:53:06.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.905+0000 7f692d599700 1 -- 172.21.15.45:0/3878006810 <== mon.1 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6920012430 con 0x7f69280d1810 2023-06-22T10:53:06.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.905+0000 7f69307ff700 1 -- 172.21.15.45:0/3878006810 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69280d1810 msgr2=0x7f6928167760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:06.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.905+0000 7f69307ff700 1 --2- 172.21.15.45:0/3878006810 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69280d1810 0x7f6928167760 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6920009d90 tx=0x7f692000b330 comp rx=0 tx=0).stop 2023-06-22T10:53:06.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.905+0000 7f69307ff700 1 -- 172.21.15.45:0/3878006810 shutdown_connections 2023-06-22T10:53:06.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.905+0000 7f69307ff700 1 --2- 172.21.15.45:0/3878006810 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69280d1810 0x7f6928167760 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:06.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.905+0000 7f69307ff700 1 -- 172.21.15.45:0/3878006810 >> 172.21.15.45:0/3878006810 conn(0x7f692806b340 msgr2=0x7f692806b740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:06.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.905+0000 7f69307ff700 1 -- 172.21.15.45:0/3878006810 shutdown_connections 2023-06-22T10:53:06.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.905+0000 7f69307ff700 1 -- 172.21.15.45:0/3878006810 wait complete. 2023-06-22T10:53:06.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.908+0000 7f69307ff700 1 Processor -- start 2023-06-22T10:53:06.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.908+0000 7f69307ff700 1 -- start start 2023-06-22T10:53:06.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.909+0000 7f69307ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f69280cfb00 0x7f692815aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:06.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.909+0000 7f69307ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69280cfed0 0x7f692815f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:06.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.909+0000 7f69307ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f692815f970 0x7f69280d07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:06.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.909+0000 7f69307ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69280c9d00 con 0x7f69280cfed0 2023-06-22T10:53:06.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.909+0000 7f69307ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69280c9fe0 con 0x7f692815f970 2023-06-22T10:53:06.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.909+0000 7f69307ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69280ca2c0 con 0x7f69280cfb00 2023-06-22T10:53:06.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.910+0000 7f692e59b700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f69280cfb00 0x7f692815aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:06.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.910+0000 7f692dd9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69280cfed0 0x7f692815f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:06.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.910+0000 7f692ed9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f692815f970 0x7f69280d07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:06.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.910+0000 7f692e59b700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f69280cfb00 0x7f692815aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3301/0 says I am v2:172.21.15.45:50390/0 (socket says 172.21.15.45:50390) 2023-06-22T10:53:06.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.910+0000 7f692ed9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f692815f970 0x7f69280d07e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46984/0 (socket says 172.21.15.45:46984) 2023-06-22T10:53:06.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.910+0000 7f692dd9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69280cfed0 0x7f692815f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.45:35162/0 (socket says 172.21.15.45:35162) 2023-06-22T10:53:06.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.910+0000 7f692e59b700 1 -- 172.21.15.45:0/4228050436 learned_addr learned my addr 172.21.15.45:0/4228050436 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-06-22T10:53:06.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.910+0000 7f692e59b700 1 -- 172.21.15.45:0/4228050436 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f692815f970 msgr2=0x7f69280d07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:06.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.910+0000 7f692e59b700 1 --2- 172.21.15.45:0/4228050436 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f692815f970 0x7f69280d07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:06.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.910+0000 7f692e59b700 1 -- 172.21.15.45:0/4228050436 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69280cfed0 msgr2=0x7f692815f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:06.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.910+0000 7f692e59b700 1 --2- 172.21.15.45:0/4228050436 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69280cfed0 0x7f692815f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:06.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.910+0000 7f692e59b700 1 -- 172.21.15.45:0/4228050436 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6920009a70 con 0x7f69280cfb00 2023-06-22T10:53:06.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.910+0000 7f692dd9a700 1 --2- 172.21.15.45:0/4228050436 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69280cfed0 0x7f692815f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-22T10:53:06.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.910+0000 7f692e59b700 1 --2- 172.21.15.45:0/4228050436 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f69280cfb00 0x7f692815aab0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f692400c480 tx=0x7f692400c790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:06.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.911+0000 7f691effd700 1 -- 172.21.15.45:0/4228050436 <== mon.2 v2:172.21.15.45:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6924005d70 con 0x7f69280cfb00 2023-06-22T10:53:06.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.911+0000 7f691effd700 1 -- 172.21.15.45:0/4228050436 <== mon.2 v2:172.21.15.45:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f692400ce90 con 0x7f69280cfb00 2023-06-22T10:53:06.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.911+0000 7f69307ff700 1 -- 172.21.15.45:0/4228050436 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69280ca5a0 con 0x7f69280cfb00 2023-06-22T10:53:06.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.911+0000 7f691effd700 1 -- 172.21.15.45:0/4228050436 <== mon.2 v2:172.21.15.45:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69240072d0 con 0x7f69280cfb00 2023-06-22T10:53:06.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.911+0000 7f69307ff700 1 -- 172.21.15.45:0/4228050436 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f692815aff0 con 0x7f69280cfb00 2023-06-22T10:53:06.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.911+0000 7f691effd700 1 -- 172.21.15.45:0/4228050436 <== mon.2 v2:172.21.15.45:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6924012400 con 0x7f69280cfb00 2023-06-22T10:53:06.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.911+0000 7f691effd700 1 -- 172.21.15.45:0/4228050436 <== mon.2 v2:172.21.15.45:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f6924012ca0 con 0x7f69280cfb00 2023-06-22T10:53:06.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.912+0000 7f69307ff700 1 -- 172.21.15.45:0/4228050436 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69280caac0 con 0x7f69280cfb00 2023-06-22T10:53:06.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:06.915+0000 7f691effd700 1 -- 172.21.15.45:0/4228050436 <== mon.2 v2:172.21.15.45:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f6924021020 con 0x7f69280cfb00 2023-06-22T10:53:07.004 INFO:tasks.ceph.mgr.x.smithi045.stderr:2023-06-22T10:53:07.001+0000 7f5e5ef67200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-06-22T10:53:07.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.002+0000 7f69307ff700 1 -- 172.21.15.45:0/4228050436 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_command({"prefix": "osd new", "uuid": "bbdb1989-f6ac-4954-9b85-b8b540d683c5", "id": 6} v 0) v1 -- 0x7f6928066ac0 con 0x7f69280cfb00 2023-06-22T10:53:07.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.007+0000 7f691effd700 1 -- 172.21.15.45:0/4228050436 <== mon.2 v2:172.21.15.45:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bbdb1989-f6ac-4954-9b85-b8b540d683c5", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6924017070 con 0x7f69280cfb00 2023-06-22T10:53:07.010 INFO:teuthology.orchestra.run.smithi045.stdout:6 2023-06-22T10:53:07.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.008+0000 7f69307ff700 1 -- 172.21.15.45:0/4228050436 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f69280cfb00 msgr2=0x7f692815aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:07.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.008+0000 7f69307ff700 1 --2- 172.21.15.45:0/4228050436 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f69280cfb00 0x7f692815aab0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f692400c480 tx=0x7f692400c790 comp rx=0 tx=0).stop 2023-06-22T10:53:07.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.008+0000 7f69307ff700 1 -- 172.21.15.45:0/4228050436 shutdown_connections 2023-06-22T10:53:07.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.008+0000 7f69307ff700 1 --2- 172.21.15.45:0/4228050436 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f69280cfb00 0x7f692815aab0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:07.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.008+0000 7f69307ff700 1 --2- 172.21.15.45:0/4228050436 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f692815f970 0x7f69280d07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:07.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.008+0000 7f69307ff700 1 --2- 172.21.15.45:0/4228050436 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69280cfed0 0x7f692815f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:07.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.008+0000 7f69307ff700 1 -- 172.21.15.45:0/4228050436 >> 172.21.15.45:0/4228050436 conn(0x7f692806b340 msgr2=0x7f69280b7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:07.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.009+0000 7f69307ff700 1 -- 172.21.15.45:0/4228050436 shutdown_connections 2023-06-22T10:53:07.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.009+0000 7f69307ff700 1 -- 172.21.15.45:0/4228050436 wait complete. 2023-06-22T10:53:07.036 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph osd new 823d44e3-58f1-4d1d-8263-a4e4a69d4327 7 2023-06-22T10:53:07.060 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-06-22T10:53:07.057+0000 7f944485e200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-06-22T10:53:07.152 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-06-22T10:53:07.149+0000 7f944485e200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-06-22T10:53:07.191 INFO:tasks.ceph.mgr.x.smithi045.stderr:2023-06-22T10:53:07.187+0000 7f5e5ef67200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-06-22T10:53:07.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.228+0000 7f0bf41ff700 1 Processor -- start 2023-06-22T10:53:07.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.228+0000 7f0bf41ff700 1 -- start start 2023-06-22T10:53:07.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.229+0000 7f0bf41ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f0bec0cd350 0x7f0bec1609b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:07.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.229+0000 7f0bf41ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0bec15d400 0x7f0bec0cd720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:07.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.229+0000 7f0bf41ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0bec15dcf0 0x7f0bec15e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:07.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.229+0000 7f0bf41ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bec160ef0 con 0x7f0bec15d400 2023-06-22T10:53:07.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.229+0000 7f0bf41ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bec15c7e0 con 0x7f0bec15dcf0 2023-06-22T10:53:07.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.229+0000 7f0bf41ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bec15fef0 con 0x7f0bec0cd350 2023-06-22T10:53:07.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.229+0000 7f0bf279c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0bec15dcf0 0x7f0bec15e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:07.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.229+0000 7f0bf1f9b700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f0bec0cd350 0x7f0bec1609b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:07.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.229+0000 7f0bf1f9b700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f0bec0cd350 0x7f0bec1609b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3301/0 says I am v2:172.21.15.45:50400/0 (socket says 172.21.15.45:50400) 2023-06-22T10:53:07.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.229+0000 7f0bf1f9b700 1 -- 172.21.15.45:0/3486310743 learned_addr learned my addr 172.21.15.45:0/3486310743 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-06-22T10:53:07.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.229+0000 7f0bf179a700 1 --2- 172.21.15.45:0/3486310743 >> v2:172.21.15.40:3300/0 conn(0x7f0bec15d400 0x7f0bec0cd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:07.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.230+0000 7f0bf279c700 1 -- 172.21.15.45:0/3486310743 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f0bec0cd350 msgr2=0x7f0bec1609b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:07.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.230+0000 7f0bf279c700 1 --2- 172.21.15.45:0/3486310743 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f0bec0cd350 0x7f0bec1609b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:07.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.230+0000 7f0bf279c700 1 -- 172.21.15.45:0/3486310743 >> v2:172.21.15.40:3300/0 conn(0x7f0bec15d400 msgr2=0x7f0bec0cd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:07.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.230+0000 7f0bf279c700 1 --2- 172.21.15.45:0/3486310743 >> v2:172.21.15.40:3300/0 conn(0x7f0bec15d400 0x7f0bec0cd720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:07.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.230+0000 7f0bf279c700 1 -- 172.21.15.45:0/3486310743 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bec0ce8b0 con 0x7f0bec15dcf0 2023-06-22T10:53:07.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.230+0000 7f0bf179a700 1 --2- 172.21.15.45:0/3486310743 >> v2:172.21.15.40:3300/0 conn(0x7f0bec15d400 0x7f0bec0cd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-22T10:53:07.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.230+0000 7f0bf279c700 1 --2- 172.21.15.45:0/3486310743 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bec15dcf0 0x7f0bec15e170 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0bec072140 tx=0x7f0be400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7fe1b3bb7638b21e server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:07.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.230+0000 7f0bf0f99700 1 -- 172.21.15.45:0/3486310743 <== mon.1 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be400e070 con 0x7f0bec15dcf0 2023-06-22T10:53:07.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.230+0000 7f0bf0f99700 1 -- 172.21.15.45:0/3486310743 <== mon.1 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be400bb20 con 0x7f0bec15dcf0 2023-06-22T10:53:07.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.230+0000 7f0bf0f99700 1 -- 172.21.15.45:0/3486310743 <== mon.1 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be4012430 con 0x7f0bec15dcf0 2023-06-22T10:53:07.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.231+0000 7f0bf41ff700 1 -- 172.21.15.45:0/3486310743 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bec15dcf0 msgr2=0x7f0bec15e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:07.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.231+0000 7f0bf41ff700 1 --2- 172.21.15.45:0/3486310743 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bec15dcf0 0x7f0bec15e170 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0bec072140 tx=0x7f0be400b330 comp rx=0 tx=0).stop 2023-06-22T10:53:07.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.231+0000 7f0bf41ff700 1 -- 172.21.15.45:0/3486310743 shutdown_connections 2023-06-22T10:53:07.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.231+0000 7f0bf41ff700 1 --2- 172.21.15.45:0/3486310743 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bec15dcf0 0x7f0bec15e170 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:07.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.231+0000 7f0bf41ff700 1 --2- 172.21.15.45:0/3486310743 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f0bec0cd350 0x7f0bec1609b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:07.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.231+0000 7f0bf41ff700 1 --2- 172.21.15.45:0/3486310743 >> v2:172.21.15.40:3300/0 conn(0x7f0bec15d400 0x7f0bec0cd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:07.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.231+0000 7f0bf41ff700 1 -- 172.21.15.45:0/3486310743 >> 172.21.15.45:0/3486310743 conn(0x7f0bec069f30 msgr2=0x7f0bec06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:07.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.231+0000 7f0bf41ff700 1 -- 172.21.15.45:0/3486310743 shutdown_connections 2023-06-22T10:53:07.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.231+0000 7f0bf41ff700 1 -- 172.21.15.45:0/3486310743 wait complete. 2023-06-22T10:53:07.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.233+0000 7f0bf41ff700 1 Processor -- start 2023-06-22T10:53:07.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.233+0000 7f0bf41ff700 1 -- start start 2023-06-22T10:53:07.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.234+0000 7f0bf41ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bec0cd350 0x7f0bec15ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:07.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.234+0000 7f0bf41ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0bec15d400 0x7f0bec0c79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:07.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.234+0000 7f0bf41ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f0bec15dcf0 0x7f0bec0c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:07.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.234+0000 7f0bf41ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bec0c8450 con 0x7f0bec15d400 2023-06-22T10:53:07.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.234+0000 7f0bf41ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bec0c9710 con 0x7f0bec0cd350 2023-06-22T10:53:07.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.234+0000 7f0bf41ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bec0c8670 con 0x7f0bec15dcf0 2023-06-22T10:53:07.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.234+0000 7f0bf1f9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bec0cd350 0x7f0bec15ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:07.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.234+0000 7f0bf1f9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bec0cd350 0x7f0bec15ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47000/0 (socket says 172.21.15.45:47000) 2023-06-22T10:53:07.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.234+0000 7f0bf1f9b700 1 -- 172.21.15.45:0/2510959899 learned_addr learned my addr 172.21.15.45:0/2510959899 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-06-22T10:53:07.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.235+0000 7f0bf179a700 1 --2- 172.21.15.45:0/2510959899 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0bec15d400 0x7f0bec0c79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:07.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.235+0000 7f0bf279c700 1 --2- 172.21.15.45:0/2510959899 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f0bec15dcf0 0x7f0bec0c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:07.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.235+0000 7f0bf1f9b700 1 -- 172.21.15.45:0/2510959899 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f0bec15dcf0 msgr2=0x7f0bec0c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:07.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.235+0000 7f0bf1f9b700 1 --2- 172.21.15.45:0/2510959899 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f0bec15dcf0 0x7f0bec0c7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:07.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.235+0000 7f0bf1f9b700 1 -- 172.21.15.45:0/2510959899 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0bec15d400 msgr2=0x7f0bec0c79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:07.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.235+0000 7f0bf1f9b700 1 --2- 172.21.15.45:0/2510959899 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0bec15d400 0x7f0bec0c79d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:07.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.235+0000 7f0bf1f9b700 1 -- 172.21.15.45:0/2510959899 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bdc0094a0 con 0x7f0bec0cd350 2023-06-22T10:53:07.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.235+0000 7f0bf1f9b700 1 --2- 172.21.15.45:0/2510959899 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bec0cd350 0x7f0bec15ebf0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0be800e990 tx=0x7f0be800eca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:07.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.235+0000 7f0be27fc700 1 -- 172.21.15.45:0/2510959899 <== mon.1 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be8013680 con 0x7f0bec0cd350 2023-06-22T10:53:07.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.235+0000 7f0be27fc700 1 -- 172.21.15.45:0/2510959899 <== mon.1 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be80137e0 con 0x7f0bec0cd350 2023-06-22T10:53:07.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.235+0000 7f0bf41ff700 1 -- 172.21.15.45:0/2510959899 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0be4009a70 con 0x7f0bec0cd350 2023-06-22T10:53:07.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.235+0000 7f0be27fc700 1 -- 172.21.15.45:0/2510959899 <== mon.1 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be8013b50 con 0x7f0bec0cd350 2023-06-22T10:53:07.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.236+0000 7f0bf41ff700 1 -- 172.21.15.45:0/2510959899 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bec0c8f10 con 0x7f0bec0cd350 2023-06-22T10:53:07.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.236+0000 7f0be27fc700 1 -- 172.21.15.45:0/2510959899 <== mon.1 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0be801c450 con 0x7f0bec0cd350 2023-06-22T10:53:07.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.236+0000 7f0be27fc700 1 -- 172.21.15.45:0/2510959899 <== mon.1 v2:172.21.15.45:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f0be801cd60 con 0x7f0bec0cd350 2023-06-22T10:53:07.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.237+0000 7f0bf41ff700 1 -- 172.21.15.45:0/2510959899 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bec15d870 con 0x7f0bec0cd350 2023-06-22T10:53:07.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.239+0000 7f0be27fc700 1 -- 172.21.15.45:0/2510959899 <== mon.1 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f0be8021060 con 0x7f0bec0cd350 2023-06-22T10:53:07.288 INFO:tasks.ceph.mgr.x.smithi045.stderr:2023-06-22T10:53:07.284+0000 7f5e5ef67200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-06-22T10:53:07.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.328+0000 7f0bf41ff700 1 -- 172.21.15.45:0/2510959899 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd new", "uuid": "823d44e3-58f1-4d1d-8263-a4e4a69d4327", "id": 7} v 0) v1 -- 0x7f0bec067580 con 0x7f0bec0cd350 2023-06-22T10:53:07.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.332+0000 7f0be27fc700 1 -- 172.21.15.45:0/2510959899 <== mon.1 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "823d44e3-58f1-4d1d-8263-a4e4a69d4327", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0be8017070 con 0x7f0bec0cd350 2023-06-22T10:53:07.336 INFO:teuthology.orchestra.run.smithi045.stdout:7 2023-06-22T10:53:07.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.333+0000 7f0bf41ff700 1 -- 172.21.15.45:0/2510959899 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bec0cd350 msgr2=0x7f0bec15ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:07.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.333+0000 7f0bf41ff700 1 --2- 172.21.15.45:0/2510959899 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bec0cd350 0x7f0bec15ebf0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0be800e990 tx=0x7f0be800eca0 comp rx=0 tx=0).stop 2023-06-22T10:53:07.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.333+0000 7f0bf41ff700 1 -- 172.21.15.45:0/2510959899 shutdown_connections 2023-06-22T10:53:07.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.333+0000 7f0bf41ff700 1 --2- 172.21.15.45:0/2510959899 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f0bec15dcf0 0x7f0bec0c7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:07.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.333+0000 7f0bf41ff700 1 --2- 172.21.15.45:0/2510959899 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bec0cd350 0x7f0bec15ebf0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:07.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.333+0000 7f0bf41ff700 1 --2- 172.21.15.45:0/2510959899 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0bec15d400 0x7f0bec0c79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:07.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.333+0000 7f0bf41ff700 1 -- 172.21.15.45:0/2510959899 >> 172.21.15.45:0/2510959899 conn(0x7f0bec069f30 msgr2=0x7f0bec158b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:07.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.334+0000 7f0bf41ff700 1 -- 172.21.15.45:0/2510959899 shutdown_connections 2023-06-22T10:53:07.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-22T10:53:07.334+0000 7f0bf41ff700 1 -- 172.21.15.45:0/2510959899 wait complete. 2023-06-22T10:53:07.354 INFO:tasks.ceph.osd.0:Restarting daemon 2023-06-22T10:53:07.354 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-06-22T10:53:07.358 INFO:tasks.ceph.osd.0:Started 2023-06-22T10:53:07.359 INFO:tasks.ceph.osd.1:Restarting daemon 2023-06-22T10:53:07.359 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-06-22T10:53:07.363 INFO:tasks.ceph.osd.1:Started 2023-06-22T10:53:07.364 INFO:tasks.ceph.osd.2:Restarting daemon 2023-06-22T10:53:07.364 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-06-22T10:53:07.369 INFO:tasks.ceph.osd.2:Started 2023-06-22T10:53:07.369 INFO:tasks.ceph.osd.3:Restarting daemon 2023-06-22T10:53:07.369 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-06-22T10:53:07.374 INFO:tasks.ceph.osd.3:Started 2023-06-22T10:53:07.374 INFO:tasks.ceph.osd.4:Restarting daemon 2023-06-22T10:53:07.374 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-06-22T10:53:07.378 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-06-22T10:53:07.375+0000 7f944485e200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-06-22T10:53:07.379 INFO:tasks.ceph.osd.4:Started 2023-06-22T10:53:07.379 INFO:tasks.ceph.osd.5:Restarting daemon 2023-06-22T10:53:07.380 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-06-22T10:53:07.384 INFO:tasks.ceph.osd.5:Started 2023-06-22T10:53:07.384 INFO:tasks.ceph.osd.6:Restarting daemon 2023-06-22T10:53:07.384 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-06-22T10:53:07.389 INFO:tasks.ceph.osd.6:Started 2023-06-22T10:53:07.389 INFO:tasks.ceph.osd.7:Restarting daemon 2023-06-22T10:53:07.389 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-06-22T10:53:07.394 INFO:tasks.ceph.osd.7:Started 2023-06-22T10:53:07.395 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-22T10:53:07.517 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-06-22T10:53:07.514+0000 7f944485e200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-06-22T10:53:07.530 INFO:tasks.ceph.mgr.x.smithi045.stderr:2023-06-22T10:53:07.527+0000 7f5e5ef67200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-06-22T10:53:07.647 INFO:tasks.ceph.mgr.x.smithi045.stderr:2023-06-22T10:53:07.644+0000 7f5e5ef67200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-06-22T10:53:07.660 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-06-22T10:53:07.657+0000 7f944485e200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-06-22T10:53:07.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.671+0000 7fcc587ff700 1 Processor -- start 2023-06-22T10:53:07.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.671+0000 7fcc587ff700 1 -- start start 2023-06-22T10:53:07.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.672+0000 7fcc587ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fcc500b44c0 0x7fcc500ac3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:07.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.672+0000 7fcc587ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcc5006dd80 0x7fcc50070c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:07.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.672+0000 7fcc587ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc500707a0 con 0x7fcc500b0540 2023-06-22T10:53:07.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.672+0000 7fcc587ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc500ad010 con 0x7fcc5006dd80 2023-06-22T10:53:07.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.672+0000 7fcc587ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc500aca50 con 0x7fcc500b44c0 2023-06-22T10:53:07.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.673+0000 7fcc55d9a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcc5006dd80 0x7fcc50070c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:07.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.673+0000 7fcc5659b700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fcc500b44c0 0x7fcc500ac3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:07.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.673+0000 7fcc55d9a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcc5006dd80 0x7fcc50070c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51636/0 (socket says 172.21.15.40:51636) 2023-06-22T10:53:07.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.673+0000 7fcc55d9a700 1 -- 172.21.15.40:0/1278162900 learned_addr learned my addr 172.21.15.40:0/1278162900 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:07.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.673+0000 7fcc55d9a700 1 -- 172.21.15.40:0/1278162900 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fcc500b44c0 msgr2=0x7fcc500ac3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:07.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.673+0000 7fcc55d9a700 1 --2- 172.21.15.40:0/1278162900 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fcc500b44c0 0x7fcc500ac3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:07.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.673+0000 7fcc55d9a700 1 -- 172.21.15.40:0/1278162900 >> v1:172.21.15.45:6789/0 conn(0x7fcc500b0540 legacy=0x7fcc5015ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:07.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.673+0000 7fcc55d9a700 1 -- 172.21.15.40:0/1278162900 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc500acd30 con 0x7fcc5006dd80 2023-06-22T10:53:07.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.673+0000 7fcc55d9a700 1 --2- 172.21.15.40:0/1278162900 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc5006dd80 0x7fcc50070c30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fcc400098e0 tx=0x7fcc40009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7da52e3558668517 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:07.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.674+0000 7fcc55599700 1 -- 172.21.15.40:0/1278162900 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc40011830 con 0x7fcc5006dd80 2023-06-22T10:53:07.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.674+0000 7fcc55599700 1 -- 172.21.15.40:0/1278162900 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc40011990 con 0x7fcc5006dd80 2023-06-22T10:53:07.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.674+0000 7fcc55599700 1 -- 172.21.15.40:0/1278162900 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc40011d40 con 0x7fcc5006dd80 2023-06-22T10:53:07.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.674+0000 7fcc587ff700 1 -- 172.21.15.40:0/1278162900 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc5006dd80 msgr2=0x7fcc50070c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:07.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.674+0000 7fcc587ff700 1 --2- 172.21.15.40:0/1278162900 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc5006dd80 0x7fcc50070c30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fcc400098e0 tx=0x7fcc40009bf0 comp rx=0 tx=0).stop 2023-06-22T10:53:07.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.674+0000 7fcc587ff700 1 -- 172.21.15.40:0/1278162900 shutdown_connections 2023-06-22T10:53:07.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.674+0000 7fcc587ff700 1 --2- 172.21.15.40:0/1278162900 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fcc500b44c0 0x7fcc500ac3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:07.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.674+0000 7fcc587ff700 1 --2- 172.21.15.40:0/1278162900 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc5006dd80 0x7fcc50070c30 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:07.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.674+0000 7fcc587ff700 1 -- 172.21.15.40:0/1278162900 >> 172.21.15.40:0/1278162900 conn(0x7fcc50069f30 msgr2=0x7fcc5006a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:07.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.674+0000 7fcc587ff700 1 -- 172.21.15.40:0/1278162900 shutdown_connections 2023-06-22T10:53:07.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.675+0000 7fcc587ff700 1 -- 172.21.15.40:0/1278162900 wait complete. 2023-06-22T10:53:07.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.676+0000 7fcc587ff700 1 Processor -- start 2023-06-22T10:53:07.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.676+0000 7fcc587ff700 1 -- start start 2023-06-22T10:53:07.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.677+0000 7fcc587ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc5006dd80 0x7fcc50141fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:07.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.677+0000 7fcc587ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc500b0540 0x7fcc501505e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:07.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.677+0000 7fcc587ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fcc500b44c0 0x7fcc501525e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:07.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.677+0000 7fcc587ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc501f23d0 con 0x7fcc500b0540 2023-06-22T10:53:07.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.677+0000 7fcc587ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc50153f00 con 0x7fcc5006dd80 2023-06-22T10:53:07.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.677+0000 7fcc587ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc501535f0 con 0x7fcc500b44c0 2023-06-22T10:53:07.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.678+0000 7fcc55d9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc500b0540 0x7fcc501505e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:07.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.678+0000 7fcc5659b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc5006dd80 0x7fcc50141fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:07.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.678+0000 7fcc5659b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc5006dd80 0x7fcc50141fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.40:45578/0 (socket says 172.21.15.40:45578) 2023-06-22T10:53:07.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.678+0000 7fcc55d9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc500b0540 0x7fcc501505e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51646/0 (socket says 172.21.15.40:51646) 2023-06-22T10:53:07.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.678+0000 7fcc5659b700 1 -- 172.21.15.40:0/775300420 learned_addr learned my addr 172.21.15.40:0/775300420 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:07.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.678+0000 7fcc56d9c700 1 --2- 172.21.15.40:0/775300420 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fcc500b44c0 0x7fcc501525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:07.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.678+0000 7fcc55d9a700 1 -- 172.21.15.40:0/775300420 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fcc500b44c0 msgr2=0x7fcc501525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:07.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.678+0000 7fcc55d9a700 1 --2- 172.21.15.40:0/775300420 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fcc500b44c0 0x7fcc501525e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:07.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.678+0000 7fcc55d9a700 1 -- 172.21.15.40:0/775300420 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc5006dd80 msgr2=0x7fcc50141fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:07.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.678+0000 7fcc55d9a700 1 --2- 172.21.15.40:0/775300420 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc5006dd80 0x7fcc50141fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:07.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.678+0000 7fcc55d9a700 1 -- 172.21.15.40:0/775300420 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc400094f0 con 0x7fcc500b0540 2023-06-22T10:53:07.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.678+0000 7fcc5659b700 1 --2- 172.21.15.40:0/775300420 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc5006dd80 0x7fcc50141fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-22T10:53:07.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.678+0000 7fcc55d9a700 1 --2- 172.21.15.40:0/775300420 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc500b0540 0x7fcc501505e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcc5006e6b0 tx=0x7fcc40004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:07.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.679+0000 7fcc46ffd700 1 -- 172.21.15.40:0/775300420 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4001a830 con 0x7fcc500b0540 2023-06-22T10:53:07.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.679+0000 7fcc46ffd700 1 -- 172.21.15.40:0/775300420 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc4001e070 con 0x7fcc500b0540 2023-06-22T10:53:07.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.679+0000 7fcc587ff700 1 -- 172.21.15.40:0/775300420 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc50150fc0 con 0x7fcc500b0540 2023-06-22T10:53:07.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.679+0000 7fcc46ffd700 1 -- 172.21.15.40:0/775300420 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4001ac10 con 0x7fcc500b0540 2023-06-22T10:53:07.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.679+0000 7fcc587ff700 1 -- 172.21.15.40:0/775300420 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc50153b90 con 0x7fcc500b0540 2023-06-22T10:53:07.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.679+0000 7fcc46ffd700 1 -- 172.21.15.40:0/775300420 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fcc4002d750 con 0x7fcc500b0540 2023-06-22T10:53:07.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.679+0000 7fcc46ffd700 1 -- 172.21.15.40:0/775300420 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fcc40024ad0 con 0x7fcc500b0540 2023-06-22T10:53:07.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.680+0000 7fcc587ff700 1 -- 172.21.15.40:0/775300420 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc50067580 con 0x7fcc500b0540 2023-06-22T10:53:07.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.682+0000 7fcc46ffd700 1 -- 172.21.15.40:0/775300420 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fcc40020070 con 0x7fcc500b0540 2023-06-22T10:53:07.748 INFO:tasks.ceph.mgr.x.smithi045.stderr:2023-06-22T10:53:07.745+0000 7f5e5ef67200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-06-22T10:53:07.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.756+0000 7fcc587ff700 1 -- 172.21.15.40:0/775300420 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcc50154040 con 0x7fcc500b0540 2023-06-22T10:53:07.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.757+0000 7fcc46ffd700 1 -- 172.21.15.40:0/775300420 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fcc40015020 con 0x7fcc500b0540 2023-06-22T10:53:07.760 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:53:07.761 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":10,"fsid":"475560bc-1a7c-4a75-b3b6-6fc6b20bdc52","created":"2023-06-22T10:53:03.784568+0000","modified":"2023-06-22T10:53:07.329974+0000","last_up_change":"0.000000","last_in_change":"2023-06-22T10:53:07.329974+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"918db6b4-053a-46ba-976d-6e1a0104017f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"0c146e2b-1725-4dae-9b5c-38795943b9d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0b3727fd-f281-46d5-a675-86c8c5ab269e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"2969c698-7039-4bbb-beda-f756f7a368a1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"3bb1d9c8-8e42-4a6b-998d-04834f34be5b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f9854ee4-302c-41be-977b-bedda090a3d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"bbdb1989-f6ac-4954-9b85-b8b540d683c5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"823d44e3-58f1-4d1d-8263-a4e4a69d4327","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-22T10:53:07.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.758+0000 7fcc587ff700 1 -- 172.21.15.40:0/775300420 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc500b0540 msgr2=0x7fcc501505e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:07.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.758+0000 7fcc587ff700 1 --2- 172.21.15.40:0/775300420 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc500b0540 0x7fcc501505e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcc5006e6b0 tx=0x7fcc40004750 comp rx=0 tx=0).stop 2023-06-22T10:53:07.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.758+0000 7fcc587ff700 1 -- 172.21.15.40:0/775300420 shutdown_connections 2023-06-22T10:53:07.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.758+0000 7fcc587ff700 1 --2- 172.21.15.40:0/775300420 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fcc500b44c0 0x7fcc501525e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:07.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.758+0000 7fcc587ff700 1 --2- 172.21.15.40:0/775300420 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc5006dd80 0x7fcc50141fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:07.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.758+0000 7fcc587ff700 1 --2- 172.21.15.40:0/775300420 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc500b0540 0x7fcc501505e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:07.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.758+0000 7fcc587ff700 1 -- 172.21.15.40:0/775300420 >> 172.21.15.40:0/775300420 conn(0x7fcc50069f30 msgr2=0x7fcc50070b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:07.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.758+0000 7fcc587ff700 1 -- 172.21.15.40:0/775300420 shutdown_connections 2023-06-22T10:53:07.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:07.758+0000 7fcc587ff700 1 -- 172.21.15.40:0/775300420 wait complete. 2023-06-22T10:53:07.780 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-06-22T10:53:07.781 INFO:tasks.ceph:Waiting for OSDs to come up 2023-06-22T10:53:07.784 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-06-22T10:53:07.781+0000 7f944485e200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-06-22T10:53:07.863 INFO:tasks.ceph.mgr.x.smithi045.stderr:2023-06-22T10:53:07.860+0000 7f5e5ef67200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-06-22T10:53:08.019 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-06-22T10:53:08.016+0000 7f944485e200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-06-22T10:53:08.082 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T10:53:08.079+0000 7f811231f640 -1 Falling back to public interface 2023-06-22T10:53:08.091 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T10:53:08.088+0000 7f79b4561640 -1 Falling back to public interface 2023-06-22T10:53:08.092 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-06-22T10:53:08.089+0000 7f7e411e7640 -1 Falling back to public interface 2023-06-22T10:53:08.097 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-06-22T10:53:08.094+0000 7fe9c4b21640 -1 Falling back to public interface 2023-06-22T10:53:08.098 INFO:tasks.ceph.mgr.x.smithi045.stderr:2023-06-22T10:53:08.095+0000 7f5e5ef67200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-06-22T10:53:08.111 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T10:53:08.108+0000 7fc30e595640 -1 Falling back to public interface 2023-06-22T10:53:08.120 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-06-22T10:53:08.117+0000 7f3abb049640 -1 Falling back to public interface 2023-06-22T10:53:08.123 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T10:53:08.120+0000 7f85c7e38640 -1 Falling back to public interface 2023-06-22T10:53:08.128 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-06-22T10:53:08.125+0000 7f944485e200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-06-22T10:53:08.136 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-06-22T10:53:08.133+0000 7f1c447a0640 -1 Falling back to public interface 2023-06-22T10:53:08.214 INFO:tasks.ceph.mgr.x.smithi045.stderr:2023-06-22T10:53:08.211+0000 7f5e5ef67200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-06-22T10:53:08.493 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-06-22T10:53:08.490+0000 7f944485e200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-06-22T10:53:08.577 INFO:tasks.ceph.mgr.x.smithi045.stderr:2023-06-22T10:53:08.574+0000 7f5e5ef67200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-06-22T10:53:08.587 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-06-22T10:53:08.589 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-06-22T10:53:08.584+0000 7f944485e200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-06-22T10:53:08.672 INFO:tasks.ceph.mgr.x.smithi045.stderr:2023-06-22T10:53:08.669+0000 7f5e5ef67200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-06-22T10:53:08.767 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.764+0000 7fc8f1dff700 1 Processor -- start 2023-06-22T10:53:08.767 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.764+0000 7fc8f1dff700 1 -- start start 2023-06-22T10:53:08.769 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.765+0000 7fc8f1dff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc8ec15c3b0 0x7fc8ec0b5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:08.769 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.765+0000 7fc8f1dff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc8ec0d2720 0x7fc8ec0cf2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:08.769 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.765+0000 7fc8f1dff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fc8ec0cf800 0x7fc8ec0cfc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:08.769 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.765+0000 7fc8f1dff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8ec0ceeb0 con 0x7fc8ec0d2720 2023-06-22T10:53:08.769 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.765+0000 7fc8f1dff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8ec06c560 con 0x7fc8ec15c3b0 2023-06-22T10:53:08.770 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.765+0000 7fc8f1dff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ec0d1870 con 0x7fc8ec0cf800 2023-06-22T10:53:08.770 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.765+0000 7fc8eaffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc8ec0d2720 0x7fc8ec0cf2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:08.770 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.765+0000 7fc8eb7fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc8ec15c3b0 0x7fc8ec0b5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:08.770 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.765+0000 7fc8ebfff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fc8ec0cf800 0x7fc8ec0cfc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:08.770 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.766+0000 7fc8eaffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc8ec0d2720 0x7fc8ec0cf2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43500/0 (socket says 172.21.15.40:43500) 2023-06-22T10:53:08.770 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.766+0000 7fc8eaffd700 1 -- 172.21.15.40:0/2120279416 learned_addr learned my addr 172.21.15.40:0/2120279416 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:08.772 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.766+0000 7fc8eb7fe700 1 -- 172.21.15.40:0/2120279416 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fc8ec0cf800 msgr2=0x7fc8ec0cfc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:08.772 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.766+0000 7fc8eb7fe700 1 --2- 172.21.15.40:0/2120279416 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fc8ec0cf800 0x7fc8ec0cfc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:08.772 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.766+0000 7fc8eb7fe700 1 -- 172.21.15.40:0/2120279416 >> v2:172.21.15.40:3300/0 conn(0x7fc8ec0d2720 msgr2=0x7fc8ec0cf2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:08.772 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.766+0000 7fc8eb7fe700 1 --2- 172.21.15.40:0/2120279416 >> v2:172.21.15.40:3300/0 conn(0x7fc8ec0d2720 0x7fc8ec0cf2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:08.772 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.766+0000 7fc8eb7fe700 1 -- 172.21.15.40:0/2120279416 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8ec0d1590 con 0x7fc8ec15c3b0 2023-06-22T10:53:08.772 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.766+0000 7fc8ebfff700 1 --2- 172.21.15.40:0/2120279416 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fc8ec0cf800 0x7fc8ec0cfc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-22T10:53:08.773 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.766+0000 7fc8eb7fe700 1 --2- 172.21.15.40:0/2120279416 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8ec15c3b0 0x7fc8ec0b5ab0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec072470 tx=0x7fc8dc009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebc56eafaeb99135 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:08.773 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.766+0000 7fc8ea7fc700 1 -- 172.21.15.40:0/2120279416 <== mon.1 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8dc011830 con 0x7fc8ec15c3b0 2023-06-22T10:53:08.773 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.767+0000 7fc8ea7fc700 1 -- 172.21.15.40:0/2120279416 <== mon.1 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8dc011990 con 0x7fc8ec15c3b0 2023-06-22T10:53:08.773 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.767+0000 7fc8ea7fc700 1 -- 172.21.15.40:0/2120279416 <== mon.1 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8dc011d20 con 0x7fc8ec15c3b0 2023-06-22T10:53:08.773 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.767+0000 7fc8f1dff700 1 -- 172.21.15.40:0/2120279416 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8ec15c3b0 msgr2=0x7fc8ec0b5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:08.773 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.767+0000 7fc8f1dff700 1 --2- 172.21.15.40:0/2120279416 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8ec15c3b0 0x7fc8ec0b5ab0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec072470 tx=0x7fc8dc009b20 comp rx=0 tx=0).stop 2023-06-22T10:53:08.773 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.767+0000 7fc8f1dff700 1 -- 172.21.15.40:0/2120279416 shutdown_connections 2023-06-22T10:53:08.774 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.767+0000 7fc8f1dff700 1 --2- 172.21.15.40:0/2120279416 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fc8ec0cf800 0x7fc8ec0cfc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:08.774 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.767+0000 7fc8f1dff700 1 --2- 172.21.15.40:0/2120279416 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8ec15c3b0 0x7fc8ec0b5ab0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:08.774 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.767+0000 7fc8f1dff700 1 --2- 172.21.15.40:0/2120279416 >> v2:172.21.15.40:3300/0 conn(0x7fc8ec0d2720 0x7fc8ec0cf2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:08.774 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.767+0000 7fc8f1dff700 1 -- 172.21.15.40:0/2120279416 >> 172.21.15.40:0/2120279416 conn(0x7fc8ec071660 msgr2=0x7fc8ec071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:08.774 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.767+0000 7fc8f1dff700 1 -- 172.21.15.40:0/2120279416 shutdown_connections 2023-06-22T10:53:08.774 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.767+0000 7fc8f1dff700 1 -- 172.21.15.40:0/2120279416 wait complete. 2023-06-22T10:53:08.776 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.769+0000 7fc8f1dff700 1 Processor -- start 2023-06-22T10:53:08.777 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.769+0000 7fc8f1dff700 1 -- start start 2023-06-22T10:53:08.777 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.770+0000 7fc8f1dff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fc8ec0cf800 0x7fc8ec0c8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:08.777 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.770+0000 7fc8f1dff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8ec0d2720 0x7fc8ec0caf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:08.777 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.770+0000 7fc8f1dff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8ec15c3b0 0x7fc8ec15ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:08.777 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.770+0000 7fc8f1dff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ec0cab00 con 0x7fc8ec0d2720 2023-06-22T10:53:08.777 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.770+0000 7fc8f1dff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ec0c9ef0 con 0x7fc8ec15c3b0 2023-06-22T10:53:08.778 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.770+0000 7fc8f1dff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ec0ca1d0 con 0x7fc8ec0cf800 2023-06-22T10:53:08.778 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.770+0000 7fc8eaffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8ec0d2720 0x7fc8ec0caf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:08.778 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.770+0000 7fc8eb7fe700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fc8ec0cf800 0x7fc8ec0c8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:08.778 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.770+0000 7fc8eb7fe700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fc8ec0cf800 0x7fc8ec0c8980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3301/0 says I am v2:172.21.15.40:34576/0 (socket says 172.21.15.40:34576) 2023-06-22T10:53:08.778 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.770+0000 7fc8eaffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8ec0d2720 0x7fc8ec0caf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43510/0 (socket says 172.21.15.40:43510) 2023-06-22T10:53:08.778 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.770+0000 7fc8eb7fe700 1 -- 172.21.15.40:0/2106551833 learned_addr learned my addr 172.21.15.40:0/2106551833 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:08.778 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.771+0000 7fc8ebfff700 1 --2- 172.21.15.40:0/2106551833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8ec15c3b0 0x7fc8ec15ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:08.779 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.771+0000 7fc8eb7fe700 1 -- 172.21.15.40:0/2106551833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8ec15c3b0 msgr2=0x7fc8ec15ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:08.779 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.771+0000 7fc8eb7fe700 1 --2- 172.21.15.40:0/2106551833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8ec15c3b0 0x7fc8ec15ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:08.779 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.771+0000 7fc8eb7fe700 1 -- 172.21.15.40:0/2106551833 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8ec0d2720 msgr2=0x7fc8ec0caf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:08.779 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.771+0000 7fc8eb7fe700 1 --2- 172.21.15.40:0/2106551833 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8ec0d2720 0x7fc8ec0caf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:08.779 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.771+0000 7fc8eb7fe700 1 -- 172.21.15.40:0/2106551833 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e4009a70 con 0x7fc8ec0cf800 2023-06-22T10:53:08.779 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.771+0000 7fc8eaffd700 1 --2- 172.21.15.40:0/2106551833 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8ec0d2720 0x7fc8ec0caf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-22T10:53:08.779 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.771+0000 7fc8eb7fe700 1 --2- 172.21.15.40:0/2106551833 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fc8ec0cf800 0x7fc8ec0c8980 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc009b60 tx=0x7fc8dc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:08.779 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.771+0000 7fc8d3fff700 1 -- 172.21.15.40:0/2106551833 <== mon.2 v2:172.21.15.45:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8dc004450 con 0x7fc8ec0cf800 2023-06-22T10:53:08.780 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.771+0000 7fc8d3fff700 1 -- 172.21.15.40:0/2106551833 <== mon.2 v2:172.21.15.45:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8dc01f070 con 0x7fc8ec0cf800 2023-06-22T10:53:08.780 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.771+0000 7fc8d3fff700 1 -- 172.21.15.40:0/2106551833 <== mon.2 v2:172.21.15.45:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8dc0038e0 con 0x7fc8ec0cf800 2023-06-22T10:53:08.780 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.771+0000 7fc8f1dff700 1 -- 172.21.15.40:0/2106551833 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8dc0094a0 con 0x7fc8ec0cf800 2023-06-22T10:53:08.780 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.772+0000 7fc8f1dff700 1 -- 172.21.15.40:0/2106551833 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8ec0ca790 con 0x7fc8ec0cf800 2023-06-22T10:53:08.780 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.772+0000 7fc8d3fff700 1 -- 172.21.15.40:0/2106551833 <== mon.2 v2:172.21.15.45:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc8dc003d40 con 0x7fc8ec0cf800 2023-06-22T10:53:08.780 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.772+0000 7fc8d3fff700 1 -- 172.21.15.40:0/2106551833 <== mon.2 v2:172.21.15.45:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fc8dc021070 con 0x7fc8ec0cf800 2023-06-22T10:53:08.781 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.773+0000 7fc8f1dff700 1 -- 172.21.15.40:0/2106551833 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8ec068330 con 0x7fc8ec0cf800 2023-06-22T10:53:08.781 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.775+0000 7fc8d3fff700 1 -- 172.21.15.40:0/2106551833 <== mon.2 v2:172.21.15.45:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fc8dc02b020 con 0x7fc8ec0cf800 2023-06-22T10:53:08.851 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.848+0000 7fc8f1dff700 1 -- 172.21.15.40:0/2106551833 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc8ec06be70 con 0x7fc8ec0cf800 2023-06-22T10:53:08.852 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.849+0000 7fc8d3fff700 1 -- 172.21.15.40:0/2106551833 <== mon.2 v2:172.21.15.45:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fc8dc015020 con 0x7fc8ec0cf800 2023-06-22T10:53:08.852 INFO:teuthology.misc.health.smithi040.stdout: 2023-06-22T10:53:08.853 INFO:teuthology.misc.health.smithi040.stdout:{"epoch":10,"fsid":"475560bc-1a7c-4a75-b3b6-6fc6b20bdc52","created":"2023-06-22T10:53:03.784568+0000","modified":"2023-06-22T10:53:07.329974+0000","last_up_change":"0.000000","last_in_change":"2023-06-22T10:53:07.329974+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"918db6b4-053a-46ba-976d-6e1a0104017f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"0c146e2b-1725-4dae-9b5c-38795943b9d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0b3727fd-f281-46d5-a675-86c8c5ab269e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"2969c698-7039-4bbb-beda-f756f7a368a1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"3bb1d9c8-8e42-4a6b-998d-04834f34be5b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f9854ee4-302c-41be-977b-bedda090a3d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"bbdb1989-f6ac-4954-9b85-b8b540d683c5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"823d44e3-58f1-4d1d-8263-a4e4a69d4327","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-22T10:53:08.853 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.850+0000 7fc8f1dff700 1 -- 172.21.15.40:0/2106551833 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fc8ec0cf800 msgr2=0x7fc8ec0c8980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:08.854 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.850+0000 7fc8f1dff700 1 --2- 172.21.15.40:0/2106551833 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fc8ec0cf800 0x7fc8ec0c8980 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc009b60 tx=0x7fc8dc004750 comp rx=0 tx=0).stop 2023-06-22T10:53:08.854 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.850+0000 7fc8f1dff700 1 -- 172.21.15.40:0/2106551833 shutdown_connections 2023-06-22T10:53:08.854 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.850+0000 7fc8f1dff700 1 --2- 172.21.15.40:0/2106551833 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fc8ec0cf800 0x7fc8ec0c8980 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:08.854 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.850+0000 7fc8f1dff700 1 --2- 172.21.15.40:0/2106551833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8ec15c3b0 0x7fc8ec15ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:08.855 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.850+0000 7fc8f1dff700 1 --2- 172.21.15.40:0/2106551833 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8ec0d2720 0x7fc8ec0caf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:08.855 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.850+0000 7fc8f1dff700 1 -- 172.21.15.40:0/2106551833 >> 172.21.15.40:0/2106551833 conn(0x7fc8ec071660 msgr2=0x7fc8ec0b5a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:08.855 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.850+0000 7fc8f1dff700 1 -- 172.21.15.40:0/2106551833 shutdown_connections 2023-06-22T10:53:08.855 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:08.850+0000 7fc8f1dff700 1 -- 172.21.15.40:0/2106551833 wait complete. 2023-06-22T10:53:08.869 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-06-22T10:53:09.247 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-06-22T10:53:09.244+0000 7f944485e200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-06-22T10:53:09.323 INFO:tasks.ceph.mgr.x.smithi045.stderr:2023-06-22T10:53:09.320+0000 7f5e5ef67200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-06-22T10:53:09.635 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-06-22T10:53:09.632+0000 7f944485e200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-06-22T10:53:09.711 INFO:tasks.ceph.mgr.x.smithi045.stderr:2023-06-22T10:53:09.708+0000 7f5e5ef67200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-06-22T10:53:09.825 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-06-22T10:53:09.821+0000 7f944485e200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-06-22T10:53:09.899 INFO:tasks.ceph.mgr.x.smithi045.stderr:2023-06-22T10:53:09.895+0000 7f5e5ef67200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-06-22T10:53:10.285 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-06-22T10:53:10.282+0000 7f944485e200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-06-22T10:53:10.358 INFO:tasks.ceph.mgr.x.smithi045.stderr:2023-06-22T10:53:10.355+0000 7f5e5ef67200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-06-22T10:53:10.477 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-06-22T10:53:10.474+0000 7f944485e200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-06-22T10:53:10.548 INFO:tasks.ceph.mgr.x.smithi045.stderr:2023-06-22T10:53:10.544+0000 7f5e5ef67200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-06-22T10:53:10.694 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-06-22T10:53:10.691+0000 7f944485e200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-06-22T10:53:10.766 INFO:tasks.ceph.mgr.x.smithi045.stderr:2023-06-22T10:53:10.762+0000 7f5e5ef67200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-06-22T10:53:11.110 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-06-22T10:53:11.106+0000 7f944485e200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-06-22T10:53:11.248 INFO:tasks.ceph.mgr.x.smithi045.stderr:2023-06-22T10:53:11.245+0000 7f5e5ef67200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-06-22T10:53:11.670 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T10:53:11.667+0000 7f79b4561640 -1 osd.6 0 log_to_monitors true 2023-06-22T10:53:11.687 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-06-22T10:53:11.683+0000 7fe9c4b21640 -1 osd.0 0 log_to_monitors true 2023-06-22T10:53:11.691 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T10:53:11.688+0000 7f811231f640 -1 osd.4 0 log_to_monitors true 2023-06-22T10:53:11.708 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-06-22T10:53:11.705+0000 7f1c447a0640 -1 osd.3 0 log_to_monitors true 2023-06-22T10:53:11.723 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T10:53:11.719+0000 7f85c7e38640 -1 osd.7 0 log_to_monitors true 2023-06-22T10:53:11.912 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-06-22T10:53:11.908+0000 7f7e411e7640 -1 osd.1 0 log_to_monitors true 2023-06-22T10:53:11.933 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-06-22T10:53:11.930+0000 7f3abb049640 -1 osd.2 0 log_to_monitors true 2023-06-22T10:53:11.943 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T10:53:11.939+0000 7fc30e595640 -1 osd.5 0 log_to_monitors true 2023-06-22T10:53:12.130 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-06-22T10:53:12.126+0000 7f93fe1fa700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-06-22T10:53:12.426 INFO:tasks.ceph.mgr.y.smithi040.stderr:2023-06-22T10:53:12.127+0000 7f93fe1fa700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-06-22T10:53:14.814 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-06-22T10:53:14.810+0000 7f7e2fff7700 -1 osd.1 0 waiting for initial osdmap 2023-06-22T10:53:14.835 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-06-22T10:53:14.832+0000 7f7e277fa700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-22T10:53:15.100 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T10:53:15.095+0000 7f81011f7700 -1 osd.4 0 waiting for initial osdmap 2023-06-22T10:53:15.128 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T10:53:15.124+0000 7f80f89fa700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-22T10:53:15.197 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T10:53:15.193+0000 7fc2fdbf8700 -1 osd.5 0 waiting for initial osdmap 2023-06-22T10:53:15.231 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T10:53:15.227+0000 7fc2f4bfa700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-22T10:53:15.551 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-06-22T10:53:15.547+0000 7f1c335f7700 -1 osd.3 0 waiting for initial osdmap 2023-06-22T10:53:15.595 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-06-22T10:53:15.592+0000 7f1c2adfa700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-22T10:53:15.676 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-06-22T10:53:15.767 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T10:53:15.764+0000 7f79a33f7700 -1 osd.6 0 waiting for initial osdmap 2023-06-22T10:53:15.855 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T10:53:15.852+0000 7f799abfa700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-22T10:53:15.900 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:15.897+0000 7f9e733ff700 1 Processor -- start 2023-06-22T10:53:15.900 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:15.897+0000 7f9e733ff700 1 -- start start 2023-06-22T10:53:15.901 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:15.898+0000 7f9e733ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9e6c0cf660 0x7f9e6c0b5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:15.902 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:15.898+0000 7f9e733ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9e6c0d33d0 0x7f9e6c0d11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:15.902 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:15.898+0000 7f9e733ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e6c0b5fe0 con 0x7f9e6c0b5010 2023-06-22T10:53:15.902 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:15.898+0000 7f9e733ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e6c0cd440 con 0x7f9e6c0d33d0 2023-06-22T10:53:15.903 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:15.898+0000 7f9e733ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e6c0cd6e0 con 0x7f9e6c0cf660 2023-06-22T10:53:15.903 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:15.898+0000 7f9e7119b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9e6c0cf660 0x7f9e6c0b5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:15.903 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:15.899+0000 7f9e7119b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9e6c0cf660 0x7f9e6c0b5aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.40:43808/0 (socket says 172.21.15.40:43808) 2023-06-22T10:53:15.903 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:15.899+0000 7f9e7119b700 1 -- 172.21.15.40:0/269808929 learned_addr learned my addr 172.21.15.40:0/269808929 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:15.903 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:15.899+0000 7f9e7199c700 1 --2- 172.21.15.40:0/269808929 >> v2:172.21.15.40:3300/0 conn(0x7f9e6c0d33d0 0x7f9e6c0d11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:15.903 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:15.899+0000 7f9e7119b700 1 -- 172.21.15.40:0/269808929 >> v2:172.21.15.40:3300/0 conn(0x7f9e6c0d33d0 msgr2=0x7f9e6c0d11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:15.903 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:15.899+0000 7f9e7119b700 1 --2- 172.21.15.40:0/269808929 >> v2:172.21.15.40:3300/0 conn(0x7f9e6c0d33d0 0x7f9e6c0d11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:15.903 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:15.899+0000 7f9e7119b700 1 -- 172.21.15.40:0/269808929 >> v1:172.21.15.40:6789/0 conn(0x7f9e6c0b5010 legacy=0x7f9e6c0cfa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:15.904 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:15.899+0000 7f9e7119b700 1 -- 172.21.15.40:0/269808929 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e6c0d09e0 con 0x7f9e6c0cf660 2023-06-22T10:53:15.904 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:15.899+0000 7f9e7119b700 1 --2- 172.21.15.40:0/269808929 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e6c0cf660 0x7f9e6c0b5aa0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c0d3cc0 tx=0x7f9e68009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67d0a5d2c72c5914 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:15.905 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:15.900+0000 7f9e63fff700 1 -- 172.21.15.40:0/269808929 <== mon.1 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e68011830 con 0x7f9e6c0cf660 2023-06-22T10:53:15.905 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:15.900+0000 7f9e63fff700 1 -- 172.21.15.40:0/269808929 <== mon.1 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e68011990 con 0x7f9e6c0cf660 2023-06-22T10:53:15.905 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:15.900+0000 7f9e63fff700 1 -- 172.21.15.40:0/269808929 <== mon.1 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e68011d20 con 0x7f9e6c0cf660 2023-06-22T10:53:15.905 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:15.900+0000 7f9e733ff700 1 -- 172.21.15.40:0/269808929 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e6c0cf660 msgr2=0x7f9e6c0b5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:15.905 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:15.900+0000 7f9e733ff700 1 --2- 172.21.15.40:0/269808929 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e6c0cf660 0x7f9e6c0b5aa0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c0d3cc0 tx=0x7f9e68009bd0 comp rx=0 tx=0).stop 2023-06-22T10:53:15.905 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:15.900+0000 7f9e733ff700 1 -- 172.21.15.40:0/269808929 shutdown_connections 2023-06-22T10:53:15.905 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:15.900+0000 7f9e733ff700 1 --2- 172.21.15.40:0/269808929 >> v2:172.21.15.40:3300/0 conn(0x7f9e6c0d33d0 0x7f9e6c0d11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:15.906 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:15.900+0000 7f9e733ff700 1 --2- 172.21.15.40:0/269808929 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e6c0cf660 0x7f9e6c0b5aa0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:15.906 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:15.900+0000 7f9e733ff700 1 -- 172.21.15.40:0/269808929 >> 172.21.15.40:0/269808929 conn(0x7f9e6c071660 msgr2=0x7f9e6c071a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:15.906 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:15.900+0000 7f9e733ff700 1 -- 172.21.15.40:0/269808929 shutdown_connections 2023-06-22T10:53:15.906 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:15.900+0000 7f9e733ff700 1 -- 172.21.15.40:0/269808929 wait complete. 2023-06-22T10:53:15.907 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:15.902+0000 7f9e733ff700 1 Processor -- start 2023-06-22T10:53:15.907 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:15.902+0000 7f9e733ff700 1 -- start start 2023-06-22T10:53:15.907 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:15.903+0000 7f9e733ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e6c0b5010 0x7f9e6c0b78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:15.907 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:15.903+0000 7f9e733ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9e6c0cf660 0x7f9e6c157230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:15.908 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:15.903+0000 7f9e733ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e6c0d33d0 0x7f9e6c0ca730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:15.908 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:15.903+0000 7f9e733ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6c157770 con 0x7f9e6c0b5010 2023-06-22T10:53:15.908 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:15.903+0000 7f9e733ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6c0cba20 con 0x7f9e6c0d33d0 2023-06-22T10:53:15.908 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:15.903+0000 7f9e733ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6c0cac70 con 0x7f9e6c0cf660 2023-06-22T10:53:15.908 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:15.904+0000 7f9e7119b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e6c0b5010 0x7f9e6c0b78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:15.908 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:15.904+0000 7f9e7099a700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9e6c0cf660 0x7f9e6c157230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:15.909 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:15.904+0000 7f9e7119b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e6c0b5010 0x7f9e6c0b78c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43644/0 (socket says 172.21.15.40:43644) 2023-06-22T10:53:15.909 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:15.904+0000 7f9e7119b700 1 -- 172.21.15.40:0/4235989936 learned_addr learned my addr 172.21.15.40:0/4235989936 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:15.909 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:15.904+0000 7f9e7199c700 1 --2- 172.21.15.40:0/4235989936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e6c0d33d0 0x7f9e6c0ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:15.910 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:15.904+0000 7f9e7099a700 1 -- 172.21.15.40:0/4235989936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e6c0d33d0 msgr2=0x7f9e6c0ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:15.910 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:15.904+0000 7f9e7099a700 1 --2- 172.21.15.40:0/4235989936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e6c0d33d0 0x7f9e6c0ca730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:15.911 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:15.904+0000 7f9e7099a700 1 -- 172.21.15.40:0/4235989936 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e6c0b5010 msgr2=0x7f9e6c0b78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:15.911 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:15.904+0000 7f9e7099a700 1 --2- 172.21.15.40:0/4235989936 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e6c0b5010 0x7f9e6c0b78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:15.911 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:15.904+0000 7f9e7099a700 1 -- 172.21.15.40:0/4235989936 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e68009550 con 0x7f9e6c0cf660 2023-06-22T10:53:15.911 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:15.904+0000 7f9e7119b700 1 --2- 172.21.15.40:0/4235989936 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e6c0b5010 0x7f9e6c0b78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-22T10:53:15.912 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:15.904+0000 7f9e7199c700 1 --2- 172.21.15.40:0/4235989936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e6c0d33d0 0x7f9e6c0ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-22T10:53:15.912 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:15.905+0000 7f9e7099a700 1 --2- 172.21.15.40:0/4235989936 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9e6c0cf660 0x7f9e6c157230 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c000f60 tx=0x7f9e5c00c6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:15.912 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:15.905+0000 7f9e61ffb700 1 -- 172.21.15.40:0/4235989936 <== mon.2 v2:172.21.15.45:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e5c0052d0 con 0x7f9e6c0cf660 2023-06-22T10:53:15.913 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:15.905+0000 7f9e61ffb700 1 -- 172.21.15.40:0/4235989936 <== mon.2 v2:172.21.15.45:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e5c005430 con 0x7f9e6c0cf660 2023-06-22T10:53:15.913 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:15.905+0000 7f9e61ffb700 1 -- 172.21.15.40:0/4235989936 <== mon.2 v2:172.21.15.45:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e5c0038c0 con 0x7f9e6c0cf660 2023-06-22T10:53:15.913 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:15.905+0000 7f9e733ff700 1 -- 172.21.15.40:0/4235989936 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e6c0caea0 con 0x7f9e6c0cf660 2023-06-22T10:53:15.913 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:15.905+0000 7f9e733ff700 1 -- 172.21.15.40:0/4235989936 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e6c0cb460 con 0x7f9e6c0cf660 2023-06-22T10:53:15.913 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:15.906+0000 7f9e733ff700 1 -- 172.21.15.40:0/4235989936 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e6c0d3160 con 0x7f9e6c0cf660 2023-06-22T10:53:15.914 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:15.908+0000 7f9e61ffb700 1 -- 172.21.15.40:0/4235989936 <== mon.2 v2:172.21.15.45:3301/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7f9e5c003c30 con 0x7f9e6c0cf660 2023-06-22T10:53:15.915 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:15.909+0000 7f9e61ffb700 1 --2- 172.21.15.40:0/4235989936 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f9e5006ac50 0x7f9e5006d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:15.915 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:15.909+0000 7f9e61ffb700 1 -- 172.21.15.40:0/4235989936 <== mon.2 v2:172.21.15.45:3301/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 3351+0+0 (secure 0 0 0) 0x7f9e5c087d70 con 0x7f9e6c0cf660 2023-06-22T10:53:15.915 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:15.909+0000 7f9e7119b700 1 --2- 172.21.15.40:0/4235989936 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f9e5006ac50 0x7f9e5006d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:15.915 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:15.910+0000 7f9e7119b700 1 --2- 172.21.15.40:0/4235989936 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f9e5006ac50 0x7f9e5006d100 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9e68009fd0 tx=0x7f9e68008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:15.918 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:15.914+0000 7f9e61ffb700 1 -- 172.21.15.40:0/4235989936 <== mon.2 v2:172.21.15.45:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9e5c053980 con 0x7f9e6c0cf660 2023-06-22T10:53:16.157 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:16.153+0000 7f9e733ff700 1 -- 172.21.15.40:0/4235989936 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9e6c068330 con 0x7f9e6c0cf660 2023-06-22T10:53:16.157 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:16.154+0000 7f9e61ffb700 1 -- 172.21.15.40:0/4235989936 <== mon.2 v2:172.21.15.45:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+8952 (secure 0 0 0) 0x7f9e5c017090 con 0x7f9e6c0cf660 2023-06-22T10:53:16.158 INFO:teuthology.misc.health.smithi040.stdout: 2023-06-22T10:53:16.158 INFO:teuthology.misc.health.smithi040.stdout:{"epoch":13,"fsid":"475560bc-1a7c-4a75-b3b6-6fc6b20bdc52","created":"2023-06-22T10:53:03.784568+0000","modified":"2023-06-22T10:53:15.825010+0000","last_up_change":"2023-06-22T10:53:15.825010+0000","last_in_change":"2023-06-22T10:53:07.329974+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"918db6b4-053a-46ba-976d-6e1a0104017f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"0c146e2b-1725-4dae-9b5c-38795943b9d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6801","nonce":230885800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6803","nonce":230885800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6807","nonce":230885800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6805","nonce":230885800}]},"public_addr":"172.21.15.40:6801/230885800","cluster_addr":"172.21.15.40:6803/230885800","heartbeat_back_addr":"172.21.15.40:6807/230885800","heartbeat_front_addr":"172.21.15.40:6805/230885800","state":["exists","up"]},{"osd":2,"uuid":"0b3727fd-f281-46d5-a675-86c8c5ab269e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"2969c698-7039-4bbb-beda-f756f7a368a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6825","nonce":111110981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6827","nonce":111110981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6831","nonce":111110981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6829","nonce":111110981}]},"public_addr":"172.21.15.40:6825/111110981","cluster_addr":"172.21.15.40:6827/111110981","heartbeat_back_addr":"172.21.15.40:6831/111110981","heartbeat_front_addr":"172.21.15.40:6829/111110981","state":["exists","up"]},{"osd":4,"uuid":"3bb1d9c8-8e42-4a6b-998d-04834f34be5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6801","nonce":3625455711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6803","nonce":3625455711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6807","nonce":3625455711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6805","nonce":3625455711}]},"public_addr":"172.21.15.45:6801/3625455711","cluster_addr":"172.21.15.45:6803/3625455711","heartbeat_back_addr":"172.21.15.45:6807/3625455711","heartbeat_front_addr":"172.21.15.45:6805/3625455711","state":["exists","up"]},{"osd":5,"uuid":"f9854ee4-302c-41be-977b-bedda090a3d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6817","nonce":3354411217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6819","nonce":3354411217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6823","nonce":3354411217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6821","nonce":3354411217}]},"public_addr":"172.21.15.45:6817/3354411217","cluster_addr":"172.21.15.45:6819/3354411217","heartbeat_back_addr":"172.21.15.45:6823/3354411217","heartbeat_front_addr":"172.21.15.45:6821/3354411217","state":["exists","up"]},{"osd":6,"uuid":"bbdb1989-f6ac-4954-9b85-b8b540d683c5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"823d44e3-58f1-4d1d-8263-a4e4a69d4327","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-22T10:53:16.160 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:16.157+0000 7f9e733ff700 1 -- 172.21.15.40:0/4235989936 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f9e5006ac50 msgr2=0x7f9e5006d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:16.160 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:16.157+0000 7f9e733ff700 1 --2- 172.21.15.40:0/4235989936 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f9e5006ac50 0x7f9e5006d100 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9e68009fd0 tx=0x7f9e68008030 comp rx=0 tx=0).stop 2023-06-22T10:53:16.161 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:16.157+0000 7f9e733ff700 1 -- 172.21.15.40:0/4235989936 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9e6c0cf660 msgr2=0x7f9e6c157230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:16.161 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:16.157+0000 7f9e733ff700 1 --2- 172.21.15.40:0/4235989936 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9e6c0cf660 0x7f9e6c157230 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c000f60 tx=0x7f9e5c00c6e0 comp rx=0 tx=0).stop 2023-06-22T10:53:16.161 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:16.157+0000 7f9e733ff700 1 -- 172.21.15.40:0/4235989936 shutdown_connections 2023-06-22T10:53:16.161 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:16.157+0000 7f9e733ff700 1 --2- 172.21.15.40:0/4235989936 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f9e5006ac50 0x7f9e5006d100 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:16.161 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:16.157+0000 7f9e733ff700 1 --2- 172.21.15.40:0/4235989936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e6c0d33d0 0x7f9e6c0ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:16.161 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:16.157+0000 7f9e733ff700 1 --2- 172.21.15.40:0/4235989936 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e6c0b5010 0x7f9e6c0b78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:16.161 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:16.157+0000 7f9e733ff700 1 --2- 172.21.15.40:0/4235989936 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9e6c0cf660 0x7f9e6c157230 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:16.162 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:16.157+0000 7f9e733ff700 1 -- 172.21.15.40:0/4235989936 >> 172.21.15.40:0/4235989936 conn(0x7f9e6c071660 msgr2=0x7f9e6c0b17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:16.162 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:16.157+0000 7f9e733ff700 1 -- 172.21.15.40:0/4235989936 shutdown_connections 2023-06-22T10:53:16.162 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:16.157+0000 7f9e733ff700 1 -- 172.21.15.40:0/4235989936 wait complete. 2023-06-22T10:53:16.176 DEBUG:teuthology.misc:4 of 8 OSDs are up 2023-06-22T10:53:16.191 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-06-22T10:53:16.188+0000 7f3aa9ff7700 -1 osd.2 0 waiting for initial osdmap 2023-06-22T10:53:16.229 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-06-22T10:53:16.225+0000 7f3aa17fa700 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-22T10:53:16.785 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T10:53:16.781+0000 7f85b75f8700 -1 osd.7 0 waiting for initial osdmap 2023-06-22T10:53:16.799 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T10:53:16.796+0000 7f85ae5fa700 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-22T10:53:17.130 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-06-22T10:53:17.127+0000 7fe9b39f7700 -1 osd.0 0 waiting for initial osdmap 2023-06-22T10:53:17.148 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-06-22T10:53:17.145+0000 7fe9ab1fa700 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-22T10:53:22.983 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-06-22T10:53:23.170 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.167+0000 7f70757ff700 1 Processor -- start 2023-06-22T10:53:23.171 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.167+0000 7f70757ff700 1 -- start start 2023-06-22T10:53:23.173 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.168+0000 7f70757ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f70700b5010 0x7f70700cfa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:23.173 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.168+0000 7f70757ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f70700d33d0 0x7f70700d11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:23.173 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.169+0000 7f70757ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70700cd440 con 0x7f70700cf660 2023-06-22T10:53:23.173 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.169+0000 7f70757ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70700cff70 con 0x7f70700d33d0 2023-06-22T10:53:23.173 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.169+0000 7f70757ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70700cd6e0 con 0x7f70700b5010 2023-06-22T10:53:23.174 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.169+0000 7f706effd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f70700cf660 0x7f70700b5aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:56136/0 (socket says 172.21.15.40:56136) 2023-06-22T10:53:23.174 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.169+0000 7f706effd700 1 -- 172.21.15.40:0/642644342 learned_addr learned my addr 172.21.15.40:0/642644342 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:53:23.174 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.169+0000 7f706e7fc700 1 --2- 172.21.15.40:0/642644342 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f70700b5010 0x7f70700cfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:23.174 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.169+0000 7f706f7fe700 1 --2- 172.21.15.40:0/642644342 >> v2:172.21.15.45:3300/0 conn(0x7f70700d33d0 0x7f70700d11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:23.174 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.169+0000 7f706dffb700 1 -- 172.21.15.40:0/642644342 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1918796092 0 0) 0x7f70700cd440 con 0x7f70700cf660 2023-06-22T10:53:23.174 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.169+0000 7f706dffb700 1 -- 172.21.15.40:0/642644342 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70580035b0 con 0x7f70700cf660 2023-06-22T10:53:23.174 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.169+0000 7f706e7fc700 1 -- 172.21.15.40:0/642644342 >> v2:172.21.15.45:3300/0 conn(0x7f70700d33d0 msgr2=0x7f70700d11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:23.175 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.169+0000 7f706e7fc700 1 --2- 172.21.15.40:0/642644342 >> v2:172.21.15.45:3300/0 conn(0x7f70700d33d0 0x7f70700d11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:23.175 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.169+0000 7f706e7fc700 1 -- 172.21.15.40:0/642644342 >> v1:172.21.15.40:6789/0 conn(0x7f70700cf660 legacy=0x7f70700b5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:23.175 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.169+0000 7f706dffb700 1 -- 172.21.15.40:0/642644342 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1149015636 0 0) 0x7f70580035b0 con 0x7f70700cf660 2023-06-22T10:53:23.175 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.170+0000 7f706e7fc700 1 -- 172.21.15.40:0/642644342 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70700d09e0 con 0x7f70700b5010 2023-06-22T10:53:23.175 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.170+0000 7f706e7fc700 1 --2- 172.21.15.40:0/642644342 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f70700b5010 0x7f70700cfa30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7064009840 tx=0x7f7064009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e381ef35c0fb4177 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:23.176 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.170+0000 7f706dffb700 1 -- 172.21.15.40:0/642644342 <== mon.2 v2:172.21.15.45:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7060001670 con 0x7f70700b5010 2023-06-22T10:53:23.176 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.170+0000 7f706dffb700 1 -- 172.21.15.40:0/642644342 <== mon.2 v2:172.21.15.45:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7064004030 con 0x7f70700b5010 2023-06-22T10:53:23.176 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.170+0000 7f706dffb700 1 -- 172.21.15.40:0/642644342 <== mon.2 v2:172.21.15.45:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70640043c0 con 0x7f70700b5010 2023-06-22T10:53:23.177 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.171+0000 7f70757ff700 1 -- 172.21.15.40:0/642644342 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f70700b5010 msgr2=0x7f70700cfa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:23.177 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.171+0000 7f70757ff700 1 --2- 172.21.15.40:0/642644342 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f70700b5010 0x7f70700cfa30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7064009840 tx=0x7f7064009b50 comp rx=0 tx=0).stop 2023-06-22T10:53:23.177 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.171+0000 7f70757ff700 1 -- 172.21.15.40:0/642644342 shutdown_connections 2023-06-22T10:53:23.177 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.171+0000 7f70757ff700 1 --2- 172.21.15.40:0/642644342 >> v2:172.21.15.45:3300/0 conn(0x7f70700d33d0 0x7f70700d11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:23.177 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.171+0000 7f70757ff700 1 --2- 172.21.15.40:0/642644342 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f70700b5010 0x7f70700cfa30 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:23.177 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.171+0000 7f70757ff700 1 -- 172.21.15.40:0/642644342 >> 172.21.15.40:0/642644342 conn(0x7f7070071660 msgr2=0x7f7070071a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:23.177 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.171+0000 7f70757ff700 1 -- 172.21.15.40:0/642644342 shutdown_connections 2023-06-22T10:53:23.177 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.171+0000 7f70757ff700 1 -- 172.21.15.40:0/642644342 wait complete. 2023-06-22T10:53:23.178 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.172+0000 7f70757ff700 1 Processor -- start 2023-06-22T10:53:23.178 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.173+0000 7f70757ff700 1 -- start start 2023-06-22T10:53:23.179 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.173+0000 7f70757ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70700b5010 0x7f707014e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:23.179 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.173+0000 7f70757ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f70700cf660 0x7f707015e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:23.179 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.173+0000 7f70757ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70700d33d0 0x7f70701e4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:23.180 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.174+0000 7f70757ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f707015e390 con 0x7f70700d33d0 2023-06-22T10:53:23.180 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.174+0000 7f70757ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f707015d780 con 0x7f70700b5010 2023-06-22T10:53:23.180 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.174+0000 7f70757ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f707015da60 con 0x7f70700cf660 2023-06-22T10:53:23.180 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.174+0000 7f706f7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70700d33d0 0x7f70701e4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:23.180 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.174+0000 7f706effd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70700b5010 0x7f707014e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:23.180 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.174+0000 7f706e7fc700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f70700cf660 0x7f707015e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:23.180 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.174+0000 7f706f7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70700d33d0 0x7f70701e4f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53886/0 (socket says 172.21.15.40:53886) 2023-06-22T10:53:23.181 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.174+0000 7f706f7fe700 1 -- 172.21.15.40:0/726106754 learned_addr learned my addr 172.21.15.40:0/726106754 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:23.181 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.174+0000 7f706f7fe700 1 -- 172.21.15.40:0/726106754 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f70700cf660 msgr2=0x7f707015e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:23.181 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.174+0000 7f706f7fe700 1 --2- 172.21.15.40:0/726106754 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f70700cf660 0x7f707015e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:23.181 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.174+0000 7f706f7fe700 1 -- 172.21.15.40:0/726106754 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70700b5010 msgr2=0x7f707014e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:23.181 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.174+0000 7f706f7fe700 1 --2- 172.21.15.40:0/726106754 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70700b5010 0x7f707014e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:23.181 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.174+0000 7f706f7fe700 1 -- 172.21.15.40:0/726106754 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70640094a0 con 0x7f70700d33d0 2023-06-22T10:53:23.181 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.175+0000 7f706f7fe700 1 --2- 172.21.15.40:0/726106754 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70700d33d0 0x7f70701e4f00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f706800efc0 tx=0x7f706800c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:23.181 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.175+0000 7f70577fe700 1 -- 172.21.15.40:0/726106754 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706800cad0 con 0x7f70700d33d0 2023-06-22T10:53:23.182 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.175+0000 7f70577fe700 1 -- 172.21.15.40:0/726106754 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f706800f040 con 0x7f70700d33d0 2023-06-22T10:53:23.182 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.175+0000 7f70577fe700 1 -- 172.21.15.40:0/726106754 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706800ce70 con 0x7f70700d33d0 2023-06-22T10:53:23.182 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.175+0000 7f70757ff700 1 -- 172.21.15.40:0/726106754 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f707015dd40 con 0x7f70700d33d0 2023-06-22T10:53:23.182 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.175+0000 7f70757ff700 1 -- 172.21.15.40:0/726106754 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70701e5440 con 0x7f70700d33d0 2023-06-22T10:53:23.182 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.176+0000 7f70757ff700 1 -- 172.21.15.40:0/726106754 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f707015e500 con 0x7f70700d33d0 2023-06-22T10:53:23.183 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.177+0000 7f70577fe700 1 -- 172.21.15.40:0/726106754 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7068014480 con 0x7f70700d33d0 2023-06-22T10:53:23.183 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.178+0000 7f70577fe700 1 --2- 172.21.15.40:0/726106754 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f705c06ace0 0x7f705c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:23.183 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.178+0000 7f70577fe700 1 -- 172.21.15.40:0/726106754 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7068089850 con 0x7f70700d33d0 2023-06-22T10:53:23.183 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.178+0000 7f706effd700 1 --2- 172.21.15.40:0/726106754 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f705c06ace0 0x7f705c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:23.183 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.179+0000 7f706effd700 1 --2- 172.21.15.40:0/726106754 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f705c06ace0 0x7f705c06d190 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7060000f60 tx=0x7f7060001230 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:23.186 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.183+0000 7f70577fe700 1 -- 172.21.15.40:0/726106754 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7068054c80 con 0x7f70700d33d0 2023-06-22T10:53:23.396 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.392+0000 7f70757ff700 1 -- 172.21.15.40:0/726106754 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7070068330 con 0x7f70700d33d0 2023-06-22T10:53:23.396 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.394+0000 7f70577fe700 1 -- 172.21.15.40:0/726106754 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12766 (secure 0 0 0) 0x7f70680861f0 con 0x7f70700d33d0 2023-06-22T10:53:23.397 INFO:teuthology.misc.health.smithi040.stdout: 2023-06-22T10:53:23.397 INFO:teuthology.misc.health.smithi040.stdout:{"epoch":17,"fsid":"475560bc-1a7c-4a75-b3b6-6fc6b20bdc52","created":"2023-06-22T10:53:03.784568+0000","modified":"2023-06-22T10:53:19.842617+0000","last_up_change":"2023-06-22T10:53:17.830348+0000","last_in_change":"2023-06-22T10:53:07.329974+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-22T10:53:17.182228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"918db6b4-053a-46ba-976d-6e1a0104017f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6809","nonce":2400162888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6811","nonce":2400162888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6815","nonce":2400162888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6813","nonce":2400162888}]},"public_addr":"172.21.15.40:6809/2400162888","cluster_addr":"172.21.15.40:6811/2400162888","heartbeat_back_addr":"172.21.15.40:6815/2400162888","heartbeat_front_addr":"172.21.15.40:6813/2400162888","state":["exists","up"]},{"osd":1,"uuid":"0c146e2b-1725-4dae-9b5c-38795943b9d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6801","nonce":230885800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6803","nonce":230885800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6807","nonce":230885800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6805","nonce":230885800}]},"public_addr":"172.21.15.40:6801/230885800","cluster_addr":"172.21.15.40:6803/230885800","heartbeat_back_addr":"172.21.15.40:6807/230885800","heartbeat_front_addr":"172.21.15.40:6805/230885800","state":["exists","up"]},{"osd":2,"uuid":"0b3727fd-f281-46d5-a675-86c8c5ab269e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6817","nonce":2681404929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6819","nonce":2681404929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6823","nonce":2681404929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6821","nonce":2681404929}]},"public_addr":"172.21.15.40:6817/2681404929","cluster_addr":"172.21.15.40:6819/2681404929","heartbeat_back_addr":"172.21.15.40:6823/2681404929","heartbeat_front_addr":"172.21.15.40:6821/2681404929","state":["exists","up"]},{"osd":3,"uuid":"2969c698-7039-4bbb-beda-f756f7a368a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6825","nonce":111110981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6827","nonce":111110981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6831","nonce":111110981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6829","nonce":111110981}]},"public_addr":"172.21.15.40:6825/111110981","cluster_addr":"172.21.15.40:6827/111110981","heartbeat_back_addr":"172.21.15.40:6831/111110981","heartbeat_front_addr":"172.21.15.40:6829/111110981","state":["exists","up"]},{"osd":4,"uuid":"3bb1d9c8-8e42-4a6b-998d-04834f34be5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6801","nonce":3625455711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6803","nonce":3625455711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6807","nonce":3625455711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6805","nonce":3625455711}]},"public_addr":"172.21.15.45:6801/3625455711","cluster_addr":"172.21.15.45:6803/3625455711","heartbeat_back_addr":"172.21.15.45:6807/3625455711","heartbeat_front_addr":"172.21.15.45:6805/3625455711","state":["exists","up"]},{"osd":5,"uuid":"f9854ee4-302c-41be-977b-bedda090a3d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6817","nonce":3354411217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6819","nonce":3354411217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6823","nonce":3354411217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6821","nonce":3354411217}]},"public_addr":"172.21.15.45:6817/3354411217","cluster_addr":"172.21.15.45:6819/3354411217","heartbeat_back_addr":"172.21.15.45:6823/3354411217","heartbeat_front_addr":"172.21.15.45:6821/3354411217","state":["exists","up"]},{"osd":6,"uuid":"bbdb1989-f6ac-4954-9b85-b8b540d683c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6809","nonce":320111074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6811","nonce":320111074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6815","nonce":320111074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6813","nonce":320111074}]},"public_addr":"172.21.15.45:6809/320111074","cluster_addr":"172.21.15.45:6811/320111074","heartbeat_back_addr":"172.21.15.45:6815/320111074","heartbeat_front_addr":"172.21.15.45:6813/320111074","state":["exists","up"]},{"osd":7,"uuid":"823d44e3-58f1-4d1d-8263-a4e4a69d4327","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6825","nonce":643617680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6827","nonce":643617680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6831","nonce":643617680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6829","nonce":643617680}]},"public_addr":"172.21.15.45:6825/643617680","cluster_addr":"172.21.15.45:6827/643617680","heartbeat_back_addr":"172.21.15.45:6831/643617680","heartbeat_front_addr":"172.21.15.45:6829/643617680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.731262+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.873226+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.898936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.666578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.645990+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.953699+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.642823+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.693395+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-22T10:53:23.400 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.396+0000 7f70757ff700 1 -- 172.21.15.40:0/726106754 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f705c06ace0 msgr2=0x7f705c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:23.400 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.396+0000 7f70757ff700 1 --2- 172.21.15.40:0/726106754 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f705c06ace0 0x7f705c06d190 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7060000f60 tx=0x7f7060001230 comp rx=0 tx=0).stop 2023-06-22T10:53:23.401 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.396+0000 7f70757ff700 1 -- 172.21.15.40:0/726106754 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70700d33d0 msgr2=0x7f70701e4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:23.401 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.396+0000 7f70757ff700 1 --2- 172.21.15.40:0/726106754 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70700d33d0 0x7f70701e4f00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f706800efc0 tx=0x7f706800c0c0 comp rx=0 tx=0).stop 2023-06-22T10:53:23.401 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.396+0000 7f70757ff700 1 -- 172.21.15.40:0/726106754 shutdown_connections 2023-06-22T10:53:23.401 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.396+0000 7f70757ff700 1 --2- 172.21.15.40:0/726106754 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f705c06ace0 0x7f705c06d190 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:23.401 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.396+0000 7f70757ff700 1 --2- 172.21.15.40:0/726106754 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70700d33d0 0x7f70701e4f00 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:23.402 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.396+0000 7f70757ff700 1 --2- 172.21.15.40:0/726106754 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70700b5010 0x7f707014e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:23.402 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.396+0000 7f70757ff700 1 --2- 172.21.15.40:0/726106754 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f70700cf660 0x7f707015e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:23.402 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.396+0000 7f70757ff700 1 -- 172.21.15.40:0/726106754 >> 172.21.15.40:0/726106754 conn(0x7f7070071660 msgr2=0x7f70700b7e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:23.402 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.396+0000 7f70757ff700 1 -- 172.21.15.40:0/726106754 shutdown_connections 2023-06-22T10:53:23.402 INFO:teuthology.misc.health.smithi040.stderr:2023-06-22T10:53:23.396+0000 7f70757ff700 1 -- 172.21.15.40:0/726106754 wait complete. 2023-06-22T10:53:23.415 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-06-22T10:53:23.416 INFO:tasks.ceph:Creating RBD pool 2023-06-22T10:53:23.416 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph osd pool create rbd 8 2023-06-22T10:53:23.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:23.610+0000 7fc8c03ff700 1 Processor -- start 2023-06-22T10:53:23.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:23.610+0000 7fc8c03ff700 1 -- start start 2023-06-22T10:53:23.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:23.612+0000 7fc8c03ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc8b80cfed0 0x7fc8b80cd280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:23.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:23.612+0000 7fc8c03ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fc8b80b87e0 0x7fc8b80cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:23.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:23.612+0000 7fc8c03ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8b80cdd00 con 0x7fc8b80cfb00 2023-06-22T10:53:23.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:23.612+0000 7fc8c03ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8b80cdf40 con 0x7fc8b80cfed0 2023-06-22T10:53:23.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:23.612+0000 7fc8c03ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b8160430 con 0x7fc8b80b87e0 2023-06-22T10:53:23.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:23.612+0000 7fc8be99c700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fc8b80b87e0 0x7fc8b80cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:23.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:23.612+0000 7fc8bd99a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc8b80cfed0 0x7fc8b80cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:23.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:23.612+0000 7fc8bd99a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc8b80cfed0 0x7fc8b80cd280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.40:42272/0 (socket says 172.21.15.40:42272) 2023-06-22T10:53:23.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:23.612+0000 7fc8bd99a700 1 -- 172.21.15.40:0/3723656469 learned_addr learned my addr 172.21.15.40:0/3723656469 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:23.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:23.612+0000 7fc8be99c700 1 -- 172.21.15.40:0/3723656469 >> v2:172.21.15.45:3300/0 conn(0x7fc8b80cfed0 msgr2=0x7fc8b80cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:23.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:23.612+0000 7fc8be99c700 1 --2- 172.21.15.40:0/3723656469 >> v2:172.21.15.45:3300/0 conn(0x7fc8b80cfed0 0x7fc8b80cd280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:23.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:23.612+0000 7fc8be99c700 1 -- 172.21.15.40:0/3723656469 >> v1:172.21.15.45:6789/0 conn(0x7fc8b80cfb00 legacy=0x7fc8b80b80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:23.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:23.612+0000 7fc8be99c700 1 -- 172.21.15.40:0/3723656469 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b8160680 con 0x7fc8b80b87e0 2023-06-22T10:53:23.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:23.613+0000 7fc8be99c700 1 --2- 172.21.15.40:0/3723656469 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fc8b80b87e0 0x7fc8b80cd7c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0009d90 tx=0x7fc8b000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a208ff78f15735ba server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:23.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:23.613+0000 7fc8bd199700 1 -- 172.21.15.40:0/3723656469 <== mon.2 v2:172.21.15.45:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b000e070 con 0x7fc8b80b87e0 2023-06-22T10:53:23.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:23.613+0000 7fc8bd199700 1 -- 172.21.15.40:0/3723656469 <== mon.2 v2:172.21.15.45:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b000bb20 con 0x7fc8b80b87e0 2023-06-22T10:53:23.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:23.613+0000 7fc8bd199700 1 -- 172.21.15.40:0/3723656469 <== mon.2 v2:172.21.15.45:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b0012430 con 0x7fc8b80b87e0 2023-06-22T10:53:23.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:23.614+0000 7fc8c03ff700 1 -- 172.21.15.40:0/3723656469 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fc8b80b87e0 msgr2=0x7fc8b80cd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:23.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:23.614+0000 7fc8c03ff700 1 --2- 172.21.15.40:0/3723656469 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fc8b80b87e0 0x7fc8b80cd7c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0009d90 tx=0x7fc8b000b330 comp rx=0 tx=0).stop 2023-06-22T10:53:23.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:23.614+0000 7fc8c03ff700 1 -- 172.21.15.40:0/3723656469 shutdown_connections 2023-06-22T10:53:23.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:23.614+0000 7fc8c03ff700 1 --2- 172.21.15.40:0/3723656469 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fc8b80b87e0 0x7fc8b80cd7c0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:23.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:23.614+0000 7fc8c03ff700 1 --2- 172.21.15.40:0/3723656469 >> v2:172.21.15.45:3300/0 conn(0x7fc8b80cfed0 0x7fc8b80cd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:23.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:23.614+0000 7fc8c03ff700 1 -- 172.21.15.40:0/3723656469 >> 172.21.15.40:0/3723656469 conn(0x7fc8b806b340 msgr2=0x7fc8b806b740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:23.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:23.614+0000 7fc8c03ff700 1 -- 172.21.15.40:0/3723656469 shutdown_connections 2023-06-22T10:53:23.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:23.614+0000 7fc8c03ff700 1 -- 172.21.15.40:0/3723656469 wait complete. 2023-06-22T10:53:23.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:23.616+0000 7fc8c03ff700 1 Processor -- start 2023-06-22T10:53:23.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:23.616+0000 7fc8c03ff700 1 -- start start 2023-06-22T10:53:23.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:23.617+0000 7fc8c03ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fc8b80b87e0 0x7fc8b80c6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:23.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:23.617+0000 7fc8c03ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8b80cfb00 0x7fc8b80c6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:23.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:23.617+0000 7fc8c03ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8b80cfed0 0x7fc8b80caef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:23.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:23.617+0000 7fc8c03ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b80c8060 con 0x7fc8b80cfed0 2023-06-22T10:53:23.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:23.617+0000 7fc8c03ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b8152dc0 con 0x7fc8b80cfb00 2023-06-22T10:53:23.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:23.617+0000 7fc8c03ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b80c71e0 con 0x7fc8b80b87e0 2023-06-22T10:53:23.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:23.617+0000 7fc8bd99a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8b80cfb00 0x7fc8b80c6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:23.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:23.617+0000 7fc8be19b700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fc8b80b87e0 0x7fc8b80c6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:23.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:23.617+0000 7fc8be99c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8b80cfed0 0x7fc8b80caef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:23.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:23.617+0000 7fc8bd99a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8b80cfb00 0x7fc8b80c6ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.40:42288/0 (socket says 172.21.15.40:42288) 2023-06-22T10:53:23.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:23.617+0000 7fc8be19b700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fc8b80b87e0 0x7fc8b80c6760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3301/0 says I am v2:172.21.15.40:54016/0 (socket says 172.21.15.40:54016) 2023-06-22T10:53:23.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:23.617+0000 7fc8bd99a700 1 -- 172.21.15.40:0/4251896226 learned_addr learned my addr 172.21.15.40:0/4251896226 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:23.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:23.617+0000 7fc8be99c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8b80cfed0 0x7fc8b80caef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53890/0 (socket says 172.21.15.40:53890) 2023-06-22T10:53:23.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:23.617+0000 7fc8be99c700 1 -- 172.21.15.40:0/4251896226 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fc8b80b87e0 msgr2=0x7fc8b80c6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:23.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:23.617+0000 7fc8be99c700 1 --2- 172.21.15.40:0/4251896226 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fc8b80b87e0 0x7fc8b80c6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:23.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:23.617+0000 7fc8be99c700 1 -- 172.21.15.40:0/4251896226 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8b80cfb00 msgr2=0x7fc8b80c6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:23.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:23.618+0000 7fc8be99c700 1 --2- 172.21.15.40:0/4251896226 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8b80cfb00 0x7fc8b80c6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:23.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:23.618+0000 7fc8be99c700 1 -- 172.21.15.40:0/4251896226 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b0009a70 con 0x7fc8b80cfed0 2023-06-22T10:53:23.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:23.618+0000 7fc8be99c700 1 --2- 172.21.15.40:0/4251896226 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8b80cfed0 0x7fc8b80caef0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0016000 tx=0x7fc8b0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:23.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:23.618+0000 7fc8aeffd700 1 -- 172.21.15.40:0/4251896226 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b0012430 con 0x7fc8b80cfed0 2023-06-22T10:53:23.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:23.618+0000 7fc8aeffd700 1 -- 172.21.15.40:0/4251896226 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b0020070 con 0x7fc8b80cfed0 2023-06-22T10:53:23.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:23.618+0000 7fc8c03ff700 1 -- 172.21.15.40:0/4251896226 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8b80c73e0 con 0x7fc8b80cfed0 2023-06-22T10:53:23.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:23.618+0000 7fc8aeffd700 1 -- 172.21.15.40:0/4251896226 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b00098f0 con 0x7fc8b80cfed0 2023-06-22T10:53:23.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:23.618+0000 7fc8c03ff700 1 -- 172.21.15.40:0/4251896226 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8b80c79a0 con 0x7fc8b80cfed0 2023-06-22T10:53:23.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:23.619+0000 7fc8c03ff700 1 -- 172.21.15.40:0/4251896226 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8b8066ac0 con 0x7fc8b80cfed0 2023-06-22T10:53:23.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:23.620+0000 7fc8aeffd700 1 -- 172.21.15.40:0/4251896226 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc8b0004040 con 0x7fc8b80cfed0 2023-06-22T10:53:23.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:23.621+0000 7fc8aeffd700 1 --2- 172.21.15.40:0/4251896226 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fc89c06ace0 0x7fc89c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:23.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:23.621+0000 7fc8aeffd700 1 -- 172.21.15.40:0/4251896226 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc8b0022070 con 0x7fc8b80cfed0 2023-06-22T10:53:23.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:23.622+0000 7fc8be19b700 1 --2- 172.21.15.40:0/4251896226 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fc89c06ace0 0x7fc89c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:23.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:23.622+0000 7fc8be19b700 1 --2- 172.21.15.40:0/4251896226 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fc89c06ace0 0x7fc89c06d190 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4007fd0 tx=0x7fc8b4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:23.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:23.626+0000 7fc8aeffd700 1 -- 172.21.15.40:0/4251896226 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc8b00560e0 con 0x7fc8b80cfed0 2023-06-22T10:53:23.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:23.833+0000 7fc8c03ff700 1 -- 172.21.15.40:0/4251896226 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fc8b8067580 con 0x7fc8b80cfed0 2023-06-22T10:53:24.512 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T10:53:24.517 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T10:53:24.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.616+0000 7fc8aeffd700 1 -- 172.21.15.40:0/4251896226 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v18) v1 ==== 109+0+0 (secure 0 0 0) 0x7fc8b002c0a0 con 0x7fc8b80cfed0 2023-06-22T10:53:24.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.619+0000 7fc8c03ff700 1 -- 172.21.15.40:0/4251896226 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fc89c06ace0 msgr2=0x7fc89c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:24.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.619+0000 7fc8c03ff700 1 --2- 172.21.15.40:0/4251896226 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fc89c06ace0 0x7fc89c06d190 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4007fd0 tx=0x7fc8b4009040 comp rx=0 tx=0).stop 2023-06-22T10:53:24.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.619+0000 7fc8c03ff700 1 -- 172.21.15.40:0/4251896226 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8b80cfed0 msgr2=0x7fc8b80caef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:24.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.619+0000 7fc8c03ff700 1 --2- 172.21.15.40:0/4251896226 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8b80cfed0 0x7fc8b80caef0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0016000 tx=0x7fc8b0004ad0 comp rx=0 tx=0).stop 2023-06-22T10:53:24.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.620+0000 7fc8c03ff700 1 -- 172.21.15.40:0/4251896226 shutdown_connections 2023-06-22T10:53:24.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.620+0000 7fc8c03ff700 1 --2- 172.21.15.40:0/4251896226 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fc89c06ace0 0x7fc89c06d190 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:24.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.620+0000 7fc8c03ff700 1 --2- 172.21.15.40:0/4251896226 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fc8b80b87e0 0x7fc8b80c6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:24.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.620+0000 7fc8c03ff700 1 --2- 172.21.15.40:0/4251896226 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8b80cfed0 0x7fc8b80caef0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:24.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.620+0000 7fc8c03ff700 1 --2- 172.21.15.40:0/4251896226 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8b80cfb00 0x7fc8b80c6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:24.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.620+0000 7fc8c03ff700 1 -- 172.21.15.40:0/4251896226 >> 172.21.15.40:0/4251896226 conn(0x7fc8b806b340 msgr2=0x7fc8b815ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:24.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.621+0000 7fc8c03ff700 1 -- 172.21.15.40:0/4251896226 shutdown_connections 2023-06-22T10:53:24.626 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.621+0000 7fc8c03ff700 1 -- 172.21.15.40:0/4251896226 wait complete. 2023-06-22T10:53:24.626 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'rbd' created 2023-06-22T10:53:24.644 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-06-22T10:53:24.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.881+0000 7f748e9ff700 1 Processor -- start 2023-06-22T10:53:24.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.881+0000 7f748e9ff700 1 -- start start 2023-06-22T10:53:24.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.883+0000 7f748e9ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f748815c460 0x7f74880cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:24.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.883+0000 7f748e9ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f74880cef00 0x7f74880b4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:24.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.883+0000 7f748e9ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74880d1ba0 con 0x7f74880cf330 2023-06-22T10:53:24.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.883+0000 7f748e9ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74880d1300 con 0x7f74880cef00 2023-06-22T10:53:24.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.883+0000 7f748e9ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74880d15e0 con 0x7f748815c460 2023-06-22T10:53:24.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.884+0000 7f74877fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f74880cef00 0x7f74880b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:24.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.884+0000 7f748cf9c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f74880cf330 0x7f748806b3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:56140/0 (socket says 172.21.15.40:56140) 2023-06-22T10:53:24.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.884+0000 7f748cf9c700 1 -- 172.21.15.40:0/1457356532 learned_addr learned my addr 172.21.15.40:0/1457356532 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:53:24.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.884+0000 7f7487fff700 1 --2- 172.21.15.40:0/1457356532 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f748815c460 0x7f74880cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:24.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.884+0000 7f74877fe700 1 -- 172.21.15.40:0/1457356532 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f748815c460 msgr2=0x7f74880cd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:24.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.884+0000 7f74877fe700 1 --2- 172.21.15.40:0/1457356532 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f748815c460 0x7f74880cd2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:24.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.884+0000 7f74877fe700 1 -- 172.21.15.40:0/1457356532 >> v1:172.21.15.40:6789/0 conn(0x7f74880cf330 legacy=0x7f748806b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:24.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.884+0000 7f74877fe700 1 -- 172.21.15.40:0/1457356532 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74880d18c0 con 0x7f74880cef00 2023-06-22T10:53:24.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.884+0000 7f7486ffd700 1 -- 172.21.15.40:0/1457356532 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 376143074 0 0) 0x7f74880d1ba0 con 0x7f74880cf330 2023-06-22T10:53:24.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.884+0000 7f74877fe700 1 --2- 172.21.15.40:0/1457356532 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74880cef00 0x7f74880b4700 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f747c009840 tx=0x7f747c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e88a3b5df45a03d6 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:24.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.885+0000 7f7486ffd700 1 -- 172.21.15.40:0/1457356532 <== mon.1 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747c011830 con 0x7f74880cef00 2023-06-22T10:53:24.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.885+0000 7f7486ffd700 1 -- 172.21.15.40:0/1457356532 <== mon.1 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f747c011990 con 0x7f74880cef00 2023-06-22T10:53:24.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.885+0000 7f7486ffd700 1 -- 172.21.15.40:0/1457356532 <== mon.1 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747c011d20 con 0x7f74880cef00 2023-06-22T10:53:24.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.885+0000 7f748e9ff700 1 -- 172.21.15.40:0/1457356532 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74880cef00 msgr2=0x7f74880b4700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:24.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.885+0000 7f748e9ff700 1 --2- 172.21.15.40:0/1457356532 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74880cef00 0x7f74880b4700 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f747c009840 tx=0x7f747c009b50 comp rx=0 tx=0).stop 2023-06-22T10:53:24.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.885+0000 7f748e9ff700 1 -- 172.21.15.40:0/1457356532 shutdown_connections 2023-06-22T10:53:24.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.885+0000 7f748e9ff700 1 --2- 172.21.15.40:0/1457356532 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f748815c460 0x7f74880cd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:24.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.885+0000 7f748e9ff700 1 --2- 172.21.15.40:0/1457356532 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74880cef00 0x7f74880b4700 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:24.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.885+0000 7f748e9ff700 1 -- 172.21.15.40:0/1457356532 >> 172.21.15.40:0/1457356532 conn(0x7f74880cf700 msgr2=0x7f74880cfb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:24.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.885+0000 7f748e9ff700 1 -- 172.21.15.40:0/1457356532 shutdown_connections 2023-06-22T10:53:24.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.885+0000 7f748e9ff700 1 -- 172.21.15.40:0/1457356532 wait complete. 2023-06-22T10:53:24.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.888+0000 7f748e9ff700 1 Processor -- start 2023-06-22T10:53:24.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.888+0000 7f748e9ff700 1 -- start start 2023-06-22T10:53:24.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.889+0000 7f748e9ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74880cef00 0x7f74880b7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:24.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.889+0000 7f748e9ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f74880cf330 0x7f748814a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:24.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.889+0000 7f748e9ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f748815c460 0x7f74880c6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:24.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.889+0000 7f748e9ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f748814a660 con 0x7f748815c460 2023-06-22T10:53:24.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.889+0000 7f748e9ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74880caf90 con 0x7f74880cef00 2023-06-22T10:53:24.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.889+0000 7f748e9ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74880c6bb0 con 0x7f74880cf330 2023-06-22T10:53:24.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.890+0000 7f748cf9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f748815c460 0x7f74880c6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:24.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.890+0000 7f748cf9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f748815c460 0x7f74880c6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53904/0 (socket says 172.21.15.40:53904) 2023-06-22T10:53:24.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.890+0000 7f748cf9c700 1 -- 172.21.15.40:0/2441408972 learned_addr learned my addr 172.21.15.40:0/2441408972 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:24.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.890+0000 7f7487fff700 1 --2- 172.21.15.40:0/2441408972 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74880cef00 0x7f74880b7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:24.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.890+0000 7f74877fe700 1 --2- 172.21.15.40:0/2441408972 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f74880cf330 0x7f748814a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:24.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.890+0000 7f748cf9c700 1 -- 172.21.15.40:0/2441408972 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f74880cf330 msgr2=0x7f748814a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:24.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.890+0000 7f748cf9c700 1 --2- 172.21.15.40:0/2441408972 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f74880cf330 0x7f748814a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:24.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.890+0000 7f748cf9c700 1 -- 172.21.15.40:0/2441408972 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74880cef00 msgr2=0x7f74880b7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:24.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.890+0000 7f748cf9c700 1 --2- 172.21.15.40:0/2441408972 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74880cef00 0x7f74880b7a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:24.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.890+0000 7f748cf9c700 1 -- 172.21.15.40:0/2441408972 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f747c0094a0 con 0x7f748815c460 2023-06-22T10:53:24.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.890+0000 7f74877fe700 1 --2- 172.21.15.40:0/2441408972 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f74880cf330 0x7f748814a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:53:24.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.890+0000 7f748cf9c700 1 --2- 172.21.15.40:0/2441408972 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f748815c460 0x7f74880c6670 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f748000cc70 tx=0x7f748000cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:24.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.890+0000 7f7484ff9700 1 -- 172.21.15.40:0/2441408972 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748000ab70 con 0x7f748815c460 2023-06-22T10:53:24.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.891+0000 7f7484ff9700 1 -- 172.21.15.40:0/2441408972 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f748000acf0 con 0x7f748815c460 2023-06-22T10:53:24.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.891+0000 7f748e9ff700 1 -- 172.21.15.40:0/2441408972 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74880cb1e0 con 0x7f748815c460 2023-06-22T10:53:24.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.891+0000 7f7484ff9700 1 -- 172.21.15.40:0/2441408972 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7480007310 con 0x7f748815c460 2023-06-22T10:53:24.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.891+0000 7f748e9ff700 1 -- 172.21.15.40:0/2441408972 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74880cb7a0 con 0x7f748815c460 2023-06-22T10:53:24.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.892+0000 7f748e9ff700 1 -- 172.21.15.40:0/2441408972 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7488067580 con 0x7f748815c460 2023-06-22T10:53:24.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.893+0000 7f7484ff9700 1 -- 172.21.15.40:0/2441408972 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7480007470 con 0x7f748815c460 2023-06-22T10:53:24.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.894+0000 7f7484ff9700 1 --2- 172.21.15.40:0/2441408972 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f747406ace0 0x7f747406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:24.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.894+0000 7f7484ff9700 1 -- 172.21.15.40:0/2441408972 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5199+0+0 (secure 0 0 0) 0x7f7480088ef0 con 0x7f748815c460 2023-06-22T10:53:24.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.894+0000 7f7487fff700 1 --2- 172.21.15.40:0/2441408972 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f747406ace0 0x7f747406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:24.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.895+0000 7f7487fff700 1 --2- 172.21.15.40:0/2441408972 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f747406ace0 0x7f747406d190 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7478009be0 tx=0x7f7478009210 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:24.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:24.899+0000 7f7484ff9700 1 -- 172.21.15.40:0/2441408972 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7480054390 con 0x7f748815c460 2023-06-22T10:53:25.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.106+0000 7f748e9ff700 1 -- 172.21.15.40:0/2441408972 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f74880d0a40 con 0x7f748815c460 2023-06-22T10:53:25.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.618+0000 7f7484ff9700 1 -- 172.21.15.40:0/2441408972 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v19) v1 ==== 173+0+0 (secure 0 0 0) 0x7f7480018020 con 0x7f748815c460 2023-06-22T10:53:25.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.621+0000 7f748e9ff700 1 -- 172.21.15.40:0/2441408972 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f747406ace0 msgr2=0x7f747406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:25.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.621+0000 7f748e9ff700 1 --2- 172.21.15.40:0/2441408972 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f747406ace0 0x7f747406d190 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7478009be0 tx=0x7f7478009210 comp rx=0 tx=0).stop 2023-06-22T10:53:25.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.621+0000 7f748e9ff700 1 -- 172.21.15.40:0/2441408972 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f748815c460 msgr2=0x7f74880c6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:25.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.621+0000 7f748e9ff700 1 --2- 172.21.15.40:0/2441408972 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f748815c460 0x7f74880c6670 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f748000cc70 tx=0x7f748000cf80 comp rx=0 tx=0).stop 2023-06-22T10:53:25.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.622+0000 7f748e9ff700 1 -- 172.21.15.40:0/2441408972 shutdown_connections 2023-06-22T10:53:25.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.622+0000 7f748e9ff700 1 --2- 172.21.15.40:0/2441408972 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f747406ace0 0x7f747406d190 secure :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7478009be0 tx=0x7f7478009210 comp rx=0 tx=0).stop 2023-06-22T10:53:25.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.622+0000 7f748e9ff700 1 --2- 172.21.15.40:0/2441408972 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f748815c460 0x7f74880c6670 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:25.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.622+0000 7f748e9ff700 1 --2- 172.21.15.40:0/2441408972 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74880cef00 0x7f74880b7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:25.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.622+0000 7f748e9ff700 1 --2- 172.21.15.40:0/2441408972 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f74880cf330 0x7f748814a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:25.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.622+0000 7f748e9ff700 1 -- 172.21.15.40:0/2441408972 >> 172.21.15.40:0/2441408972 conn(0x7f74880cf700 msgr2=0x7f74880b5cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:25.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.623+0000 7f748e9ff700 1 -- 172.21.15.40:0/2441408972 shutdown_connections 2023-06-22T10:53:25.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.624+0000 7f748e9ff700 1 -- 172.21.15.40:0/2441408972 wait complete. 2023-06-22T10:53:25.631 INFO:teuthology.orchestra.run.smithi040.stderr:enabled application 'rbd' on pool 'rbd' 2023-06-22T10:53:25.647 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-06-22T10:53:25.648 INFO:tasks.ceph.mds.a:Restarting daemon 2023-06-22T10:53:25.648 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-06-22T10:53:25.654 INFO:tasks.ceph.mds.a:Started 2023-06-22T10:53:25.654 INFO:tasks.ceph.mds.c:Restarting daemon 2023-06-22T10:53:25.654 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-06-22T10:53:25.659 INFO:tasks.ceph.mds.c:Started 2023-06-22T10:53:25.660 INFO:tasks.ceph.mds.b:Restarting daemon 2023-06-22T10:53:25.660 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-06-22T10:53:25.665 INFO:tasks.ceph.mds.b:Started 2023-06-22T10:53:25.666 INFO:tasks.ceph.mds.d:Restarting daemon 2023-06-22T10:53:25.666 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-06-22T10:53:25.671 INFO:tasks.ceph.mds.d:Started 2023-06-22T10:53:25.672 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-06-22T10:53:25.673 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-22T10:53:25.811 INFO:tasks.ceph.mds.a.smithi040.stdout:starting mds.a at 2023-06-22T10:53:25.817 INFO:tasks.ceph.mds.c.smithi040.stdout:starting mds.c at 2023-06-22T10:53:25.824 INFO:tasks.ceph.mds.b.smithi045.stdout:starting mds.b at 2023-06-22T10:53:25.824 INFO:tasks.ceph.mds.d.smithi045.stdout:starting mds.d at 2023-06-22T10:53:25.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.890+0000 7fd3203ff700 1 Processor -- start 2023-06-22T10:53:25.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.890+0000 7fd3203ff700 1 -- start start 2023-06-22T10:53:25.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.891+0000 7fd3203ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd3180d2830 0x7fd3180b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:25.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.891+0000 7fd3203ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd3180b4c60 0x7fd3180d0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:25.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.891+0000 7fd3203ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3180b2130 con 0x7fd31815c720 2023-06-22T10:53:25.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.891+0000 7fd3203ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd318160d60 con 0x7fd3180d2830 2023-06-22T10:53:25.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.891+0000 7fd3203ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3180b50e0 con 0x7fd3180b4c60 2023-06-22T10:53:25.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.892+0000 7fd31d99a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd3180d2830 0x7fd3180b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:25.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.892+0000 7fd31e99c700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd3180b4c60 0x7fd3180d0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:25.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.892+0000 7fd31d99a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd3180d2830 0x7fd3180b4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.40:42352/0 (socket says 172.21.15.40:42352) 2023-06-22T10:53:25.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.892+0000 7fd31d99a700 1 -- 172.21.15.40:0/3027917814 learned_addr learned my addr 172.21.15.40:0/3027917814 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:25.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.892+0000 7fd31d99a700 1 -- 172.21.15.40:0/3027917814 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd3180b4c60 msgr2=0x7fd3180d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:25.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.892+0000 7fd31d99a700 1 --2- 172.21.15.40:0/3027917814 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd3180b4c60 0x7fd3180d0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:25.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.892+0000 7fd31d99a700 1 -- 172.21.15.40:0/3027917814 >> v1:172.21.15.45:6789/0 conn(0x7fd31815c720 legacy=0x7fd3180b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:25.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.892+0000 7fd31d99a700 1 -- 172.21.15.40:0/3027917814 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd318161180 con 0x7fd3180d2830 2023-06-22T10:53:25.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.892+0000 7fd31e99c700 1 --2- 172.21.15.40:0/3027917814 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd3180b4c60 0x7fd3180d0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-22T10:53:25.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.892+0000 7fd31d99a700 1 --2- 172.21.15.40:0/3027917814 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3180d2830 0x7fd3180b4720 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd308009920 tx=0x7fd308009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5eeb7eb471ea65a3 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:25.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.893+0000 7fd31d199700 1 -- 172.21.15.40:0/3027917814 <== mon.1 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd308011830 con 0x7fd3180d2830 2023-06-22T10:53:25.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.893+0000 7fd31d199700 1 -- 172.21.15.40:0/3027917814 <== mon.1 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd308011990 con 0x7fd3180d2830 2023-06-22T10:53:25.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.893+0000 7fd31d199700 1 -- 172.21.15.40:0/3027917814 <== mon.1 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd308011d20 con 0x7fd3180d2830 2023-06-22T10:53:25.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.893+0000 7fd3203ff700 1 -- 172.21.15.40:0/3027917814 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3180d2830 msgr2=0x7fd3180b4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:25.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.893+0000 7fd3203ff700 1 --2- 172.21.15.40:0/3027917814 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3180d2830 0x7fd3180b4720 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd308009920 tx=0x7fd308009c30 comp rx=0 tx=0).stop 2023-06-22T10:53:25.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.893+0000 7fd3203ff700 1 -- 172.21.15.40:0/3027917814 shutdown_connections 2023-06-22T10:53:25.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.893+0000 7fd3203ff700 1 --2- 172.21.15.40:0/3027917814 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd3180b4c60 0x7fd3180d0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:25.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.893+0000 7fd3203ff700 1 --2- 172.21.15.40:0/3027917814 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3180d2830 0x7fd3180b4720 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:25.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.893+0000 7fd3203ff700 1 -- 172.21.15.40:0/3027917814 >> 172.21.15.40:0/3027917814 conn(0x7fd3180cf720 msgr2=0x7fd3180cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:25.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.893+0000 7fd3203ff700 1 -- 172.21.15.40:0/3027917814 shutdown_connections 2023-06-22T10:53:25.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.893+0000 7fd3203ff700 1 -- 172.21.15.40:0/3027917814 wait complete. 2023-06-22T10:53:25.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.895+0000 7fd3203ff700 1 Processor -- start 2023-06-22T10:53:25.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.895+0000 7fd3203ff700 1 -- start start 2023-06-22T10:53:25.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.896+0000 7fd3203ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd3180b4c60 0x7fd3181f4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:25.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.896+0000 7fd3203ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3180d2830 0x7fd3181f2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:25.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.896+0000 7fd3203ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd31815c720 0x7fd3180b7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:25.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.896+0000 7fd3203ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3181f5120 con 0x7fd3180d2830 2023-06-22T10:53:25.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.896+0000 7fd3203ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3180a95e0 con 0x7fd31815c720 2023-06-22T10:53:25.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.896+0000 7fd3203ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3180aa160 con 0x7fd3180b4c60 2023-06-22T10:53:25.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.896+0000 7fd31d99a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3180d2830 0x7fd3181f2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:25.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.896+0000 7fd31d99a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3180d2830 0x7fd3181f2eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53914/0 (socket says 172.21.15.40:53914) 2023-06-22T10:53:25.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.896+0000 7fd31d99a700 1 -- 172.21.15.40:0/345175207 learned_addr learned my addr 172.21.15.40:0/345175207 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:25.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.897+0000 7fd31e19b700 1 --2- 172.21.15.40:0/345175207 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd3180b4c60 0x7fd3181f4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:25.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.897+0000 7fd31e99c700 1 --2- 172.21.15.40:0/345175207 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd31815c720 0x7fd3180b7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:25.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.897+0000 7fd31d99a700 1 -- 172.21.15.40:0/345175207 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd3180b4c60 msgr2=0x7fd3181f4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:25.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.897+0000 7fd31d99a700 1 --2- 172.21.15.40:0/345175207 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd3180b4c60 0x7fd3181f4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:25.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.897+0000 7fd31d99a700 1 -- 172.21.15.40:0/345175207 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd31815c720 msgr2=0x7fd3180b7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:25.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.897+0000 7fd31d99a700 1 --2- 172.21.15.40:0/345175207 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd31815c720 0x7fd3180b7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:25.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.897+0000 7fd31d99a700 1 -- 172.21.15.40:0/345175207 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd310009a70 con 0x7fd3180d2830 2023-06-22T10:53:25.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.897+0000 7fd31e99c700 1 --2- 172.21.15.40:0/345175207 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd31815c720 0x7fd3180b7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-22T10:53:25.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.897+0000 7fd31d99a700 1 --2- 172.21.15.40:0/345175207 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3180d2830 0x7fd3181f2eb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd308009c70 tx=0x7fd308004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:25.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.897+0000 7fd30effd700 1 -- 172.21.15.40:0/345175207 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd308004400 con 0x7fd3180d2830 2023-06-22T10:53:25.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.897+0000 7fd30effd700 1 -- 172.21.15.40:0/345175207 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd30801f070 con 0x7fd3180d2830 2023-06-22T10:53:25.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.897+0000 7fd3203ff700 1 -- 172.21.15.40:0/345175207 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd308009550 con 0x7fd3180d2830 2023-06-22T10:53:25.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.897+0000 7fd30effd700 1 -- 172.21.15.40:0/345175207 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3080038e0 con 0x7fd3180d2830 2023-06-22T10:53:25.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.897+0000 7fd3203ff700 1 -- 172.21.15.40:0/345175207 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3181f33f0 con 0x7fd3180d2830 2023-06-22T10:53:25.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.899+0000 7fd3203ff700 1 -- 172.21.15.40:0/345175207 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd318067580 con 0x7fd3180d2830 2023-06-22T10:53:25.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.899+0000 7fd30effd700 1 -- 172.21.15.40:0/345175207 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd308021030 con 0x7fd3180d2830 2023-06-22T10:53:25.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.900+0000 7fd30effd700 1 --2- 172.21.15.40:0/345175207 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fd2fc06ace0 0x7fd2fc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:25.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.901+0000 7fd30effd700 1 -- 172.21.15.40:0/345175207 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd30808a380 con 0x7fd3180d2830 2023-06-22T10:53:25.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.901+0000 7fd31e19b700 1 --2- 172.21.15.40:0/345175207 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fd2fc06ace0 0x7fd2fc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:25.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.901+0000 7fd31e19b700 1 --2- 172.21.15.40:0/345175207 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fd2fc06ace0 0x7fd2fc06d190 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd314000f60 tx=0x7fd314009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:25.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:25.905+0000 7fd30effd700 1 -- 172.21.15.40:0/345175207 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd308055770 con 0x7fd3180d2830 2023-06-22T10:53:26.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.113+0000 7fd3203ff700 1 -- 172.21.15.40:0/345175207 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd3180aa2a0 con 0x7fd3180d2830 2023-06-22T10:53:26.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.114+0000 7fd30effd700 1 -- 172.21.15.40:0/345175207 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+14565 (secure 0 0 0) 0x7fd308058d90 con 0x7fd3180d2830 2023-06-22T10:53:26.118 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:53:26.118 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":19,"fsid":"475560bc-1a7c-4a75-b3b6-6fc6b20bdc52","created":"2023-06-22T10:53:03.784568+0000","modified":"2023-06-22T10:53:25.614412+0000","last_up_change":"2023-06-22T10:53:17.830348+0000","last_in_change":"2023-06-22T10:53:07.329974+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-22T10:53:17.182228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-22T10:53:23.874432+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"918db6b4-053a-46ba-976d-6e1a0104017f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6809","nonce":2400162888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6811","nonce":2400162888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6815","nonce":2400162888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6813","nonce":2400162888}]},"public_addr":"172.21.15.40:6809/2400162888","cluster_addr":"172.21.15.40:6811/2400162888","heartbeat_back_addr":"172.21.15.40:6815/2400162888","heartbeat_front_addr":"172.21.15.40:6813/2400162888","state":["exists","up"]},{"osd":1,"uuid":"0c146e2b-1725-4dae-9b5c-38795943b9d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6801","nonce":230885800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6803","nonce":230885800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6807","nonce":230885800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6805","nonce":230885800}]},"public_addr":"172.21.15.40:6801/230885800","cluster_addr":"172.21.15.40:6803/230885800","heartbeat_back_addr":"172.21.15.40:6807/230885800","heartbeat_front_addr":"172.21.15.40:6805/230885800","state":["exists","up"]},{"osd":2,"uuid":"0b3727fd-f281-46d5-a675-86c8c5ab269e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6817","nonce":2681404929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6819","nonce":2681404929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6823","nonce":2681404929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6821","nonce":2681404929}]},"public_addr":"172.21.15.40:6817/2681404929","cluster_addr":"172.21.15.40:6819/2681404929","heartbeat_back_addr":"172.21.15.40:6823/2681404929","heartbeat_front_addr":"172.21.15.40:6821/2681404929","state":["exists","up"]},{"osd":3,"uuid":"2969c698-7039-4bbb-beda-f756f7a368a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6825","nonce":111110981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6827","nonce":111110981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6831","nonce":111110981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6829","nonce":111110981}]},"public_addr":"172.21.15.40:6825/111110981","cluster_addr":"172.21.15.40:6827/111110981","heartbeat_back_addr":"172.21.15.40:6831/111110981","heartbeat_front_addr":"172.21.15.40:6829/111110981","state":["exists","up"]},{"osd":4,"uuid":"3bb1d9c8-8e42-4a6b-998d-04834f34be5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6801","nonce":3625455711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6803","nonce":3625455711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6807","nonce":3625455711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6805","nonce":3625455711}]},"public_addr":"172.21.15.45:6801/3625455711","cluster_addr":"172.21.15.45:6803/3625455711","heartbeat_back_addr":"172.21.15.45:6807/3625455711","heartbeat_front_addr":"172.21.15.45:6805/3625455711","state":["exists","up"]},{"osd":5,"uuid":"f9854ee4-302c-41be-977b-bedda090a3d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6817","nonce":3354411217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6819","nonce":3354411217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6823","nonce":3354411217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6821","nonce":3354411217}]},"public_addr":"172.21.15.45:6817/3354411217","cluster_addr":"172.21.15.45:6819/3354411217","heartbeat_back_addr":"172.21.15.45:6823/3354411217","heartbeat_front_addr":"172.21.15.45:6821/3354411217","state":["exists","up"]},{"osd":6,"uuid":"bbdb1989-f6ac-4954-9b85-b8b540d683c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6809","nonce":320111074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6811","nonce":320111074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6815","nonce":320111074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6813","nonce":320111074}]},"public_addr":"172.21.15.45:6809/320111074","cluster_addr":"172.21.15.45:6811/320111074","heartbeat_back_addr":"172.21.15.45:6815/320111074","heartbeat_front_addr":"172.21.15.45:6813/320111074","state":["exists","up"]},{"osd":7,"uuid":"823d44e3-58f1-4d1d-8263-a4e4a69d4327","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6825","nonce":643617680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6827","nonce":643617680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6831","nonce":643617680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6829","nonce":643617680}]},"public_addr":"172.21.15.45:6825/643617680","cluster_addr":"172.21.15.45:6827/643617680","heartbeat_back_addr":"172.21.15.45:6831/643617680","heartbeat_front_addr":"172.21.15.45:6829/643617680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.731262+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.873226+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.898936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.666578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.645990+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.953699+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.642823+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.693395+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-22T10:53:26.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.116+0000 7fd3203ff700 1 -- 172.21.15.40:0/345175207 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fd2fc06ace0 msgr2=0x7fd2fc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:26.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.116+0000 7fd3203ff700 1 --2- 172.21.15.40:0/345175207 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fd2fc06ace0 0x7fd2fc06d190 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd314000f60 tx=0x7fd314009040 comp rx=0 tx=0).stop 2023-06-22T10:53:26.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.116+0000 7fd3203ff700 1 -- 172.21.15.40:0/345175207 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3180d2830 msgr2=0x7fd3181f2eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:26.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.116+0000 7fd3203ff700 1 --2- 172.21.15.40:0/345175207 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3180d2830 0x7fd3181f2eb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd308009c70 tx=0x7fd308004750 comp rx=0 tx=0).stop 2023-06-22T10:53:26.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.116+0000 7fd3203ff700 1 -- 172.21.15.40:0/345175207 shutdown_connections 2023-06-22T10:53:26.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.116+0000 7fd3203ff700 1 --2- 172.21.15.40:0/345175207 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fd2fc06ace0 0x7fd2fc06d190 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:26.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.116+0000 7fd3203ff700 1 --2- 172.21.15.40:0/345175207 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd3180b4c60 0x7fd3181f4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:26.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.116+0000 7fd3203ff700 1 --2- 172.21.15.40:0/345175207 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd31815c720 0x7fd3180b7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:26.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.116+0000 7fd3203ff700 1 --2- 172.21.15.40:0/345175207 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3180d2830 0x7fd3181f2eb0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:26.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.116+0000 7fd3203ff700 1 -- 172.21.15.40:0/345175207 >> 172.21.15.40:0/345175207 conn(0x7fd3180cf720 msgr2=0x7fd3180b3b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:26.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.116+0000 7fd3203ff700 1 -- 172.21.15.40:0/345175207 shutdown_connections 2023-06-22T10:53:26.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.116+0000 7fd3203ff700 1 -- 172.21.15.40:0/345175207 wait complete. 2023-06-22T10:53:26.139 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-22T10:53:17.182228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-22T10:53:23.874432+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-22T10:53:26.140 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-22T10:53:26.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.341+0000 7fa2a39ff700 1 Processor -- start 2023-06-22T10:53:26.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.341+0000 7fa2a39ff700 1 -- start start 2023-06-22T10:53:26.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.343+0000 7fa2a39ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa29c089590 0x7fa29c0ccd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:26.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.343+0000 7fa2a39ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa29c0c9ab0 0x7fa29c0c9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:26.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.343+0000 7fa2a39ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa29c0ccaa0 con 0x7fa29c16c620 2023-06-22T10:53:26.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.343+0000 7fa2a39ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa29c0cc370 con 0x7fa29c0c9ab0 2023-06-22T10:53:26.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.343+0000 7fa2a39ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c0ca850 con 0x7fa29c089590 2023-06-22T10:53:26.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.343+0000 7fa2a1f9c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa29c0c9ab0 0x7fa29c0c9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:26.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.343+0000 7fa2a1f9c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa29c0c9ab0 0x7fa29c0c9f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53926/0 (socket says 172.21.15.40:53926) 2023-06-22T10:53:26.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.343+0000 7fa2a1f9c700 1 -- 172.21.15.40:0/1188127123 learned_addr learned my addr 172.21.15.40:0/1188127123 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:26.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.343+0000 7fa2a0f9a700 1 --2- 172.21.15.40:0/1188127123 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa29c089590 0x7fa29c0ccd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:26.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.343+0000 7fa293fff700 1 -- 172.21.15.40:0/1188127123 <== mon.1 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2060483518 0 0) 0x7fa29c0ccaa0 con 0x7fa29c16c620 2023-06-22T10:53:26.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.382+0000 7fa293fff700 1 -- 172.21.15.40:0/1188127123 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa288003590 con 0x7fa29c16c620 2023-06-22T10:53:26.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.382+0000 7fa2a1f9c700 1 -- 172.21.15.40:0/1188127123 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa29c089590 msgr2=0x7fa29c0ccd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:26.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.382+0000 7fa2a1f9c700 1 --2- 172.21.15.40:0/1188127123 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa29c089590 0x7fa29c0ccd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:26.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.382+0000 7fa2a1f9c700 1 -- 172.21.15.40:0/1188127123 >> v1:172.21.15.45:6789/0 conn(0x7fa29c16c620 legacy=0x7fa29c0c3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:26.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.382+0000 7fa2a1f9c700 1 -- 172.21.15.40:0/1188127123 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa29c0cab30 con 0x7fa29c0c9ab0 2023-06-22T10:53:26.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.382+0000 7fa2a1f9c700 1 --2- 172.21.15.40:0/1188127123 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa29c0c9ab0 0x7fa29c0c9f30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa2940083f0 tx=0x7fa294013b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92e50ca02bade878 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:26.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.382+0000 7fa293fff700 1 -- 172.21.15.40:0/1188127123 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa294003a20 con 0x7fa29c0c9ab0 2023-06-22T10:53:26.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.382+0000 7fa293fff700 1 -- 172.21.15.40:0/1188127123 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa294003b80 con 0x7fa29c0c9ab0 2023-06-22T10:53:26.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.382+0000 7fa293fff700 1 -- 172.21.15.40:0/1188127123 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa294004030 con 0x7fa29c0c9ab0 2023-06-22T10:53:26.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.382+0000 7fa2a39ff700 1 -- 172.21.15.40:0/1188127123 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa29c0c9ab0 msgr2=0x7fa29c0c9f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:26.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.382+0000 7fa2a39ff700 1 --2- 172.21.15.40:0/1188127123 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa29c0c9ab0 0x7fa29c0c9f30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa2940083f0 tx=0x7fa294013b30 comp rx=0 tx=0).stop 2023-06-22T10:53:26.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.383+0000 7fa2a39ff700 1 -- 172.21.15.40:0/1188127123 shutdown_connections 2023-06-22T10:53:26.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.383+0000 7fa2a39ff700 1 --2- 172.21.15.40:0/1188127123 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa29c0c9ab0 0x7fa29c0c9f30 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:26.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.383+0000 7fa2a39ff700 1 --2- 172.21.15.40:0/1188127123 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa29c089590 0x7fa29c0ccd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:26.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.383+0000 7fa2a39ff700 1 -- 172.21.15.40:0/1188127123 >> 172.21.15.40:0/1188127123 conn(0x7fa29c0b1040 msgr2=0x7fa29c0ce7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:26.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.383+0000 7fa2a39ff700 1 -- 172.21.15.40:0/1188127123 shutdown_connections 2023-06-22T10:53:26.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.383+0000 7fa2a39ff700 1 -- 172.21.15.40:0/1188127123 wait complete. 2023-06-22T10:53:26.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.385+0000 7fa2a39ff700 1 Processor -- start 2023-06-22T10:53:26.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.385+0000 7fa2a39ff700 1 -- start start 2023-06-22T10:53:26.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.386+0000 7fa2a39ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa29c089590 0x7fa29c0c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:26.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.386+0000 7fa2a39ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa29c0c9ab0 0x7fa29c15cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:26.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.386+0000 7fa2a39ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa29c16c620 0x7fa29c1ff3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:26.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.386+0000 7fa2a39ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c1fe870 con 0x7fa29c16c620 2023-06-22T10:53:26.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.386+0000 7fa2a39ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c15d290 con 0x7fa29c0c9ab0 2023-06-22T10:53:26.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.386+0000 7fa2a39ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c1ff900 con 0x7fa29c089590 2023-06-22T10:53:26.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.386+0000 7fa2a1f9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa29c16c620 0x7fa29c1ff3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:26.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.386+0000 7fa2a1f9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa29c16c620 0x7fa29c1ff3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53932/0 (socket says 172.21.15.40:53932) 2023-06-22T10:53:26.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.386+0000 7fa2a1f9c700 1 -- 172.21.15.40:0/2205507916 learned_addr learned my addr 172.21.15.40:0/2205507916 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:26.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.386+0000 7fa2a179b700 1 --2- 172.21.15.40:0/2205507916 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa29c089590 0x7fa29c0c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:26.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.386+0000 7fa2a0f9a700 1 --2- 172.21.15.40:0/2205507916 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa29c0c9ab0 0x7fa29c15cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:26.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.386+0000 7fa2a179b700 1 -- 172.21.15.40:0/2205507916 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa29c0c9ab0 msgr2=0x7fa29c15cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:26.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.386+0000 7fa2a179b700 1 --2- 172.21.15.40:0/2205507916 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa29c0c9ab0 0x7fa29c15cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:26.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.386+0000 7fa2a179b700 1 -- 172.21.15.40:0/2205507916 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa29c16c620 msgr2=0x7fa29c1ff3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:26.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.386+0000 7fa2a179b700 1 --2- 172.21.15.40:0/2205507916 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa29c16c620 0x7fa29c1ff3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:26.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.386+0000 7fa2a179b700 1 -- 172.21.15.40:0/2205507916 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa29400ab50 con 0x7fa29c089590 2023-06-22T10:53:26.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.386+0000 7fa2a1f9c700 1 --2- 172.21.15.40:0/2205507916 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa29c16c620 0x7fa29c1ff3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-22T10:53:26.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.387+0000 7fa2a179b700 1 --2- 172.21.15.40:0/2205507916 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa29c089590 0x7fa29c0c8040 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa29800c450 tx=0x7fa29800c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:26.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.387+0000 7fa291ffb700 1 -- 172.21.15.40:0/2205507916 <== mon.2 v2:172.21.15.45:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2980052d0 con 0x7fa29c089590 2023-06-22T10:53:26.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.387+0000 7fa291ffb700 1 -- 172.21.15.40:0/2205507916 <== mon.2 v2:172.21.15.45:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa298005430 con 0x7fa29c089590 2023-06-22T10:53:26.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.387+0000 7fa2a39ff700 1 -- 172.21.15.40:0/2205507916 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa29c0b3030 con 0x7fa29c089590 2023-06-22T10:53:26.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.387+0000 7fa291ffb700 1 -- 172.21.15.40:0/2205507916 <== mon.2 v2:172.21.15.45:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2980038c0 con 0x7fa29c089590 2023-06-22T10:53:26.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.387+0000 7fa2a39ff700 1 -- 172.21.15.40:0/2205507916 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa29c0b35b0 con 0x7fa29c089590 2023-06-22T10:53:26.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.388+0000 7fa2a39ff700 1 -- 172.21.15.40:0/2205507916 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa29c067580 con 0x7fa29c089590 2023-06-22T10:53:26.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.389+0000 7fa291ffb700 1 -- 172.21.15.40:0/2205507916 <== mon.2 v2:172.21.15.45:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa298003a20 con 0x7fa29c089590 2023-06-22T10:53:26.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.390+0000 7fa291ffb700 1 --2- 172.21.15.40:0/2205507916 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fa28006ace0 0x7fa28006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:26.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.390+0000 7fa291ffb700 1 -- 172.21.15.40:0/2205507916 <== mon.2 v2:172.21.15.45:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa298088560 con 0x7fa29c089590 2023-06-22T10:53:26.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.390+0000 7fa2a0f9a700 1 --2- 172.21.15.40:0/2205507916 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fa28006ace0 0x7fa28006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:26.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.391+0000 7fa2a0f9a700 1 --2- 172.21.15.40:0/2205507916 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fa28006ace0 0x7fa28006d190 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa29c06e620 tx=0x7fa28c00e040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:26.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.396+0000 7fa291ffb700 1 -- 172.21.15.40:0/2205507916 <== mon.2 v2:172.21.15.45:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa298053980 con 0x7fa29c089590 2023-06-22T10:53:26.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.599+0000 7fa2a39ff700 1 -- 172.21.15.40:0/2205507916 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa29c169860 con 0x7fa29c089590 2023-06-22T10:53:26.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.600+0000 7fa291ffb700 1 -- 172.21.15.40:0/2205507916 <== mon.2 v2:172.21.15.45:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa29800ce60 con 0x7fa29c089590 2023-06-22T10:53:26.603 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-06-22T10:53:26.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.602+0000 7fa2a39ff700 1 -- 172.21.15.40:0/2205507916 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fa28006ace0 msgr2=0x7fa28006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:26.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.602+0000 7fa2a39ff700 1 --2- 172.21.15.40:0/2205507916 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fa28006ace0 0x7fa28006d190 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa29c06e620 tx=0x7fa28c00e040 comp rx=0 tx=0).stop 2023-06-22T10:53:26.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.602+0000 7fa2a39ff700 1 -- 172.21.15.40:0/2205507916 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa29c089590 msgr2=0x7fa29c0c8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:26.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.602+0000 7fa2a39ff700 1 --2- 172.21.15.40:0/2205507916 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa29c089590 0x7fa29c0c8040 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa29800c450 tx=0x7fa29800c760 comp rx=0 tx=0).stop 2023-06-22T10:53:26.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.602+0000 7fa2a39ff700 1 -- 172.21.15.40:0/2205507916 shutdown_connections 2023-06-22T10:53:26.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.602+0000 7fa2a39ff700 1 --2- 172.21.15.40:0/2205507916 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fa28006ace0 0x7fa28006d190 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:26.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.602+0000 7fa2a39ff700 1 --2- 172.21.15.40:0/2205507916 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa29c089590 0x7fa29c0c8040 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:26.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.602+0000 7fa2a39ff700 1 --2- 172.21.15.40:0/2205507916 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa29c16c620 0x7fa29c1ff3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:26.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.602+0000 7fa2a39ff700 1 --2- 172.21.15.40:0/2205507916 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa29c0c9ab0 0x7fa29c15cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:26.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.602+0000 7fa2a39ff700 1 -- 172.21.15.40:0/2205507916 >> 172.21.15.40:0/2205507916 conn(0x7fa29c0b1040 msgr2=0x7fa29c0ce670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:26.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.602+0000 7fa2a39ff700 1 -- 172.21.15.40:0/2205507916 shutdown_connections 2023-06-22T10:53:26.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.602+0000 7fa2a39ff700 1 -- 172.21.15.40:0/2205507916 wait complete. 2023-06-22T10:53:26.624 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-22T10:53:26.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.824+0000 7f63f61ff700 1 Processor -- start 2023-06-22T10:53:26.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.824+0000 7f63f61ff700 1 -- start start 2023-06-22T10:53:26.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.826+0000 7f63f61ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f63f00b59a0 0x7f63f00b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:26.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.826+0000 7f63f61ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63f00d1be0 con 0x7f63f00d2130 2023-06-22T10:53:26.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.826+0000 7f63f61ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63f00d1360 con 0x7f63f00b45d0 2023-06-22T10:53:26.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.826+0000 7f63f61ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63f00d17f0 con 0x7f63f00b59a0 2023-06-22T10:53:26.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.826+0000 7f63eeffd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f63f00d2130 0x7f63f00cd1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:56164/0 (socket says 172.21.15.40:56164) 2023-06-22T10:53:26.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.826+0000 7f63eeffd700 1 -- 172.21.15.40:0/2032467282 learned_addr learned my addr 172.21.15.40:0/2032467282 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:53:26.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.826+0000 7f63effff700 1 --2- 172.21.15.40:0/2032467282 >> v2:172.21.15.40:3300/0 conn(0x7f63f00b59a0 0x7f63f00b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:26.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.827+0000 7f63effff700 1 -- 172.21.15.40:0/2032467282 >> v1:172.21.15.45:6789/0 conn(0x7f63f00b45d0 legacy=0x7f63f00b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:26.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.827+0000 7f63effff700 1 -- 172.21.15.40:0/2032467282 >> v1:172.21.15.40:6789/0 conn(0x7f63f00d2130 legacy=0x7f63f00cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:26.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.827+0000 7f63effff700 1 -- 172.21.15.40:0/2032467282 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f00cef40 con 0x7f63f00b59a0 2023-06-22T10:53:26.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.827+0000 7f63effff700 1 --2- 172.21.15.40:0/2032467282 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63f00b59a0 0x7f63f00b5e40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f63e8009d90 tx=0x7f63e800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddd174ba4d4aa16e server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:26.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.827+0000 7f63ee7fc700 1 -- 172.21.15.40:0/2032467282 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e800e070 con 0x7f63f00b59a0 2023-06-22T10:53:26.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.827+0000 7f63ee7fc700 1 -- 172.21.15.40:0/2032467282 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e800bad0 con 0x7f63f00b59a0 2023-06-22T10:53:26.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.827+0000 7f63ee7fc700 1 -- 172.21.15.40:0/2032467282 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e800be80 con 0x7f63f00b59a0 2023-06-22T10:53:26.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.828+0000 7f63f61ff700 1 -- 172.21.15.40:0/2032467282 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63f00b59a0 msgr2=0x7f63f00b5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:26.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.828+0000 7f63f61ff700 1 --2- 172.21.15.40:0/2032467282 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63f00b59a0 0x7f63f00b5e40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f63e8009d90 tx=0x7f63e800b330 comp rx=0 tx=0).stop 2023-06-22T10:53:26.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.828+0000 7f63f61ff700 1 -- 172.21.15.40:0/2032467282 shutdown_connections 2023-06-22T10:53:26.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.828+0000 7f63f61ff700 1 --2- 172.21.15.40:0/2032467282 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63f00b59a0 0x7f63f00b5e40 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:26.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.828+0000 7f63f61ff700 1 -- 172.21.15.40:0/2032467282 >> 172.21.15.40:0/2032467282 conn(0x7f63f00cf5d0 msgr2=0x7f63f00cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:26.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.828+0000 7f63f61ff700 1 -- 172.21.15.40:0/2032467282 shutdown_connections 2023-06-22T10:53:26.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.828+0000 7f63f61ff700 1 -- 172.21.15.40:0/2032467282 wait complete. 2023-06-22T10:53:26.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.831+0000 7f63f61ff700 1 Processor -- start 2023-06-22T10:53:26.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.831+0000 7f63f61ff700 1 -- start start 2023-06-22T10:53:26.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.832+0000 7f63f61ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f63f00b45d0 0x7f63f00a9d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:26.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.832+0000 7f63f61ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63f00b59a0 0x7f63f01f4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:26.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.832+0000 7f63f61ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63f00d2130 0x7f63f01f52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:26.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.832+0000 7f63f61ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f015f000 con 0x7f63f00d2130 2023-06-22T10:53:26.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.832+0000 7f63f61ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f015e480 con 0x7f63f00b59a0 2023-06-22T10:53:26.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.832+0000 7f63f61ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63f015e760 con 0x7f63f00b45d0 2023-06-22T10:53:26.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.832+0000 7f63effff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63f00d2130 0x7f63f01f52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:26.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.832+0000 7f63effff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63f00d2130 0x7f63f01f52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53950/0 (socket says 172.21.15.40:53950) 2023-06-22T10:53:26.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.832+0000 7f63effff700 1 -- 172.21.15.40:0/1955112570 learned_addr learned my addr 172.21.15.40:0/1955112570 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:26.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.833+0000 7f63eeffd700 1 --2- 172.21.15.40:0/1955112570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63f00b59a0 0x7f63f01f4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:26.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.833+0000 7f63ef7fe700 1 --2- 172.21.15.40:0/1955112570 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f63f00b45d0 0x7f63f00a9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:26.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.833+0000 7f63effff700 1 -- 172.21.15.40:0/1955112570 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f63f00b45d0 msgr2=0x7f63f00a9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:26.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.833+0000 7f63effff700 1 --2- 172.21.15.40:0/1955112570 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f63f00b45d0 0x7f63f00a9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:26.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.833+0000 7f63effff700 1 -- 172.21.15.40:0/1955112570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63f00b59a0 msgr2=0x7f63f01f4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:26.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.833+0000 7f63effff700 1 --2- 172.21.15.40:0/1955112570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63f00b59a0 0x7f63f01f4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:26.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.833+0000 7f63effff700 1 -- 172.21.15.40:0/1955112570 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e8009a70 con 0x7f63f00d2130 2023-06-22T10:53:26.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.833+0000 7f63ef7fe700 1 --2- 172.21.15.40:0/1955112570 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f63f00b45d0 0x7f63f00a9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:53:26.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.833+0000 7f63effff700 1 --2- 172.21.15.40:0/1955112570 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63f00d2130 0x7f63f01f52b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f63f006a0c0 tx=0x7f63e8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:26.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.833+0000 7f63d7fff700 1 -- 172.21.15.40:0/1955112570 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e8012630 con 0x7f63f00d2130 2023-06-22T10:53:26.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.833+0000 7f63d7fff700 1 -- 172.21.15.40:0/1955112570 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e8012790 con 0x7f63f00d2130 2023-06-22T10:53:26.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.833+0000 7f63d7fff700 1 -- 172.21.15.40:0/1955112570 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e8012b40 con 0x7f63f00d2130 2023-06-22T10:53:26.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.833+0000 7f63f61ff700 1 -- 172.21.15.40:0/1955112570 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63f015ea40 con 0x7f63f00d2130 2023-06-22T10:53:26.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.834+0000 7f63f61ff700 1 -- 172.21.15.40:0/1955112570 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63f00b15d0 con 0x7f63f00d2130 2023-06-22T10:53:26.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.835+0000 7f63d5ffb700 1 -- 172.21.15.40:0/1955112570 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63f0067580 con 0x7f63f00d2130 2023-06-22T10:53:26.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.837+0000 7f63d7fff700 1 -- 172.21.15.40:0/1955112570 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f63e8012ca0 con 0x7f63f00d2130 2023-06-22T10:53:26.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.837+0000 7f63d7fff700 1 --2- 172.21.15.40:0/1955112570 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f63dc06ace0 0x7f63dc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:26.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.837+0000 7f63d7fff700 1 -- 172.21.15.40:0/1955112570 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f63e808b210 con 0x7f63f00d2130 2023-06-22T10:53:26.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.837+0000 7f63ef7fe700 1 --2- 172.21.15.40:0/1955112570 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f63dc06ace0 0x7f63dc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:26.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.838+0000 7f63ef7fe700 1 --2- 172.21.15.40:0/1955112570 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f63dc06ace0 0x7f63dc06d190 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f63e00016e0 tx=0x7f63e0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:26.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:26.841+0000 7f63d7fff700 1 -- 172.21.15.40:0/1955112570 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f63e8056600 con 0x7f63f00d2130 2023-06-22T10:53:27.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.049+0000 7f63d5ffb700 1 -- 172.21.15.40:0/1955112570 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f63f00c98f0 con 0x7f63f00d2130 2023-06-22T10:53:27.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.049+0000 7f63d7fff700 1 -- 172.21.15.40:0/1955112570 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f63e8059c20 con 0x7f63f00d2130 2023-06-22T10:53:27.054 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 8 2023-06-22T10:53:27.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.051+0000 7f63d5ffb700 1 -- 172.21.15.40:0/1955112570 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f63dc06ace0 msgr2=0x7f63dc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:27.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.051+0000 7f63d5ffb700 1 --2- 172.21.15.40:0/1955112570 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f63dc06ace0 0x7f63dc06d190 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f63e00016e0 tx=0x7f63e0009040 comp rx=0 tx=0).stop 2023-06-22T10:53:27.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.051+0000 7f63d5ffb700 1 -- 172.21.15.40:0/1955112570 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63f00d2130 msgr2=0x7f63f01f52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:27.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.051+0000 7f63d5ffb700 1 --2- 172.21.15.40:0/1955112570 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63f00d2130 0x7f63f01f52b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f63f006a0c0 tx=0x7f63e8004ad0 comp rx=0 tx=0).stop 2023-06-22T10:53:27.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.052+0000 7f63d5ffb700 1 -- 172.21.15.40:0/1955112570 shutdown_connections 2023-06-22T10:53:27.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.052+0000 7f63d5ffb700 1 --2- 172.21.15.40:0/1955112570 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f63dc06ace0 0x7f63dc06d190 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:27.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.052+0000 7f63d5ffb700 1 --2- 172.21.15.40:0/1955112570 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f63f00b45d0 0x7f63f00a9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:27.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.052+0000 7f63d5ffb700 1 --2- 172.21.15.40:0/1955112570 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63f00d2130 0x7f63f01f52b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:27.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.052+0000 7f63d5ffb700 1 --2- 172.21.15.40:0/1955112570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63f00b59a0 0x7f63f01f4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:27.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.052+0000 7f63d5ffb700 1 -- 172.21.15.40:0/1955112570 >> 172.21.15.40:0/1955112570 conn(0x7f63f00cf5d0 msgr2=0x7f63f00d0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:27.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.052+0000 7f63d5ffb700 1 -- 172.21.15.40:0/1955112570 shutdown_connections 2023-06-22T10:53:27.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.052+0000 7f63d5ffb700 1 -- 172.21.15.40:0/1955112570 wait complete. 2023-06-22T10:53:27.073 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-22T10:53:27.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.272+0000 7f8bed5ff700 1 Processor -- start 2023-06-22T10:53:27.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.272+0000 7f8bed5ff700 1 -- start start 2023-06-22T10:53:27.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.272+0000 7f8bed5ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8be80d2830 0x7f8be80b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:27.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.272+0000 7f8bed5ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8be80b4c60 0x7f8be80d0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:27.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.272+0000 7f8bed5ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8be80b2130 con 0x7f8be815c720 2023-06-22T10:53:27.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.272+0000 7f8bed5ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8be8160d60 con 0x7f8be80b4c60 2023-06-22T10:53:27.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.272+0000 7f8bed5ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8be80b50e0 con 0x7f8be80d2830 2023-06-22T10:53:27.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.272+0000 7f8be6ffd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f8be815c720 0x7f8be80b1870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:56178/0 (socket says 172.21.15.40:56178) 2023-06-22T10:53:27.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.273+0000 7f8be6ffd700 1 -- 172.21.15.40:0/998177582 learned_addr learned my addr 172.21.15.40:0/998177582 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:53:27.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.273+0000 7f8be77fe700 1 --2- 172.21.15.40:0/998177582 >> v2:172.21.15.40:3300/0 conn(0x7f8be80b4c60 0x7f8be80d0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:27.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.273+0000 7f8be67fc700 1 --2- 172.21.15.40:0/998177582 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8be80d2830 0x7f8be80b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:27.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.273+0000 7f8be5ffb700 1 -- 172.21.15.40:0/998177582 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1731959326 0 0) 0x7f8be80b2130 con 0x7f8be815c720 2023-06-22T10:53:27.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.273+0000 7f8be5ffb700 1 -- 172.21.15.40:0/998177582 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bd00035b0 con 0x7f8be815c720 2023-06-22T10:53:27.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.273+0000 7f8be77fe700 1 -- 172.21.15.40:0/998177582 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8be80d2830 msgr2=0x7f8be80b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:27.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.273+0000 7f8be77fe700 1 --2- 172.21.15.40:0/998177582 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8be80d2830 0x7f8be80b4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:27.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.273+0000 7f8be77fe700 1 -- 172.21.15.40:0/998177582 >> v1:172.21.15.40:6789/0 conn(0x7f8be815c720 legacy=0x7f8be80b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:27.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.273+0000 7f8be77fe700 1 -- 172.21.15.40:0/998177582 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8be8161180 con 0x7f8be80b4c60 2023-06-22T10:53:27.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.273+0000 7f8be77fe700 1 --2- 172.21.15.40:0/998177582 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8be80b4c60 0x7f8be80d0d00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8be0009d90 tx=0x7f8be000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96c0b3f72fce1239 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:27.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.274+0000 7f8be5ffb700 1 -- 172.21.15.40:0/998177582 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be000e070 con 0x7f8be80b4c60 2023-06-22T10:53:27.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.274+0000 7f8be5ffb700 1 -- 172.21.15.40:0/998177582 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be000bb20 con 0x7f8be80b4c60 2023-06-22T10:53:27.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.274+0000 7f8be5ffb700 1 -- 172.21.15.40:0/998177582 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be0012430 con 0x7f8be80b4c60 2023-06-22T10:53:27.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.274+0000 7f8bed5ff700 1 -- 172.21.15.40:0/998177582 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8be80b4c60 msgr2=0x7f8be80d0d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:27.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.274+0000 7f8bed5ff700 1 --2- 172.21.15.40:0/998177582 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8be80b4c60 0x7f8be80d0d00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8be0009d90 tx=0x7f8be000b330 comp rx=0 tx=0).stop 2023-06-22T10:53:27.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.274+0000 7f8bed5ff700 1 -- 172.21.15.40:0/998177582 shutdown_connections 2023-06-22T10:53:27.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.274+0000 7f8bed5ff700 1 --2- 172.21.15.40:0/998177582 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8be80b4c60 0x7f8be80d0d00 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:27.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.274+0000 7f8bed5ff700 1 --2- 172.21.15.40:0/998177582 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8be80d2830 0x7f8be80b4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:27.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.274+0000 7f8bed5ff700 1 -- 172.21.15.40:0/998177582 >> 172.21.15.40:0/998177582 conn(0x7f8be80cf720 msgr2=0x7f8be80cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:27.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.274+0000 7f8bed5ff700 1 -- 172.21.15.40:0/998177582 shutdown_connections 2023-06-22T10:53:27.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.274+0000 7f8bed5ff700 1 -- 172.21.15.40:0/998177582 wait complete. 2023-06-22T10:53:27.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.276+0000 7f8bed5ff700 1 Processor -- start 2023-06-22T10:53:27.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.276+0000 7f8bed5ff700 1 -- start start 2023-06-22T10:53:27.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.277+0000 7f8bed5ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8be80b4c60 0x7f8be8158300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:27.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.277+0000 7f8bed5ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8be80d2830 0x7f8be80cb500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:27.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.277+0000 7f8bed5ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8be815c720 0x7f8be815cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:27.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.277+0000 7f8bed5ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be80ca780 con 0x7f8be80b4c60 2023-06-22T10:53:27.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.277+0000 7f8bed5ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be815d640 con 0x7f8be80d2830 2023-06-22T10:53:27.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.277+0000 7f8bed5ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8be80caa20 con 0x7f8be815c720 2023-06-22T10:53:27.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.277+0000 7f8be6ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8be80b4c60 0x7f8be8158300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:27.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.277+0000 7f8be6ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8be80b4c60 0x7f8be8158300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53982/0 (socket says 172.21.15.40:53982) 2023-06-22T10:53:27.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.277+0000 7f8be6ffd700 1 -- 172.21.15.40:0/355906640 learned_addr learned my addr 172.21.15.40:0/355906640 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:27.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.278+0000 7f8be67fc700 1 --2- 172.21.15.40:0/355906640 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8be80d2830 0x7f8be80cb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:27.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.278+0000 7f8be77fe700 1 --2- 172.21.15.40:0/355906640 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8be815c720 0x7f8be815cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:27.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.278+0000 7f8be6ffd700 1 -- 172.21.15.40:0/355906640 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8be815c720 msgr2=0x7f8be815cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:27.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.278+0000 7f8be6ffd700 1 --2- 172.21.15.40:0/355906640 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8be815c720 0x7f8be815cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:27.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.278+0000 7f8be6ffd700 1 -- 172.21.15.40:0/355906640 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8be80d2830 msgr2=0x7f8be80cb500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:27.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.278+0000 7f8be6ffd700 1 --2- 172.21.15.40:0/355906640 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8be80d2830 0x7f8be80cb500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:27.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.278+0000 7f8be6ffd700 1 -- 172.21.15.40:0/355906640 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8be0009a70 con 0x7f8be80b4c60 2023-06-22T10:53:27.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.278+0000 7f8be67fc700 1 --2- 172.21.15.40:0/355906640 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8be80d2830 0x7f8be80cb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-22T10:53:27.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.278+0000 7f8be6ffd700 1 --2- 172.21.15.40:0/355906640 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8be80b4c60 0x7f8be8158300 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8bd800c700 tx=0x7f8bd800cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:27.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.278+0000 7f8bcf7fe700 1 -- 172.21.15.40:0/355906640 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd8005d70 con 0x7f8be80b4c60 2023-06-22T10:53:27.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.278+0000 7f8bcf7fe700 1 -- 172.21.15.40:0/355906640 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bd80070d0 con 0x7f8be80b4c60 2023-06-22T10:53:27.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.278+0000 7f8bcf7fe700 1 -- 172.21.15.40:0/355906640 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd8007460 con 0x7f8be80b4c60 2023-06-22T10:53:27.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.278+0000 7f8bed5ff700 1 -- 172.21.15.40:0/355906640 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8be80cad00 con 0x7f8be80b4c60 2023-06-22T10:53:27.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.279+0000 7f8bed5ff700 1 -- 172.21.15.40:0/355906640 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8be80cba40 con 0x7f8be80b4c60 2023-06-22T10:53:27.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.280+0000 7f8bed5ff700 1 -- 172.21.15.40:0/355906640 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8be80ce080 con 0x7f8be80b4c60 2023-06-22T10:53:27.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.281+0000 7f8bcf7fe700 1 -- 172.21.15.40:0/355906640 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8bd80075c0 con 0x7f8be80b4c60 2023-06-22T10:53:27.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.281+0000 7f8bcf7fe700 1 --2- 172.21.15.40:0/355906640 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f8bd406ace0 0x7f8bd406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:27.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.282+0000 7f8bcf7fe700 1 -- 172.21.15.40:0/355906640 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8bd80887d0 con 0x7f8be80b4c60 2023-06-22T10:53:27.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.282+0000 7f8be67fc700 1 --2- 172.21.15.40:0/355906640 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f8bd406ace0 0x7f8bd406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:27.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.282+0000 7f8be67fc700 1 --2- 172.21.15.40:0/355906640 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f8bd406ace0 0x7f8bd406d190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8be80cd440 tx=0x7f8bdc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:27.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.287+0000 7f8bcf7fe700 1 -- 172.21.15.40:0/355906640 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8bd8053b40 con 0x7f8be80b4c60 2023-06-22T10:53:27.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.536+0000 7f8bed5ff700 1 -- 172.21.15.40:0/355906640 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8be8066e70 con 0x7f8be80b4c60 2023-06-22T10:53:27.540 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.537+0000 7f8bcf7fe700 1 -- 172.21.15.40:0/355906640 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3521 (secure 0 0 0) 0x7f8bd8017de0 con 0x7f8be80b4c60 2023-06-22T10:53:27.541 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:53:27.541 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/627935577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":627935577},{"type":"v1","addr":"172.21.15.40:6835","nonce":627935577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3018871402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3018871402},{"type":"v1","addr":"172.21.15.40:6837","nonce":3018871402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/4036649607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":4036649607},{"type":"v1","addr":"172.21.15.45:6834","nonce":4036649607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4303,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1579627519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":1579627519},{"type":"v1","addr":"172.21.15.45:6835","nonce":1579627519}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-06-22T10:53:27.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.539+0000 7f8bed5ff700 1 -- 172.21.15.40:0/355906640 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f8bd406ace0 msgr2=0x7f8bd406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:27.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.539+0000 7f8bed5ff700 1 --2- 172.21.15.40:0/355906640 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f8bd406ace0 0x7f8bd406d190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8be80cd440 tx=0x7f8bdc008040 comp rx=0 tx=0).stop 2023-06-22T10:53:27.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.539+0000 7f8bed5ff700 1 -- 172.21.15.40:0/355906640 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8be80b4c60 msgr2=0x7f8be8158300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:27.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.539+0000 7f8bed5ff700 1 --2- 172.21.15.40:0/355906640 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8be80b4c60 0x7f8be8158300 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8bd800c700 tx=0x7f8bd800cac0 comp rx=0 tx=0).stop 2023-06-22T10:53:27.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.539+0000 7f8bed5ff700 1 -- 172.21.15.40:0/355906640 shutdown_connections 2023-06-22T10:53:27.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.539+0000 7f8bed5ff700 1 --2- 172.21.15.40:0/355906640 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f8bd406ace0 0x7f8bd406d190 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:27.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.539+0000 7f8bed5ff700 1 --2- 172.21.15.40:0/355906640 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8be815c720 0x7f8be815cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:27.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.539+0000 7f8bed5ff700 1 --2- 172.21.15.40:0/355906640 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8be80b4c60 0x7f8be8158300 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:27.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.539+0000 7f8bed5ff700 1 --2- 172.21.15.40:0/355906640 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8be80d2830 0x7f8be80cb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:27.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.539+0000 7f8bed5ff700 1 -- 172.21.15.40:0/355906640 >> 172.21.15.40:0/355906640 conn(0x7f8be80cf720 msgr2=0x7f8be80b2690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:27.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.540+0000 7f8bed5ff700 1 -- 172.21.15.40:0/355906640 shutdown_connections 2023-06-22T10:53:27.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.540+0000 7f8bed5ff700 1 -- 172.21.15.40:0/355906640 wait complete. 2023-06-22T10:53:27.546 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 3 2023-06-22T10:53:27.560 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-22T10:53:27.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.759+0000 7f1d59dff700 1 Processor -- start 2023-06-22T10:53:27.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.759+0000 7f1d59dff700 1 -- start start 2023-06-22T10:53:27.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.759+0000 7f1d59dff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1d540d2830 0x7f1d540b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:27.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.759+0000 7f1d59dff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1d540b4c60 0x7f1d540d0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:27.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.759+0000 7f1d59dff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d540b2130 con 0x7f1d5415c720 2023-06-22T10:53:27.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.759+0000 7f1d59dff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d54160d60 con 0x7f1d540d2830 2023-06-22T10:53:27.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.759+0000 7f1d59dff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d540b50e0 con 0x7f1d540b4c60 2023-06-22T10:53:27.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.760+0000 7f1d52ffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1d540d2830 0x7f1d540b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:27.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.760+0000 7f1d537fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f1d5415c720 0x7f1d540b1870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:56180/0 (socket says 172.21.15.40:56180) 2023-06-22T10:53:27.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.760+0000 7f1d537fe700 1 -- 172.21.15.40:0/3697747200 learned_addr learned my addr 172.21.15.40:0/3697747200 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:53:27.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.760+0000 7f1d53fff700 1 --2- 172.21.15.40:0/3697747200 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1d540b4c60 0x7f1d540d0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:27.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.760+0000 7f1d52ffd700 1 -- 172.21.15.40:0/3697747200 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1d540b4c60 msgr2=0x7f1d540d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:27.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.760+0000 7f1d52ffd700 1 --2- 172.21.15.40:0/3697747200 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1d540b4c60 0x7f1d540d0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:27.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.760+0000 7f1d52ffd700 1 -- 172.21.15.40:0/3697747200 >> v1:172.21.15.40:6789/0 conn(0x7f1d5415c720 legacy=0x7f1d540b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:27.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.760+0000 7f1d52ffd700 1 -- 172.21.15.40:0/3697747200 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d54161180 con 0x7f1d540d2830 2023-06-22T10:53:27.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.760+0000 7f1d527fc700 1 -- 172.21.15.40:0/3697747200 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1666451863 0 0) 0x7f1d540b2130 con 0x7f1d5415c720 2023-06-22T10:53:27.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.760+0000 7f1d52ffd700 1 --2- 172.21.15.40:0/3697747200 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d540d2830 0x7f1d540b4720 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1d48009870 tx=0x7f1d48009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9512af74a731b9a1 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:27.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.761+0000 7f1d527fc700 1 -- 172.21.15.40:0/3697747200 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d48011830 con 0x7f1d540d2830 2023-06-22T10:53:27.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.761+0000 7f1d527fc700 1 -- 172.21.15.40:0/3697747200 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d48011990 con 0x7f1d540d2830 2023-06-22T10:53:27.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.761+0000 7f1d527fc700 1 -- 172.21.15.40:0/3697747200 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d48011d20 con 0x7f1d540d2830 2023-06-22T10:53:27.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.761+0000 7f1d59dff700 1 -- 172.21.15.40:0/3697747200 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d540d2830 msgr2=0x7f1d540b4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:27.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.761+0000 7f1d59dff700 1 --2- 172.21.15.40:0/3697747200 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d540d2830 0x7f1d540b4720 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1d48009870 tx=0x7f1d48009b80 comp rx=0 tx=0).stop 2023-06-22T10:53:27.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.761+0000 7f1d59dff700 1 -- 172.21.15.40:0/3697747200 shutdown_connections 2023-06-22T10:53:27.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.761+0000 7f1d59dff700 1 --2- 172.21.15.40:0/3697747200 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1d540b4c60 0x7f1d540d0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:27.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.761+0000 7f1d59dff700 1 --2- 172.21.15.40:0/3697747200 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d540d2830 0x7f1d540b4720 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:27.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.761+0000 7f1d59dff700 1 -- 172.21.15.40:0/3697747200 >> 172.21.15.40:0/3697747200 conn(0x7f1d540cf720 msgr2=0x7f1d540cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:27.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.761+0000 7f1d59dff700 1 -- 172.21.15.40:0/3697747200 shutdown_connections 2023-06-22T10:53:27.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.761+0000 7f1d59dff700 1 -- 172.21.15.40:0/3697747200 wait complete. 2023-06-22T10:53:27.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.763+0000 7f1d59dff700 1 Processor -- start 2023-06-22T10:53:27.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.763+0000 7f1d59dff700 1 -- start start 2023-06-22T10:53:27.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.764+0000 7f1d59dff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d540b4c60 0x7f1d5415caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:27.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.764+0000 7f1d59dff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1d540d2830 0x7f1d540c9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:27.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.764+0000 7f1d59dff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d5415c720 0x7f1d540ca2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:27.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.764+0000 7f1d59dff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5415d460 con 0x7f1d5415c720 2023-06-22T10:53:27.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.764+0000 7f1d59dff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5415d740 con 0x7f1d540b4c60 2023-06-22T10:53:27.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.764+0000 7f1d59dff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5415da20 con 0x7f1d540d2830 2023-06-22T10:53:27.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.764+0000 7f1d53fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d5415c720 0x7f1d540ca2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:27.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.764+0000 7f1d53fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d5415c720 0x7f1d540ca2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54008/0 (socket says 172.21.15.40:54008) 2023-06-22T10:53:27.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.764+0000 7f1d53fff700 1 -- 172.21.15.40:0/2400247068 learned_addr learned my addr 172.21.15.40:0/2400247068 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:27.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.765+0000 7f1d537fe700 1 --2- 172.21.15.40:0/2400247068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d540b4c60 0x7f1d5415caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:27.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.765+0000 7f1d52ffd700 1 --2- 172.21.15.40:0/2400247068 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1d540d2830 0x7f1d540c9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:27.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.765+0000 7f1d53fff700 1 -- 172.21.15.40:0/2400247068 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1d540d2830 msgr2=0x7f1d540c9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:27.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.765+0000 7f1d53fff700 1 --2- 172.21.15.40:0/2400247068 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1d540d2830 0x7f1d540c9d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:27.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.765+0000 7f1d53fff700 1 -- 172.21.15.40:0/2400247068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d540b4c60 msgr2=0x7f1d5415caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:27.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.765+0000 7f1d53fff700 1 --2- 172.21.15.40:0/2400247068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d540b4c60 0x7f1d5415caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:27.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.765+0000 7f1d53fff700 1 -- 172.21.15.40:0/2400247068 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d480094a0 con 0x7f1d5415c720 2023-06-22T10:53:27.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.765+0000 7f1d53fff700 1 --2- 172.21.15.40:0/2400247068 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d5415c720 0x7f1d540ca2b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c007e40 tx=0x7f1d4c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:27.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.765+0000 7f1d3bfff700 1 -- 172.21.15.40:0/2400247068 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c00eea0 con 0x7f1d5415c720 2023-06-22T10:53:27.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.765+0000 7f1d3bfff700 1 -- 172.21.15.40:0/2400247068 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d4c014420 con 0x7f1d5415c720 2023-06-22T10:53:27.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.765+0000 7f1d3bfff700 1 -- 172.21.15.40:0/2400247068 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c0147b0 con 0x7f1d5415c720 2023-06-22T10:53:27.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.765+0000 7f1d59dff700 1 -- 172.21.15.40:0/2400247068 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d5415dd00 con 0x7f1d5415c720 2023-06-22T10:53:27.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.765+0000 7f1d59dff700 1 -- 172.21.15.40:0/2400247068 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d5415d030 con 0x7f1d5415c720 2023-06-22T10:53:27.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.766+0000 7f1d59dff700 1 -- 172.21.15.40:0/2400247068 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d5415e220 con 0x7f1d5415c720 2023-06-22T10:53:27.779 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.767+0000 7f1d3bfff700 1 -- 172.21.15.40:0/2400247068 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1d4c014910 con 0x7f1d5415c720 2023-06-22T10:53:27.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.768+0000 7f1d3bfff700 1 --2- 172.21.15.40:0/2400247068 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f1d4006ace0 0x7f1d4006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:27.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.768+0000 7f1d3bfff700 1 -- 172.21.15.40:0/2400247068 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f1d4c089a10 con 0x7f1d5415c720 2023-06-22T10:53:27.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.768+0000 7f1d537fe700 1 --2- 172.21.15.40:0/2400247068 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f1d4006ace0 0x7f1d4006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:27.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.769+0000 7f1d537fe700 1 --2- 172.21.15.40:0/2400247068 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f1d4006ace0 0x7f1d4006d190 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1d44000f60 tx=0x7f1d44007c90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:27.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.773+0000 7f1d3bfff700 1 -- 172.21.15.40:0/2400247068 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1d4c054d70 con 0x7f1d5415c720 2023-06-22T10:53:27.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.985+0000 7f1d59dff700 1 -- 172.21.15.40:0/2400247068 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d5415d1c0 con 0x7f1d5415c720 2023-06-22T10:53:27.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.985+0000 7f1d3bfff700 1 -- 172.21.15.40:0/2400247068 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+14552 (secure 0 0 0) 0x7f1d4c058390 con 0x7f1d5415c720 2023-06-22T10:53:27.988 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:53:27.989 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":20,"fsid":"475560bc-1a7c-4a75-b3b6-6fc6b20bdc52","created":"2023-06-22T10:53:03.784568+0000","modified":"2023-06-22T10:53:26.616199+0000","last_up_change":"2023-06-22T10:53:17.830348+0000","last_in_change":"2023-06-22T10:53:07.329974+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-22T10:53:17.182228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-22T10:53:23.874432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"918db6b4-053a-46ba-976d-6e1a0104017f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6809","nonce":2400162888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6811","nonce":2400162888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6815","nonce":2400162888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6813","nonce":2400162888}]},"public_addr":"172.21.15.40:6809/2400162888","cluster_addr":"172.21.15.40:6811/2400162888","heartbeat_back_addr":"172.21.15.40:6815/2400162888","heartbeat_front_addr":"172.21.15.40:6813/2400162888","state":["exists","up"]},{"osd":1,"uuid":"0c146e2b-1725-4dae-9b5c-38795943b9d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6801","nonce":230885800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6803","nonce":230885800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6807","nonce":230885800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6805","nonce":230885800}]},"public_addr":"172.21.15.40:6801/230885800","cluster_addr":"172.21.15.40:6803/230885800","heartbeat_back_addr":"172.21.15.40:6807/230885800","heartbeat_front_addr":"172.21.15.40:6805/230885800","state":["exists","up"]},{"osd":2,"uuid":"0b3727fd-f281-46d5-a675-86c8c5ab269e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6817","nonce":2681404929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6819","nonce":2681404929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6823","nonce":2681404929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6821","nonce":2681404929}]},"public_addr":"172.21.15.40:6817/2681404929","cluster_addr":"172.21.15.40:6819/2681404929","heartbeat_back_addr":"172.21.15.40:6823/2681404929","heartbeat_front_addr":"172.21.15.40:6821/2681404929","state":["exists","up"]},{"osd":3,"uuid":"2969c698-7039-4bbb-beda-f756f7a368a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6825","nonce":111110981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6827","nonce":111110981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6831","nonce":111110981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6829","nonce":111110981}]},"public_addr":"172.21.15.40:6825/111110981","cluster_addr":"172.21.15.40:6827/111110981","heartbeat_back_addr":"172.21.15.40:6831/111110981","heartbeat_front_addr":"172.21.15.40:6829/111110981","state":["exists","up"]},{"osd":4,"uuid":"3bb1d9c8-8e42-4a6b-998d-04834f34be5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6801","nonce":3625455711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6803","nonce":3625455711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6807","nonce":3625455711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6805","nonce":3625455711}]},"public_addr":"172.21.15.45:6801/3625455711","cluster_addr":"172.21.15.45:6803/3625455711","heartbeat_back_addr":"172.21.15.45:6807/3625455711","heartbeat_front_addr":"172.21.15.45:6805/3625455711","state":["exists","up"]},{"osd":5,"uuid":"f9854ee4-302c-41be-977b-bedda090a3d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6817","nonce":3354411217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6819","nonce":3354411217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6823","nonce":3354411217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6821","nonce":3354411217}]},"public_addr":"172.21.15.45:6817/3354411217","cluster_addr":"172.21.15.45:6819/3354411217","heartbeat_back_addr":"172.21.15.45:6823/3354411217","heartbeat_front_addr":"172.21.15.45:6821/3354411217","state":["exists","up"]},{"osd":6,"uuid":"bbdb1989-f6ac-4954-9b85-b8b540d683c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6809","nonce":320111074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6811","nonce":320111074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6815","nonce":320111074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6813","nonce":320111074}]},"public_addr":"172.21.15.45:6809/320111074","cluster_addr":"172.21.15.45:6811/320111074","heartbeat_back_addr":"172.21.15.45:6815/320111074","heartbeat_front_addr":"172.21.15.45:6813/320111074","state":["exists","up"]},{"osd":7,"uuid":"823d44e3-58f1-4d1d-8263-a4e4a69d4327","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6825","nonce":643617680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6827","nonce":643617680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6831","nonce":643617680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6829","nonce":643617680}]},"public_addr":"172.21.15.45:6825/643617680","cluster_addr":"172.21.15.45:6827/643617680","heartbeat_back_addr":"172.21.15.45:6831/643617680","heartbeat_front_addr":"172.21.15.45:6829/643617680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.731262+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.873226+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.898936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.666578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.645990+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.953699+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.642823+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.693395+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-22T10:53:27.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.988+0000 7f1d59dff700 1 -- 172.21.15.40:0/2400247068 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f1d4006ace0 msgr2=0x7f1d4006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:27.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.988+0000 7f1d59dff700 1 --2- 172.21.15.40:0/2400247068 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f1d4006ace0 0x7f1d4006d190 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1d44000f60 tx=0x7f1d44007c90 comp rx=0 tx=0).stop 2023-06-22T10:53:27.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.988+0000 7f1d59dff700 1 -- 172.21.15.40:0/2400247068 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d5415c720 msgr2=0x7f1d540ca2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:27.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.988+0000 7f1d59dff700 1 --2- 172.21.15.40:0/2400247068 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d5415c720 0x7f1d540ca2b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c007e40 tx=0x7f1d4c00e3c0 comp rx=0 tx=0).stop 2023-06-22T10:53:27.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.988+0000 7f1d59dff700 1 -- 172.21.15.40:0/2400247068 shutdown_connections 2023-06-22T10:53:27.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.988+0000 7f1d59dff700 1 --2- 172.21.15.40:0/2400247068 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f1d4006ace0 0x7f1d4006d190 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:27.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.988+0000 7f1d59dff700 1 --2- 172.21.15.40:0/2400247068 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d5415c720 0x7f1d540ca2b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:27.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.988+0000 7f1d59dff700 1 --2- 172.21.15.40:0/2400247068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d540b4c60 0x7f1d5415caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:27.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.988+0000 7f1d59dff700 1 --2- 172.21.15.40:0/2400247068 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1d540d2830 0x7f1d540c9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:27.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.988+0000 7f1d59dff700 1 -- 172.21.15.40:0/2400247068 >> 172.21.15.40:0/2400247068 conn(0x7f1d540cf720 msgr2=0x7f1d540d17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:27.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.988+0000 7f1d59dff700 1 -- 172.21.15.40:0/2400247068 shutdown_connections 2023-06-22T10:53:27.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:27.988+0000 7f1d59dff700 1 -- 172.21.15.40:0/2400247068 wait complete. 2023-06-22T10:53:28.009 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-22T10:53:17.182228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-22T10:53:23.874432+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-22T10:53:28.011 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-22T10:53:28.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.212+0000 7f0f8a9ff700 1 Processor -- start 2023-06-22T10:53:28.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.213+0000 7f0f8a9ff700 1 -- start start 2023-06-22T10:53:28.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.214+0000 7f0f8a9ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f0f840b45d0 0x7f0f840b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:28.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.214+0000 7f0f8a9ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0f840b59a0 0x7f0f840b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:28.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.214+0000 7f0f8a9ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f840d1be0 con 0x7f0f840d2130 2023-06-22T10:53:28.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.214+0000 7f0f8a9ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f840d17f0 con 0x7f0f840b59a0 2023-06-22T10:53:28.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.214+0000 7f0f8a9ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f840d1360 con 0x7f0f840b45d0 2023-06-22T10:53:28.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.214+0000 7f0f837fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f0f840d2130 0x7f0f840cd1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:56194/0 (socket says 172.21.15.40:56194) 2023-06-22T10:53:28.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.214+0000 7f0f837fe700 1 -- 172.21.15.40:0/2500378863 learned_addr learned my addr 172.21.15.40:0/2500378863 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:53:28.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.214+0000 7f0f83fff700 1 --2- 172.21.15.40:0/2500378863 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f0f840b45d0 0x7f0f840b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:28.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.214+0000 7f0f88f9c700 1 --2- 172.21.15.40:0/2500378863 >> v2:172.21.15.45:3300/0 conn(0x7f0f840b59a0 0x7f0f840b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:28.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.215+0000 7f0f82ffd700 1 -- 172.21.15.40:0/2500378863 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4263279380 0 0) 0x7f0f840d1be0 con 0x7f0f840d2130 2023-06-22T10:53:28.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.215+0000 7f0f82ffd700 1 -- 172.21.15.40:0/2500378863 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f6c0035b0 con 0x7f0f840d2130 2023-06-22T10:53:28.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.215+0000 7f0f83fff700 1 -- 172.21.15.40:0/2500378863 >> v2:172.21.15.45:3300/0 conn(0x7f0f840b59a0 msgr2=0x7f0f840b5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:28.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.215+0000 7f0f83fff700 1 --2- 172.21.15.40:0/2500378863 >> v2:172.21.15.45:3300/0 conn(0x7f0f840b59a0 0x7f0f840b5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:28.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.215+0000 7f0f83fff700 1 -- 172.21.15.40:0/2500378863 >> v1:172.21.15.40:6789/0 conn(0x7f0f840d2130 legacy=0x7f0f840cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:28.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.215+0000 7f0f82ffd700 1 -- 172.21.15.40:0/2500378863 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3363344319 0 0) 0x7f0f6c0035b0 con 0x7f0f840d2130 2023-06-22T10:53:28.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.215+0000 7f0f83fff700 1 -- 172.21.15.40:0/2500378863 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f840b4ee0 con 0x7f0f840b45d0 2023-06-22T10:53:28.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.215+0000 7f0f88f9c700 1 --2- 172.21.15.40:0/2500378863 >> v2:172.21.15.45:3300/0 conn(0x7f0f840b59a0 0x7f0f840b5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-22T10:53:28.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.215+0000 7f0f83fff700 1 --2- 172.21.15.40:0/2500378863 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f0f840b45d0 0x7f0f840b49a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0f74009840 tx=0x7f0f74009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=632d1c3ec07fd38a server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:28.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.215+0000 7f0f82ffd700 1 -- 172.21.15.40:0/2500378863 <== mon.2 v2:172.21.15.45:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f78001670 con 0x7f0f840b45d0 2023-06-22T10:53:28.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.216+0000 7f0f82ffd700 1 -- 172.21.15.40:0/2500378863 <== mon.2 v2:172.21.15.45:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f74004030 con 0x7f0f840b45d0 2023-06-22T10:53:28.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.216+0000 7f0f82ffd700 1 -- 172.21.15.40:0/2500378863 <== mon.2 v2:172.21.15.45:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f740043c0 con 0x7f0f840b45d0 2023-06-22T10:53:28.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.216+0000 7f0f8a9ff700 1 -- 172.21.15.40:0/2500378863 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f0f840b45d0 msgr2=0x7f0f840b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:28.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.216+0000 7f0f8a9ff700 1 --2- 172.21.15.40:0/2500378863 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f0f840b45d0 0x7f0f840b49a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0f74009840 tx=0x7f0f74009b50 comp rx=0 tx=0).stop 2023-06-22T10:53:28.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.216+0000 7f0f8a9ff700 1 -- 172.21.15.40:0/2500378863 shutdown_connections 2023-06-22T10:53:28.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.216+0000 7f0f8a9ff700 1 --2- 172.21.15.40:0/2500378863 >> v2:172.21.15.45:3300/0 conn(0x7f0f840b59a0 0x7f0f840b5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:28.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.216+0000 7f0f8a9ff700 1 --2- 172.21.15.40:0/2500378863 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f0f840b45d0 0x7f0f840b49a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:28.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.216+0000 7f0f8a9ff700 1 -- 172.21.15.40:0/2500378863 >> 172.21.15.40:0/2500378863 conn(0x7f0f840cf5d0 msgr2=0x7f0f840cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:28.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.216+0000 7f0f8a9ff700 1 -- 172.21.15.40:0/2500378863 shutdown_connections 2023-06-22T10:53:28.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.216+0000 7f0f8a9ff700 1 -- 172.21.15.40:0/2500378863 wait complete. 2023-06-22T10:53:28.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.219+0000 7f0f8a9ff700 1 Processor -- start 2023-06-22T10:53:28.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.219+0000 7f0f8a9ff700 1 -- start start 2023-06-22T10:53:28.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.220+0000 7f0f8a9ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f0f840b45d0 0x7f0f841553d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:28.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.220+0000 7f0f8a9ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f840b59a0 0x7f0f8406b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:28.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.220+0000 7f0f8a9ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f840d2130 0x7f0f840cac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:28.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.220+0000 7f0f8a9ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8415cb30 con 0x7f0f840d2130 2023-06-22T10:53:28.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.220+0000 7f0f8a9ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f840cb5e0 con 0x7f0f840b59a0 2023-06-22T10:53:28.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.220+0000 7f0f8a9ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f840cb8c0 con 0x7f0f840b45d0 2023-06-22T10:53:28.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.220+0000 7f0f88f9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f840d2130 0x7f0f840cac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:28.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.220+0000 7f0f88f9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f840d2130 0x7f0f840cac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54024/0 (socket says 172.21.15.40:54024) 2023-06-22T10:53:28.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.220+0000 7f0f88f9c700 1 -- 172.21.15.40:0/2356924713 learned_addr learned my addr 172.21.15.40:0/2356924713 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:28.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.220+0000 7f0f837fe700 1 --2- 172.21.15.40:0/2356924713 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f840b59a0 0x7f0f8406b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:28.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.220+0000 7f0f83fff700 1 --2- 172.21.15.40:0/2356924713 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f0f840b45d0 0x7f0f841553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:28.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.221+0000 7f0f88f9c700 1 -- 172.21.15.40:0/2356924713 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f0f840b45d0 msgr2=0x7f0f841553d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:28.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.221+0000 7f0f88f9c700 1 --2- 172.21.15.40:0/2356924713 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f0f840b45d0 0x7f0f841553d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:28.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.221+0000 7f0f88f9c700 1 -- 172.21.15.40:0/2356924713 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f840b59a0 msgr2=0x7f0f8406b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:28.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.221+0000 7f0f88f9c700 1 --2- 172.21.15.40:0/2356924713 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f840b59a0 0x7f0f8406b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:28.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.221+0000 7f0f88f9c700 1 -- 172.21.15.40:0/2356924713 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f7c009a70 con 0x7f0f840d2130 2023-06-22T10:53:28.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.221+0000 7f0f88f9c700 1 --2- 172.21.15.40:0/2356924713 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f840d2130 0x7f0f840cac70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c00efc0 tx=0x7f0f7c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:28.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.221+0000 7f0f80ff9700 1 -- 172.21.15.40:0/2356924713 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7c00ca90 con 0x7f0f840d2130 2023-06-22T10:53:28.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.221+0000 7f0f80ff9700 1 -- 172.21.15.40:0/2356924713 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f7c00f040 con 0x7f0f840d2130 2023-06-22T10:53:28.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.221+0000 7f0f8a9ff700 1 -- 172.21.15.40:0/2356924713 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f740094a0 con 0x7f0f840d2130 2023-06-22T10:53:28.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.221+0000 7f0f80ff9700 1 -- 172.21.15.40:0/2356924713 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7c00ce30 con 0x7f0f840d2130 2023-06-22T10:53:28.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.221+0000 7f0f8a9ff700 1 -- 172.21.15.40:0/2356924713 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f8415cd80 con 0x7f0f840d2130 2023-06-22T10:53:28.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.223+0000 7f0f8a9ff700 1 -- 172.21.15.40:0/2356924713 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f8415cfa0 con 0x7f0f840d2130 2023-06-22T10:53:28.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.223+0000 7f0f80ff9700 1 -- 172.21.15.40:0/2356924713 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0f7c014480 con 0x7f0f840d2130 2023-06-22T10:53:28.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.224+0000 7f0f80ff9700 1 --2- 172.21.15.40:0/2356924713 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f0f7006ace0 0x7f0f7006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:28.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.224+0000 7f0f80ff9700 1 -- 172.21.15.40:0/2356924713 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0f7c089810 con 0x7f0f840d2130 2023-06-22T10:53:28.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.225+0000 7f0f83fff700 1 --2- 172.21.15.40:0/2356924713 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f0f7006ace0 0x7f0f7006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:28.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.225+0000 7f0f83fff700 1 --2- 172.21.15.40:0/2356924713 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f0f7006ace0 0x7f0f7006d190 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0f740090b0 tx=0x7f0f74008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:28.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.229+0000 7f0f80ff9700 1 -- 172.21.15.40:0/2356924713 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0f7c058600 con 0x7f0f840d2130 2023-06-22T10:53:28.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.432+0000 7f0f8a9ff700 1 -- 172.21.15.40:0/2356924713 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0f84067580 con 0x7f0f840d2130 2023-06-22T10:53:28.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.432+0000 7f0f80ff9700 1 -- 172.21.15.40:0/2356924713 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0f7c009cd0 con 0x7f0f840d2130 2023-06-22T10:53:28.435 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-06-22T10:53:28.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.435+0000 7f0f8a9ff700 1 -- 172.21.15.40:0/2356924713 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f0f7006ace0 msgr2=0x7f0f7006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:28.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.435+0000 7f0f8a9ff700 1 --2- 172.21.15.40:0/2356924713 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f0f7006ace0 0x7f0f7006d190 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0f740090b0 tx=0x7f0f74008030 comp rx=0 tx=0).stop 2023-06-22T10:53:28.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.435+0000 7f0f8a9ff700 1 -- 172.21.15.40:0/2356924713 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f840d2130 msgr2=0x7f0f840cac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:28.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.435+0000 7f0f8a9ff700 1 --2- 172.21.15.40:0/2356924713 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f840d2130 0x7f0f840cac70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c00efc0 tx=0x7f0f7c00c3a0 comp rx=0 tx=0).stop 2023-06-22T10:53:28.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.435+0000 7f0f8a9ff700 1 -- 172.21.15.40:0/2356924713 shutdown_connections 2023-06-22T10:53:28.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.435+0000 7f0f8a9ff700 1 --2- 172.21.15.40:0/2356924713 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f0f7006ace0 0x7f0f7006d190 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:28.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.435+0000 7f0f8a9ff700 1 --2- 172.21.15.40:0/2356924713 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f0f840b45d0 0x7f0f841553d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:28.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.435+0000 7f0f8a9ff700 1 --2- 172.21.15.40:0/2356924713 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f840d2130 0x7f0f840cac70 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:28.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.435+0000 7f0f8a9ff700 1 --2- 172.21.15.40:0/2356924713 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f840b59a0 0x7f0f8406b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:28.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.435+0000 7f0f8a9ff700 1 -- 172.21.15.40:0/2356924713 >> 172.21.15.40:0/2356924713 conn(0x7f0f840cf5d0 msgr2=0x7f0f840d03e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:28.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.435+0000 7f0f8a9ff700 1 -- 172.21.15.40:0/2356924713 shutdown_connections 2023-06-22T10:53:28.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.435+0000 7f0f8a9ff700 1 -- 172.21.15.40:0/2356924713 wait complete. 2023-06-22T10:53:28.455 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-22T10:53:28.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.657+0000 7f6b06dff700 1 Processor -- start 2023-06-22T10:53:28.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.657+0000 7f6b06dff700 1 -- start start 2023-06-22T10:53:28.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.658+0000 7f6b06dff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6b000b45d0 0x7f6b000b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:28.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.658+0000 7f6b06dff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6b000d2130 0x7f6b000cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:28.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.658+0000 7f6b06dff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f6b000cd6e0 0x7f6b000b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:28.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.658+0000 7f6b06dff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b000d17f0 con 0x7f6b000b45d0 2023-06-22T10:53:28.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.658+0000 7f6b06dff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b000d1be0 con 0x7f6b000d2130 2023-06-22T10:53:28.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.658+0000 7f6b06dff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b000d1360 con 0x7f6b000cd6e0 2023-06-22T10:53:28.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.658+0000 7f6b04b9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6b000b45d0 0x7f6b000b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:28.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.658+0000 7f6b04b9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6b000b45d0 0x7f6b000b49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50682/0 (socket says 172.21.15.40:50682) 2023-06-22T10:53:28.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.658+0000 7f6b04b9b700 1 -- 172.21.15.40:0/3896725747 learned_addr learned my addr 172.21.15.40:0/3896725747 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:28.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.658+0000 7f6b0539c700 1 --2- 172.21.15.40:0/3896725747 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f6b000cd6e0 0x7f6b000b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:28.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.658+0000 7f6afffff700 1 --2- 172.21.15.40:0/3896725747 >> v2:172.21.15.45:3300/0 conn(0x7f6b000d2130 0x7f6b000cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:28.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.659+0000 7f6b04b9b700 1 -- 172.21.15.40:0/3896725747 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f6b000cd6e0 msgr2=0x7f6b000b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:28.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.659+0000 7f6b04b9b700 1 --2- 172.21.15.40:0/3896725747 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f6b000cd6e0 0x7f6b000b59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:28.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.659+0000 7f6b04b9b700 1 -- 172.21.15.40:0/3896725747 >> v2:172.21.15.45:3300/0 conn(0x7f6b000d2130 msgr2=0x7f6b000cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:28.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.659+0000 7f6b04b9b700 1 --2- 172.21.15.40:0/3896725747 >> v2:172.21.15.45:3300/0 conn(0x7f6b000d2130 0x7f6b000cd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:28.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.659+0000 7f6b04b9b700 1 -- 172.21.15.40:0/3896725747 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b000b4ee0 con 0x7f6b000b45d0 2023-06-22T10:53:28.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.659+0000 7f6afffff700 1 --2- 172.21.15.40:0/3896725747 >> v2:172.21.15.45:3300/0 conn(0x7f6b000d2130 0x7f6b000cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:53:28.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.659+0000 7f6b04b9b700 1 --2- 172.21.15.40:0/3896725747 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b000b45d0 0x7f6b000b49a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6b000668c0 tx=0x7f6af4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47aedbcc33063d18 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:28.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.659+0000 7f6aff7fe700 1 -- 172.21.15.40:0/3896725747 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af4011830 con 0x7f6b000b45d0 2023-06-22T10:53:28.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.659+0000 7f6aff7fe700 1 -- 172.21.15.40:0/3896725747 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6af4011990 con 0x7f6b000b45d0 2023-06-22T10:53:28.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.659+0000 7f6aff7fe700 1 -- 172.21.15.40:0/3896725747 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af4011d20 con 0x7f6b000b45d0 2023-06-22T10:53:28.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.660+0000 7f6b06dff700 1 -- 172.21.15.40:0/3896725747 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b000b45d0 msgr2=0x7f6b000b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:28.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.660+0000 7f6b06dff700 1 --2- 172.21.15.40:0/3896725747 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b000b45d0 0x7f6b000b49a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6b000668c0 tx=0x7f6af4009bd0 comp rx=0 tx=0).stop 2023-06-22T10:53:28.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.660+0000 7f6b06dff700 1 -- 172.21.15.40:0/3896725747 shutdown_connections 2023-06-22T10:53:28.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.660+0000 7f6b06dff700 1 --2- 172.21.15.40:0/3896725747 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f6b000cd6e0 0x7f6b000b59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:28.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.660+0000 7f6b06dff700 1 --2- 172.21.15.40:0/3896725747 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b000b45d0 0x7f6b000b49a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:28.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.660+0000 7f6b06dff700 1 --2- 172.21.15.40:0/3896725747 >> v2:172.21.15.45:3300/0 conn(0x7f6b000d2130 0x7f6b000cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:28.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.660+0000 7f6b06dff700 1 -- 172.21.15.40:0/3896725747 >> 172.21.15.40:0/3896725747 conn(0x7f6b000cf5d0 msgr2=0x7f6b000cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:28.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.660+0000 7f6b06dff700 1 -- 172.21.15.40:0/3896725747 shutdown_connections 2023-06-22T10:53:28.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.660+0000 7f6b06dff700 1 -- 172.21.15.40:0/3896725747 wait complete. 2023-06-22T10:53:28.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.662+0000 7f6b06dff700 1 Processor -- start 2023-06-22T10:53:28.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.662+0000 7f6b06dff700 1 -- start start 2023-06-22T10:53:28.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.663+0000 7f6b06dff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f6b000b45d0 0x7f6b0015e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:28.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.663+0000 7f6b06dff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b000cd6e0 0x7f6b001f1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:28.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.663+0000 7f6b06dff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b000d2130 0x7f6b00146c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:28.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.663+0000 7f6b06dff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b00144c30 con 0x7f6b000d2130 2023-06-22T10:53:28.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.663+0000 7f6b06dff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0015e6a0 con 0x7f6b000cd6e0 2023-06-22T10:53:28.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.663+0000 7f6b06dff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0015e980 con 0x7f6b000b45d0 2023-06-22T10:53:28.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.663+0000 7f6b0539c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b000d2130 0x7f6b00146c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:28.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.663+0000 7f6b0539c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b000d2130 0x7f6b00146c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50688/0 (socket says 172.21.15.40:50688) 2023-06-22T10:53:28.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.663+0000 7f6b0539c700 1 -- 172.21.15.40:0/2745298598 learned_addr learned my addr 172.21.15.40:0/2745298598 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:28.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.663+0000 7f6b04b9b700 1 --2- 172.21.15.40:0/2745298598 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f6b000b45d0 0x7f6b0015e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:28.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.663+0000 7f6afffff700 1 --2- 172.21.15.40:0/2745298598 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b000cd6e0 0x7f6b001f1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:28.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.664+0000 7f6b0539c700 1 -- 172.21.15.40:0/2745298598 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f6b000b45d0 msgr2=0x7f6b0015e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:28.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.664+0000 7f6b0539c700 1 --2- 172.21.15.40:0/2745298598 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f6b000b45d0 0x7f6b0015e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:28.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.664+0000 7f6b0539c700 1 -- 172.21.15.40:0/2745298598 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b000cd6e0 msgr2=0x7f6b001f1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:28.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.664+0000 7f6b0539c700 1 --2- 172.21.15.40:0/2745298598 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b000cd6e0 0x7f6b001f1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:28.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.664+0000 7f6b0539c700 1 -- 172.21.15.40:0/2745298598 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6af4009550 con 0x7f6b000d2130 2023-06-22T10:53:28.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.664+0000 7f6b0539c700 1 --2- 172.21.15.40:0/2745298598 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b000d2130 0x7f6b00146c00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6af800eed0 tx=0x7f6af800b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:28.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.664+0000 7f6afd7fa700 1 -- 172.21.15.40:0/2745298598 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af8010040 con 0x7f6b000d2130 2023-06-22T10:53:28.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.664+0000 7f6afd7fa700 1 -- 172.21.15.40:0/2745298598 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6af800bc80 con 0x7f6b000d2130 2023-06-22T10:53:28.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.664+0000 7f6afd7fa700 1 -- 172.21.15.40:0/2745298598 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af8009e40 con 0x7f6b000d2130 2023-06-22T10:53:28.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.664+0000 7f6b06dff700 1 -- 172.21.15.40:0/2745298598 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b0015ec60 con 0x7f6b000d2130 2023-06-22T10:53:28.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.664+0000 7f6b06dff700 1 -- 172.21.15.40:0/2745298598 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b001f1b80 con 0x7f6b000d2130 2023-06-22T10:53:28.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.665+0000 7f6b06dff700 1 -- 172.21.15.40:0/2745298598 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b00144de0 con 0x7f6b000d2130 2023-06-22T10:53:28.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.666+0000 7f6afd7fa700 1 -- 172.21.15.40:0/2745298598 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6af8014400 con 0x7f6b000d2130 2023-06-22T10:53:28.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.668+0000 7f6afd7fa700 1 --2- 172.21.15.40:0/2745298598 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f6ae406ace0 0x7f6ae406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:28.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.668+0000 7f6afd7fa700 1 -- 172.21.15.40:0/2745298598 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6af8089490 con 0x7f6b000d2130 2023-06-22T10:53:28.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.668+0000 7f6b04b9b700 1 --2- 172.21.15.40:0/2745298598 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f6ae406ace0 0x7f6ae406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:28.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.669+0000 7f6b04b9b700 1 --2- 172.21.15.40:0/2745298598 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f6ae406ace0 0x7f6ae406d190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6af4014040 tx=0x7f6af4008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:28.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.672+0000 7f6afd7fa700 1 -- 172.21.15.40:0/2745298598 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6af8054880 con 0x7f6b000d2130 2023-06-22T10:53:28.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.881+0000 7f6b06dff700 1 -- 172.21.15.40:0/2745298598 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6b00067580 con 0x7f6b000d2130 2023-06-22T10:53:28.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.882+0000 7f6afd7fa700 1 -- 172.21.15.40:0/2745298598 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6af8018020 con 0x7f6b000d2130 2023-06-22T10:53:28.886 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 8 2023-06-22T10:53:28.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.884+0000 7f6b06dff700 1 -- 172.21.15.40:0/2745298598 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f6ae406ace0 msgr2=0x7f6ae406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:28.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.884+0000 7f6b06dff700 1 --2- 172.21.15.40:0/2745298598 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f6ae406ace0 0x7f6ae406d190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6af4014040 tx=0x7f6af4008030 comp rx=0 tx=0).stop 2023-06-22T10:53:28.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.884+0000 7f6b06dff700 1 -- 172.21.15.40:0/2745298598 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b000d2130 msgr2=0x7f6b00146c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:28.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.884+0000 7f6b06dff700 1 --2- 172.21.15.40:0/2745298598 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b000d2130 0x7f6b00146c00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6af800eed0 tx=0x7f6af800b390 comp rx=0 tx=0).stop 2023-06-22T10:53:28.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.884+0000 7f6b06dff700 1 -- 172.21.15.40:0/2745298598 shutdown_connections 2023-06-22T10:53:28.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.884+0000 7f6b06dff700 1 --2- 172.21.15.40:0/2745298598 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f6ae406ace0 0x7f6ae406d190 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:28.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.884+0000 7f6b06dff700 1 --2- 172.21.15.40:0/2745298598 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f6b000b45d0 0x7f6b0015e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:28.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.884+0000 7f6b06dff700 1 --2- 172.21.15.40:0/2745298598 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b000d2130 0x7f6b00146c00 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:28.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.884+0000 7f6b06dff700 1 --2- 172.21.15.40:0/2745298598 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6b000cd6e0 0x7f6b001f1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:28.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.884+0000 7f6b06dff700 1 -- 172.21.15.40:0/2745298598 >> 172.21.15.40:0/2745298598 conn(0x7f6b000cf5d0 msgr2=0x7f6b000b7990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:28.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.884+0000 7f6b06dff700 1 -- 172.21.15.40:0/2745298598 shutdown_connections 2023-06-22T10:53:28.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:28.884+0000 7f6b06dff700 1 -- 172.21.15.40:0/2745298598 wait complete. 2023-06-22T10:53:28.904 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-06-22T10:53:29.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.102+0000 7fbedefff700 1 Processor -- start 2023-06-22T10:53:29.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.103+0000 7fbedefff700 1 -- start start 2023-06-22T10:53:29.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.104+0000 7fbedefff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbed80d2830 0x7fbed80b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:29.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.104+0000 7fbedefff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fbed80b4c60 0x7fbed80d0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:29.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.104+0000 7fbedefff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbed80b2130 con 0x7fbed815c720 2023-06-22T10:53:29.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.104+0000 7fbedefff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbed8160d60 con 0x7fbed80d2830 2023-06-22T10:53:29.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.104+0000 7fbedefff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbed80b50e0 con 0x7fbed80b4c60 2023-06-22T10:53:29.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.104+0000 7fbed7fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbed80d2830 0x7fbed80b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:29.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.104+0000 7fbed7fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbed80d2830 0x7fbed80b4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50704/0 (socket says 172.21.15.40:50704) 2023-06-22T10:53:29.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.104+0000 7fbed7fff700 1 -- 172.21.15.40:0/4280495494 learned_addr learned my addr 172.21.15.40:0/4280495494 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:29.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.104+0000 7fbedd59c700 1 --2- 172.21.15.40:0/4280495494 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fbed80b4c60 0x7fbed80d0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:29.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.105+0000 7fbed7fff700 1 -- 172.21.15.40:0/4280495494 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fbed80b4c60 msgr2=0x7fbed80d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:29.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.105+0000 7fbed7fff700 1 --2- 172.21.15.40:0/4280495494 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fbed80b4c60 0x7fbed80d0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:29.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.105+0000 7fbed7fff700 1 -- 172.21.15.40:0/4280495494 >> v1:172.21.15.45:6789/0 conn(0x7fbed815c720 legacy=0x7fbed80b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:29.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.105+0000 7fbed7fff700 1 -- 172.21.15.40:0/4280495494 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbed8161180 con 0x7fbed80d2830 2023-06-22T10:53:29.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.105+0000 7fbed7fff700 1 --2- 172.21.15.40:0/4280495494 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbed80d2830 0x7fbed80b4720 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbec4009920 tx=0x7fbec4009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb3cecb1ccbe4eb4 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:29.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.105+0000 7fbed77fe700 1 -- 172.21.15.40:0/4280495494 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec4004230 con 0x7fbed80d2830 2023-06-22T10:53:29.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.105+0000 7fbed77fe700 1 -- 172.21.15.40:0/4280495494 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec4004390 con 0x7fbed80d2830 2023-06-22T10:53:29.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.105+0000 7fbed77fe700 1 -- 172.21.15.40:0/4280495494 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec4009e70 con 0x7fbed80d2830 2023-06-22T10:53:29.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.105+0000 7fbedefff700 1 -- 172.21.15.40:0/4280495494 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbed80d2830 msgr2=0x7fbed80b4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:29.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.105+0000 7fbedefff700 1 --2- 172.21.15.40:0/4280495494 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbed80d2830 0x7fbed80b4720 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbec4009920 tx=0x7fbec4009c30 comp rx=0 tx=0).stop 2023-06-22T10:53:29.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.106+0000 7fbedefff700 1 -- 172.21.15.40:0/4280495494 shutdown_connections 2023-06-22T10:53:29.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.106+0000 7fbedefff700 1 --2- 172.21.15.40:0/4280495494 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fbed80b4c60 0x7fbed80d0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:29.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.106+0000 7fbedefff700 1 --2- 172.21.15.40:0/4280495494 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbed80d2830 0x7fbed80b4720 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:29.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.106+0000 7fbedefff700 1 -- 172.21.15.40:0/4280495494 >> 172.21.15.40:0/4280495494 conn(0x7fbed80cf720 msgr2=0x7fbed80cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:29.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.106+0000 7fbedefff700 1 -- 172.21.15.40:0/4280495494 shutdown_connections 2023-06-22T10:53:29.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.106+0000 7fbedefff700 1 -- 172.21.15.40:0/4280495494 wait complete. 2023-06-22T10:53:29.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.108+0000 7fbedefff700 1 Processor -- start 2023-06-22T10:53:29.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.108+0000 7fbedefff700 1 -- start start 2023-06-22T10:53:29.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.109+0000 7fbedefff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbed80b4c60 0x7fbed81f1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:29.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.109+0000 7fbedefff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fbed80d2830 0x7fbed80b7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:29.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.110+0000 7fbedefff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbed815c720 0x7fbed80b7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:29.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.110+0000 7fbedefff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed80b7660 con 0x7fbed80b4c60 2023-06-22T10:53:29.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.110+0000 7fbedefff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed80ca4f0 con 0x7fbed815c720 2023-06-22T10:53:29.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.110+0000 7fbedefff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbed80b7380 con 0x7fbed80d2830 2023-06-22T10:53:29.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.110+0000 7fbedcd9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbed80b4c60 0x7fbed81f1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:29.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.110+0000 7fbed7fff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fbed80d2830 0x7fbed80b7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:29.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.110+0000 7fbedcd9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbed80b4c60 0x7fbed81f1790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50718/0 (socket says 172.21.15.40:50718) 2023-06-22T10:53:29.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.110+0000 7fbedcd9b700 1 -- 172.21.15.40:0/2588955652 learned_addr learned my addr 172.21.15.40:0/2588955652 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:29.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.110+0000 7fbedd59c700 1 --2- 172.21.15.40:0/2588955652 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbed815c720 0x7fbed80b7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:29.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.110+0000 7fbedcd9b700 1 -- 172.21.15.40:0/2588955652 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fbed80d2830 msgr2=0x7fbed80b7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:29.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.110+0000 7fbedcd9b700 1 --2- 172.21.15.40:0/2588955652 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fbed80d2830 0x7fbed80b7a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:29.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.110+0000 7fbedcd9b700 1 -- 172.21.15.40:0/2588955652 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbed815c720 msgr2=0x7fbed80b7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:29.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.110+0000 7fbedcd9b700 1 --2- 172.21.15.40:0/2588955652 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbed815c720 0x7fbed80b7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:29.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.110+0000 7fbedcd9b700 1 -- 172.21.15.40:0/2588955652 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec4009550 con 0x7fbed80b4c60 2023-06-22T10:53:29.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.111+0000 7fbedcd9b700 1 --2- 172.21.15.40:0/2588955652 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbed80b4c60 0x7fbed81f1790 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbecc00b4d0 tx=0x7fbecc00b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:29.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.111+0000 7fbed57fa700 1 -- 172.21.15.40:0/2588955652 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbecc00bea0 con 0x7fbed80b4c60 2023-06-22T10:53:29.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.111+0000 7fbed57fa700 1 -- 172.21.15.40:0/2588955652 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbecc011830 con 0x7fbed80b4c60 2023-06-22T10:53:29.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.111+0000 7fbedefff700 1 -- 172.21.15.40:0/2588955652 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbed80c9ea0 con 0x7fbed80b4c60 2023-06-22T10:53:29.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.111+0000 7fbed57fa700 1 -- 172.21.15.40:0/2588955652 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbecc011be0 con 0x7fbed80b4c60 2023-06-22T10:53:29.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.111+0000 7fbedefff700 1 -- 172.21.15.40:0/2588955652 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbed81f1cd0 con 0x7fbed80b4c60 2023-06-22T10:53:29.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.112+0000 7fbedefff700 1 -- 172.21.15.40:0/2588955652 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbed8067580 con 0x7fbed80b4c60 2023-06-22T10:53:29.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.113+0000 7fbed57fa700 1 -- 172.21.15.40:0/2588955652 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbecc011d40 con 0x7fbed80b4c60 2023-06-22T10:53:29.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.114+0000 7fbed57fa700 1 --2- 172.21.15.40:0/2588955652 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fbebc06ace0 0x7fbebc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:29.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.114+0000 7fbed57fa700 1 -- 172.21.15.40:0/2588955652 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fbecc088cb0 con 0x7fbed80b4c60 2023-06-22T10:53:29.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.114+0000 7fbed7fff700 1 --2- 172.21.15.40:0/2588955652 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fbebc06ace0 0x7fbebc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:29.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.115+0000 7fbed7fff700 1 --2- 172.21.15.40:0/2588955652 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fbebc06ace0 0x7fbebc06d190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbed80d2c70 tx=0x7fbec4008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:29.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.119+0000 7fbed57fa700 1 -- 172.21.15.40:0/2588955652 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbecc0540a0 con 0x7fbed80b4c60 2023-06-22T10:53:29.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.326+0000 7fbedefff700 1 -- 172.21.15.40:0/2588955652 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fbed80b4400 con 0x7fbed80b4c60 2023-06-22T10:53:29.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.327+0000 7fbed57fa700 1 -- 172.21.15.40:0/2588955652 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v20) v1 ==== 84+0+126 (secure 0 0 0) 0x7fbecc015090 con 0x7fbed80b4c60 2023-06-22T10:53:29.330 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:53:29.330 INFO:teuthology.orchestra.run.smithi040.stdout:[ 2023-06-22T10:53:29.331 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-06-22T10:53:29.331 INFO:teuthology.orchestra.run.smithi040.stdout: "poolnum": 1, 2023-06-22T10:53:29.331 INFO:teuthology.orchestra.run.smithi040.stdout: "poolname": ".mgr" 2023-06-22T10:53:29.331 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-06-22T10:53:29.332 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-06-22T10:53:29.332 INFO:teuthology.orchestra.run.smithi040.stdout: "poolnum": 2, 2023-06-22T10:53:29.332 INFO:teuthology.orchestra.run.smithi040.stdout: "poolname": "rbd" 2023-06-22T10:53:29.332 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-06-22T10:53:29.333 INFO:teuthology.orchestra.run.smithi040.stdout:] 2023-06-22T10:53:29.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.329+0000 7fbedefff700 1 -- 172.21.15.40:0/2588955652 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fbebc06ace0 msgr2=0x7fbebc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:29.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.329+0000 7fbedefff700 1 --2- 172.21.15.40:0/2588955652 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fbebc06ace0 0x7fbebc06d190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbed80d2c70 tx=0x7fbec4008030 comp rx=0 tx=0).stop 2023-06-22T10:53:29.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.329+0000 7fbedefff700 1 -- 172.21.15.40:0/2588955652 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbed80b4c60 msgr2=0x7fbed81f1790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:29.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.329+0000 7fbedefff700 1 --2- 172.21.15.40:0/2588955652 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbed80b4c60 0x7fbed81f1790 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbecc00b4d0 tx=0x7fbecc00b7e0 comp rx=0 tx=0).stop 2023-06-22T10:53:29.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.329+0000 7fbedefff700 1 -- 172.21.15.40:0/2588955652 shutdown_connections 2023-06-22T10:53:29.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.329+0000 7fbedefff700 1 --2- 172.21.15.40:0/2588955652 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fbebc06ace0 0x7fbebc06d190 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:29.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.329+0000 7fbedefff700 1 --2- 172.21.15.40:0/2588955652 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbed815c720 0x7fbed80b7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:29.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.329+0000 7fbedefff700 1 --2- 172.21.15.40:0/2588955652 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbed80b4c60 0x7fbed81f1790 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:29.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.329+0000 7fbedefff700 1 --2- 172.21.15.40:0/2588955652 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fbed80d2830 0x7fbed80b7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:29.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.329+0000 7fbedefff700 1 -- 172.21.15.40:0/2588955652 >> 172.21.15.40:0/2588955652 conn(0x7fbed80cf720 msgr2=0x7fbed815b490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:29.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.329+0000 7fbedefff700 1 -- 172.21.15.40:0/2588955652 shutdown_connections 2023-06-22T10:53:29.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.330+0000 7fbedefff700 1 -- 172.21.15.40:0/2588955652 wait complete. 2023-06-22T10:53:29.350 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-06-22T10:53:29.351 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-06-22T10:53:29.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.554+0000 7f8ba33ff700 1 Processor -- start 2023-06-22T10:53:29.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.554+0000 7f8ba33ff700 1 -- start start 2023-06-22T10:53:29.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.555+0000 7f8ba33ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8b9c15c3e0 0x7f8b9c0b5a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:29.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.555+0000 7f8ba33ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8b9c06bda0 0x7f8b9c0d1910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:29.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.555+0000 7f8ba33ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b9c0b5f90 con 0x7f8b9c0d1e50 2023-06-22T10:53:29.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.555+0000 7f8ba33ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b9c0cda60 con 0x7f8b9c15c3e0 2023-06-22T10:53:29.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.555+0000 7f8ba33ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9c0d11e0 con 0x7f8b9c06bda0 2023-06-22T10:53:29.560 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.555+0000 7f8ba119b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8b9c15c3e0 0x7f8b9c0b5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:29.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.555+0000 7f8ba199c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f8b9c0d1e50 0x7f8b9c0b4680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:50688/0 (socket says 172.21.15.40:50688) 2023-06-22T10:53:29.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.556+0000 7f8ba199c700 1 -- 172.21.15.40:0/146519924 learned_addr learned my addr 172.21.15.40:0/146519924 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:53:29.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.556+0000 7f8ba099a700 1 --2- 172.21.15.40:0/146519924 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8b9c06bda0 0x7f8b9c0d1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:29.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.556+0000 7f8ba119b700 1 -- 172.21.15.40:0/146519924 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8b9c06bda0 msgr2=0x7f8b9c0d1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:29.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.556+0000 7f8ba119b700 1 --2- 172.21.15.40:0/146519924 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8b9c06bda0 0x7f8b9c0d1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:29.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.556+0000 7f8ba119b700 1 -- 172.21.15.40:0/146519924 >> v1:172.21.15.40:6789/0 conn(0x7f8b9c0d1e50 legacy=0x7f8b9c0b4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:29.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.556+0000 7f8ba119b700 1 -- 172.21.15.40:0/146519924 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b9c0cd250 con 0x7f8b9c15c3e0 2023-06-22T10:53:29.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.556+0000 7f8ba099a700 1 --2- 172.21.15.40:0/146519924 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8b9c06bda0 0x7f8b9c0d1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:53:29.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.556+0000 7f8b93fff700 1 -- 172.21.15.40:0/146519924 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1489062516 0 0) 0x7f8b9c0b5f90 con 0x7f8b9c0d1e50 2023-06-22T10:53:29.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.556+0000 7f8ba119b700 1 --2- 172.21.15.40:0/146519924 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b9c15c3e0 0x7f8b9c0b5a50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8b98009840 tx=0x7f8b98009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2191b6214487853 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:29.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.556+0000 7f8b93fff700 1 -- 172.21.15.40:0/146519924 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b98011830 con 0x7f8b9c15c3e0 2023-06-22T10:53:29.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.557+0000 7f8b93fff700 1 -- 172.21.15.40:0/146519924 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b98011990 con 0x7f8b9c15c3e0 2023-06-22T10:53:29.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.557+0000 7f8b93fff700 1 -- 172.21.15.40:0/146519924 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b98011d20 con 0x7f8b9c15c3e0 2023-06-22T10:53:29.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.557+0000 7f8ba33ff700 1 -- 172.21.15.40:0/146519924 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b9c15c3e0 msgr2=0x7f8b9c0b5a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:29.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.557+0000 7f8ba33ff700 1 --2- 172.21.15.40:0/146519924 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b9c15c3e0 0x7f8b9c0b5a50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8b98009840 tx=0x7f8b98009b50 comp rx=0 tx=0).stop 2023-06-22T10:53:29.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.557+0000 7f8ba33ff700 1 -- 172.21.15.40:0/146519924 shutdown_connections 2023-06-22T10:53:29.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.557+0000 7f8ba33ff700 1 --2- 172.21.15.40:0/146519924 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b9c15c3e0 0x7f8b9c0b5a50 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:29.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.557+0000 7f8ba33ff700 1 --2- 172.21.15.40:0/146519924 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8b9c06bda0 0x7f8b9c0d1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:29.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.557+0000 7f8ba33ff700 1 -- 172.21.15.40:0/146519924 >> 172.21.15.40:0/146519924 conn(0x7f8b9c06b290 msgr2=0x7f8b9c06b690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:29.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.557+0000 7f8ba33ff700 1 -- 172.21.15.40:0/146519924 shutdown_connections 2023-06-22T10:53:29.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.557+0000 7f8ba33ff700 1 -- 172.21.15.40:0/146519924 wait complete. 2023-06-22T10:53:29.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.559+0000 7f8ba33ff700 1 Processor -- start 2023-06-22T10:53:29.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.559+0000 7f8ba33ff700 1 -- start start 2023-06-22T10:53:29.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.560+0000 7f8ba33ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b9c06bda0 0x7f8b9c0b3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:29.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.560+0000 7f8ba33ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8b9c0d1e50 0x7f8b9c14dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:29.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.560+0000 7f8ba33ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b9c15c3e0 0x7f8b9c0b7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:29.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.560+0000 7f8ba33ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9c15cd20 con 0x7f8b9c06bda0 2023-06-22T10:53:29.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.560+0000 7f8ba33ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9c0b3750 con 0x7f8b9c15c3e0 2023-06-22T10:53:29.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.560+0000 7f8ba33ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9c0b3a30 con 0x7f8b9c0d1e50 2023-06-22T10:53:29.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.560+0000 7f8ba119b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b9c06bda0 0x7f8b9c0b3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:29.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.560+0000 7f8ba119b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b9c06bda0 0x7f8b9c0b3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50736/0 (socket says 172.21.15.40:50736) 2023-06-22T10:53:29.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.560+0000 7f8ba119b700 1 -- 172.21.15.40:0/3396382584 learned_addr learned my addr 172.21.15.40:0/3396382584 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:29.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.561+0000 7f8ba119b700 1 -- 172.21.15.40:0/3396382584 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8b9c0d1e50 msgr2=0x7f8b9c14dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:29.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.561+0000 7f8ba119b700 1 --2- 172.21.15.40:0/3396382584 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8b9c0d1e50 0x7f8b9c14dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:29.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.561+0000 7f8ba119b700 1 -- 172.21.15.40:0/3396382584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b9c15c3e0 msgr2=0x7f8b9c0b7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:29.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.561+0000 7f8ba119b700 1 --2- 172.21.15.40:0/3396382584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b9c15c3e0 0x7f8b9c0b7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:29.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.561+0000 7f8ba119b700 1 -- 172.21.15.40:0/3396382584 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b980094a0 con 0x7f8b9c06bda0 2023-06-22T10:53:29.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.561+0000 7f8ba119b700 1 --2- 172.21.15.40:0/3396382584 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b9c06bda0 0x7f8b9c0b3170 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8b98009b90 tx=0x7f8b98004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:29.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.561+0000 7f8b91ffb700 1 -- 172.21.15.40:0/3396382584 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b980038a0 con 0x7f8b9c06bda0 2023-06-22T10:53:29.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.561+0000 7f8b91ffb700 1 -- 172.21.15.40:0/3396382584 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b9801e070 con 0x7f8b9c06bda0 2023-06-22T10:53:29.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.561+0000 7f8b91ffb700 1 -- 172.21.15.40:0/3396382584 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b98003c00 con 0x7f8b9c06bda0 2023-06-22T10:53:29.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.561+0000 7f8ba33ff700 1 -- 172.21.15.40:0/3396382584 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b9c0b3d10 con 0x7f8b9c06bda0 2023-06-22T10:53:29.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.561+0000 7f8ba33ff700 1 -- 172.21.15.40:0/3396382584 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b9c0b4ea0 con 0x7f8b9c06bda0 2023-06-22T10:53:29.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.562+0000 7f8ba33ff700 1 -- 172.21.15.40:0/3396382584 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b9c067580 con 0x7f8b9c06bda0 2023-06-22T10:53:29.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.563+0000 7f8b91ffb700 1 -- 172.21.15.40:0/3396382584 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8b9801a420 con 0x7f8b9c06bda0 2023-06-22T10:53:29.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.564+0000 7f8b91ffb700 1 --2- 172.21.15.40:0/3396382584 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f8b8006ace0 0x7f8b8006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:29.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.564+0000 7f8b91ffb700 1 -- 172.21.15.40:0/3396382584 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8b9808a2e0 con 0x7f8b9c06bda0 2023-06-22T10:53:29.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.564+0000 7f8ba099a700 1 --2- 172.21.15.40:0/3396382584 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f8b8006ace0 0x7f8b8006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:29.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.565+0000 7f8ba099a700 1 --2- 172.21.15.40:0/3396382584 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f8b8006ace0 0x7f8b8006d190 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c08be40 tx=0x7f8b8c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:29.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.568+0000 7f8b91ffb700 1 -- 172.21.15.40:0/3396382584 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8b980556d0 con 0x7f8b9c06bda0 2023-06-22T10:53:29.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.772+0000 7f8ba33ff700 1 -- 172.21.15.40:0/3396382584 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f8b9c15b970 con 0x7f8b9c06bda0 2023-06-22T10:53:29.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.907+0000 7f8b91ffb700 1 -- 172.21.15.40:0/3396382584 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v21) v1 ==== 138+0+0 (secure 0 0 0) 0x7f8b98058cf0 con 0x7f8b9c06bda0 2023-06-22T10:53:29.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.911+0000 7f8ba33ff700 1 -- 172.21.15.40:0/3396382584 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f8b8006ace0 msgr2=0x7f8b8006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:29.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.911+0000 7f8ba33ff700 1 --2- 172.21.15.40:0/3396382584 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f8b8006ace0 0x7f8b8006d190 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c08be40 tx=0x7f8b8c008040 comp rx=0 tx=0).stop 2023-06-22T10:53:29.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.911+0000 7f8ba33ff700 1 -- 172.21.15.40:0/3396382584 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b9c06bda0 msgr2=0x7f8b9c0b3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:29.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.911+0000 7f8ba33ff700 1 --2- 172.21.15.40:0/3396382584 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b9c06bda0 0x7f8b9c0b3170 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8b98009b90 tx=0x7f8b98004750 comp rx=0 tx=0).stop 2023-06-22T10:53:29.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.911+0000 7f8ba33ff700 1 -- 172.21.15.40:0/3396382584 shutdown_connections 2023-06-22T10:53:29.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.911+0000 7f8ba33ff700 1 --2- 172.21.15.40:0/3396382584 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f8b8006ace0 0x7f8b8006d190 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:29.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.911+0000 7f8ba33ff700 1 --2- 172.21.15.40:0/3396382584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8b9c15c3e0 0x7f8b9c0b7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:29.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.911+0000 7f8ba33ff700 1 --2- 172.21.15.40:0/3396382584 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b9c06bda0 0x7f8b9c0b3170 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:29.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.911+0000 7f8ba33ff700 1 --2- 172.21.15.40:0/3396382584 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8b9c0d1e50 0x7f8b9c14dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:29.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.911+0000 7f8ba33ff700 1 -- 172.21.15.40:0/3396382584 >> 172.21.15.40:0/3396382584 conn(0x7f8b9c06b290 msgr2=0x7f8b9c0cbce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:29.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.911+0000 7f8ba33ff700 1 -- 172.21.15.40:0/3396382584 shutdown_connections 2023-06-22T10:53:29.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:29.912+0000 7f8ba33ff700 1 -- 172.21.15.40:0/3396382584 wait complete. 2023-06-22T10:53:29.916 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_metadata' created 2023-06-22T10:53:29.934 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-06-22T10:53:30.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.140+0000 7fe4835ff700 1 Processor -- start 2023-06-22T10:53:30.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.140+0000 7fe4835ff700 1 -- start start 2023-06-22T10:53:30.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.142+0000 7fe4835ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe47c0d2050 0x7fe47c0d1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:30.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.142+0000 7fe4835ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe47c160b00 con 0x7fe47c0d1b00 2023-06-22T10:53:30.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.142+0000 7fe4835ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe47c0cd2f0 con 0x7fe47c15fe30 2023-06-22T10:53:30.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.142+0000 7fe4835ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe47c160da0 con 0x7fe47c0d2050 2023-06-22T10:53:30.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.142+0000 7fe480b9a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe47c0d2050 0x7fe47c0d1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:30.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.142+0000 7fe481b9c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe47c0d1b00 0x7fe47c0d25a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:50702/0 (socket says 172.21.15.40:50702) 2023-06-22T10:53:30.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.142+0000 7fe481b9c700 1 -- 172.21.15.40:0/2673270731 learned_addr learned my addr 172.21.15.40:0/2673270731 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:53:30.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.142+0000 7fe480b9a700 1 -- 172.21.15.40:0/2673270731 >> v1:172.21.15.45:6789/0 conn(0x7fe47c15fe30 legacy=0x7fe47c160200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:30.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.143+0000 7fe480b9a700 1 -- 172.21.15.40:0/2673270731 >> v1:172.21.15.40:6789/0 conn(0x7fe47c0d1b00 legacy=0x7fe47c0d25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:30.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.143+0000 7fe473fff700 1 -- 172.21.15.40:0/2673270731 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 47350354 0 0) 0x7fe47c160b00 con 0x7fe47c0d1b00 2023-06-22T10:53:30.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.143+0000 7fe480b9a700 1 -- 172.21.15.40:0/2673270731 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe47c0cd5d0 con 0x7fe47c0d2050 2023-06-22T10:53:30.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.143+0000 7fe480b9a700 1 --2- 172.21.15.40:0/2673270731 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe47c0d2050 0x7fe47c0d1480 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe46c009840 tx=0x7fe46c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1b0d4f0da18aab7 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:30.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.143+0000 7fe473fff700 1 -- 172.21.15.40:0/2673270731 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46c011830 con 0x7fe47c0d2050 2023-06-22T10:53:30.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.143+0000 7fe473fff700 1 -- 172.21.15.40:0/2673270731 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe46c011990 con 0x7fe47c0d2050 2023-06-22T10:53:30.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.143+0000 7fe473fff700 1 -- 172.21.15.40:0/2673270731 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46c011d20 con 0x7fe47c0d2050 2023-06-22T10:53:30.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.143+0000 7fe4835ff700 1 -- 172.21.15.40:0/2673270731 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe47c0d2050 msgr2=0x7fe47c0d1480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:30.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.143+0000 7fe4835ff700 1 --2- 172.21.15.40:0/2673270731 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe47c0d2050 0x7fe47c0d1480 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe46c009840 tx=0x7fe46c009b50 comp rx=0 tx=0).stop 2023-06-22T10:53:30.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.144+0000 7fe4835ff700 1 -- 172.21.15.40:0/2673270731 shutdown_connections 2023-06-22T10:53:30.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.144+0000 7fe4835ff700 1 --2- 172.21.15.40:0/2673270731 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe47c0d2050 0x7fe47c0d1480 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:30.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.144+0000 7fe4835ff700 1 -- 172.21.15.40:0/2673270731 >> 172.21.15.40:0/2673270731 conn(0x7fe47c071660 msgr2=0x7fe47c071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:30.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.144+0000 7fe4835ff700 1 -- 172.21.15.40:0/2673270731 shutdown_connections 2023-06-22T10:53:30.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.144+0000 7fe4835ff700 1 -- 172.21.15.40:0/2673270731 wait complete. 2023-06-22T10:53:30.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.145+0000 7fe4835ff700 1 Processor -- start 2023-06-22T10:53:30.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.146+0000 7fe4835ff700 1 -- start start 2023-06-22T10:53:30.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.147+0000 7fe4835ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe47c0d1b00 0x7fe47c154100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:30.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.147+0000 7fe4835ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe47c0d2050 0x7fe47c1f4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:30.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.147+0000 7fe4835ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe47c15fe30 0x7fe47c1f31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:30.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.147+0000 7fe4835ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe47c154640 con 0x7fe47c0d1b00 2023-06-22T10:53:30.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.147+0000 7fe4835ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe47c1f4640 con 0x7fe47c0d2050 2023-06-22T10:53:30.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.147+0000 7fe4835ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe47c1f3a30 con 0x7fe47c15fe30 2023-06-22T10:53:30.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.147+0000 7fe48139b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe47c0d1b00 0x7fe47c154100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:30.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.147+0000 7fe48139b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe47c0d1b00 0x7fe47c154100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50754/0 (socket says 172.21.15.40:50754) 2023-06-22T10:53:30.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.147+0000 7fe48139b700 1 -- 172.21.15.40:0/1075022500 learned_addr learned my addr 172.21.15.40:0/1075022500 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:30.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.147+0000 7fe480b9a700 1 --2- 172.21.15.40:0/1075022500 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe47c0d2050 0x7fe47c1f4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:30.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.147+0000 7fe481b9c700 1 --2- 172.21.15.40:0/1075022500 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe47c15fe30 0x7fe47c1f31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:30.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.147+0000 7fe48139b700 1 -- 172.21.15.40:0/1075022500 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe47c15fe30 msgr2=0x7fe47c1f31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:30.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.147+0000 7fe48139b700 1 --2- 172.21.15.40:0/1075022500 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe47c15fe30 0x7fe47c1f31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:30.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.147+0000 7fe48139b700 1 -- 172.21.15.40:0/1075022500 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe47c0d2050 msgr2=0x7fe47c1f4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:30.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.147+0000 7fe48139b700 1 --2- 172.21.15.40:0/1075022500 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe47c0d2050 0x7fe47c1f4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:30.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.147+0000 7fe48139b700 1 -- 172.21.15.40:0/1075022500 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe46c0094a0 con 0x7fe47c0d1b00 2023-06-22T10:53:30.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.148+0000 7fe48139b700 1 --2- 172.21.15.40:0/1075022500 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe47c0d1b00 0x7fe47c154100 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe47800c450 tx=0x7fe47800c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:30.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.148+0000 7fe471ffb700 1 -- 172.21.15.40:0/1075022500 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4780052d0 con 0x7fe47c0d1b00 2023-06-22T10:53:30.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.148+0000 7fe471ffb700 1 -- 172.21.15.40:0/1075022500 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe478005430 con 0x7fe47c0d1b00 2023-06-22T10:53:30.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.148+0000 7fe4835ff700 1 -- 172.21.15.40:0/1075022500 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe47c1f3d10 con 0x7fe47c0d1b00 2023-06-22T10:53:30.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.148+0000 7fe471ffb700 1 -- 172.21.15.40:0/1075022500 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4780038c0 con 0x7fe47c0d1b00 2023-06-22T10:53:30.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.148+0000 7fe4835ff700 1 -- 172.21.15.40:0/1075022500 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe47c1f42d0 con 0x7fe47c0d1b00 2023-06-22T10:53:30.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.149+0000 7fe4835ff700 1 -- 172.21.15.40:0/1075022500 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe47c1f4920 con 0x7fe47c0d1b00 2023-06-22T10:53:30.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.150+0000 7fe471ffb700 1 -- 172.21.15.40:0/1075022500 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe478003a20 con 0x7fe47c0d1b00 2023-06-22T10:53:30.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.151+0000 7fe471ffb700 1 --2- 172.21.15.40:0/1075022500 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe46006ace0 0x7fe46006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:30.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.151+0000 7fe471ffb700 1 -- 172.21.15.40:0/1075022500 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fe4780885d0 con 0x7fe47c0d1b00 2023-06-22T10:53:30.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.151+0000 7fe480b9a700 1 --2- 172.21.15.40:0/1075022500 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe46006ace0 0x7fe46006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:30.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.152+0000 7fe480b9a700 1 --2- 172.21.15.40:0/1075022500 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe46006ace0 0x7fe46006d190 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe46c0090b0 tx=0x7fe46c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:30.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.156+0000 7fe471ffb700 1 -- 172.21.15.40:0/1075022500 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe478053850 con 0x7fe47c0d1b00 2023-06-22T10:53:30.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.364+0000 7fe4835ff700 1 -- 172.21.15.40:0/1075022500 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7fe47c067580 con 0x7fe47c0d1b00 2023-06-22T10:53:30.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.915+0000 7fe471ffb700 1 -- 172.21.15.40:0/1075022500 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v22) v1 ==== 171+0+0 (secure 0 0 0) 0x7fe47800ce60 con 0x7fe47c0d1b00 2023-06-22T10:53:30.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.928+0000 7fe4835ff700 1 -- 172.21.15.40:0/1075022500 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe46006ace0 msgr2=0x7fe46006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:30.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.928+0000 7fe4835ff700 1 --2- 172.21.15.40:0/1075022500 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe46006ace0 0x7fe46006d190 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe46c0090b0 tx=0x7fe46c008030 comp rx=0 tx=0).stop 2023-06-22T10:53:30.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.928+0000 7fe4835ff700 1 -- 172.21.15.40:0/1075022500 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe47c0d1b00 msgr2=0x7fe47c154100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:30.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.928+0000 7fe4835ff700 1 --2- 172.21.15.40:0/1075022500 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe47c0d1b00 0x7fe47c154100 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe47800c450 tx=0x7fe47800c760 comp rx=0 tx=0).stop 2023-06-22T10:53:30.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.928+0000 7fe4835ff700 1 -- 172.21.15.40:0/1075022500 shutdown_connections 2023-06-22T10:53:30.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.928+0000 7fe4835ff700 1 --2- 172.21.15.40:0/1075022500 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe46006ace0 0x7fe46006d190 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:30.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.928+0000 7fe4835ff700 1 --2- 172.21.15.40:0/1075022500 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe47c15fe30 0x7fe47c1f31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:30.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.928+0000 7fe4835ff700 1 --2- 172.21.15.40:0/1075022500 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe47c0d1b00 0x7fe47c154100 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:30.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.928+0000 7fe4835ff700 1 --2- 172.21.15.40:0/1075022500 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe47c0d2050 0x7fe47c1f4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:30.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.928+0000 7fe4835ff700 1 -- 172.21.15.40:0/1075022500 >> 172.21.15.40:0/1075022500 conn(0x7fe47c071660 msgr2=0x7fe47c0b6570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:30.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.929+0000 7fe4835ff700 1 -- 172.21.15.40:0/1075022500 shutdown_connections 2023-06-22T10:53:30.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:30.929+0000 7fe4835ff700 1 -- 172.21.15.40:0/1075022500 wait complete. 2023-06-22T10:53:30.936 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_data' created 2023-06-22T10:53:30.960 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-06-22T10:53:31.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.162+0000 7fdc07bff700 1 Processor -- start 2023-06-22T10:53:31.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.163+0000 7fdc07bff700 1 -- start start 2023-06-22T10:53:31.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.164+0000 7fdc07bff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdc000b45d0 0x7fdc000b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:31.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.164+0000 7fdc07bff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdc000d2130 0x7fdc000cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:31.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.164+0000 7fdc07bff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fdc000cd6e0 0x7fdc000b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:31.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.164+0000 7fdc07bff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc000d17f0 con 0x7fdc000b45d0 2023-06-22T10:53:31.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.164+0000 7fdc07bff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc000d1be0 con 0x7fdc000d2130 2023-06-22T10:53:31.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.164+0000 7fdc07bff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc000d1360 con 0x7fdc000cd6e0 2023-06-22T10:53:31.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.164+0000 7fdc0599b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdc000b45d0 0x7fdc000b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:31.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.164+0000 7fdc0599b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdc000b45d0 0x7fdc000b49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50766/0 (socket says 172.21.15.40:50766) 2023-06-22T10:53:31.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.164+0000 7fdc0599b700 1 -- 172.21.15.40:0/2160863510 learned_addr learned my addr 172.21.15.40:0/2160863510 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:31.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.164+0000 7fdc0619c700 1 --2- 172.21.15.40:0/2160863510 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fdc000cd6e0 0x7fdc000b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:31.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.164+0000 7fdc0519a700 1 --2- 172.21.15.40:0/2160863510 >> v2:172.21.15.45:3300/0 conn(0x7fdc000d2130 0x7fdc000cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:31.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.165+0000 7fdc0599b700 1 -- 172.21.15.40:0/2160863510 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fdc000cd6e0 msgr2=0x7fdc000b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:31.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.165+0000 7fdc0599b700 1 --2- 172.21.15.40:0/2160863510 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fdc000cd6e0 0x7fdc000b59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:31.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.165+0000 7fdc0599b700 1 -- 172.21.15.40:0/2160863510 >> v2:172.21.15.45:3300/0 conn(0x7fdc000d2130 msgr2=0x7fdc000cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:31.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.165+0000 7fdc0599b700 1 --2- 172.21.15.40:0/2160863510 >> v2:172.21.15.45:3300/0 conn(0x7fdc000d2130 0x7fdc000cd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:31.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.165+0000 7fdc0599b700 1 -- 172.21.15.40:0/2160863510 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc000b4ee0 con 0x7fdc000b45d0 2023-06-22T10:53:31.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.165+0000 7fdc0519a700 1 --2- 172.21.15.40:0/2160863510 >> v2:172.21.15.45:3300/0 conn(0x7fdc000d2130 0x7fdc000cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:53:31.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.165+0000 7fdc0599b700 1 --2- 172.21.15.40:0/2160863510 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc000b45d0 0x7fdc000b49a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdc000668c0 tx=0x7fdbfc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=580addcd02a5652a server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:31.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.165+0000 7fdc04999700 1 -- 172.21.15.40:0/2160863510 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbfc011830 con 0x7fdc000b45d0 2023-06-22T10:53:31.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.165+0000 7fdc04999700 1 -- 172.21.15.40:0/2160863510 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbfc011990 con 0x7fdc000b45d0 2023-06-22T10:53:31.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.165+0000 7fdc04999700 1 -- 172.21.15.40:0/2160863510 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbfc011d20 con 0x7fdc000b45d0 2023-06-22T10:53:31.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.166+0000 7fdc07bff700 1 -- 172.21.15.40:0/2160863510 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc000b45d0 msgr2=0x7fdc000b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:31.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.166+0000 7fdc07bff700 1 --2- 172.21.15.40:0/2160863510 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc000b45d0 0x7fdc000b49a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdc000668c0 tx=0x7fdbfc009bd0 comp rx=0 tx=0).stop 2023-06-22T10:53:31.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.166+0000 7fdc07bff700 1 -- 172.21.15.40:0/2160863510 shutdown_connections 2023-06-22T10:53:31.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.166+0000 7fdc07bff700 1 --2- 172.21.15.40:0/2160863510 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fdc000cd6e0 0x7fdc000b59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:31.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.166+0000 7fdc07bff700 1 --2- 172.21.15.40:0/2160863510 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc000b45d0 0x7fdc000b49a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:31.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.166+0000 7fdc07bff700 1 --2- 172.21.15.40:0/2160863510 >> v2:172.21.15.45:3300/0 conn(0x7fdc000d2130 0x7fdc000cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:31.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.166+0000 7fdc07bff700 1 -- 172.21.15.40:0/2160863510 >> 172.21.15.40:0/2160863510 conn(0x7fdc000cf5d0 msgr2=0x7fdc000cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:31.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.166+0000 7fdc07bff700 1 -- 172.21.15.40:0/2160863510 shutdown_connections 2023-06-22T10:53:31.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.166+0000 7fdc07bff700 1 -- 172.21.15.40:0/2160863510 wait complete. 2023-06-22T10:53:31.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.168+0000 7fdc07bff700 1 Processor -- start 2023-06-22T10:53:31.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.169+0000 7fdc07bff700 1 -- start start 2023-06-22T10:53:31.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.170+0000 7fdc07bff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fdc000b45d0 0x7fdc0015e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:31.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.170+0000 7fdc07bff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc000cd6e0 0x7fdc001f1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:31.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.170+0000 7fdc07bff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc000d2130 0x7fdc00146c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:31.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.170+0000 7fdc07bff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc00144c30 con 0x7fdc000d2130 2023-06-22T10:53:31.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.170+0000 7fdc07bff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0015e6a0 con 0x7fdc000cd6e0 2023-06-22T10:53:31.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.170+0000 7fdc07bff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0015e980 con 0x7fdc000b45d0 2023-06-22T10:53:31.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.170+0000 7fdc0619c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc000d2130 0x7fdc00146c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:31.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.170+0000 7fdc0619c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc000d2130 0x7fdc00146c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50768/0 (socket says 172.21.15.40:50768) 2023-06-22T10:53:31.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.170+0000 7fdc0619c700 1 -- 172.21.15.40:0/105573705 learned_addr learned my addr 172.21.15.40:0/105573705 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:31.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.171+0000 7fdc0519a700 1 --2- 172.21.15.40:0/105573705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc000cd6e0 0x7fdc001f1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:31.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.171+0000 7fdc0599b700 1 --2- 172.21.15.40:0/105573705 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fdc000b45d0 0x7fdc0015e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:31.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.171+0000 7fdc0619c700 1 -- 172.21.15.40:0/105573705 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fdc000b45d0 msgr2=0x7fdc0015e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:31.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.171+0000 7fdc0619c700 1 --2- 172.21.15.40:0/105573705 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fdc000b45d0 0x7fdc0015e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:31.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.171+0000 7fdc0619c700 1 -- 172.21.15.40:0/105573705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc000cd6e0 msgr2=0x7fdc001f1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:31.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.171+0000 7fdc0619c700 1 --2- 172.21.15.40:0/105573705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc000cd6e0 0x7fdc001f1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:31.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.171+0000 7fdc0619c700 1 -- 172.21.15.40:0/105573705 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbfc009550 con 0x7fdc000d2130 2023-06-22T10:53:31.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.171+0000 7fdc0519a700 1 --2- 172.21.15.40:0/105573705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc000cd6e0 0x7fdc001f1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-22T10:53:31.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.171+0000 7fdc0599b700 1 --2- 172.21.15.40:0/105573705 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fdc000b45d0 0x7fdc0015e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-22T10:53:31.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.171+0000 7fdc0619c700 1 --2- 172.21.15.40:0/105573705 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc000d2130 0x7fdc00146c00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdbf800eed0 tx=0x7fdbf800b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:31.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.171+0000 7fdbf67fc700 1 -- 172.21.15.40:0/105573705 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf8010040 con 0x7fdc000d2130 2023-06-22T10:53:31.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.171+0000 7fdbf67fc700 1 -- 172.21.15.40:0/105573705 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbf800bd30 con 0x7fdc000d2130 2023-06-22T10:53:31.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.171+0000 7fdc07bff700 1 -- 172.21.15.40:0/105573705 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc0015ec60 con 0x7fdc000d2130 2023-06-22T10:53:31.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.171+0000 7fdbf67fc700 1 -- 172.21.15.40:0/105573705 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf8009ea0 con 0x7fdc000d2130 2023-06-22T10:53:31.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.171+0000 7fdc07bff700 1 -- 172.21.15.40:0/105573705 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc001f1b80 con 0x7fdc000d2130 2023-06-22T10:53:31.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.172+0000 7fdc07bff700 1 -- 172.21.15.40:0/105573705 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc00144de0 con 0x7fdc000d2130 2023-06-22T10:53:31.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.174+0000 7fdbf67fc700 1 -- 172.21.15.40:0/105573705 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdbf8014640 con 0x7fdc000d2130 2023-06-22T10:53:31.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.175+0000 7fdbf67fc700 1 --2- 172.21.15.40:0/105573705 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fdbe406ace0 0x7fdbe406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:31.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.175+0000 7fdbf67fc700 1 -- 172.21.15.40:0/105573705 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fdbf8089a30 con 0x7fdc000d2130 2023-06-22T10:53:31.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.175+0000 7fdc0599b700 1 --2- 172.21.15.40:0/105573705 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fdbe406ace0 0x7fdbe406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:31.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.175+0000 7fdc0599b700 1 --2- 172.21.15.40:0/105573705 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fdbe406ace0 0x7fdbe406d190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc014040 tx=0x7fdbfc008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:31.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.180+0000 7fdbf67fc700 1 -- 172.21.15.40:0/105573705 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdbf8054b30 con 0x7fdc000d2130 2023-06-22T10:53:31.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.429+0000 7fdc07bff700 1 -- 172.21.15.40:0/105573705 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fdc00067580 con 0x7fdc000d2130 2023-06-22T10:53:31.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.916+0000 7fdbf67fc700 1 -- 172.21.15.40:0/105573705 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fdbf8018020 con 0x7fdc000d2130 2023-06-22T10:53:31.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.928+0000 7fdc07bff700 1 -- 172.21.15.40:0/105573705 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fdbe406ace0 msgr2=0x7fdbe406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:31.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.928+0000 7fdc07bff700 1 --2- 172.21.15.40:0/105573705 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fdbe406ace0 0x7fdbe406d190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc014040 tx=0x7fdbfc008030 comp rx=0 tx=0).stop 2023-06-22T10:53:31.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.928+0000 7fdc07bff700 1 -- 172.21.15.40:0/105573705 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc000d2130 msgr2=0x7fdc00146c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:31.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.928+0000 7fdc07bff700 1 --2- 172.21.15.40:0/105573705 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc000d2130 0x7fdc00146c00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdbf800eed0 tx=0x7fdbf800b390 comp rx=0 tx=0).stop 2023-06-22T10:53:31.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.930+0000 7fdc07bff700 1 -- 172.21.15.40:0/105573705 shutdown_connections 2023-06-22T10:53:31.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.930+0000 7fdc07bff700 1 --2- 172.21.15.40:0/105573705 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fdbe406ace0 0x7fdbe406d190 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:31.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.930+0000 7fdc07bff700 1 --2- 172.21.15.40:0/105573705 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fdc000b45d0 0x7fdc0015e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:31.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.930+0000 7fdc07bff700 1 --2- 172.21.15.40:0/105573705 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdc000d2130 0x7fdc00146c00 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:31.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.930+0000 7fdc07bff700 1 --2- 172.21.15.40:0/105573705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc000cd6e0 0x7fdc001f1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:31.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.930+0000 7fdc07bff700 1 -- 172.21.15.40:0/105573705 >> 172.21.15.40:0/105573705 conn(0x7fdc000cf5d0 msgr2=0x7fdc000b7990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:31.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.935+0000 7fdc07bff700 1 -- 172.21.15.40:0/105573705 shutdown_connections 2023-06-22T10:53:31.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:31.937+0000 7fdc07bff700 1 -- 172.21.15.40:0/105573705 wait complete. 2023-06-22T10:53:31.946 INFO:teuthology.orchestra.run.smithi040.stderr:new fs with metadata pool 3 and data pool 4 2023-06-22T10:53:31.971 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-06-22T10:53:31.972 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-06-22T10:53:32.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.176+0000 7fd0a53ff700 1 Processor -- start 2023-06-22T10:53:32.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.176+0000 7fd0a53ff700 1 -- start start 2023-06-22T10:53:32.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.177+0000 7fd0a53ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd0a015c3e0 0x7fd0a00b5a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:32.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.177+0000 7fd0a53ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd0a00d2020 0x7fd0a00cee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:32.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.177+0000 7fd0a53ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0a00b5f90 con 0x7fd0a006bda0 2023-06-22T10:53:32.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.177+0000 7fd0a53ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0a00cda60 con 0x7fd0a00d2020 2023-06-22T10:53:32.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.177+0000 7fd0a53ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a00d11e0 con 0x7fd0a015c3e0 2023-06-22T10:53:32.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.177+0000 7fd09f7fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd0a00d2020 0x7fd0a00cee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:32.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.178+0000 7fd09effd700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd0a015c3e0 0x7fd0a00b5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:32.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.178+0000 7fd09f7fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd0a00d2020 0x7fd0a00cee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.40:33004/0 (socket says 172.21.15.40:33004) 2023-06-22T10:53:32.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.178+0000 7fd09f7fe700 1 -- 172.21.15.40:0/1898641286 learned_addr learned my addr 172.21.15.40:0/1898641286 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:32.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.178+0000 7fd09f7fe700 1 -- 172.21.15.40:0/1898641286 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd0a015c3e0 msgr2=0x7fd0a00b5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:32.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.178+0000 7fd09f7fe700 1 --2- 172.21.15.40:0/1898641286 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd0a015c3e0 0x7fd0a00b5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:32.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.178+0000 7fd09f7fe700 1 -- 172.21.15.40:0/1898641286 >> v1:172.21.15.45:6789/0 conn(0x7fd0a006bda0 legacy=0x7fd0a00d1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:32.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.178+0000 7fd09f7fe700 1 -- 172.21.15.40:0/1898641286 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a00cd250 con 0x7fd0a00d2020 2023-06-22T10:53:32.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.178+0000 7fd09effd700 1 --2- 172.21.15.40:0/1898641286 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd0a015c3e0 0x7fd0a00b5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-22T10:53:32.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.178+0000 7fd09f7fe700 1 --2- 172.21.15.40:0/1898641286 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0a00d2020 0x7fd0a00cee50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd098009e50 tx=0x7fd09800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c54b6bd31ffd7edb server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:32.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.179+0000 7fd09e7fc700 1 -- 172.21.15.40:0/1898641286 <== mon.1 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09800e070 con 0x7fd0a00d2020 2023-06-22T10:53:32.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.179+0000 7fd09e7fc700 1 -- 172.21.15.40:0/1898641286 <== mon.1 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd09800b910 con 0x7fd0a00d2020 2023-06-22T10:53:32.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.179+0000 7fd09e7fc700 1 -- 172.21.15.40:0/1898641286 <== mon.1 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09800bcc0 con 0x7fd0a00d2020 2023-06-22T10:53:32.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.179+0000 7fd0a53ff700 1 -- 172.21.15.40:0/1898641286 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0a00d2020 msgr2=0x7fd0a00cee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:32.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.179+0000 7fd0a53ff700 1 --2- 172.21.15.40:0/1898641286 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0a00d2020 0x7fd0a00cee50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd098009e50 tx=0x7fd09800b330 comp rx=0 tx=0).stop 2023-06-22T10:53:32.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.179+0000 7fd0a53ff700 1 -- 172.21.15.40:0/1898641286 shutdown_connections 2023-06-22T10:53:32.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.179+0000 7fd0a53ff700 1 --2- 172.21.15.40:0/1898641286 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0a00d2020 0x7fd0a00cee50 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:32.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.179+0000 7fd0a53ff700 1 --2- 172.21.15.40:0/1898641286 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd0a015c3e0 0x7fd0a00b5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:32.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.179+0000 7fd0a53ff700 1 -- 172.21.15.40:0/1898641286 >> 172.21.15.40:0/1898641286 conn(0x7fd0a006b290 msgr2=0x7fd0a006b690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:32.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.179+0000 7fd0a53ff700 1 -- 172.21.15.40:0/1898641286 shutdown_connections 2023-06-22T10:53:32.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.179+0000 7fd0a53ff700 1 -- 172.21.15.40:0/1898641286 wait complete. 2023-06-22T10:53:32.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.181+0000 7fd0a53ff700 1 Processor -- start 2023-06-22T10:53:32.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.181+0000 7fd0a53ff700 1 -- start start 2023-06-22T10:53:32.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.182+0000 7fd0a53ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd0a006bda0 0x7fd0a015b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:32.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.182+0000 7fd0a53ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0a00d2020 0x7fd0a01e37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:32.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.182+0000 7fd0a53ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0a015c3e0 0x7fd0a01e3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:32.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.182+0000 7fd0a53ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a01f1790 con 0x7fd0a015c3e0 2023-06-22T10:53:32.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.182+0000 7fd0a53ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a01f1a10 con 0x7fd0a00d2020 2023-06-22T10:53:32.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.182+0000 7fd0a53ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a01f1cf0 con 0x7fd0a006bda0 2023-06-22T10:53:32.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.182+0000 7fd09f7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0a015c3e0 0x7fd0a01e3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:32.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.182+0000 7fd09f7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0a015c3e0 0x7fd0a01e3ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50770/0 (socket says 172.21.15.40:50770) 2023-06-22T10:53:32.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.182+0000 7fd09f7fe700 1 -- 172.21.15.40:0/2281374360 learned_addr learned my addr 172.21.15.40:0/2281374360 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:32.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.183+0000 7fd09effd700 1 --2- 172.21.15.40:0/2281374360 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd0a006bda0 0x7fd0a015b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:32.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.183+0000 7fd097fff700 1 --2- 172.21.15.40:0/2281374360 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0a00d2020 0x7fd0a01e37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:32.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.183+0000 7fd09f7fe700 1 -- 172.21.15.40:0/2281374360 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd0a006bda0 msgr2=0x7fd0a015b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:32.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.183+0000 7fd09f7fe700 1 --2- 172.21.15.40:0/2281374360 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd0a006bda0 0x7fd0a015b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:32.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.183+0000 7fd09f7fe700 1 -- 172.21.15.40:0/2281374360 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0a00d2020 msgr2=0x7fd0a01e37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:32.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.183+0000 7fd09f7fe700 1 --2- 172.21.15.40:0/2281374360 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0a00d2020 0x7fd0a01e37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:32.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.183+0000 7fd09f7fe700 1 -- 172.21.15.40:0/2281374360 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0900094a0 con 0x7fd0a015c3e0 2023-06-22T10:53:32.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.183+0000 7fd09f7fe700 1 --2- 172.21.15.40:0/2281374360 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0a015c3e0 0x7fd0a01e3ce0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd0a008ac40 tx=0x7fd098004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:32.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.183+0000 7fd0977fe700 1 -- 172.21.15.40:0/2281374360 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd098004920 con 0x7fd0a015c3e0 2023-06-22T10:53:32.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.183+0000 7fd0977fe700 1 -- 172.21.15.40:0/2281374360 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0980092e0 con 0x7fd0a015c3e0 2023-06-22T10:53:32.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.183+0000 7fd0977fe700 1 -- 172.21.15.40:0/2281374360 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09801c660 con 0x7fd0a015c3e0 2023-06-22T10:53:32.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.183+0000 7fd0a53ff700 1 -- 172.21.15.40:0/2281374360 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd098009b30 con 0x7fd0a015c3e0 2023-06-22T10:53:32.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.183+0000 7fd0a53ff700 1 -- 172.21.15.40:0/2281374360 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0a01f22b0 con 0x7fd0a015c3e0 2023-06-22T10:53:32.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.184+0000 7fd0a53ff700 1 -- 172.21.15.40:0/2281374360 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0a0067580 con 0x7fd0a015c3e0 2023-06-22T10:53:32.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.185+0000 7fd0977fe700 1 -- 172.21.15.40:0/2281374360 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd09801c7c0 con 0x7fd0a015c3e0 2023-06-22T10:53:32.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.186+0000 7fd0977fe700 1 --2- 172.21.15.40:0/2281374360 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fd08006ace0 0x7fd08006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:32.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.186+0000 7fd0977fe700 1 -- 172.21.15.40:0/2281374360 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd09808b260 con 0x7fd0a015c3e0 2023-06-22T10:53:32.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.186+0000 7fd09effd700 1 --2- 172.21.15.40:0/2281374360 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fd08006ace0 0x7fd08006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:32.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.187+0000 7fd09effd700 1 --2- 172.21.15.40:0/2281374360 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fd08006ace0 0x7fd08006d190 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd090009c60 tx=0x7fd090008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:32.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.191+0000 7fd0977fe700 1 -- 172.21.15.40:0/2281374360 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd098056300 con 0x7fd0a015c3e0 2023-06-22T10:53:32.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.408+0000 7fd0a53ff700 1 -- 172.21.15.40:0/2281374360 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fd0a00cfdb0 con 0x7fd0a015c3e0 2023-06-22T10:53:32.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.935+0000 7fd0977fe700 1 -- 172.21.15.40:0/2281374360 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v24) v1 ==== 157+0+0 (secure 0 0 0) 0x7fd098059920 con 0x7fd0a015c3e0 2023-06-22T10:53:32.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.938+0000 7fd0a53ff700 1 -- 172.21.15.40:0/2281374360 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fd08006ace0 msgr2=0x7fd08006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:32.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.938+0000 7fd0a53ff700 1 --2- 172.21.15.40:0/2281374360 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fd08006ace0 0x7fd08006d190 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd090009c60 tx=0x7fd090008040 comp rx=0 tx=0).stop 2023-06-22T10:53:32.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.938+0000 7fd0a53ff700 1 -- 172.21.15.40:0/2281374360 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0a015c3e0 msgr2=0x7fd0a01e3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:32.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.938+0000 7fd0a53ff700 1 --2- 172.21.15.40:0/2281374360 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0a015c3e0 0x7fd0a01e3ce0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd0a008ac40 tx=0x7fd098004ad0 comp rx=0 tx=0).stop 2023-06-22T10:53:32.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.938+0000 7fd0a53ff700 1 -- 172.21.15.40:0/2281374360 shutdown_connections 2023-06-22T10:53:32.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.938+0000 7fd0a53ff700 1 --2- 172.21.15.40:0/2281374360 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fd08006ace0 0x7fd08006d190 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:32.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.938+0000 7fd0a53ff700 1 --2- 172.21.15.40:0/2281374360 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd0a006bda0 0x7fd0a015b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:32.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.938+0000 7fd0a53ff700 1 --2- 172.21.15.40:0/2281374360 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0a015c3e0 0x7fd0a01e3ce0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:32.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.938+0000 7fd0a53ff700 1 --2- 172.21.15.40:0/2281374360 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0a00d2020 0x7fd0a01e37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:32.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.938+0000 7fd0a53ff700 1 -- 172.21.15.40:0/2281374360 >> 172.21.15.40:0/2281374360 conn(0x7fd0a006b290 msgr2=0x7fd0a00b6120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:32.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.938+0000 7fd0a53ff700 1 -- 172.21.15.40:0/2281374360 shutdown_connections 2023-06-22T10:53:32.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:32.938+0000 7fd0a53ff700 1 -- 172.21.15.40:0/2281374360 wait complete. 2023-06-22T10:53:32.961 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-06-22T10:53:33.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:33.169+0000 7f06a3fff700 1 Processor -- start 2023-06-22T10:53:33.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:33.169+0000 7f06a3fff700 1 -- start start 2023-06-22T10:53:33.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:33.171+0000 7f06a3fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f069c15fe30 0x7f069c0d1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:33.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:33.171+0000 7f06a3fff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f069c160b00 con 0x7f069c0d2050 2023-06-22T10:53:33.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:33.171+0000 7f06a3fff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f069c0cd2f0 con 0x7f069c0d1b00 2023-06-22T10:53:33.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:33.171+0000 7f06a3fff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f069c160da0 con 0x7f069c15fe30 2023-06-22T10:53:33.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:33.172+0000 7f06a159a700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f069c0d2050 0x7f069c160200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:50718/0 (socket says 172.21.15.40:50718) 2023-06-22T10:53:33.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:33.172+0000 7f06a159a700 1 -- 172.21.15.40:0/3413398649 learned_addr learned my addr 172.21.15.40:0/3413398649 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:53:33.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:33.172+0000 7f06a1d9b700 1 --2- 172.21.15.40:0/3413398649 >> v2:172.21.15.45:3300/0 conn(0x7f069c15fe30 0x7f069c0d1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:33.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:33.172+0000 7f06a0d99700 1 -- 172.21.15.40:0/3413398649 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1558127727 0 0) 0x7f069c160b00 con 0x7f069c0d2050 2023-06-22T10:53:33.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:33.172+0000 7f06a0d99700 1 -- 172.21.15.40:0/3413398649 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06880035b0 con 0x7f069c0d2050 2023-06-22T10:53:33.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:33.172+0000 7f06a0d99700 1 -- 172.21.15.40:0/3413398649 <== mon.1 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1667491290 0 0) 0x7f069c0cd2f0 con 0x7f069c0d1b00 2023-06-22T10:53:33.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:33.172+0000 7f06a0d99700 1 -- 172.21.15.40:0/3413398649 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f069c160b00 con 0x7f069c0d1b00 2023-06-22T10:53:33.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:33.172+0000 7f06a1d9b700 1 -- 172.21.15.40:0/3413398649 >> v1:172.21.15.45:6789/0 conn(0x7f069c0d1b00 legacy=0x7f069c0d25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:33.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:33.172+0000 7f06a1d9b700 1 -- 172.21.15.40:0/3413398649 >> v1:172.21.15.40:6789/0 conn(0x7f069c0d2050 legacy=0x7f069c160200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:33.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:33.172+0000 7f06a1d9b700 1 -- 172.21.15.40:0/3413398649 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f069c0cd5d0 con 0x7f069c15fe30 2023-06-22T10:53:33.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:33.173+0000 7f06a1d9b700 1 --2- 172.21.15.40:0/3413398649 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f069c15fe30 0x7f069c0d1480 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0698009840 tx=0x7f0698009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b724e671d299bc01 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:33.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:33.173+0000 7f06a0d99700 1 -- 172.21.15.40:0/3413398649 <== mon.1 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0698011830 con 0x7f069c15fe30 2023-06-22T10:53:33.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:33.173+0000 7f06a0d99700 1 -- 172.21.15.40:0/3413398649 <== mon.1 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0698011990 con 0x7f069c15fe30 2023-06-22T10:53:33.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:33.173+0000 7f06a0d99700 1 -- 172.21.15.40:0/3413398649 <== mon.1 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0698011d20 con 0x7f069c15fe30 2023-06-22T10:53:33.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:33.173+0000 7f06a3fff700 1 -- 172.21.15.40:0/3413398649 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f069c15fe30 msgr2=0x7f069c0d1480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:33.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:33.173+0000 7f06a3fff700 1 --2- 172.21.15.40:0/3413398649 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f069c15fe30 0x7f069c0d1480 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0698009840 tx=0x7f0698009b50 comp rx=0 tx=0).stop 2023-06-22T10:53:33.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:33.173+0000 7f06a3fff700 1 -- 172.21.15.40:0/3413398649 shutdown_connections 2023-06-22T10:53:33.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:33.173+0000 7f06a3fff700 1 --2- 172.21.15.40:0/3413398649 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f069c15fe30 0x7f069c0d1480 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:33.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:33.173+0000 7f06a3fff700 1 -- 172.21.15.40:0/3413398649 >> 172.21.15.40:0/3413398649 conn(0x7f069c071660 msgr2=0x7f069c071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:33.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:33.174+0000 7f06a3fff700 1 -- 172.21.15.40:0/3413398649 shutdown_connections 2023-06-22T10:53:33.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:33.174+0000 7f06a3fff700 1 -- 172.21.15.40:0/3413398649 wait complete. 2023-06-22T10:53:33.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:33.175+0000 7f06a3fff700 1 Processor -- start 2023-06-22T10:53:33.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:33.175+0000 7f06a3fff700 1 -- start start 2023-06-22T10:53:33.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:33.176+0000 7f06a3fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f069c0d1b00 0x7f069c15f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:33.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:33.176+0000 7f06a3fff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f069c0d2050 0x7f069c0c6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:33.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:33.176+0000 7f06a3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f069c15fe30 0x7f069c0c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:33.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:33.176+0000 7f06a3fff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069c0c87d0 con 0x7f069c0d1b00 2023-06-22T10:53:33.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:33.176+0000 7f06a3fff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069c0c76d0 con 0x7f069c15fe30 2023-06-22T10:53:33.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:33.176+0000 7f06a3fff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f069c0c79b0 con 0x7f069c0d2050 2023-06-22T10:53:33.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:33.176+0000 7f06a1d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f069c0d1b00 0x7f069c15f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:33.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:33.177+0000 7f06a1d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f069c0d1b00 0x7f069c15f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50784/0 (socket says 172.21.15.40:50784) 2023-06-22T10:53:33.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:33.177+0000 7f06a1d9b700 1 -- 172.21.15.40:0/4059758288 learned_addr learned my addr 172.21.15.40:0/4059758288 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:33.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:33.177+0000 7f06a159a700 1 --2- 172.21.15.40:0/4059758288 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f069c0d2050 0x7f069c0c6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:33.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:33.177+0000 7f06a259c700 1 --2- 172.21.15.40:0/4059758288 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f069c15fe30 0x7f069c0c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:33.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:33.177+0000 7f06a1d9b700 1 -- 172.21.15.40:0/4059758288 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f069c0d2050 msgr2=0x7f069c0c6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:33.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:33.177+0000 7f06a1d9b700 1 --2- 172.21.15.40:0/4059758288 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f069c0d2050 0x7f069c0c6fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:33.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:33.177+0000 7f06a1d9b700 1 -- 172.21.15.40:0/4059758288 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f069c15fe30 msgr2=0x7f069c0c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:33.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:33.177+0000 7f06a1d9b700 1 --2- 172.21.15.40:0/4059758288 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f069c15fe30 0x7f069c0c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:33.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:33.177+0000 7f06a1d9b700 1 -- 172.21.15.40:0/4059758288 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06980094a0 con 0x7f069c0d1b00 2023-06-22T10:53:33.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:33.177+0000 7f06a1d9b700 1 --2- 172.21.15.40:0/4059758288 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f069c0d1b00 0x7f069c15f2f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0698014040 tx=0x7f0698004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:33.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:33.177+0000 7f06927fc700 1 -- 172.21.15.40:0/4059758288 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069801a6e0 con 0x7f069c0d1b00 2023-06-22T10:53:33.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:33.177+0000 7f06927fc700 1 -- 172.21.15.40:0/4059758288 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f069801a840 con 0x7f069c0d1b00 2023-06-22T10:53:33.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:33.178+0000 7f06927fc700 1 -- 172.21.15.40:0/4059758288 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069801abb0 con 0x7f069c0d1b00 2023-06-22T10:53:33.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:33.178+0000 7f06a3fff700 1 -- 172.21.15.40:0/4059758288 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f069c0c7c90 con 0x7f069c0d1b00 2023-06-22T10:53:33.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:33.178+0000 7f06a3fff700 1 -- 172.21.15.40:0/4059758288 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f069c0c9c40 con 0x7f069c0d1b00 2023-06-22T10:53:33.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:33.179+0000 7f06a3fff700 1 -- 172.21.15.40:0/4059758288 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f069c067580 con 0x7f069c0d1b00 2023-06-22T10:53:33.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:33.180+0000 7f06927fc700 1 -- 172.21.15.40:0/4059758288 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0698022070 con 0x7f069c0d1b00 2023-06-22T10:53:33.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:33.181+0000 7f06927fc700 1 --2- 172.21.15.40:0/4059758288 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f068006ace0 0x7f068006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:33.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:33.181+0000 7f06927fc700 1 -- 172.21.15.40:0/4059758288 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6288+0+0 (secure 0 0 0) 0x7f069808a010 con 0x7f069c0d1b00 2023-06-22T10:53:33.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:33.181+0000 7f06a159a700 1 --2- 172.21.15.40:0/4059758288 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f068006ace0 0x7f068006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:33.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:33.182+0000 7f06a159a700 1 --2- 172.21.15.40:0/4059758288 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f068006ace0 0x7f068006d190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f069c0c8fb0 tx=0x7f068c007de0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:33.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:33.186+0000 7f06927fc700 1 -- 172.21.15.40:0/4059758288 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0698055120 con 0x7f069c0d1b00 2023-06-22T10:53:33.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:33.393+0000 7f06a3fff700 1 -- 172.21.15.40:0/4059758288 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f069c0b6b20 con 0x7f069c0d1b00 2023-06-22T10:53:34.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:34.946+0000 7f06927fc700 1 -- 172.21.15.40:0/4059758288 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v26) v1 ==== 228+0+0 (secure 0 0 0) 0x7f0698015100 con 0x7f069c0d1b00 2023-06-22T10:53:34.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:34.952+0000 7f06a3fff700 1 -- 172.21.15.40:0/4059758288 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f068006ace0 msgr2=0x7f068006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:34.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:34.952+0000 7f06a3fff700 1 --2- 172.21.15.40:0/4059758288 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f068006ace0 0x7f068006d190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f069c0c8fb0 tx=0x7f068c007de0 comp rx=0 tx=0).stop 2023-06-22T10:53:34.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:34.952+0000 7f06a3fff700 1 -- 172.21.15.40:0/4059758288 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f069c0d1b00 msgr2=0x7f069c15f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:34.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:34.952+0000 7f06a3fff700 1 --2- 172.21.15.40:0/4059758288 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f069c0d1b00 0x7f069c15f2f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0698014040 tx=0x7f0698004750 comp rx=0 tx=0).stop 2023-06-22T10:53:34.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:34.953+0000 7f06a3fff700 1 -- 172.21.15.40:0/4059758288 shutdown_connections 2023-06-22T10:53:34.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:34.953+0000 7f06a3fff700 1 --2- 172.21.15.40:0/4059758288 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f068006ace0 0x7f068006d190 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:34.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:34.953+0000 7f06a3fff700 1 --2- 172.21.15.40:0/4059758288 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f069c15fe30 0x7f069c0c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:34.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:34.953+0000 7f06a3fff700 1 --2- 172.21.15.40:0/4059758288 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f069c0d1b00 0x7f069c15f2f0 secure :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0698014040 tx=0x7f0698004750 comp rx=0 tx=0).stop 2023-06-22T10:53:34.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:34.953+0000 7f06a3fff700 1 --2- 172.21.15.40:0/4059758288 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f069c0d2050 0x7f069c0c6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:34.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:34.953+0000 7f06a3fff700 1 -- 172.21.15.40:0/4059758288 >> 172.21.15.40:0/4059758288 conn(0x7f069c071660 msgr2=0x7f069c0b6410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:34.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:34.957+0000 7f06a3fff700 1 -- 172.21.15.40:0/4059758288 shutdown_connections 2023-06-22T10:53:34.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:34.962+0000 7f06a3fff700 1 -- 172.21.15.40:0/4059758288 wait complete. 2023-06-22T10:53:34.967 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_data_ec' created 2023-06-22T10:53:34.986 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-06-22T10:53:35.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.191+0000 7fcbc49ff700 1 Processor -- start 2023-06-22T10:53:35.195 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.191+0000 7fcbc49ff700 1 -- start start 2023-06-22T10:53:35.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.192+0000 7fcbc49ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcbc006bda0 0x7fcbc00b5a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:35.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.193+0000 7fcbc49ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbc00b5f90 con 0x7fcbc00d2020 2023-06-22T10:53:35.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.193+0000 7fcbc49ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbc00cd250 con 0x7fcbc015c3e0 2023-06-22T10:53:35.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.193+0000 7fcbc49ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbc00cda60 con 0x7fcbc006bda0 2023-06-22T10:53:35.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.193+0000 7fcbbed9d700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fcbc00d2020 0x7fcbc00cee50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:50726/0 (socket says 172.21.15.40:50726) 2023-06-22T10:53:35.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.193+0000 7fcbbed9d700 1 -- 172.21.15.40:0/1826788946 learned_addr learned my addr 172.21.15.40:0/1826788946 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:53:35.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.193+0000 7fcbbdd9b700 1 --2- 172.21.15.40:0/1826788946 >> v2:172.21.15.45:3300/0 conn(0x7fcbc006bda0 0x7fcbc00b5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:35.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.193+0000 7fcbbd59a700 1 -- 172.21.15.40:0/1826788946 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1978850428 0 0) 0x7fcbc00b5f90 con 0x7fcbc00d2020 2023-06-22T10:53:35.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.193+0000 7fcbbd59a700 1 -- 172.21.15.40:0/1826788946 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcba80035b0 con 0x7fcbc00d2020 2023-06-22T10:53:35.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.193+0000 7fcbbdd9b700 1 -- 172.21.15.40:0/1826788946 >> v1:172.21.15.45:6789/0 conn(0x7fcbc015c3e0 legacy=0x7fcbc00d1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:35.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.193+0000 7fcbbdd9b700 1 -- 172.21.15.40:0/1826788946 >> v1:172.21.15.40:6789/0 conn(0x7fcbc00d2020 legacy=0x7fcbc00cee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:35.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.193+0000 7fcbbdd9b700 1 -- 172.21.15.40:0/1826788946 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc00d1480 con 0x7fcbc006bda0 2023-06-22T10:53:35.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.194+0000 7fcbbdd9b700 1 --2- 172.21.15.40:0/1826788946 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbc006bda0 0x7fcbc00b5a50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4009840 tx=0x7fcbb4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b087dfc10ec9330e server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:35.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.194+0000 7fcbbd59a700 1 -- 172.21.15.40:0/1826788946 <== mon.1 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb4011830 con 0x7fcbc006bda0 2023-06-22T10:53:35.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.194+0000 7fcbbd59a700 1 -- 172.21.15.40:0/1826788946 <== mon.1 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbb4011990 con 0x7fcbc006bda0 2023-06-22T10:53:35.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.194+0000 7fcbbd59a700 1 -- 172.21.15.40:0/1826788946 <== mon.1 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb4011d20 con 0x7fcbc006bda0 2023-06-22T10:53:35.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.195+0000 7fcbc49ff700 1 -- 172.21.15.40:0/1826788946 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbc006bda0 msgr2=0x7fcbc00b5a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:35.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.195+0000 7fcbc49ff700 1 --2- 172.21.15.40:0/1826788946 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbc006bda0 0x7fcbc00b5a50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4009840 tx=0x7fcbb4009b50 comp rx=0 tx=0).stop 2023-06-22T10:53:35.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.195+0000 7fcbc49ff700 1 -- 172.21.15.40:0/1826788946 shutdown_connections 2023-06-22T10:53:35.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.195+0000 7fcbc49ff700 1 --2- 172.21.15.40:0/1826788946 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbc006bda0 0x7fcbc00b5a50 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:35.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.195+0000 7fcbc49ff700 1 -- 172.21.15.40:0/1826788946 >> 172.21.15.40:0/1826788946 conn(0x7fcbc006b290 msgr2=0x7fcbc006b690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:35.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.195+0000 7fcbc49ff700 1 -- 172.21.15.40:0/1826788946 shutdown_connections 2023-06-22T10:53:35.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.195+0000 7fcbc49ff700 1 -- 172.21.15.40:0/1826788946 wait complete. 2023-06-22T10:53:35.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.196+0000 7fcbc49ff700 1 Processor -- start 2023-06-22T10:53:35.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.197+0000 7fcbc49ff700 1 -- start start 2023-06-22T10:53:35.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.197+0000 7fcbc49ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fcbc006bda0 0x7fcbc0148160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:35.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.197+0000 7fcbc49ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbc00d2020 0x7fcbc00cc720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:35.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.197+0000 7fcbc49ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbc015c3e0 0x7fcbc015a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:35.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.197+0000 7fcbc49ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc00cc300 con 0x7fcbc015c3e0 2023-06-22T10:53:35.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.197+0000 7fcbc49ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc01f1a00 con 0x7fcbc00d2020 2023-06-22T10:53:35.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.197+0000 7fcbc49ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc01486a0 con 0x7fcbc006bda0 2023-06-22T10:53:35.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.198+0000 7fcbbdd9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbc00d2020 0x7fcbc00cc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:35.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.198+0000 7fcbbed9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbc015c3e0 0x7fcbc015a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:35.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.198+0000 7fcbbdd9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbc00d2020 0x7fcbc00cc720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.40:33050/0 (socket says 172.21.15.40:33050) 2023-06-22T10:53:35.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.198+0000 7fcbbdd9b700 1 -- 172.21.15.40:0/1648915267 learned_addr learned my addr 172.21.15.40:0/1648915267 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:35.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.198+0000 7fcbbe59c700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fcbc006bda0 0x7fcbc0148160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:35.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.198+0000 7fcbbdd9b700 1 -- 172.21.15.40:0/1648915267 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fcbc006bda0 msgr2=0x7fcbc0148160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:35.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.198+0000 7fcbbdd9b700 1 --2- 172.21.15.40:0/1648915267 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fcbc006bda0 0x7fcbc0148160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:35.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.198+0000 7fcbbdd9b700 1 -- 172.21.15.40:0/1648915267 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbc015c3e0 msgr2=0x7fcbc015a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:35.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.198+0000 7fcbbdd9b700 1 --2- 172.21.15.40:0/1648915267 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbc015c3e0 0x7fcbc015a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:35.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.198+0000 7fcbbdd9b700 1 -- 172.21.15.40:0/1648915267 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbb40094a0 con 0x7fcbc00d2020 2023-06-22T10:53:35.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.199+0000 7fcbbdd9b700 1 --2- 172.21.15.40:0/1648915267 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbc00d2020 0x7fcbc00cc720 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4009fd0 tx=0x7fcbb4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:35.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.199+0000 7fcbaeffd700 1 -- 172.21.15.40:0/1648915267 <== mon.1 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb40036a0 con 0x7fcbc00d2020 2023-06-22T10:53:35.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.199+0000 7fcbaeffd700 1 -- 172.21.15.40:0/1648915267 <== mon.1 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbb401f070 con 0x7fcbc00d2020 2023-06-22T10:53:35.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.199+0000 7fcbc49ff700 1 -- 172.21.15.40:0/1648915267 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbc00cb960 con 0x7fcbc00d2020 2023-06-22T10:53:35.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.199+0000 7fcbaeffd700 1 -- 172.21.15.40:0/1648915267 <== mon.1 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb4003a60 con 0x7fcbc00d2020 2023-06-22T10:53:35.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.199+0000 7fcbc49ff700 1 -- 172.21.15.40:0/1648915267 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbc00cbf20 con 0x7fcbc00d2020 2023-06-22T10:53:35.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.200+0000 7fcbc49ff700 1 -- 172.21.15.40:0/1648915267 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbc0067580 con 0x7fcbc00d2020 2023-06-22T10:53:35.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.201+0000 7fcbaeffd700 1 -- 172.21.15.40:0/1648915267 <== mon.1 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcbb4003bc0 con 0x7fcbc00d2020 2023-06-22T10:53:35.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.202+0000 7fcbaeffd700 1 --2- 172.21.15.40:0/1648915267 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fcba006ace0 0x7fcba006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:35.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.202+0000 7fcbaeffd700 1 -- 172.21.15.40:0/1648915267 <== mon.1 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6781+0+0 (secure 0 0 0) 0x7fcbb4021070 con 0x7fcbc00d2020 2023-06-22T10:53:35.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.202+0000 7fcbbe59c700 1 --2- 172.21.15.40:0/1648915267 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fcba006ace0 0x7fcba006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:35.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.203+0000 7fcbbe59c700 1 --2- 172.21.15.40:0/1648915267 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fcba006ace0 0x7fcba006d190 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcbb0007fd0 tx=0x7fcbb0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:35.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.207+0000 7fcbaeffd700 1 -- 172.21.15.40:0/1648915267 <== mon.1 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcbb4055f10 con 0x7fcbc00d2020 2023-06-22T10:53:35.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.410+0000 7fcbc49ff700 1 -- 172.21.15.40:0/1648915267 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7fcbc00cfeb0 con 0x7fcbc00d2020 2023-06-22T10:53:35.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.956+0000 7fcbaeffd700 1 -- 172.21.15.40:0/1648915267 <== mon.1 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 5 allow_ec_overwrites to true v27) v1 ==== 169+0+0 (secure 0 0 0) 0x7fcbb4059530 con 0x7fcbc00d2020 2023-06-22T10:53:35.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.967+0000 7fcbc49ff700 1 -- 172.21.15.40:0/1648915267 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fcba006ace0 msgr2=0x7fcba006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:35.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.967+0000 7fcbc49ff700 1 --2- 172.21.15.40:0/1648915267 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fcba006ace0 0x7fcba006d190 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcbb0007fd0 tx=0x7fcbb0009040 comp rx=0 tx=0).stop 2023-06-22T10:53:35.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.967+0000 7fcbc49ff700 1 -- 172.21.15.40:0/1648915267 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbc00d2020 msgr2=0x7fcbc00cc720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:35.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.967+0000 7fcbc49ff700 1 --2- 172.21.15.40:0/1648915267 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbc00d2020 0x7fcbc00cc720 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4009fd0 tx=0x7fcbb4004750 comp rx=0 tx=0).stop 2023-06-22T10:53:35.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.973+0000 7fcbc49ff700 1 -- 172.21.15.40:0/1648915267 shutdown_connections 2023-06-22T10:53:35.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.973+0000 7fcbc49ff700 1 --2- 172.21.15.40:0/1648915267 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fcba006ace0 0x7fcba006d190 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:35.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.973+0000 7fcbc49ff700 1 --2- 172.21.15.40:0/1648915267 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fcbc006bda0 0x7fcbc0148160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:35.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.973+0000 7fcbc49ff700 1 --2- 172.21.15.40:0/1648915267 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbc015c3e0 0x7fcbc015a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:35.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.973+0000 7fcbc49ff700 1 --2- 172.21.15.40:0/1648915267 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbc00d2020 0x7fcbc00cc720 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:35.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.973+0000 7fcbc49ff700 1 -- 172.21.15.40:0/1648915267 >> 172.21.15.40:0/1648915267 conn(0x7fcbc006b290 msgr2=0x7fcbc00d1910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:35.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.976+0000 7fcbc49ff700 1 -- 172.21.15.40:0/1648915267 shutdown_connections 2023-06-22T10:53:35.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:35.977+0000 7fcbc49ff700 1 -- 172.21.15.40:0/1648915267 wait complete. 2023-06-22T10:53:35.994 INFO:teuthology.orchestra.run.smithi040.stderr:set pool 5 allow_ec_overwrites to true 2023-06-22T10:53:36.012 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-06-22T10:53:36.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.214+0000 7f4544bff700 1 Processor -- start 2023-06-22T10:53:36.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.214+0000 7f4544bff700 1 -- start start 2023-06-22T10:53:36.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.215+0000 7f4544bff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f45400b45d0 0x7f45400b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:36.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.215+0000 7f4544bff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f45400b59a0 0x7f45400b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:36.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.215+0000 7f4544bff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45400d1be0 con 0x7f45400d2130 2023-06-22T10:53:36.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.215+0000 7f4544bff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45400d17f0 con 0x7f45400b45d0 2023-06-22T10:53:36.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.215+0000 7f4544bff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45400d1360 con 0x7f45400b59a0 2023-06-22T10:53:36.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.215+0000 7f453e59c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f45400b45d0 0x7f45400b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:36.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.215+0000 7f453dd9b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f45400d2130 0x7f45400cd1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:50730/0 (socket says 172.21.15.40:50730) 2023-06-22T10:53:36.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.215+0000 7f453dd9b700 1 -- 172.21.15.40:0/1478415128 learned_addr learned my addr 172.21.15.40:0/1478415128 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:53:36.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.215+0000 7f453ed9d700 1 --2- 172.21.15.40:0/1478415128 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f45400b59a0 0x7f45400b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:36.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.216+0000 7f453e59c700 1 -- 172.21.15.40:0/1478415128 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f45400b59a0 msgr2=0x7f45400b5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:36.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.216+0000 7f453e59c700 1 --2- 172.21.15.40:0/1478415128 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f45400b59a0 0x7f45400b5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:36.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.216+0000 7f453e59c700 1 -- 172.21.15.40:0/1478415128 >> v1:172.21.15.40:6789/0 conn(0x7f45400d2130 legacy=0x7f45400cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:36.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.216+0000 7f453e59c700 1 -- 172.21.15.40:0/1478415128 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45400b4ee0 con 0x7f45400b45d0 2023-06-22T10:53:36.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.216+0000 7f453e59c700 1 --2- 172.21.15.40:0/1478415128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45400b45d0 0x7f45400b49a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4530009840 tx=0x7f4530009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38526b25f4a8280e server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:36.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.216+0000 7f453d59a700 1 -- 172.21.15.40:0/1478415128 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4530011830 con 0x7f45400b45d0 2023-06-22T10:53:36.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.216+0000 7f453d59a700 1 -- 172.21.15.40:0/1478415128 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4530011990 con 0x7f45400b45d0 2023-06-22T10:53:36.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.216+0000 7f453d59a700 1 -- 172.21.15.40:0/1478415128 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4530011d20 con 0x7f45400b45d0 2023-06-22T10:53:36.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.217+0000 7f4544bff700 1 -- 172.21.15.40:0/1478415128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45400b45d0 msgr2=0x7f45400b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:36.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.217+0000 7f4544bff700 1 --2- 172.21.15.40:0/1478415128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45400b45d0 0x7f45400b49a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4530009840 tx=0x7f4530009b50 comp rx=0 tx=0).stop 2023-06-22T10:53:36.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.217+0000 7f4544bff700 1 -- 172.21.15.40:0/1478415128 shutdown_connections 2023-06-22T10:53:36.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.217+0000 7f4544bff700 1 --2- 172.21.15.40:0/1478415128 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f45400b59a0 0x7f45400b5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:36.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.217+0000 7f4544bff700 1 --2- 172.21.15.40:0/1478415128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45400b45d0 0x7f45400b49a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:36.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.217+0000 7f4544bff700 1 -- 172.21.15.40:0/1478415128 >> 172.21.15.40:0/1478415128 conn(0x7f45400cf5d0 msgr2=0x7f45400cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:36.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.217+0000 7f4544bff700 1 -- 172.21.15.40:0/1478415128 shutdown_connections 2023-06-22T10:53:36.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.217+0000 7f4544bff700 1 -- 172.21.15.40:0/1478415128 wait complete. 2023-06-22T10:53:36.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.219+0000 7f4544bff700 1 Processor -- start 2023-06-22T10:53:36.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.219+0000 7f4544bff700 1 -- start start 2023-06-22T10:53:36.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.220+0000 7f4544bff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f45400b45d0 0x7f4540151e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:36.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.220+0000 7f4544bff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45400b59a0 0x7f454015e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:36.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.220+0000 7f4544bff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45400d2130 0x7f454015ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:36.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.220+0000 7f4544bff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45400aadb0 con 0x7f45400d2130 2023-06-22T10:53:36.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.220+0000 7f4544bff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45401f1d80 con 0x7f45400b59a0 2023-06-22T10:53:36.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.220+0000 7f4544bff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45400aa230 con 0x7f45400b45d0 2023-06-22T10:53:36.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.220+0000 7f453ed9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45400d2130 0x7f454015ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:36.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.220+0000 7f453ed9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45400d2130 0x7f454015ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50818/0 (socket says 172.21.15.40:50818) 2023-06-22T10:53:36.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.220+0000 7f453ed9d700 1 -- 172.21.15.40:0/2502347115 learned_addr learned my addr 172.21.15.40:0/2502347115 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:36.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.220+0000 7f453e59c700 1 --2- 172.21.15.40:0/2502347115 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f45400b45d0 0x7f4540151e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:36.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.220+0000 7f453dd9b700 1 --2- 172.21.15.40:0/2502347115 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45400b59a0 0x7f454015e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:36.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.220+0000 7f453ed9d700 1 -- 172.21.15.40:0/2502347115 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f45400b45d0 msgr2=0x7f4540151e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:36.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.220+0000 7f453ed9d700 1 --2- 172.21.15.40:0/2502347115 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f45400b45d0 0x7f4540151e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:36.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.220+0000 7f453ed9d700 1 -- 172.21.15.40:0/2502347115 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45400b59a0 msgr2=0x7f454015e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:36.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.220+0000 7f453ed9d700 1 --2- 172.21.15.40:0/2502347115 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45400b59a0 0x7f454015e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:36.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.220+0000 7f453ed9d700 1 -- 172.21.15.40:0/2502347115 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45300094a0 con 0x7f45400d2130 2023-06-22T10:53:36.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.220+0000 7f453ed9d700 1 --2- 172.21.15.40:0/2502347115 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45400d2130 0x7f454015ebb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4538007e40 tx=0x7f453800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:36.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.221+0000 7f452effd700 1 -- 172.21.15.40:0/2502347115 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453800ede0 con 0x7f45400d2130 2023-06-22T10:53:36.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.221+0000 7f452effd700 1 -- 172.21.15.40:0/2502347115 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4538014420 con 0x7f45400d2130 2023-06-22T10:53:36.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.221+0000 7f452effd700 1 -- 172.21.15.40:0/2502347115 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45380147d0 con 0x7f45400d2130 2023-06-22T10:53:36.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.221+0000 7f4544bff700 1 -- 172.21.15.40:0/2502347115 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45400aa510 con 0x7f45400d2130 2023-06-22T10:53:36.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.221+0000 7f4544bff700 1 -- 172.21.15.40:0/2502347115 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45400aaad0 con 0x7f45400d2130 2023-06-22T10:53:36.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.222+0000 7f4544bff700 1 -- 172.21.15.40:0/2502347115 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45401f1f40 con 0x7f45400d2130 2023-06-22T10:53:36.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.223+0000 7f452effd700 1 -- 172.21.15.40:0/2502347115 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4538014930 con 0x7f45400d2130 2023-06-22T10:53:36.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.224+0000 7f452effd700 1 --2- 172.21.15.40:0/2502347115 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f452006ace0 0x7f452006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:36.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.224+0000 7f452effd700 1 -- 172.21.15.40:0/2502347115 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6781+0+0 (secure 0 0 0) 0x7f4538089f90 con 0x7f45400d2130 2023-06-22T10:53:36.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.224+0000 7f453e59c700 1 --2- 172.21.15.40:0/2502347115 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f452006ace0 0x7f452006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:36.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.225+0000 7f453e59c700 1 --2- 172.21.15.40:0/2502347115 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f452006ace0 0x7f452006d190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f45300090b0 tx=0x7f453001c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:36.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.229+0000 7f452effd700 1 -- 172.21.15.40:0/2502347115 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f45401f1f40 con 0x7f45400d2130 2023-06-22T10:53:36.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.481+0000 7f4544bff700 1 -- 172.21.15.40:0/2502347115 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f45401f1f40 con 0x7f45400d2130 2023-06-22T10:53:36.833 INFO:tasks.ceph.mds.d.smithi045.stderr:2023-06-22T10:53:36.830+0000 7f966dff1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-22T10:53:36.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.955+0000 7f452effd700 1 -- 172.21.15.40:0/2502347115 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 5 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f45401f1f40 con 0x7f45400d2130 2023-06-22T10:53:36.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.958+0000 7f4544bff700 1 -- 172.21.15.40:0/2502347115 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f452006ace0 msgr2=0x7f452006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:36.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.958+0000 7f4544bff700 1 --2- 172.21.15.40:0/2502347115 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f452006ace0 0x7f452006d190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f45300090b0 tx=0x7f453001c040 comp rx=0 tx=0).stop 2023-06-22T10:53:36.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.958+0000 7f4544bff700 1 -- 172.21.15.40:0/2502347115 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45400d2130 msgr2=0x7f454015ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:36.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.958+0000 7f4544bff700 1 --2- 172.21.15.40:0/2502347115 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45400d2130 0x7f454015ebb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4538007e40 tx=0x7f453800e3c0 comp rx=0 tx=0).stop 2023-06-22T10:53:36.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.958+0000 7f4544bff700 1 -- 172.21.15.40:0/2502347115 shutdown_connections 2023-06-22T10:53:36.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.958+0000 7f4544bff700 1 --2- 172.21.15.40:0/2502347115 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f452006ace0 0x7f452006d190 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:36.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.958+0000 7f4544bff700 1 --2- 172.21.15.40:0/2502347115 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f45400b45d0 0x7f4540151e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:36.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.958+0000 7f4544bff700 1 --2- 172.21.15.40:0/2502347115 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f45400d2130 0x7f454015ebb0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:36.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.958+0000 7f4544bff700 1 --2- 172.21.15.40:0/2502347115 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45400b59a0 0x7f454015e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:36.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.958+0000 7f4544bff700 1 -- 172.21.15.40:0/2502347115 >> 172.21.15.40:0/2502347115 conn(0x7f45400cf5d0 msgr2=0x7f45400d03e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:36.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.958+0000 7f4544bff700 1 -- 172.21.15.40:0/2502347115 shutdown_connections 2023-06-22T10:53:36.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:36.959+0000 7f4544bff700 1 -- 172.21.15.40:0/2502347115 wait complete. 2023-06-22T10:53:36.964 INFO:teuthology.orchestra.run.smithi040.stderr:added data pool 5 to fsmap 2023-06-22T10:53:36.982 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-22T10:53:37.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.184+0000 7f7520fff700 1 Processor -- start 2023-06-22T10:53:37.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.185+0000 7f7520fff700 1 -- start start 2023-06-22T10:53:37.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.186+0000 7f7520fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f751c15c720 0x7f751c0b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:37.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.186+0000 7f7520fff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f751c0b2130 con 0x7f751c0b4e30 2023-06-22T10:53:37.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.186+0000 7f7520fff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f751c161180 con 0x7f751c0d2830 2023-06-22T10:53:37.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.186+0000 7f7520fff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f751c160d60 con 0x7f751c15c720 2023-06-22T10:53:37.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.186+0000 7f751a59c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f751c15c720 0x7f751c0b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:37.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.186+0000 7f751ad9d700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f751c0b4e30 0x7f751c0d0d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:50742/0 (socket says 172.21.15.40:50742) 2023-06-22T10:53:37.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.186+0000 7f751ad9d700 1 -- 172.21.15.40:0/3134306906 learned_addr learned my addr 172.21.15.40:0/3134306906 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:53:37.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.186+0000 7f751a59c700 1 -- 172.21.15.40:0/3134306906 >> v1:172.21.15.45:6789/0 conn(0x7f751c0d2830 legacy=0x7f751c0b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:37.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.186+0000 7f751a59c700 1 -- 172.21.15.40:0/3134306906 >> v1:172.21.15.40:6789/0 conn(0x7f751c0b4e30 legacy=0x7f751c0d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:37.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.186+0000 7f751a59c700 1 -- 172.21.15.40:0/3134306906 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f751c1603c0 con 0x7f751c15c720 2023-06-22T10:53:37.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.186+0000 7f7519d9b700 1 -- 172.21.15.40:0/3134306906 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3289375261 0 0) 0x7f751c0b2130 con 0x7f751c0b4e30 2023-06-22T10:53:37.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.187+0000 7f751a59c700 1 --2- 172.21.15.40:0/3134306906 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f751c15c720 0x7f751c0b1870 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f750c009840 tx=0x7f750c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=580cffbb1a9ffdf8 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:37.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.187+0000 7f7519d9b700 1 -- 172.21.15.40:0/3134306906 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750c011830 con 0x7f751c15c720 2023-06-22T10:53:37.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.187+0000 7f7519d9b700 1 -- 172.21.15.40:0/3134306906 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f750c011990 con 0x7f751c15c720 2023-06-22T10:53:37.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.187+0000 7f7519d9b700 1 -- 172.21.15.40:0/3134306906 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750c011d20 con 0x7f751c15c720 2023-06-22T10:53:37.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.187+0000 7f7520fff700 1 -- 172.21.15.40:0/3134306906 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f751c15c720 msgr2=0x7f751c0b1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:37.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.187+0000 7f7520fff700 1 --2- 172.21.15.40:0/3134306906 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f751c15c720 0x7f751c0b1870 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f750c009840 tx=0x7f750c009b50 comp rx=0 tx=0).stop 2023-06-22T10:53:37.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.188+0000 7f7520fff700 1 -- 172.21.15.40:0/3134306906 shutdown_connections 2023-06-22T10:53:37.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.188+0000 7f7520fff700 1 --2- 172.21.15.40:0/3134306906 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f751c15c720 0x7f751c0b1870 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:37.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.188+0000 7f7520fff700 1 -- 172.21.15.40:0/3134306906 >> 172.21.15.40:0/3134306906 conn(0x7f751c0cf720 msgr2=0x7f751c0cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:37.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.188+0000 7f7520fff700 1 -- 172.21.15.40:0/3134306906 shutdown_connections 2023-06-22T10:53:37.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.188+0000 7f7520fff700 1 -- 172.21.15.40:0/3134306906 wait complete. 2023-06-22T10:53:37.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.190+0000 7f7520fff700 1 Processor -- start 2023-06-22T10:53:37.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.190+0000 7f7520fff700 1 -- start start 2023-06-22T10:53:37.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.191+0000 7f7520fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f751c0b4e30 0x7f751c0c9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:37.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.191+0000 7f7520fff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f751c0d2830 0x7f751c15e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:37.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.191+0000 7f7520fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f751c15c720 0x7f751c1f1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:37.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.191+0000 7f7520fff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751c0cc010 con 0x7f751c15c720 2023-06-22T10:53:37.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.191+0000 7f7520fff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751c1f2af0 con 0x7f751c0b4e30 2023-06-22T10:53:37.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.191+0000 7f7520fff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f751c1f2dd0 con 0x7f751c0d2830 2023-06-22T10:53:37.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.191+0000 7f751ad9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f751c15c720 0x7f751c1f1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:37.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.191+0000 7f751ad9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f751c15c720 0x7f751c1f1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50826/0 (socket says 172.21.15.40:50826) 2023-06-22T10:53:37.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.191+0000 7f751ad9d700 1 -- 172.21.15.40:0/1119709024 learned_addr learned my addr 172.21.15.40:0/1119709024 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:37.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.192+0000 7f751a59c700 1 --2- 172.21.15.40:0/1119709024 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f751c0b4e30 0x7f751c0c9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:37.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.192+0000 7f7513fff700 1 --2- 172.21.15.40:0/1119709024 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f751c0d2830 0x7f751c15e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:37.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.192+0000 7f751ad9d700 1 -- 172.21.15.40:0/1119709024 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f751c0d2830 msgr2=0x7f751c15e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:37.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.192+0000 7f751ad9d700 1 --2- 172.21.15.40:0/1119709024 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f751c0d2830 0x7f751c15e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:37.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.192+0000 7f751ad9d700 1 -- 172.21.15.40:0/1119709024 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f751c0b4e30 msgr2=0x7f751c0c9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:37.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.192+0000 7f751ad9d700 1 --2- 172.21.15.40:0/1119709024 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f751c0b4e30 0x7f751c0c9d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:37.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.192+0000 7f751ad9d700 1 -- 172.21.15.40:0/1119709024 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f750c0094a0 con 0x7f751c15c720 2023-06-22T10:53:37.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.192+0000 7f751a59c700 1 --2- 172.21.15.40:0/1119709024 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f751c0b4e30 0x7f751c0c9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:53:37.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.192+0000 7f751ad9d700 1 --2- 172.21.15.40:0/1119709024 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f751c15c720 0x7f751c1f1f10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f751400cc70 tx=0x7f751400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:37.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.192+0000 7f7512ffd700 1 -- 172.21.15.40:0/1119709024 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751400ad80 con 0x7f751c15c720 2023-06-22T10:53:37.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.192+0000 7f7512ffd700 1 -- 172.21.15.40:0/1119709024 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f751400ce70 con 0x7f751c15c720 2023-06-22T10:53:37.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.192+0000 7f7512ffd700 1 -- 172.21.15.40:0/1119709024 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75140072f0 con 0x7f751c15c720 2023-06-22T10:53:37.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.192+0000 7f7520fff700 1 -- 172.21.15.40:0/1119709024 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f751c15cd50 con 0x7f751c15c720 2023-06-22T10:53:37.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.192+0000 7f7520fff700 1 -- 172.21.15.40:0/1119709024 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f751c15d310 con 0x7f751c15c720 2023-06-22T10:53:37.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.193+0000 7f7520fff700 1 -- 172.21.15.40:0/1119709024 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f751c067580 con 0x7f751c15c720 2023-06-22T10:53:37.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.195+0000 7f7512ffd700 1 -- 172.21.15.40:0/1119709024 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7514007450 con 0x7f751c15c720 2023-06-22T10:53:37.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.195+0000 7f7512ffd700 1 --2- 172.21.15.40:0/1119709024 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f74fc06ace0 0x7f74fc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:37.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.196+0000 7f7512ffd700 1 -- 172.21.15.40:0/1119709024 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7514089370 con 0x7f751c15c720 2023-06-22T10:53:37.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.196+0000 7f751a59c700 1 --2- 172.21.15.40:0/1119709024 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f74fc06ace0 0x7f74fc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:37.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.196+0000 7f751a59c700 1 --2- 172.21.15.40:0/1119709024 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f74fc06ace0 0x7f74fc06d190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f750c0090b0 tx=0x7f750c01c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:37.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.200+0000 7f7512ffd700 1 -- 172.21.15.40:0/1119709024 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7514054090 con 0x7f751c15c720 2023-06-22T10:53:37.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.452+0000 7f7520fff700 1 -- 172.21.15.40:0/1119709024 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f751c15b730 con 0x7f751c15c720 2023-06-22T10:53:37.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.452+0000 7f7512ffd700 1 -- 172.21.15.40:0/1119709024 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4664 (secure 0 0 0) 0x7f75140576b0 con 0x7f751c15c720 2023-06-22T10:53:37.470 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:53:37.470 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/627935577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":627935577},{"type":"v1","addr":"172.21.15.40:6835","nonce":627935577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3018871402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3018871402},{"type":"v1","addr":"172.21.15.40:6837","nonce":3018871402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/4036649607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":4036649607},{"type":"v1","addr":"172.21.15.45:6834","nonce":4036649607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-22T10:53:31.430326+0000","modified":"2023-06-22T10:53:36.951183+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4303},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4303":{"gid":4303,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/1579627519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":1579627519},{"type":"v1","addr":"172.21.15.45:6835","nonce":1579627519}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-06-22T10:53:37.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.454+0000 7f7520fff700 1 -- 172.21.15.40:0/1119709024 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f74fc06ace0 msgr2=0x7f74fc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:37.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.454+0000 7f7520fff700 1 --2- 172.21.15.40:0/1119709024 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f74fc06ace0 0x7f74fc06d190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f750c0090b0 tx=0x7f750c01c040 comp rx=0 tx=0).stop 2023-06-22T10:53:37.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.454+0000 7f7520fff700 1 -- 172.21.15.40:0/1119709024 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f751c15c720 msgr2=0x7f751c1f1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:37.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.454+0000 7f7520fff700 1 --2- 172.21.15.40:0/1119709024 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f751c15c720 0x7f751c1f1f10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f751400cc70 tx=0x7f751400a340 comp rx=0 tx=0).stop 2023-06-22T10:53:37.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.454+0000 7f7520fff700 1 -- 172.21.15.40:0/1119709024 shutdown_connections 2023-06-22T10:53:37.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.454+0000 7f7520fff700 1 --2- 172.21.15.40:0/1119709024 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f74fc06ace0 0x7f74fc06d190 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:37.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.454+0000 7f7520fff700 1 --2- 172.21.15.40:0/1119709024 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f751c15c720 0x7f751c1f1f10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:37.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.454+0000 7f7520fff700 1 --2- 172.21.15.40:0/1119709024 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f751c0b4e30 0x7f751c0c9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:37.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.454+0000 7f7520fff700 1 --2- 172.21.15.40:0/1119709024 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f751c0d2830 0x7f751c15e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:37.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.454+0000 7f7520fff700 1 -- 172.21.15.40:0/1119709024 >> 172.21.15.40:0/1119709024 conn(0x7f751c0cf720 msgr2=0x7f751c0b5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:37.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.455+0000 7f7520fff700 1 -- 172.21.15.40:0/1119709024 shutdown_connections 2023-06-22T10:53:37.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.455+0000 7f7520fff700 1 -- 172.21.15.40:0/1119709024 wait complete. 2023-06-22T10:53:37.474 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 7 2023-06-22T10:53:37.476 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-22T10:53:37.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.673+0000 7f16f69ff700 1 Processor -- start 2023-06-22T10:53:37.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.674+0000 7f16f69ff700 1 -- start start 2023-06-22T10:53:37.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.675+0000 7f16f69ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f16f015c720 0x7f16f00b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:37.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.675+0000 7f16f69ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f16f00d2830 0x7f16f00b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:37.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.675+0000 7f16f69ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f16f00b4c60 0x7f16f006b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:37.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.675+0000 7f16f69ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16f0160d60 con 0x7f16f015c720 2023-06-22T10:53:37.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.675+0000 7f16f69ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16f00b50e0 con 0x7f16f00d2830 2023-06-22T10:53:37.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.675+0000 7f16f69ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16f00b2130 con 0x7f16f00b4c60 2023-06-22T10:53:37.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.675+0000 7f16effff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f16f015c720 0x7f16f00b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:37.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.675+0000 7f16effff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f16f015c720 0x7f16f00b1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50842/0 (socket says 172.21.15.40:50842) 2023-06-22T10:53:37.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.675+0000 7f16effff700 1 -- 172.21.15.40:0/2753271396 learned_addr learned my addr 172.21.15.40:0/2753271396 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:37.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.675+0000 7f16ef7fe700 1 --2- 172.21.15.40:0/2753271396 >> v2:172.21.15.45:3300/0 conn(0x7f16f00d2830 0x7f16f00b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:37.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.675+0000 7f16f4f9c700 1 --2- 172.21.15.40:0/2753271396 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f16f00b4c60 0x7f16f006b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:37.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.675+0000 7f16effff700 1 -- 172.21.15.40:0/2753271396 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f16f00b4c60 msgr2=0x7f16f006b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:37.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.675+0000 7f16effff700 1 --2- 172.21.15.40:0/2753271396 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f16f00b4c60 0x7f16f006b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:37.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.675+0000 7f16effff700 1 -- 172.21.15.40:0/2753271396 >> v2:172.21.15.45:3300/0 conn(0x7f16f00d2830 msgr2=0x7f16f00b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:37.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.675+0000 7f16effff700 1 --2- 172.21.15.40:0/2753271396 >> v2:172.21.15.45:3300/0 conn(0x7f16f00d2830 0x7f16f00b4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:37.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.676+0000 7f16effff700 1 -- 172.21.15.40:0/2753271396 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f0161180 con 0x7f16f015c720 2023-06-22T10:53:37.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.676+0000 7f16f4f9c700 1 --2- 172.21.15.40:0/2753271396 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f16f00b4c60 0x7f16f006b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:53:37.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.676+0000 7f16effff700 1 --2- 172.21.15.40:0/2753271396 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16f015c720 0x7f16f00b1870 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f16e00098f0 tx=0x7f16e0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=336d01e02578e2cc server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:37.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.676+0000 7f16eeffd700 1 -- 172.21.15.40:0/2753271396 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e000b860 con 0x7f16f015c720 2023-06-22T10:53:37.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.676+0000 7f16eeffd700 1 -- 172.21.15.40:0/2753271396 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16e000b9c0 con 0x7f16f015c720 2023-06-22T10:53:37.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.676+0000 7f16eeffd700 1 -- 172.21.15.40:0/2753271396 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e000bd50 con 0x7f16f015c720 2023-06-22T10:53:37.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.676+0000 7f16f69ff700 1 -- 172.21.15.40:0/2753271396 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16f015c720 msgr2=0x7f16f00b1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:37.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.676+0000 7f16f69ff700 1 --2- 172.21.15.40:0/2753271396 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16f015c720 0x7f16f00b1870 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f16e00098f0 tx=0x7f16e0009c00 comp rx=0 tx=0).stop 2023-06-22T10:53:37.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.677+0000 7f16f69ff700 1 -- 172.21.15.40:0/2753271396 shutdown_connections 2023-06-22T10:53:37.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.677+0000 7f16f69ff700 1 --2- 172.21.15.40:0/2753271396 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f16f00b4c60 0x7f16f006b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:37.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.677+0000 7f16f69ff700 1 --2- 172.21.15.40:0/2753271396 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16f015c720 0x7f16f00b1870 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:37.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.677+0000 7f16f69ff700 1 --2- 172.21.15.40:0/2753271396 >> v2:172.21.15.45:3300/0 conn(0x7f16f00d2830 0x7f16f00b4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:37.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.677+0000 7f16f69ff700 1 -- 172.21.15.40:0/2753271396 >> 172.21.15.40:0/2753271396 conn(0x7f16f00cf720 msgr2=0x7f16f00cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:37.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.677+0000 7f16f69ff700 1 -- 172.21.15.40:0/2753271396 shutdown_connections 2023-06-22T10:53:37.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.677+0000 7f16f69ff700 1 -- 172.21.15.40:0/2753271396 wait complete. 2023-06-22T10:53:37.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.678+0000 7f16f69ff700 1 Processor -- start 2023-06-22T10:53:37.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.679+0000 7f16f69ff700 1 -- start start 2023-06-22T10:53:37.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.679+0000 7f16f69ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f16f00b4c60 0x7f16f015caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:37.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.680+0000 7f16f69ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16f00d2830 0x7f16f015e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:37.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.680+0000 7f16f69ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16f015c720 0x7f16f00b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:37.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.680+0000 7f16f69ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f015d030 con 0x7f16f015c720 2023-06-22T10:53:37.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.680+0000 7f16f69ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f015d2d0 con 0x7f16f00d2830 2023-06-22T10:53:37.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.680+0000 7f16f69ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16f015d5b0 con 0x7f16f00b4c60 2023-06-22T10:53:37.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.680+0000 7f16f4f9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16f015c720 0x7f16f00b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:37.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.680+0000 7f16effff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f16f00b4c60 0x7f16f015caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:37.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.680+0000 7f16effff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f16f00b4c60 0x7f16f015caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3301/0 says I am v2:172.21.15.40:43636/0 (socket says 172.21.15.40:43636) 2023-06-22T10:53:37.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.680+0000 7f16effff700 1 -- 172.21.15.40:0/1474192576 learned_addr learned my addr 172.21.15.40:0/1474192576 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:37.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.680+0000 7f16f4f9c700 1 --2- 172.21.15.40:0/1474192576 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16f015c720 0x7f16f00b3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50852/0 (socket says 172.21.15.40:50852) 2023-06-22T10:53:37.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.680+0000 7f16ef7fe700 1 --2- 172.21.15.40:0/1474192576 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16f00d2830 0x7f16f015e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:37.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.680+0000 7f16f4f9c700 1 -- 172.21.15.40:0/1474192576 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f16f00b4c60 msgr2=0x7f16f015caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:37.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.680+0000 7f16f4f9c700 1 --2- 172.21.15.40:0/1474192576 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f16f00b4c60 0x7f16f015caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:37.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.680+0000 7f16f4f9c700 1 -- 172.21.15.40:0/1474192576 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16f00d2830 msgr2=0x7f16f015e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:37.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.680+0000 7f16f4f9c700 1 --2- 172.21.15.40:0/1474192576 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16f00d2830 0x7f16f015e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:37.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.680+0000 7f16f4f9c700 1 -- 172.21.15.40:0/1474192576 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e0009550 con 0x7f16f015c720 2023-06-22T10:53:37.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.681+0000 7f16f4f9c700 1 --2- 172.21.15.40:0/1474192576 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16f015c720 0x7f16f00b3ac0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f16e8007d40 tx=0x7f16e800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:37.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.681+0000 7f16ecff9700 1 -- 172.21.15.40:0/1474192576 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e800dd20 con 0x7f16f015c720 2023-06-22T10:53:37.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.681+0000 7f16ecff9700 1 -- 172.21.15.40:0/1474192576 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16e800f040 con 0x7f16f015c720 2023-06-22T10:53:37.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.681+0000 7f16f69ff700 1 -- 172.21.15.40:0/1474192576 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16f015d890 con 0x7f16f015c720 2023-06-22T10:53:37.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.681+0000 7f16ecff9700 1 -- 172.21.15.40:0/1474192576 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e8003c60 con 0x7f16f015c720 2023-06-22T10:53:37.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.681+0000 7f16f69ff700 1 -- 172.21.15.40:0/1474192576 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16f015de50 con 0x7f16f015c720 2023-06-22T10:53:37.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.682+0000 7f16f69ff700 1 -- 172.21.15.40:0/1474192576 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16f015e070 con 0x7f16f015c720 2023-06-22T10:53:37.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.683+0000 7f16ecff9700 1 -- 172.21.15.40:0/1474192576 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f16e8004030 con 0x7f16f015c720 2023-06-22T10:53:37.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.684+0000 7f16ecff9700 1 --2- 172.21.15.40:0/1474192576 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f16dc06ace0 0x7f16dc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:37.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.684+0000 7f16ecff9700 1 -- 172.21.15.40:0/1474192576 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f16e8089620 con 0x7f16f015c720 2023-06-22T10:53:37.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.684+0000 7f16effff700 1 --2- 172.21.15.40:0/1474192576 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f16dc06ace0 0x7f16dc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:37.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.685+0000 7f16effff700 1 --2- 172.21.15.40:0/1474192576 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f16dc06ace0 0x7f16dc06d190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f16e0009130 tx=0x7f16e0008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:37.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.688+0000 7f16ecff9700 1 -- 172.21.15.40:0/1474192576 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f16e80543d0 con 0x7f16f015c720 2023-06-22T10:53:37.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.900+0000 7f16f69ff700 1 -- 172.21.15.40:0/1474192576 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f16f0067580 con 0x7f16f015c720 2023-06-22T10:53:37.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.901+0000 7f16ecff9700 1 -- 172.21.15.40:0/1474192576 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20036 (secure 0 0 0) 0x7f16e80579f0 con 0x7f16f015c720 2023-06-22T10:53:37.905 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:53:37.905 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":28,"fsid":"475560bc-1a7c-4a75-b3b6-6fc6b20bdc52","created":"2023-06-22T10:53:03.784568+0000","modified":"2023-06-22T10:53:36.483308+0000","last_up_change":"2023-06-22T10:53:17.830348+0000","last_in_change":"2023-06-22T10:53:07.329974+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-22T10:53:17.182228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-22T10:53:23.874432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-22T10:53:29.812963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-22T10:53:30.404021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-22T10:53:33.982289+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"918db6b4-053a-46ba-976d-6e1a0104017f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6809","nonce":2400162888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6811","nonce":2400162888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6815","nonce":2400162888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6813","nonce":2400162888}]},"public_addr":"172.21.15.40:6809/2400162888","cluster_addr":"172.21.15.40:6811/2400162888","heartbeat_back_addr":"172.21.15.40:6815/2400162888","heartbeat_front_addr":"172.21.15.40:6813/2400162888","state":["exists","up"]},{"osd":1,"uuid":"0c146e2b-1725-4dae-9b5c-38795943b9d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6801","nonce":230885800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6803","nonce":230885800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6807","nonce":230885800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6805","nonce":230885800}]},"public_addr":"172.21.15.40:6801/230885800","cluster_addr":"172.21.15.40:6803/230885800","heartbeat_back_addr":"172.21.15.40:6807/230885800","heartbeat_front_addr":"172.21.15.40:6805/230885800","state":["exists","up"]},{"osd":2,"uuid":"0b3727fd-f281-46d5-a675-86c8c5ab269e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6817","nonce":2681404929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6819","nonce":2681404929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6823","nonce":2681404929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6821","nonce":2681404929}]},"public_addr":"172.21.15.40:6817/2681404929","cluster_addr":"172.21.15.40:6819/2681404929","heartbeat_back_addr":"172.21.15.40:6823/2681404929","heartbeat_front_addr":"172.21.15.40:6821/2681404929","state":["exists","up"]},{"osd":3,"uuid":"2969c698-7039-4bbb-beda-f756f7a368a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6825","nonce":111110981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6827","nonce":111110981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6831","nonce":111110981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6829","nonce":111110981}]},"public_addr":"172.21.15.40:6825/111110981","cluster_addr":"172.21.15.40:6827/111110981","heartbeat_back_addr":"172.21.15.40:6831/111110981","heartbeat_front_addr":"172.21.15.40:6829/111110981","state":["exists","up"]},{"osd":4,"uuid":"3bb1d9c8-8e42-4a6b-998d-04834f34be5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6801","nonce":3625455711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6803","nonce":3625455711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6807","nonce":3625455711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6805","nonce":3625455711}]},"public_addr":"172.21.15.45:6801/3625455711","cluster_addr":"172.21.15.45:6803/3625455711","heartbeat_back_addr":"172.21.15.45:6807/3625455711","heartbeat_front_addr":"172.21.15.45:6805/3625455711","state":["exists","up"]},{"osd":5,"uuid":"f9854ee4-302c-41be-977b-bedda090a3d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6817","nonce":3354411217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6819","nonce":3354411217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6823","nonce":3354411217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6821","nonce":3354411217}]},"public_addr":"172.21.15.45:6817/3354411217","cluster_addr":"172.21.15.45:6819/3354411217","heartbeat_back_addr":"172.21.15.45:6823/3354411217","heartbeat_front_addr":"172.21.15.45:6821/3354411217","state":["exists","up"]},{"osd":6,"uuid":"bbdb1989-f6ac-4954-9b85-b8b540d683c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6809","nonce":320111074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6811","nonce":320111074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6815","nonce":320111074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6813","nonce":320111074}]},"public_addr":"172.21.15.45:6809/320111074","cluster_addr":"172.21.15.45:6811/320111074","heartbeat_back_addr":"172.21.15.45:6815/320111074","heartbeat_front_addr":"172.21.15.45:6813/320111074","state":["exists","up"]},{"osd":7,"uuid":"823d44e3-58f1-4d1d-8263-a4e4a69d4327","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6825","nonce":643617680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6827","nonce":643617680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6831","nonce":643617680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6829","nonce":643617680}]},"public_addr":"172.21.15.45:6825/643617680","cluster_addr":"172.21.15.45:6827/643617680","heartbeat_back_addr":"172.21.15.45:6831/643617680","heartbeat_front_addr":"172.21.15.45:6829/643617680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.731262+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.873226+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.898936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.666578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.645990+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.953699+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.642823+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.693395+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-22T10:53:37.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.904+0000 7f16f69ff700 1 -- 172.21.15.40:0/1474192576 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f16dc06ace0 msgr2=0x7f16dc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:37.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.904+0000 7f16f69ff700 1 --2- 172.21.15.40:0/1474192576 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f16dc06ace0 0x7f16dc06d190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f16e0009130 tx=0x7f16e0008030 comp rx=0 tx=0).stop 2023-06-22T10:53:37.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.904+0000 7f16f69ff700 1 -- 172.21.15.40:0/1474192576 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16f015c720 msgr2=0x7f16f00b3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:37.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.904+0000 7f16f69ff700 1 --2- 172.21.15.40:0/1474192576 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16f015c720 0x7f16f00b3ac0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f16e8007d40 tx=0x7f16e800d3b0 comp rx=0 tx=0).stop 2023-06-22T10:53:37.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.904+0000 7f16f69ff700 1 -- 172.21.15.40:0/1474192576 shutdown_connections 2023-06-22T10:53:37.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.904+0000 7f16f69ff700 1 --2- 172.21.15.40:0/1474192576 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f16dc06ace0 0x7f16dc06d190 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:37.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.904+0000 7f16f69ff700 1 --2- 172.21.15.40:0/1474192576 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f16f00b4c60 0x7f16f015caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:37.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.904+0000 7f16f69ff700 1 --2- 172.21.15.40:0/1474192576 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16f015c720 0x7f16f00b3ac0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:37.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.904+0000 7f16f69ff700 1 --2- 172.21.15.40:0/1474192576 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16f00d2830 0x7f16f015e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:37.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.904+0000 7f16f69ff700 1 -- 172.21.15.40:0/1474192576 >> 172.21.15.40:0/1474192576 conn(0x7f16f00cf720 msgr2=0x7f16f00b5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:37.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.904+0000 7f16f69ff700 1 -- 172.21.15.40:0/1474192576 shutdown_connections 2023-06-22T10:53:37.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:37.904+0000 7f16f69ff700 1 -- 172.21.15.40:0/1474192576 wait complete. 2023-06-22T10:53:37.926 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-22T10:53:38.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.125+0000 7ff59f3ff700 1 Processor -- start 2023-06-22T10:53:38.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.125+0000 7ff59f3ff700 1 -- start start 2023-06-22T10:53:38.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.127+0000 7ff59f3ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff59815c720 0x7ff5980b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:38.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.127+0000 7ff59f3ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff5980b4e30 0x7ff5980d0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:38.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.127+0000 7ff59f3ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5980b2130 con 0x7ff5980d2830 2023-06-22T10:53:38.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.127+0000 7ff59f3ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff598160d60 con 0x7ff5980b4e30 2023-06-22T10:53:38.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.127+0000 7ff59f3ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff598161180 con 0x7ff59815c720 2023-06-22T10:53:38.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.127+0000 7ff59c99a700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff5980d2830 0x7ff5980b4720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:50758/0 (socket says 172.21.15.40:50758) 2023-06-22T10:53:38.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.127+0000 7ff59c99a700 1 -- 172.21.15.40:0/3859232237 learned_addr learned my addr 172.21.15.40:0/3859232237 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:53:38.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.127+0000 7ff59d99c700 1 --2- 172.21.15.40:0/3859232237 >> v2:172.21.15.40:3300/0 conn(0x7ff5980b4e30 0x7ff5980d0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:38.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.127+0000 7ff59d19b700 1 --2- 172.21.15.40:0/3859232237 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff59815c720 0x7ff5980b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:38.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.127+0000 7ff58ffff700 1 -- 172.21.15.40:0/3859232237 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 260456272 0 0) 0x7ff5980b2130 con 0x7ff5980d2830 2023-06-22T10:53:38.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.127+0000 7ff58ffff700 1 -- 172.21.15.40:0/3859232237 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5840035b0 con 0x7ff5980d2830 2023-06-22T10:53:38.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.127+0000 7ff59d99c700 1 -- 172.21.15.40:0/3859232237 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff59815c720 msgr2=0x7ff5980b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:38.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.127+0000 7ff59d99c700 1 --2- 172.21.15.40:0/3859232237 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff59815c720 0x7ff5980b1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:38.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.127+0000 7ff59d99c700 1 -- 172.21.15.40:0/3859232237 >> v1:172.21.15.40:6789/0 conn(0x7ff5980d2830 legacy=0x7ff5980b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:38.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.127+0000 7ff59d99c700 1 -- 172.21.15.40:0/3859232237 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5981603c0 con 0x7ff5980b4e30 2023-06-22T10:53:38.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.128+0000 7ff59d99c700 1 --2- 172.21.15.40:0/3859232237 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5980b4e30 0x7ff5980d0d00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff590009d90 tx=0x7ff59000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d1d2aef976b928 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:38.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.128+0000 7ff58ffff700 1 -- 172.21.15.40:0/3859232237 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59000e070 con 0x7ff5980b4e30 2023-06-22T10:53:38.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.128+0000 7ff58ffff700 1 -- 172.21.15.40:0/3859232237 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff59000bb20 con 0x7ff5980b4e30 2023-06-22T10:53:38.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.128+0000 7ff58ffff700 1 -- 172.21.15.40:0/3859232237 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59000be90 con 0x7ff5980b4e30 2023-06-22T10:53:38.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.128+0000 7ff59f3ff700 1 -- 172.21.15.40:0/3859232237 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5980b4e30 msgr2=0x7ff5980d0d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:38.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.128+0000 7ff59f3ff700 1 --2- 172.21.15.40:0/3859232237 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5980b4e30 0x7ff5980d0d00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff590009d90 tx=0x7ff59000b330 comp rx=0 tx=0).stop 2023-06-22T10:53:38.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.129+0000 7ff59f3ff700 1 -- 172.21.15.40:0/3859232237 shutdown_connections 2023-06-22T10:53:38.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.129+0000 7ff59f3ff700 1 --2- 172.21.15.40:0/3859232237 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5980b4e30 0x7ff5980d0d00 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:38.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.129+0000 7ff59f3ff700 1 --2- 172.21.15.40:0/3859232237 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff59815c720 0x7ff5980b1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:38.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.129+0000 7ff59f3ff700 1 -- 172.21.15.40:0/3859232237 >> 172.21.15.40:0/3859232237 conn(0x7ff5980cf720 msgr2=0x7ff5980cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:38.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.129+0000 7ff59f3ff700 1 -- 172.21.15.40:0/3859232237 shutdown_connections 2023-06-22T10:53:38.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.129+0000 7ff59f3ff700 1 -- 172.21.15.40:0/3859232237 wait complete. 2023-06-22T10:53:38.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.130+0000 7ff59f3ff700 1 Processor -- start 2023-06-22T10:53:38.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.131+0000 7ff59f3ff700 1 -- start start 2023-06-22T10:53:38.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.131+0000 7ff59f3ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5980b4e30 0x7ff5980c9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:38.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.131+0000 7ff59f3ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5980d2830 0x7ff5980cb580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:38.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.131+0000 7ff59f3ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff59815c720 0x7ff598148320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:38.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.131+0000 7ff59f3ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5980cbac0 con 0x7ff5980b4e30 2023-06-22T10:53:38.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.131+0000 7ff59f3ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff59815fd30 con 0x7ff5980d2830 2023-06-22T10:53:38.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.131+0000 7ff59f3ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5980b72a0 con 0x7ff59815c720 2023-06-22T10:53:38.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.132+0000 7ff59d19b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5980b4e30 0x7ff5980c9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:38.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.132+0000 7ff59d19b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5980b4e30 0x7ff5980c9150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50862/0 (socket says 172.21.15.40:50862) 2023-06-22T10:53:38.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.132+0000 7ff59d19b700 1 -- 172.21.15.40:0/1137659539 learned_addr learned my addr 172.21.15.40:0/1137659539 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:38.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.132+0000 7ff59d99c700 1 --2- 172.21.15.40:0/1137659539 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff59815c720 0x7ff598148320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:38.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.132+0000 7ff59c99a700 1 --2- 172.21.15.40:0/1137659539 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5980d2830 0x7ff5980cb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:38.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.132+0000 7ff59d19b700 1 -- 172.21.15.40:0/1137659539 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff59815c720 msgr2=0x7ff598148320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:38.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.132+0000 7ff59d19b700 1 --2- 172.21.15.40:0/1137659539 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff59815c720 0x7ff598148320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:38.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.132+0000 7ff59d19b700 1 -- 172.21.15.40:0/1137659539 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5980d2830 msgr2=0x7ff5980cb580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:38.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.132+0000 7ff59d19b700 1 --2- 172.21.15.40:0/1137659539 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5980d2830 0x7ff5980cb580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:38.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.132+0000 7ff59d19b700 1 -- 172.21.15.40:0/1137659539 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff590009a70 con 0x7ff5980b4e30 2023-06-22T10:53:38.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.132+0000 7ff59c99a700 1 --2- 172.21.15.40:0/1137659539 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5980d2830 0x7ff5980cb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:53:38.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.132+0000 7ff59d19b700 1 --2- 172.21.15.40:0/1137659539 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5980b4e30 0x7ff5980c9150 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff59400e810 tx=0x7ff59400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:38.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.133+0000 7ff58dffb700 1 -- 172.21.15.40:0/1137659539 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff594013610 con 0x7ff5980b4e30 2023-06-22T10:53:38.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.133+0000 7ff58dffb700 1 -- 172.21.15.40:0/1137659539 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff594013770 con 0x7ff5980b4e30 2023-06-22T10:53:38.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.133+0000 7ff59f3ff700 1 -- 172.21.15.40:0/1137659539 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff598148860 con 0x7ff5980b4e30 2023-06-22T10:53:38.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.133+0000 7ff58dffb700 1 -- 172.21.15.40:0/1137659539 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff594013b20 con 0x7ff5980b4e30 2023-06-22T10:53:38.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.133+0000 7ff59f3ff700 1 -- 172.21.15.40:0/1137659539 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5980b6c50 con 0x7ff5980b4e30 2023-06-22T10:53:38.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.134+0000 7ff59f3ff700 1 -- 172.21.15.40:0/1137659539 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff598067580 con 0x7ff5980b4e30 2023-06-22T10:53:38.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.135+0000 7ff58dffb700 1 -- 172.21.15.40:0/1137659539 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff594013c80 con 0x7ff5980b4e30 2023-06-22T10:53:38.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.136+0000 7ff58dffb700 1 --2- 172.21.15.40:0/1137659539 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7ff57c06ace0 0x7ff57c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:38.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.136+0000 7ff58dffb700 1 -- 172.21.15.40:0/1137659539 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff594089350 con 0x7ff5980b4e30 2023-06-22T10:53:38.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.136+0000 7ff59c99a700 1 --2- 172.21.15.40:0/1137659539 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7ff57c06ace0 0x7ff57c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:38.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.136+0000 7ff59c99a700 1 --2- 172.21.15.40:0/1137659539 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7ff57c06ace0 0x7ff57c06d190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff5981568f0 tx=0x7ff588009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:38.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.140+0000 7ff58dffb700 1 -- 172.21.15.40:0/1137659539 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff594054120 con 0x7ff5980b4e30 2023-06-22T10:53:38.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.347+0000 7ff59f3ff700 1 -- 172.21.15.40:0/1137659539 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff5980ce070 con 0x7ff5980b4e30 2023-06-22T10:53:38.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.348+0000 7ff58dffb700 1 -- 172.21.15.40:0/1137659539 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20036 (secure 0 0 0) 0x7ff594057740 con 0x7ff5980b4e30 2023-06-22T10:53:38.352 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:53:38.352 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":28,"fsid":"475560bc-1a7c-4a75-b3b6-6fc6b20bdc52","created":"2023-06-22T10:53:03.784568+0000","modified":"2023-06-22T10:53:36.483308+0000","last_up_change":"2023-06-22T10:53:17.830348+0000","last_in_change":"2023-06-22T10:53:07.329974+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-22T10:53:17.182228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-22T10:53:23.874432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-22T10:53:29.812963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-22T10:53:30.404021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-22T10:53:33.982289+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"918db6b4-053a-46ba-976d-6e1a0104017f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6809","nonce":2400162888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6811","nonce":2400162888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6815","nonce":2400162888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6813","nonce":2400162888}]},"public_addr":"172.21.15.40:6809/2400162888","cluster_addr":"172.21.15.40:6811/2400162888","heartbeat_back_addr":"172.21.15.40:6815/2400162888","heartbeat_front_addr":"172.21.15.40:6813/2400162888","state":["exists","up"]},{"osd":1,"uuid":"0c146e2b-1725-4dae-9b5c-38795943b9d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6801","nonce":230885800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6803","nonce":230885800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6807","nonce":230885800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6805","nonce":230885800}]},"public_addr":"172.21.15.40:6801/230885800","cluster_addr":"172.21.15.40:6803/230885800","heartbeat_back_addr":"172.21.15.40:6807/230885800","heartbeat_front_addr":"172.21.15.40:6805/230885800","state":["exists","up"]},{"osd":2,"uuid":"0b3727fd-f281-46d5-a675-86c8c5ab269e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6817","nonce":2681404929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6819","nonce":2681404929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6823","nonce":2681404929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6821","nonce":2681404929}]},"public_addr":"172.21.15.40:6817/2681404929","cluster_addr":"172.21.15.40:6819/2681404929","heartbeat_back_addr":"172.21.15.40:6823/2681404929","heartbeat_front_addr":"172.21.15.40:6821/2681404929","state":["exists","up"]},{"osd":3,"uuid":"2969c698-7039-4bbb-beda-f756f7a368a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6825","nonce":111110981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6827","nonce":111110981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6831","nonce":111110981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6829","nonce":111110981}]},"public_addr":"172.21.15.40:6825/111110981","cluster_addr":"172.21.15.40:6827/111110981","heartbeat_back_addr":"172.21.15.40:6831/111110981","heartbeat_front_addr":"172.21.15.40:6829/111110981","state":["exists","up"]},{"osd":4,"uuid":"3bb1d9c8-8e42-4a6b-998d-04834f34be5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6801","nonce":3625455711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6803","nonce":3625455711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6807","nonce":3625455711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6805","nonce":3625455711}]},"public_addr":"172.21.15.45:6801/3625455711","cluster_addr":"172.21.15.45:6803/3625455711","heartbeat_back_addr":"172.21.15.45:6807/3625455711","heartbeat_front_addr":"172.21.15.45:6805/3625455711","state":["exists","up"]},{"osd":5,"uuid":"f9854ee4-302c-41be-977b-bedda090a3d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6817","nonce":3354411217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6819","nonce":3354411217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6823","nonce":3354411217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6821","nonce":3354411217}]},"public_addr":"172.21.15.45:6817/3354411217","cluster_addr":"172.21.15.45:6819/3354411217","heartbeat_back_addr":"172.21.15.45:6823/3354411217","heartbeat_front_addr":"172.21.15.45:6821/3354411217","state":["exists","up"]},{"osd":6,"uuid":"bbdb1989-f6ac-4954-9b85-b8b540d683c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6809","nonce":320111074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6811","nonce":320111074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6815","nonce":320111074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6813","nonce":320111074}]},"public_addr":"172.21.15.45:6809/320111074","cluster_addr":"172.21.15.45:6811/320111074","heartbeat_back_addr":"172.21.15.45:6815/320111074","heartbeat_front_addr":"172.21.15.45:6813/320111074","state":["exists","up"]},{"osd":7,"uuid":"823d44e3-58f1-4d1d-8263-a4e4a69d4327","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6825","nonce":643617680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6827","nonce":643617680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6831","nonce":643617680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6829","nonce":643617680}]},"public_addr":"172.21.15.45:6825/643617680","cluster_addr":"172.21.15.45:6827/643617680","heartbeat_back_addr":"172.21.15.45:6831/643617680","heartbeat_front_addr":"172.21.15.45:6829/643617680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.731262+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.873226+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.898936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.666578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.645990+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.953699+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.642823+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.693395+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-22T10:53:38.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.350+0000 7ff59f3ff700 1 -- 172.21.15.40:0/1137659539 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7ff57c06ace0 msgr2=0x7ff57c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:38.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.350+0000 7ff59f3ff700 1 --2- 172.21.15.40:0/1137659539 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7ff57c06ace0 0x7ff57c06d190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff5981568f0 tx=0x7ff588009040 comp rx=0 tx=0).stop 2023-06-22T10:53:38.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.350+0000 7ff59f3ff700 1 -- 172.21.15.40:0/1137659539 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5980b4e30 msgr2=0x7ff5980c9150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:38.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.350+0000 7ff59f3ff700 1 --2- 172.21.15.40:0/1137659539 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5980b4e30 0x7ff5980c9150 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff59400e810 tx=0x7ff59400eb20 comp rx=0 tx=0).stop 2023-06-22T10:53:38.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.350+0000 7ff59f3ff700 1 -- 172.21.15.40:0/1137659539 shutdown_connections 2023-06-22T10:53:38.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.350+0000 7ff59f3ff700 1 --2- 172.21.15.40:0/1137659539 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7ff57c06ace0 0x7ff57c06d190 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:38.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.350+0000 7ff59f3ff700 1 --2- 172.21.15.40:0/1137659539 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff59815c720 0x7ff598148320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:38.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.350+0000 7ff59f3ff700 1 --2- 172.21.15.40:0/1137659539 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5980b4e30 0x7ff5980c9150 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:38.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.350+0000 7ff59f3ff700 1 --2- 172.21.15.40:0/1137659539 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5980d2830 0x7ff5980cb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:38.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.350+0000 7ff59f3ff700 1 -- 172.21.15.40:0/1137659539 >> 172.21.15.40:0/1137659539 conn(0x7ff5980cf720 msgr2=0x7ff5980d0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:38.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.350+0000 7ff59f3ff700 1 -- 172.21.15.40:0/1137659539 shutdown_connections 2023-06-22T10:53:38.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.351+0000 7ff59f3ff700 1 -- 172.21.15.40:0/1137659539 wait complete. 2023-06-22T10:53:38.388 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-22T10:53:38.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.586+0000 7f5b509ff700 1 Processor -- start 2023-06-22T10:53:38.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.586+0000 7f5b509ff700 1 -- start start 2023-06-22T10:53:38.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.587+0000 7f5b509ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f5b4c15c720 0x7f5b4c0b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:38.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.587+0000 7f5b509ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5b4c0b4e30 0x7f5b4c0d0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:38.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.587+0000 7f5b509ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b4c0b2130 con 0x7f5b4c0d2830 2023-06-22T10:53:38.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.587+0000 7f5b509ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b4c160d60 con 0x7f5b4c0b4e30 2023-06-22T10:53:38.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.587+0000 7f5b509ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4c161180 con 0x7f5b4c15c720 2023-06-22T10:53:38.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.588+0000 7f5b49d9b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f5b4c0d2830 0x7f5b4c0b4720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45320/0 (socket says 172.21.15.40:45320) 2023-06-22T10:53:38.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.588+0000 7f5b49d9b700 1 -- 172.21.15.40:0/1646698836 learned_addr learned my addr 172.21.15.40:0/1646698836 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:53:38.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.588+0000 7f5b4a59c700 1 --2- 172.21.15.40:0/1646698836 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f5b4c15c720 0x7f5b4c0b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:38.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.588+0000 7f5b4ad9d700 1 --2- 172.21.15.40:0/1646698836 >> v2:172.21.15.45:3300/0 conn(0x7f5b4c0b4e30 0x7f5b4c0d0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:38.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.588+0000 7f5b4959a700 1 -- 172.21.15.40:0/1646698836 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3629093161 0 0) 0x7f5b4c0b2130 con 0x7f5b4c0d2830 2023-06-22T10:53:38.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.588+0000 7f5b4959a700 1 -- 172.21.15.40:0/1646698836 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b340035b0 con 0x7f5b4c0d2830 2023-06-22T10:53:38.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.588+0000 7f5b4959a700 1 -- 172.21.15.40:0/1646698836 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 147859449 0 0) 0x7f5b340035b0 con 0x7f5b4c0d2830 2023-06-22T10:53:38.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.588+0000 7f5b4959a700 1 -- 172.21.15.40:0/1646698836 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f5b4c15c720 msgr2=0x7f5b4c0b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:38.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.588+0000 7f5b4959a700 1 --2- 172.21.15.40:0/1646698836 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f5b4c15c720 0x7f5b4c0b1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:38.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.588+0000 7f5b4959a700 1 -- 172.21.15.40:0/1646698836 >> v2:172.21.15.45:3300/0 conn(0x7f5b4c0b4e30 msgr2=0x7f5b4c0d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:38.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.588+0000 7f5b4959a700 1 --2- 172.21.15.40:0/1646698836 >> v2:172.21.15.45:3300/0 conn(0x7f5b4c0b4e30 0x7f5b4c0d0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:38.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.588+0000 7f5b4959a700 1 -- 172.21.15.40:0/1646698836 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b4c1603c0 con 0x7f5b4c0d2830 2023-06-22T10:53:38.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.588+0000 7f5b4959a700 1 -- 172.21.15.40:0/1646698836 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1490606486 0 0) 0x7f5b40001670 con 0x7f5b4c0d2830 2023-06-22T10:53:38.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.588+0000 7f5b4ad9d700 1 --2- 172.21.15.40:0/1646698836 >> v2:172.21.15.45:3300/0 conn(0x7f5b4c0b4e30 0x7f5b4c0d0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-22T10:53:38.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.588+0000 7f5b4959a700 1 -- 172.21.15.40:0/1646698836 >> v1:172.21.15.40:6789/0 conn(0x7f5b4c0d2830 legacy=0x7f5b4c0b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:38.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.589+0000 7f5b4959a700 1 --2- 172.21.15.40:0/1646698836 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b34003a00 0x7f5b34003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:38.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.589+0000 7f5b4959a700 1 --2- 172.21.15.40:0/1646698836 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f5b34004850 0x7f5b34004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:38.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.589+0000 7f5b4959a700 1 --2- 172.21.15.40:0/1646698836 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b34005200 0x7f5b3400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:38.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.589+0000 7f5b4959a700 1 -- 172.21.15.40:0/1646698836 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4c160d60 con 0x7f5b34003a00 2023-06-22T10:53:38.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.589+0000 7f5b4959a700 1 -- 172.21.15.40:0/1646698836 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4c161180 con 0x7f5b34005200 2023-06-22T10:53:38.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.589+0000 7f5b4959a700 1 -- 172.21.15.40:0/1646698836 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3400bfd0 con 0x7f5b34004850 2023-06-22T10:53:38.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.589+0000 7f5b4a59c700 1 --2- 172.21.15.40:0/1646698836 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f5b4c15c720 0x7f5b4c0b1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-22T10:53:38.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.589+0000 7f5b4a59c700 1 --2- 172.21.15.40:0/1646698836 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b34003a00 0x7f5b34003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:38.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.589+0000 7f5b49d9b700 1 --2- 172.21.15.40:0/1646698836 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f5b34004850 0x7f5b34004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:38.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.589+0000 7f5b4ad9d700 1 --2- 172.21.15.40:0/1646698836 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b34005200 0x7f5b3400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:38.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.589+0000 7f5b4a59c700 1 -- 172.21.15.40:0/1646698836 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f5b34004850 msgr2=0x7f5b34004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:38.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.589+0000 7f5b4a59c700 1 --2- 172.21.15.40:0/1646698836 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f5b34004850 0x7f5b34004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:38.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.589+0000 7f5b4a59c700 1 -- 172.21.15.40:0/1646698836 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b34005200 msgr2=0x7f5b3400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:38.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.589+0000 7f5b4a59c700 1 --2- 172.21.15.40:0/1646698836 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b34005200 0x7f5b3400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:38.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.589+0000 7f5b4a59c700 1 -- 172.21.15.40:0/1646698836 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b340035b0 con 0x7f5b34003a00 2023-06-22T10:53:38.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.590+0000 7f5b4a59c700 1 --2- 172.21.15.40:0/1646698836 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b34003a00 0x7f5b34003e10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c0d3d30 tx=0x7f5b34005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d1d7047daf8a283 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:38.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.590+0000 7f5b4959a700 1 -- 172.21.15.40:0/1646698836 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3c004030 con 0x7f5b34003a00 2023-06-22T10:53:38.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.590+0000 7f5b4959a700 1 -- 172.21.15.40:0/1646698836 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b3c004190 con 0x7f5b34003a00 2023-06-22T10:53:38.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.590+0000 7f5b4959a700 1 -- 172.21.15.40:0/1646698836 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3c004540 con 0x7f5b34003a00 2023-06-22T10:53:38.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.590+0000 7f5b509ff700 1 -- 172.21.15.40:0/1646698836 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b34003a00 msgr2=0x7f5b34003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:38.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.590+0000 7f5b509ff700 1 --2- 172.21.15.40:0/1646698836 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b34003a00 0x7f5b34003e10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c0d3d30 tx=0x7f5b34005880 comp rx=0 tx=0).stop 2023-06-22T10:53:38.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.590+0000 7f5b4ad9d700 1 -- 172.21.15.40:0/1646698836 reap_dead start 2023-06-22T10:53:38.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.590+0000 7f5b509ff700 1 -- 172.21.15.40:0/1646698836 shutdown_connections 2023-06-22T10:53:38.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.590+0000 7f5b509ff700 1 -- 172.21.15.40:0/1646698836 >> 172.21.15.40:0/1646698836 conn(0x7f5b4c0cf720 msgr2=0x7f5b4c0cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:38.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.590+0000 7f5b509ff700 1 -- 172.21.15.40:0/1646698836 shutdown_connections 2023-06-22T10:53:38.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.590+0000 7f5b509ff700 1 -- 172.21.15.40:0/1646698836 wait complete. 2023-06-22T10:53:38.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.592+0000 7f5b509ff700 1 Processor -- start 2023-06-22T10:53:38.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.592+0000 7f5b509ff700 1 -- start start 2023-06-22T10:53:38.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.593+0000 7f5b509ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b34003a00 0x7f5b4c1506f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:38.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.593+0000 7f5b509ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f5b4c0b6fe0 0x7f5b4c1f5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:38.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.593+0000 7f5b509ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b4c0cc5f0 0x7f5b4c0cca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:38.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.593+0000 7f5b509ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4c15e050 con 0x7f5b34003a00 2023-06-22T10:53:38.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.593+0000 7f5b509ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4c1f5ec0 con 0x7f5b4c0cc5f0 2023-06-22T10:53:38.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.593+0000 7f5b509ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4c1f61a0 con 0x7f5b4c0b6fe0 2023-06-22T10:53:38.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.593+0000 7f5b4a59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b34003a00 0x7f5b4c1506f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:38.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.593+0000 7f5b4a59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b34003a00 0x7f5b4c1506f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55476/0 (socket says 172.21.15.40:55476) 2023-06-22T10:53:38.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.593+0000 7f5b4a59c700 1 -- 172.21.15.40:0/2100052093 learned_addr learned my addr 172.21.15.40:0/2100052093 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:38.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.594+0000 7f5b4ad9d700 1 --2- 172.21.15.40:0/2100052093 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b4c0cc5f0 0x7f5b4c0cca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:38.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.594+0000 7f5b49d9b700 1 --2- 172.21.15.40:0/2100052093 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f5b4c0b6fe0 0x7f5b4c1f5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:38.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.594+0000 7f5b4a59c700 1 -- 172.21.15.40:0/2100052093 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f5b4c0b6fe0 msgr2=0x7f5b4c1f5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:38.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.594+0000 7f5b4a59c700 1 --2- 172.21.15.40:0/2100052093 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f5b4c0b6fe0 0x7f5b4c1f5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:38.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.594+0000 7f5b4a59c700 1 -- 172.21.15.40:0/2100052093 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b4c0cc5f0 msgr2=0x7f5b4c0cca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:38.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.594+0000 7f5b4a59c700 1 --2- 172.21.15.40:0/2100052093 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b4c0cc5f0 0x7f5b4c0cca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:38.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.594+0000 7f5b4a59c700 1 -- 172.21.15.40:0/2100052093 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b4c1f6480 con 0x7f5b34003a00 2023-06-22T10:53:38.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.594+0000 7f5b4ad9d700 1 --2- 172.21.15.40:0/2100052093 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b4c0cc5f0 0x7f5b4c0cca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:53:38.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.594+0000 7f5b4a59c700 1 --2- 172.21.15.40:0/2100052093 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b34003a00 0x7f5b4c1506f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c00e4b0 tx=0x7f5b3c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:38.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.594+0000 7f5b3affd700 1 -- 172.21.15.40:0/2100052093 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3c006e60 con 0x7f5b34003a00 2023-06-22T10:53:38.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.594+0000 7f5b3affd700 1 -- 172.21.15.40:0/2100052093 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b3c003ab0 con 0x7f5b34003a00 2023-06-22T10:53:38.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.594+0000 7f5b3affd700 1 -- 172.21.15.40:0/2100052093 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3c004030 con 0x7f5b34003a00 2023-06-22T10:53:38.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.594+0000 7f5b509ff700 1 -- 172.21.15.40:0/2100052093 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b4c15e2f0 con 0x7f5b34003a00 2023-06-22T10:53:38.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.595+0000 7f5b509ff700 1 -- 172.21.15.40:0/2100052093 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b4c1f5bb0 con 0x7f5b34003a00 2023-06-22T10:53:38.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.596+0000 7f5b509ff700 1 -- 172.21.15.40:0/2100052093 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b4c15e660 con 0x7f5b34003a00 2023-06-22T10:53:38.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.596+0000 7f5b3affd700 1 -- 172.21.15.40:0/2100052093 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5b3c013470 con 0x7f5b34003a00 2023-06-22T10:53:38.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.597+0000 7f5b3affd700 1 --2- 172.21.15.40:0/2100052093 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f5b2c06ace0 0x7f5b2c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:38.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.597+0000 7f5b3affd700 1 -- 172.21.15.40:0/2100052093 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5b3c08b160 con 0x7f5b34003a00 2023-06-22T10:53:38.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.598+0000 7f5b49d9b700 1 --2- 172.21.15.40:0/2100052093 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f5b2c06ace0 0x7f5b2c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:38.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.598+0000 7f5b49d9b700 1 --2- 172.21.15.40:0/2100052093 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f5b2c06ace0 0x7f5b2c06d190 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c0b1830 tx=0x7f5b40007980 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:38.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.602+0000 7f5b3affd700 1 -- 172.21.15.40:0/2100052093 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5b3c0599a0 con 0x7f5b34003a00 2023-06-22T10:53:38.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.855+0000 7f5b509ff700 1 -- 172.21.15.40:0/2100052093 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5b4c1f6610 con 0x7f5b34003a00 2023-06-22T10:53:38.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.856+0000 7f5b3affd700 1 -- 172.21.15.40:0/2100052093 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4664 (secure 0 0 0) 0x7f5b3c00ee60 con 0x7f5b34003a00 2023-06-22T10:53:38.859 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:53:38.860 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/627935577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":627935577},{"type":"v1","addr":"172.21.15.40:6835","nonce":627935577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3018871402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3018871402},{"type":"v1","addr":"172.21.15.40:6837","nonce":3018871402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/4036649607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":4036649607},{"type":"v1","addr":"172.21.15.45:6834","nonce":4036649607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-22T10:53:31.430326+0000","modified":"2023-06-22T10:53:36.951183+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4303},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4303":{"gid":4303,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/1579627519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":1579627519},{"type":"v1","addr":"172.21.15.45:6835","nonce":1579627519}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-06-22T10:53:38.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.858+0000 7f5b509ff700 1 -- 172.21.15.40:0/2100052093 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f5b2c06ace0 msgr2=0x7f5b2c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:38.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.858+0000 7f5b509ff700 1 --2- 172.21.15.40:0/2100052093 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f5b2c06ace0 0x7f5b2c06d190 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c0b1830 tx=0x7f5b40007980 comp rx=0 tx=0).stop 2023-06-22T10:53:38.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.858+0000 7f5b509ff700 1 -- 172.21.15.40:0/2100052093 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b34003a00 msgr2=0x7f5b4c1506f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:38.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.858+0000 7f5b509ff700 1 --2- 172.21.15.40:0/2100052093 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b34003a00 0x7f5b4c1506f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c00e4b0 tx=0x7f5b3c0047c0 comp rx=0 tx=0).stop 2023-06-22T10:53:38.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.858+0000 7f5b509ff700 1 -- 172.21.15.40:0/2100052093 shutdown_connections 2023-06-22T10:53:38.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.858+0000 7f5b509ff700 1 --2- 172.21.15.40:0/2100052093 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f5b2c06ace0 0x7f5b2c06d190 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:38.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.858+0000 7f5b509ff700 1 --2- 172.21.15.40:0/2100052093 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b4c0cc5f0 0x7f5b4c0cca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:38.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.858+0000 7f5b509ff700 1 --2- 172.21.15.40:0/2100052093 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b34003a00 0x7f5b4c1506f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:38.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.858+0000 7f5b509ff700 1 --2- 172.21.15.40:0/2100052093 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f5b4c0b6fe0 0x7f5b4c1f5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:38.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.858+0000 7f5b509ff700 1 -- 172.21.15.40:0/2100052093 >> 172.21.15.40:0/2100052093 conn(0x7f5b4c0cf720 msgr2=0x7f5b4c06b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:38.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.858+0000 7f5b509ff700 1 -- 172.21.15.40:0/2100052093 shutdown_connections 2023-06-22T10:53:38.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:38.858+0000 7f5b509ff700 1 -- 172.21.15.40:0/2100052093 wait complete. 2023-06-22T10:53:38.864 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 7 2023-06-22T10:53:38.879 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-22T10:53:39.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.078+0000 7fa937dff700 1 Processor -- start 2023-06-22T10:53:39.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.078+0000 7fa937dff700 1 -- start start 2023-06-22T10:53:39.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.080+0000 7fa937dff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa9300d2830 0x7fa9300b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:39.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.080+0000 7fa937dff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9300b50a0 con 0x7fa9300b4c60 2023-06-22T10:53:39.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.080+0000 7fa937dff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9300b2130 con 0x7fa93015c720 2023-06-22T10:53:39.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.080+0000 7fa937dff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa930160d60 con 0x7fa9300d2830 2023-06-22T10:53:39.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.080+0000 7fa93639c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa9300b4c60 0x7fa9300d0d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45322/0 (socket says 172.21.15.40:45322) 2023-06-22T10:53:39.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.080+0000 7fa93639c700 1 -- 172.21.15.40:0/2990279431 learned_addr learned my addr 172.21.15.40:0/2990279431 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:53:39.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.080+0000 7fa93539a700 1 --2- 172.21.15.40:0/2990279431 >> v2:172.21.15.40:3300/0 conn(0x7fa9300d2830 0x7fa9300b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:39.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.080+0000 7fa93539a700 1 -- 172.21.15.40:0/2990279431 >> v1:172.21.15.45:6789/0 conn(0x7fa93015c720 legacy=0x7fa9300b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:39.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.080+0000 7fa93539a700 1 -- 172.21.15.40:0/2990279431 >> v1:172.21.15.40:6789/0 conn(0x7fa9300b4c60 legacy=0x7fa9300d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:39.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.080+0000 7fa93539a700 1 -- 172.21.15.40:0/2990279431 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa930161180 con 0x7fa9300d2830 2023-06-22T10:53:39.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.081+0000 7fa93539a700 1 --2- 172.21.15.40:0/2990279431 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa9300d2830 0x7fa9300b4720 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa920009870 tx=0x7fa920009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3243e11bc3d11cf4 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:39.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.081+0000 7fa934b99700 1 -- 172.21.15.40:0/2990279431 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa920011830 con 0x7fa9300d2830 2023-06-22T10:53:39.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.081+0000 7fa934b99700 1 -- 172.21.15.40:0/2990279431 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa920011990 con 0x7fa9300d2830 2023-06-22T10:53:39.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.081+0000 7fa934b99700 1 -- 172.21.15.40:0/2990279431 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa920011d20 con 0x7fa9300d2830 2023-06-22T10:53:39.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.081+0000 7fa937dff700 1 -- 172.21.15.40:0/2990279431 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa9300d2830 msgr2=0x7fa9300b4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:39.086 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.081+0000 7fa937dff700 1 --2- 172.21.15.40:0/2990279431 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa9300d2830 0x7fa9300b4720 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa920009870 tx=0x7fa920009b80 comp rx=0 tx=0).stop 2023-06-22T10:53:39.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.081+0000 7fa937dff700 1 -- 172.21.15.40:0/2990279431 shutdown_connections 2023-06-22T10:53:39.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.081+0000 7fa937dff700 1 --2- 172.21.15.40:0/2990279431 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa9300d2830 0x7fa9300b4720 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:39.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.081+0000 7fa937dff700 1 -- 172.21.15.40:0/2990279431 >> 172.21.15.40:0/2990279431 conn(0x7fa9300cf720 msgr2=0x7fa9300cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:39.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.082+0000 7fa937dff700 1 -- 172.21.15.40:0/2990279431 shutdown_connections 2023-06-22T10:53:39.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.082+0000 7fa937dff700 1 -- 172.21.15.40:0/2990279431 wait complete. 2023-06-22T10:53:39.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.083+0000 7fa937dff700 1 Processor -- start 2023-06-22T10:53:39.087 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.083+0000 7fa937dff700 1 -- start start 2023-06-22T10:53:39.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.084+0000 7fa937dff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9300b4c60 0x7fa9301f2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:39.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.084+0000 7fa937dff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa9300d2830 0x7fa9300aa160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:39.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.084+0000 7fa937dff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa93015c720 0x7fa9300aabe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:39.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.084+0000 7fa937dff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9301f2e40 con 0x7fa9300d2830 2023-06-22T10:53:39.089 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.084+0000 7fa937dff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa93015ed80 con 0x7fa9300b4c60 2023-06-22T10:53:39.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.084+0000 7fa937dff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa93015f060 con 0x7fa93015c720 2023-06-22T10:53:39.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.085+0000 7fa93539a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa9300d2830 0x7fa9300aa160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:39.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.085+0000 7fa93539a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa9300d2830 0x7fa9300aa160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55496/0 (socket says 172.21.15.40:55496) 2023-06-22T10:53:39.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.085+0000 7fa93539a700 1 -- 172.21.15.40:0/3537162556 learned_addr learned my addr 172.21.15.40:0/3537162556 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:39.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.085+0000 7fa935b9b700 1 --2- 172.21.15.40:0/3537162556 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9300b4c60 0x7fa9301f2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:39.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.085+0000 7fa93639c700 1 --2- 172.21.15.40:0/3537162556 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa93015c720 0x7fa9300aabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:39.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.085+0000 7fa93539a700 1 -- 172.21.15.40:0/3537162556 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa93015c720 msgr2=0x7fa9300aabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:39.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.085+0000 7fa93539a700 1 --2- 172.21.15.40:0/3537162556 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa93015c720 0x7fa9300aabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:39.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.085+0000 7fa93539a700 1 -- 172.21.15.40:0/3537162556 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9300b4c60 msgr2=0x7fa9301f2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:39.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.085+0000 7fa93539a700 1 --2- 172.21.15.40:0/3537162556 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9300b4c60 0x7fa9301f2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:39.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.085+0000 7fa93539a700 1 -- 172.21.15.40:0/3537162556 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9200094a0 con 0x7fa9300d2830 2023-06-22T10:53:39.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.085+0000 7fa93539a700 1 --2- 172.21.15.40:0/3537162556 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa9300d2830 0x7fa9300aa160 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa9200090b0 tx=0x7fa920004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:39.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.085+0000 7fa9267fc700 1 -- 172.21.15.40:0/3537162556 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9200036a0 con 0x7fa9300d2830 2023-06-22T10:53:39.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.086+0000 7fa9267fc700 1 -- 172.21.15.40:0/3537162556 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa92001f070 con 0x7fa9300d2830 2023-06-22T10:53:39.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.086+0000 7fa9267fc700 1 -- 172.21.15.40:0/3537162556 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa920003a60 con 0x7fa9300d2830 2023-06-22T10:53:39.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.086+0000 7fa937dff700 1 -- 172.21.15.40:0/3537162556 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9300a9680 con 0x7fa9300d2830 2023-06-22T10:53:39.092 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.086+0000 7fa937dff700 1 -- 172.21.15.40:0/3537162556 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9300a9c40 con 0x7fa9300d2830 2023-06-22T10:53:39.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.087+0000 7fa937dff700 1 -- 172.21.15.40:0/3537162556 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa930067580 con 0x7fa9300d2830 2023-06-22T10:53:39.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.088+0000 7fa9267fc700 1 -- 172.21.15.40:0/3537162556 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa920003bc0 con 0x7fa9300d2830 2023-06-22T10:53:39.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.089+0000 7fa9267fc700 1 --2- 172.21.15.40:0/3537162556 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fa91406ace0 0x7fa91406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:39.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.089+0000 7fa9267fc700 1 -- 172.21.15.40:0/3537162556 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa920021070 con 0x7fa9300d2830 2023-06-22T10:53:39.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.089+0000 7fa935b9b700 1 --2- 172.21.15.40:0/3537162556 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fa91406ace0 0x7fa91406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:39.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.089+0000 7fa935b9b700 1 --2- 172.21.15.40:0/3537162556 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fa91406ace0 0x7fa91406d190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa9300b8260 tx=0x7fa92c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:39.096 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.093+0000 7fa9267fc700 1 -- 172.21.15.40:0/3537162556 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa920055e50 con 0x7fa9300d2830 2023-06-22T10:53:39.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.305+0000 7fa937dff700 1 -- 172.21.15.40:0/3537162556 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa9300b6960 con 0x7fa9300d2830 2023-06-22T10:53:39.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.306+0000 7fa9267fc700 1 -- 172.21.15.40:0/3537162556 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20036 (secure 0 0 0) 0x7fa920015090 con 0x7fa9300d2830 2023-06-22T10:53:39.310 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:53:39.310 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":28,"fsid":"475560bc-1a7c-4a75-b3b6-6fc6b20bdc52","created":"2023-06-22T10:53:03.784568+0000","modified":"2023-06-22T10:53:36.483308+0000","last_up_change":"2023-06-22T10:53:17.830348+0000","last_in_change":"2023-06-22T10:53:07.329974+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-22T10:53:17.182228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-22T10:53:23.874432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-22T10:53:29.812963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-22T10:53:30.404021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-22T10:53:33.982289+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"918db6b4-053a-46ba-976d-6e1a0104017f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6809","nonce":2400162888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6811","nonce":2400162888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6815","nonce":2400162888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6813","nonce":2400162888}]},"public_addr":"172.21.15.40:6809/2400162888","cluster_addr":"172.21.15.40:6811/2400162888","heartbeat_back_addr":"172.21.15.40:6815/2400162888","heartbeat_front_addr":"172.21.15.40:6813/2400162888","state":["exists","up"]},{"osd":1,"uuid":"0c146e2b-1725-4dae-9b5c-38795943b9d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6801","nonce":230885800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6803","nonce":230885800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6807","nonce":230885800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6805","nonce":230885800}]},"public_addr":"172.21.15.40:6801/230885800","cluster_addr":"172.21.15.40:6803/230885800","heartbeat_back_addr":"172.21.15.40:6807/230885800","heartbeat_front_addr":"172.21.15.40:6805/230885800","state":["exists","up"]},{"osd":2,"uuid":"0b3727fd-f281-46d5-a675-86c8c5ab269e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6817","nonce":2681404929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6819","nonce":2681404929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6823","nonce":2681404929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6821","nonce":2681404929}]},"public_addr":"172.21.15.40:6817/2681404929","cluster_addr":"172.21.15.40:6819/2681404929","heartbeat_back_addr":"172.21.15.40:6823/2681404929","heartbeat_front_addr":"172.21.15.40:6821/2681404929","state":["exists","up"]},{"osd":3,"uuid":"2969c698-7039-4bbb-beda-f756f7a368a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6825","nonce":111110981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6827","nonce":111110981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6831","nonce":111110981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6829","nonce":111110981}]},"public_addr":"172.21.15.40:6825/111110981","cluster_addr":"172.21.15.40:6827/111110981","heartbeat_back_addr":"172.21.15.40:6831/111110981","heartbeat_front_addr":"172.21.15.40:6829/111110981","state":["exists","up"]},{"osd":4,"uuid":"3bb1d9c8-8e42-4a6b-998d-04834f34be5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6801","nonce":3625455711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6803","nonce":3625455711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6807","nonce":3625455711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6805","nonce":3625455711}]},"public_addr":"172.21.15.45:6801/3625455711","cluster_addr":"172.21.15.45:6803/3625455711","heartbeat_back_addr":"172.21.15.45:6807/3625455711","heartbeat_front_addr":"172.21.15.45:6805/3625455711","state":["exists","up"]},{"osd":5,"uuid":"f9854ee4-302c-41be-977b-bedda090a3d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6817","nonce":3354411217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6819","nonce":3354411217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6823","nonce":3354411217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6821","nonce":3354411217}]},"public_addr":"172.21.15.45:6817/3354411217","cluster_addr":"172.21.15.45:6819/3354411217","heartbeat_back_addr":"172.21.15.45:6823/3354411217","heartbeat_front_addr":"172.21.15.45:6821/3354411217","state":["exists","up"]},{"osd":6,"uuid":"bbdb1989-f6ac-4954-9b85-b8b540d683c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6809","nonce":320111074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6811","nonce":320111074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6815","nonce":320111074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6813","nonce":320111074}]},"public_addr":"172.21.15.45:6809/320111074","cluster_addr":"172.21.15.45:6811/320111074","heartbeat_back_addr":"172.21.15.45:6815/320111074","heartbeat_front_addr":"172.21.15.45:6813/320111074","state":["exists","up"]},{"osd":7,"uuid":"823d44e3-58f1-4d1d-8263-a4e4a69d4327","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6825","nonce":643617680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6827","nonce":643617680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6831","nonce":643617680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6829","nonce":643617680}]},"public_addr":"172.21.15.45:6825/643617680","cluster_addr":"172.21.15.45:6827/643617680","heartbeat_back_addr":"172.21.15.45:6831/643617680","heartbeat_front_addr":"172.21.15.45:6829/643617680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.731262+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.873226+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.898936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.666578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.645990+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.953699+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.642823+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.693395+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-22T10:53:39.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.309+0000 7fa937dff700 1 -- 172.21.15.40:0/3537162556 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fa91406ace0 msgr2=0x7fa91406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:39.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.309+0000 7fa937dff700 1 --2- 172.21.15.40:0/3537162556 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fa91406ace0 0x7fa91406d190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa9300b8260 tx=0x7fa92c009040 comp rx=0 tx=0).stop 2023-06-22T10:53:39.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.309+0000 7fa937dff700 1 -- 172.21.15.40:0/3537162556 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa9300d2830 msgr2=0x7fa9300aa160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:39.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.309+0000 7fa937dff700 1 --2- 172.21.15.40:0/3537162556 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa9300d2830 0x7fa9300aa160 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa9200090b0 tx=0x7fa920004750 comp rx=0 tx=0).stop 2023-06-22T10:53:39.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.309+0000 7fa937dff700 1 -- 172.21.15.40:0/3537162556 shutdown_connections 2023-06-22T10:53:39.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.309+0000 7fa937dff700 1 --2- 172.21.15.40:0/3537162556 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fa91406ace0 0x7fa91406d190 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:39.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.309+0000 7fa937dff700 1 --2- 172.21.15.40:0/3537162556 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa93015c720 0x7fa9300aabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:39.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.309+0000 7fa937dff700 1 --2- 172.21.15.40:0/3537162556 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9300b4c60 0x7fa9301f2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:39.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.309+0000 7fa937dff700 1 --2- 172.21.15.40:0/3537162556 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa9300d2830 0x7fa9300aa160 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:39.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.309+0000 7fa937dff700 1 -- 172.21.15.40:0/3537162556 >> 172.21.15.40:0/3537162556 conn(0x7fa9300cf720 msgr2=0x7fa9300b4380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:39.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.309+0000 7fa937dff700 1 -- 172.21.15.40:0/3537162556 shutdown_connections 2023-06-22T10:53:39.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.309+0000 7fa937dff700 1 -- 172.21.15.40:0/3537162556 wait complete. 2023-06-22T10:53:39.733 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-06-22T10:53:31.430326+0000', 'modified': '2023-06-22T10:53:36.951183+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4303}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4303': {'gid': 4303, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.45:6835/1579627519', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6833', 'nonce': 1579627519}, {'type': 'v1', 'addr': '172.21.15.45:6835', 'nonce': 1579627519}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-06-22T10:53:39.734 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-06-22T10:53:39.734 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-06-22T10:53:39.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.942+0000 7f23effff700 1 Processor -- start 2023-06-22T10:53:39.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.942+0000 7f23effff700 1 -- start start 2023-06-22T10:53:39.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.944+0000 7f23effff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f23e815c720 0x7f23e80b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:39.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.944+0000 7f23effff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23e80b2130 con 0x7f23e80d2830 2023-06-22T10:53:39.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.944+0000 7f23effff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23e8161180 con 0x7f23e80b4e30 2023-06-22T10:53:39.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.944+0000 7f23effff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23e8160d60 con 0x7f23e815c720 2023-06-22T10:53:39.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.944+0000 7f23ed59a700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f23e80d2830 0x7f23e80b4720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45338/0 (socket says 172.21.15.40:45338) 2023-06-22T10:53:39.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.944+0000 7f23ed59a700 1 -- 172.21.15.40:0/4001336289 learned_addr learned my addr 172.21.15.40:0/4001336289 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:53:39.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.944+0000 7f23edd9b700 1 --2- 172.21.15.40:0/4001336289 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f23e815c720 0x7f23e80b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:39.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.945+0000 7f23ecd99700 1 -- 172.21.15.40:0/4001336289 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2542104597 0 0) 0x7f23e80b2130 con 0x7f23e80d2830 2023-06-22T10:53:39.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.945+0000 7f23ecd99700 1 -- 172.21.15.40:0/4001336289 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23d40035b0 con 0x7f23e80d2830 2023-06-22T10:53:39.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.945+0000 7f23ecd99700 1 -- 172.21.15.40:0/4001336289 <== mon.1 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1104144559 0 0) 0x7f23e8161180 con 0x7f23e80b4e30 2023-06-22T10:53:39.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.945+0000 7f23ecd99700 1 -- 172.21.15.40:0/4001336289 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23e80b2130 con 0x7f23e80b4e30 2023-06-22T10:53:39.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.945+0000 7f23edd9b700 1 -- 172.21.15.40:0/4001336289 >> v1:172.21.15.45:6789/0 conn(0x7f23e80b4e30 legacy=0x7f23e80d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:39.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.945+0000 7f23edd9b700 1 -- 172.21.15.40:0/4001336289 >> v1:172.21.15.40:6789/0 conn(0x7f23e80d2830 legacy=0x7f23e80b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:39.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.945+0000 7f23ecd99700 1 -- 172.21.15.40:0/4001336289 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3794361756 0 0) 0x7f23d40035b0 con 0x7f23e80d2830 2023-06-22T10:53:39.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.945+0000 7f23edd9b700 1 -- 172.21.15.40:0/4001336289 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e81603c0 con 0x7f23e815c720 2023-06-22T10:53:39.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.946+0000 7f23edd9b700 1 --2- 172.21.15.40:0/4001336289 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f23e815c720 0x7f23e80b1870 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f23e4009870 tx=0x7f23e4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab5bde730b65e334 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:39.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.946+0000 7f23ecd99700 1 -- 172.21.15.40:0/4001336289 <== mon.2 v2:172.21.15.45:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d8001670 con 0x7f23e815c720 2023-06-22T10:53:39.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.946+0000 7f23ecd99700 1 -- 172.21.15.40:0/4001336289 <== mon.2 v2:172.21.15.45:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23e4004030 con 0x7f23e815c720 2023-06-22T10:53:39.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.946+0000 7f23ecd99700 1 -- 172.21.15.40:0/4001336289 <== mon.2 v2:172.21.15.45:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e40043a0 con 0x7f23e815c720 2023-06-22T10:53:39.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.946+0000 7f23effff700 1 -- 172.21.15.40:0/4001336289 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f23e815c720 msgr2=0x7f23e80b1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:39.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.946+0000 7f23effff700 1 --2- 172.21.15.40:0/4001336289 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f23e815c720 0x7f23e80b1870 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f23e4009870 tx=0x7f23e4009b80 comp rx=0 tx=0).stop 2023-06-22T10:53:39.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.947+0000 7f23effff700 1 -- 172.21.15.40:0/4001336289 shutdown_connections 2023-06-22T10:53:39.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.947+0000 7f23effff700 1 --2- 172.21.15.40:0/4001336289 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f23e815c720 0x7f23e80b1870 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:39.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.947+0000 7f23effff700 1 -- 172.21.15.40:0/4001336289 >> 172.21.15.40:0/4001336289 conn(0x7f23e80cf720 msgr2=0x7f23e80cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:39.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.947+0000 7f23effff700 1 -- 172.21.15.40:0/4001336289 shutdown_connections 2023-06-22T10:53:39.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.947+0000 7f23effff700 1 -- 172.21.15.40:0/4001336289 wait complete. 2023-06-22T10:53:39.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.948+0000 7f23effff700 1 Processor -- start 2023-06-22T10:53:39.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.949+0000 7f23effff700 1 -- start start 2023-06-22T10:53:39.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.950+0000 7f23effff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f23e80b4e30 0x7f23e81f1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:39.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.950+0000 7f23effff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23e80d2830 0x7f23e80b8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:39.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.950+0000 7f23effff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23e815c720 0x7f23e81f3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:39.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.950+0000 7f23effff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e80c9e10 con 0x7f23e815c720 2023-06-22T10:53:39.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.950+0000 7f23effff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e81f24f0 con 0x7f23e80d2830 2023-06-22T10:53:39.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.950+0000 7f23effff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23e81f27d0 con 0x7f23e80b4e30 2023-06-22T10:53:39.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.950+0000 7f23ee59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23e815c720 0x7f23e81f3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:39.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.950+0000 7f23edd9b700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f23e80b4e30 0x7f23e81f1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:39.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.950+0000 7f23ed59a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23e80d2830 0x7f23e80b8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:39.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.950+0000 7f23ee59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23e815c720 0x7f23e81f3060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55498/0 (socket says 172.21.15.40:55498) 2023-06-22T10:53:39.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.950+0000 7f23ee59c700 1 -- 172.21.15.40:0/1571504556 learned_addr learned my addr 172.21.15.40:0/1571504556 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:39.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.950+0000 7f23ee59c700 1 -- 172.21.15.40:0/1571504556 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f23e80b4e30 msgr2=0x7f23e81f1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:39.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.950+0000 7f23ee59c700 1 --2- 172.21.15.40:0/1571504556 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f23e80b4e30 0x7f23e81f1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:39.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.950+0000 7f23ee59c700 1 -- 172.21.15.40:0/1571504556 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23e80d2830 msgr2=0x7f23e80b8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:39.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.950+0000 7f23ee59c700 1 --2- 172.21.15.40:0/1571504556 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23e80d2830 0x7f23e80b8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:39.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.950+0000 7f23ee59c700 1 -- 172.21.15.40:0/1571504556 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e40094a0 con 0x7f23e815c720 2023-06-22T10:53:39.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.951+0000 7f23ee59c700 1 --2- 172.21.15.40:0/1571504556 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23e815c720 0x7f23e81f3060 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f23e000cc50 tx=0x7f23e000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:39.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.951+0000 7f23de7fc700 1 -- 172.21.15.40:0/1571504556 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e0003c00 con 0x7f23e815c720 2023-06-22T10:53:39.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.951+0000 7f23de7fc700 1 -- 172.21.15.40:0/1571504556 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23e0003d60 con 0x7f23e815c720 2023-06-22T10:53:39.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.951+0000 7f23effff700 1 -- 172.21.15.40:0/1571504556 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23e81f2ab0 con 0x7f23e815c720 2023-06-22T10:53:39.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.951+0000 7f23de7fc700 1 -- 172.21.15.40:0/1571504556 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e000aab0 con 0x7f23e815c720 2023-06-22T10:53:39.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.951+0000 7f23effff700 1 -- 172.21.15.40:0/1571504556 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23e81f2d90 con 0x7f23e815c720 2023-06-22T10:53:39.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.953+0000 7f23de7fc700 1 -- 172.21.15.40:0/1571504556 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f23e000ac10 con 0x7f23e815c720 2023-06-22T10:53:39.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.954+0000 7f23de7fc700 1 --2- 172.21.15.40:0/1571504556 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f23cc06ace0 0x7f23cc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:39.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.954+0000 7f23de7fc700 1 -- 172.21.15.40:0/1571504556 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f23e0089860 con 0x7f23e815c720 2023-06-22T10:53:39.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.955+0000 7f23edd9b700 1 --2- 172.21.15.40:0/1571504556 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f23cc06ace0 0x7f23cc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:39.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.955+0000 7f23edd9b700 1 --2- 172.21.15.40:0/1571504556 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f23cc06ace0 0x7f23cc06d190 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f23e40090b0 tx=0x7f23e4008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:39.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.957+0000 7f24038e6b80 1 Processor -- start 2023-06-22T10:53:39.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.958+0000 7f24038e6b80 1 -- start start 2023-06-22T10:53:39.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.958+0000 7f24038e6b80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5629b4628320 0x5629b46286f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:39.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.958+0000 7f24038e6b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5629b45fb6d0 0x5629b45fe500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:39.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.958+0000 7f24038e6b80 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x5629b45f95b0 0x5629b4625510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:39.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.958+0000 7f24038e6b80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629b4572ea0 con 0x5629b4628320 2023-06-22T10:53:39.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.958+0000 7f24038e6b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629b44e6600 con 0x5629b45fb6d0 2023-06-22T10:53:39.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.958+0000 7f24038e6b80 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x5629b4555910 con 0x5629b45f95b0 2023-06-22T10:53:39.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.959+0000 7f23edd9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5629b4628320 0x5629b46286f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:39.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.959+0000 7f23edd9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5629b4628320 0x5629b46286f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55510/0 (socket says 172.21.15.40:55510) 2023-06-22T10:53:39.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.959+0000 7f23edd9b700 1 -- 172.21.15.40:0/2073609936 learned_addr learned my addr 172.21.15.40:0/2073609936 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:39.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.959+0000 7f23ee59c700 1 --2- 172.21.15.40:0/2073609936 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x5629b45f95b0 0x5629b4625510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:39.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.959+0000 7f23ed59a700 1 --2- 172.21.15.40:0/2073609936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5629b45fb6d0 0x5629b45fe500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:39.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.959+0000 7f23edd9b700 1 -- 172.21.15.40:0/2073609936 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x5629b45f95b0 msgr2=0x5629b4625510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:39.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.959+0000 7f23edd9b700 1 --2- 172.21.15.40:0/2073609936 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x5629b45f95b0 0x5629b4625510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:39.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.959+0000 7f23edd9b700 1 -- 172.21.15.40:0/2073609936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5629b45fb6d0 msgr2=0x5629b45fe500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:39.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.959+0000 7f23edd9b700 1 --2- 172.21.15.40:0/2073609936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5629b45fb6d0 0x5629b45fe500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:39.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.959+0000 7f23edd9b700 1 -- 172.21.15.40:0/2073609936 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5629b4342790 con 0x5629b4628320 2023-06-22T10:53:39.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.959+0000 7f23edd9b700 1 --2- 172.21.15.40:0/2073609936 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5629b4628320 0x5629b46286f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f23e4000c00 tx=0x7f23e4010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e9158ad9666c86f server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:39.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.960+0000 7f23cb7fe700 1 -- 172.21.15.40:0/2073609936 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e4020070 con 0x5629b4628320 2023-06-22T10:53:39.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.960+0000 7f23cb7fe700 1 -- 172.21.15.40:0/2073609936 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23e4003bb0 con 0x5629b4628320 2023-06-22T10:53:39.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.960+0000 7f23cb7fe700 1 -- 172.21.15.40:0/2073609936 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e4011630 con 0x5629b4628320 2023-06-22T10:53:39.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.960+0000 7f24038e6b80 1 -- 172.21.15.40:0/2073609936 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5629b4628320 msgr2=0x5629b46286f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:39.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.960+0000 7f24038e6b80 1 --2- 172.21.15.40:0/2073609936 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5629b4628320 0x5629b46286f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f23e4000c00 tx=0x7f23e4010000 comp rx=0 tx=0).stop 2023-06-22T10:53:39.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.960+0000 7f24038e6b80 1 -- 172.21.15.40:0/2073609936 shutdown_connections 2023-06-22T10:53:39.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.960+0000 7f24038e6b80 1 --2- 172.21.15.40:0/2073609936 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x5629b45f95b0 0x5629b4625510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:39.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.960+0000 7f24038e6b80 1 --2- 172.21.15.40:0/2073609936 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5629b4628320 0x5629b46286f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:39.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.960+0000 7f24038e6b80 1 --2- 172.21.15.40:0/2073609936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5629b45fb6d0 0x5629b45fe500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:39.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.960+0000 7f24038e6b80 1 -- 172.21.15.40:0/2073609936 >> 172.21.15.40:0/2073609936 conn(0x5629b45f2dd0 msgr2=0x5629b4643130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:39.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.961+0000 7f24038e6b80 1 -- 172.21.15.40:0/2073609936 shutdown_connections 2023-06-22T10:53:39.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.961+0000 7f24038e6b80 1 -- 172.21.15.40:0/2073609936 wait complete. 2023-06-22T10:53:39.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.961+0000 7f24038e6b80 1 -- start start 2023-06-22T10:53:39.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.962+0000 7f24038e6b80 1 Processor -- start 2023-06-22T10:53:39.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.962+0000 7f24038e6b80 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x5629b45f95b0 0x5629b46292d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:39.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.963+0000 7f24038e6b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5629b45fb6d0 0x5629b45fbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:39.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.963+0000 7f24038e6b80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5629b4628320 0x5629b46153f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:39.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.963+0000 7f24038e6b80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629b454ebe0 con 0x5629b4628320 2023-06-22T10:53:39.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.963+0000 7f24038e6b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629b450c5b0 con 0x5629b45fb6d0 2023-06-22T10:53:39.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.963+0000 7f24038e6b80 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x5629b44f2910 con 0x5629b45f95b0 2023-06-22T10:53:39.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.963+0000 7f24038e6b80 10 client.0 _ll_register_callbacks cb 0x5629b450ab70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-22T10:53:39.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.963+0000 7f23ee59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5629b4628320 0x5629b46153f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:39.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.963+0000 7f23edd9b700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x5629b45f95b0 0x5629b46292d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:39.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.963+0000 7f23ed59a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5629b45fb6d0 0x5629b45fbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:39.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.963+0000 7f23ee59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5629b4628320 0x5629b46153f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55512/0 (socket says 172.21.15.40:55512) 2023-06-22T10:53:39.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.963+0000 7f23ee59c700 1 -- 172.21.15.40:0/1140928576 learned_addr learned my addr 172.21.15.40:0/1140928576 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:39.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.963+0000 7f23ee59c700 1 -- 172.21.15.40:0/1140928576 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x5629b45f95b0 msgr2=0x5629b46292d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:39.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.963+0000 7f23ee59c700 1 --2- 172.21.15.40:0/1140928576 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x5629b45f95b0 0x5629b46292d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:39.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.963+0000 7f23ee59c700 1 -- 172.21.15.40:0/1140928576 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5629b45fb6d0 msgr2=0x5629b45fbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:39.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.963+0000 7f23ee59c700 1 --2- 172.21.15.40:0/1140928576 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5629b45fb6d0 0x5629b45fbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:39.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.963+0000 7f23ee59c700 1 -- 172.21.15.40:0/1140928576 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23e81603c0 con 0x5629b4628320 2023-06-22T10:53:39.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.963+0000 7f23ee59c700 1 --2- 172.21.15.40:0/1140928576 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5629b4628320 0x5629b46153f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f23e0057f40 tx=0x7f23e00183a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab29e2bfe9268843 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:39.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.963+0000 7f23c8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-06-22T10:53:39.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.964+0000 7f23c8ff9700 1 -- 172.21.15.40:0/1140928576 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e0057930 con 0x5629b4628320 2023-06-22T10:53:39.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.964+0000 7f24038e6b80 1 -- 172.21.15.40:0/1140928576 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5629b45f03e0 con 0x5629b4628320 2023-06-22T10:53:39.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.964+0000 7f23c8ff9700 1 -- 172.21.15.40:0/1140928576 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f23e006be40 con 0x5629b4628320 2023-06-22T10:53:39.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.964+0000 7f23c8ff9700 1 -- 172.21.15.40:0/1140928576 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f23e005e0e0 con 0x5629b4628320 2023-06-22T10:53:39.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.964+0000 7f24038e6b80 10 client.4449 fetch_fsmap learned FSMap version 7 2023-06-22T10:53:39.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.964+0000 7f24038e6b80 1 -- 172.21.15.40:0/1140928576 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x5629b442f0a0 con 0x5629b4628320 2023-06-22T10:53:39.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.964+0000 7f23c8ff9700 1 -- 172.21.15.40:0/1140928576 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5629b45f03e0 con 0x5629b4628320 2023-06-22T10:53:39.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.964+0000 7f23c8ff9700 1 -- 172.21.15.40:0/1140928576 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 7) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f23e0060100 con 0x5629b4628320 2023-06-22T10:53:39.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.964+0000 7f24038e6b80 10 client.4449 fetch_fsmap finished waiting for FSMap version 7 2023-06-22T10:53:39.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.964+0000 7f24038e6b80 10 client.4449 resolve_mds: resolved name 'd' to daemon mds.d 2023-06-22T10:53:39.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.964+0000 7f24038e6b80 20 client.4449 populate_metadata read hostname 'smithi040' 2023-06-22T10:53:39.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.964+0000 7f24038e6b80 1 --2- 172.21.15.40:0/1140928576 >> [v2:172.21.15.45:6833/1579627519,v1:172.21.15.45:6835/1579627519] conn(0x5629b462b260 0x5629b4652b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:39.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.964+0000 7f24038e6b80 4 client.4449 mds_command: new command op to 4303 tid=0[{"prefix": "get_command_descriptions"}] 2023-06-22T10:53:39.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.964+0000 7f24038e6b80 1 -- 172.21.15.40:0/1140928576 --> [v2:172.21.15.45:6833/1579627519,v1:172.21.15.45:6835/1579627519] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5629b45cca50 con 0x5629b462b260 2023-06-22T10:53:39.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.965+0000 7f23edd9b700 1 --2- 172.21.15.40:0/1140928576 >> [v2:172.21.15.45:6833/1579627519,v1:172.21.15.45:6835/1579627519] conn(0x5629b462b260 0x5629b4652b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:39.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.965+0000 7f23edd9b700 1 --2- 172.21.15.40:0/1140928576 >> [v2:172.21.15.45:6833/1579627519,v1:172.21.15.45:6835/1579627519] conn(0x5629b462b260 0x5629b4652b10 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76717229ca383fe1 server_cookie=f889e9c16a7f6782 in_seq=0 out_seq=0 2023-06-22T10:53:39.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.965+0000 7f23c8ff9700 10 client.4449 ms_handle_connect on v2:172.21.15.45:6833/1579627519 2023-06-22T10:53:39.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.966+0000 7f23c8ff9700 1 -- 172.21.15.40:0/1140928576 <== mds.0 v2:172.21.15.45:6833/1579627519 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5629b45cca50 con 0x5629b462b260 2023-06-22T10:53:39.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.966+0000 7f23c8ff9700 10 client.4449 handle_command_reply: tid=0 2023-06-22T10:53:39.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.966+0000 7f24038e6b80 1 client.4449 shutdown 2023-06-22T10:53:39.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.967+0000 7f24038e6b80 1 -- 172.21.15.40:0/1140928576 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5629b4628320 msgr2=0x5629b46153f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:39.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.967+0000 7f24038e6b80 1 --2- 172.21.15.40:0/1140928576 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5629b4628320 0x5629b46153f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f23e0057f40 tx=0x7f23e00183a0 comp rx=0 tx=0).stop 2023-06-22T10:53:39.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.967+0000 7f24038e6b80 1 -- 172.21.15.40:0/1140928576 shutdown_connections 2023-06-22T10:53:39.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.967+0000 7f24038e6b80 1 --2- 172.21.15.40:0/1140928576 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x5629b45f95b0 0x5629b46292d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:39.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.967+0000 7f24038e6b80 1 --2- 172.21.15.40:0/1140928576 >> [v2:172.21.15.45:6833/1579627519,v1:172.21.15.45:6835/1579627519] conn(0x5629b462b260 0x5629b4652b10 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:39.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.967+0000 7f24038e6b80 1 --2- 172.21.15.40:0/1140928576 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5629b4628320 0x5629b46153f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:39.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.967+0000 7f24038e6b80 1 --2- 172.21.15.40:0/1140928576 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5629b45fb6d0 0x5629b45fbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:39.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.967+0000 7f23c8ff9700 0 client.4449 ms_handle_reset on v2:172.21.15.45:6833/1579627519 2023-06-22T10:53:39.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.967+0000 7f24038e6b80 1 -- 172.21.15.40:0/1140928576 >> 172.21.15.40:0/1140928576 conn(0x5629b45f2dd0 msgr2=0x5629b45f7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:39.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.967+0000 7f24038e6b80 1 -- 172.21.15.40:0/1140928576 shutdown_connections 2023-06-22T10:53:39.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.967+0000 7f24038e6b80 1 -- 172.21.15.40:0/1140928576 wait complete. 2023-06-22T10:53:39.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.967+0000 7f24038e6b80 20 client.4449 trim_cache size 0 max 16384 2023-06-22T10:53:39.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.986+0000 7f24038e6b80 1 Processor -- start 2023-06-22T10:53:39.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.986+0000 7f24038e6b80 1 -- start start 2023-06-22T10:53:39.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.987+0000 7f24038e6b80 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x5629b45f95b0 0x5629b4654d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:39.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.987+0000 7f24038e6b80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5629b45fb6d0 0x5629b4642f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:39.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.987+0000 7f24038e6b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5629b4628320 0x5629b4643470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:39.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.987+0000 7f24038e6b80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629b4343390 con 0x5629b45fb6d0 2023-06-22T10:53:39.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.987+0000 7f24038e6b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629b4665090 con 0x5629b4628320 2023-06-22T10:53:39.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.987+0000 7f24038e6b80 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x5629b46286f0 con 0x5629b45f95b0 2023-06-22T10:53:39.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.987+0000 7f23ed59a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5629b45fb6d0 0x5629b4642f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:39.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.987+0000 7f23ed59a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5629b45fb6d0 0x5629b4642f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55524/0 (socket says 172.21.15.40:55524) 2023-06-22T10:53:39.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.987+0000 7f23ed59a700 1 -- 172.21.15.40:0/1485040661 learned_addr learned my addr 172.21.15.40:0/1485040661 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:39.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.987+0000 7f23edd9b700 1 --2- 172.21.15.40:0/1485040661 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x5629b45f95b0 0x5629b4654d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:39.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.987+0000 7f23ee59c700 1 --2- 172.21.15.40:0/1485040661 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5629b4628320 0x5629b4643470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:39.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.987+0000 7f23ed59a700 1 -- 172.21.15.40:0/1485040661 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x5629b45f95b0 msgr2=0x5629b4654d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:39.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.987+0000 7f23ed59a700 1 --2- 172.21.15.40:0/1485040661 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x5629b45f95b0 0x5629b4654d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:39.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.987+0000 7f23ed59a700 1 -- 172.21.15.40:0/1485040661 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5629b4628320 msgr2=0x5629b4643470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:39.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.987+0000 7f23ed59a700 1 --2- 172.21.15.40:0/1485040661 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5629b4628320 0x5629b4643470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:39.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.987+0000 7f23ed59a700 1 -- 172.21.15.40:0/1485040661 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5629b4514b10 con 0x5629b45fb6d0 2023-06-22T10:53:39.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.988+0000 7f23ed59a700 1 --2- 172.21.15.40:0/1485040661 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5629b45fb6d0 0x5629b4642f30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f23d8004b90 tx=0x7f23d8000f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=250d9a74abf8ec7b server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:39.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.988+0000 7f23cbfff700 1 -- 172.21.15.40:0/1485040661 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d8014960 con 0x5629b45fb6d0 2023-06-22T10:53:39.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.988+0000 7f23cbfff700 1 -- 172.21.15.40:0/1485040661 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23d8014ac0 con 0x5629b45fb6d0 2023-06-22T10:53:39.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.988+0000 7f23cbfff700 1 -- 172.21.15.40:0/1485040661 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d8014c30 con 0x5629b45fb6d0 2023-06-22T10:53:39.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.988+0000 7f24038e6b80 1 -- 172.21.15.40:0/1485040661 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5629b45fb6d0 msgr2=0x5629b4642f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:39.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.988+0000 7f24038e6b80 1 --2- 172.21.15.40:0/1485040661 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5629b45fb6d0 0x5629b4642f30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f23d8004b90 tx=0x7f23d8000f10 comp rx=0 tx=0).stop 2023-06-22T10:53:39.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.989+0000 7f24038e6b80 1 -- 172.21.15.40:0/1485040661 shutdown_connections 2023-06-22T10:53:39.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.989+0000 7f24038e6b80 1 --2- 172.21.15.40:0/1485040661 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x5629b45f95b0 0x5629b4654d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:39.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.989+0000 7f24038e6b80 1 --2- 172.21.15.40:0/1485040661 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5629b4628320 0x5629b4643470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:39.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.989+0000 7f24038e6b80 1 --2- 172.21.15.40:0/1485040661 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5629b45fb6d0 0x5629b4642f30 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:39.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.989+0000 7f24038e6b80 1 -- 172.21.15.40:0/1485040661 >> 172.21.15.40:0/1485040661 conn(0x5629b45f2dd0 msgr2=0x5629b45ff1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:39.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.989+0000 7f24038e6b80 1 -- 172.21.15.40:0/1485040661 shutdown_connections 2023-06-22T10:53:39.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.989+0000 7f24038e6b80 1 -- 172.21.15.40:0/1485040661 wait complete. 2023-06-22T10:53:39.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.989+0000 7f24038e6b80 1 -- start start 2023-06-22T10:53:39.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.990+0000 7f24038e6b80 1 Processor -- start 2023-06-22T10:53:39.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.990+0000 7f24038e6b80 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x5629b45f95b0 0x5629b45f7060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:39.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.990+0000 7f24038e6b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5629b45fb6d0 0x5629b45f75a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:39.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.991+0000 7f24038e6b80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5629b4628320 0x5629b45fc630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:39.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.991+0000 7f24038e6b80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629b4629930 con 0x5629b4628320 2023-06-22T10:53:39.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.991+0000 7f24038e6b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629b4659030 con 0x5629b45fb6d0 2023-06-22T10:53:39.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.991+0000 7f24038e6b80 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x5629b4659270 con 0x5629b45f95b0 2023-06-22T10:53:39.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.991+0000 7f24038e6b80 10 client.0 _ll_register_callbacks cb 0x7f23e0057c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-22T10:53:39.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.991+0000 7f23ee59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5629b4628320 0x5629b45fc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:39.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.991+0000 7f23ee59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5629b4628320 0x5629b45fc630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55530/0 (socket says 172.21.15.40:55530) 2023-06-22T10:53:39.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.991+0000 7f23ed59a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5629b45fb6d0 0x5629b45f75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:39.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.991+0000 7f23ee59c700 1 -- 172.21.15.40:0/3423085043 learned_addr learned my addr 172.21.15.40:0/3423085043 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:39.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.991+0000 7f23edd9b700 1 --2- 172.21.15.40:0/3423085043 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x5629b45f95b0 0x5629b45f7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:39.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.991+0000 7f23ee59c700 1 -- 172.21.15.40:0/3423085043 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x5629b45f95b0 msgr2=0x5629b45f7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:39.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.991+0000 7f23ee59c700 1 --2- 172.21.15.40:0/3423085043 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x5629b45f95b0 0x5629b45f7060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:39.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.991+0000 7f23ee59c700 1 -- 172.21.15.40:0/3423085043 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5629b45fb6d0 msgr2=0x5629b45f75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:39.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.991+0000 7f23ee59c700 1 --2- 172.21.15.40:0/3423085043 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5629b45fb6d0 0x5629b45f75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:39.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.991+0000 7f23ee59c700 1 -- 172.21.15.40:0/3423085043 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23d8004870 con 0x5629b4628320 2023-06-22T10:53:40.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.991+0000 7f23ee59c700 1 --2- 172.21.15.40:0/3423085043 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5629b4628320 0x5629b45fc630 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f23e0056830 tx=0x7f23e0087770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8e9aa59a5ba68f2 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:40.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.991+0000 7f23c8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-06-22T10:53:40.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.992+0000 7f23c8ff9700 1 -- 172.21.15.40:0/3423085043 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e00573f0 con 0x5629b4628320 2023-06-22T10:53:40.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.992+0000 7f23c8ff9700 1 -- 172.21.15.40:0/3423085043 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f23e006be40 con 0x5629b4628320 2023-06-22T10:53:40.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.992+0000 7f24038e6b80 1 -- 172.21.15.40:0/3423085043 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f23e4003bb0 con 0x5629b4628320 2023-06-22T10:53:40.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.992+0000 7f23c8ff9700 1 -- 172.21.15.40:0/3423085043 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f23e005e0e0 con 0x5629b4628320 2023-06-22T10:53:40.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.992+0000 7f24038e6b80 10 client.4455 fetch_fsmap learned FSMap version 7 2023-06-22T10:53:40.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.992+0000 7f24038e6b80 1 -- 172.21.15.40:0/3423085043 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x5629b43a31d0 con 0x5629b4628320 2023-06-22T10:53:40.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.992+0000 7f23c8ff9700 1 -- 172.21.15.40:0/3423085043 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23e4003bb0 con 0x5629b4628320 2023-06-22T10:53:40.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.992+0000 7f23c8ff9700 1 -- 172.21.15.40:0/3423085043 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 7) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f23e0054030 con 0x5629b4628320 2023-06-22T10:53:40.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.992+0000 7f24038e6b80 10 client.4455 fetch_fsmap finished waiting for FSMap version 7 2023-06-22T10:53:40.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.992+0000 7f24038e6b80 10 client.4455 resolve_mds: resolved name 'd' to daemon mds.d 2023-06-22T10:53:40.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.992+0000 7f24038e6b80 20 client.4455 populate_metadata read hostname 'smithi040' 2023-06-22T10:53:40.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.992+0000 7f24038e6b80 1 --2- 172.21.15.40:0/3423085043 >> [v2:172.21.15.45:6833/1579627519,v1:172.21.15.45:6835/1579627519] conn(0x5629b46a0520 0x5629b45fcb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:40.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.992+0000 7f24038e6b80 4 client.4455 mds_command: new command op to 4303 tid=0[{"prefix": "status"}] 2023-06-22T10:53:40.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.992+0000 7f24038e6b80 1 -- 172.21.15.40:0/3423085043 --> [v2:172.21.15.45:6833/1579627519,v1:172.21.15.45:6835/1579627519] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5629b4547d20 con 0x5629b46a0520 2023-06-22T10:53:40.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.993+0000 7f23edd9b700 1 --2- 172.21.15.40:0/3423085043 >> [v2:172.21.15.45:6833/1579627519,v1:172.21.15.45:6835/1579627519] conn(0x5629b46a0520 0x5629b45fcb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:40.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.993+0000 7f23edd9b700 1 --2- 172.21.15.40:0/3423085043 >> [v2:172.21.15.45:6833/1579627519,v1:172.21.15.45:6835/1579627519] conn(0x5629b46a0520 0x5629b45fcb70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0e58ccd196b637e server_cookie=6ba6c55a75341254 in_seq=0 out_seq=0 2023-06-22T10:53:40.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.993+0000 7f23c8ff9700 10 client.4455 ms_handle_connect on v2:172.21.15.45:6833/1579627519 2023-06-22T10:53:40.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.993+0000 7f23c8ff9700 1 -- 172.21.15.40:0/3423085043 <== mds.0 v2:172.21.15.45:6833/1579627519 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x5629b4547d20 con 0x5629b46a0520 2023-06-22T10:53:40.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.993+0000 7f23c8ff9700 10 client.4455 handle_command_reply: tid=0 2023-06-22T10:53:40.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.993+0000 7f24038e6b80 1 client.4455 shutdown 2023-06-22T10:53:40.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.994+0000 7f24038e6b80 1 -- 172.21.15.40:0/3423085043 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5629b4628320 msgr2=0x5629b45fc630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:40.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.994+0000 7f24038e6b80 1 --2- 172.21.15.40:0/3423085043 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5629b4628320 0x5629b45fc630 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f23e0056830 tx=0x7f23e0087770 comp rx=0 tx=0).stop 2023-06-22T10:53:40.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.994+0000 7f24038e6b80 1 -- 172.21.15.40:0/3423085043 shutdown_connections 2023-06-22T10:53:40.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.994+0000 7f24038e6b80 1 --2- 172.21.15.40:0/3423085043 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x5629b45f95b0 0x5629b45f7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:40.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.994+0000 7f24038e6b80 1 --2- 172.21.15.40:0/3423085043 >> [v2:172.21.15.45:6833/1579627519,v1:172.21.15.45:6835/1579627519] conn(0x5629b46a0520 0x5629b45fcb70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:40.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.994+0000 7f24038e6b80 1 --2- 172.21.15.40:0/3423085043 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5629b4628320 0x5629b45fc630 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:40.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.994+0000 7f24038e6b80 1 --2- 172.21.15.40:0/3423085043 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5629b45fb6d0 0x5629b45f75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:40.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.994+0000 7f23c8ff9700 0 client.4455 ms_handle_reset on v2:172.21.15.45:6833/1579627519 2023-06-22T10:53:40.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.994+0000 7f24038e6b80 1 -- 172.21.15.40:0/3423085043 >> 172.21.15.40:0/3423085043 conn(0x5629b45f2dd0 msgr2=0x5629b4651a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:40.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.994+0000 7f24038e6b80 1 -- 172.21.15.40:0/3423085043 shutdown_connections 2023-06-22T10:53:40.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.994+0000 7f24038e6b80 1 -- 172.21.15.40:0/3423085043 wait complete. 2023-06-22T10:53:40.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.994+0000 7f24038e6b80 20 client.4455 trim_cache size 0 max 16384 2023-06-22T10:53:40.005 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-06-22T10:53:40.006 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "475560bc-1a7c-4a75-b3b6-6fc6b20bdc52", 2023-06-22T10:53:40.006 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 0, 2023-06-22T10:53:40.006 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 4303, 2023-06-22T10:53:40.006 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2023-06-22T10:53:40.006 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2023-06-22T10:53:40.006 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2023-06-22T10:53:40.006 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 8.0800167940000005, 2023-06-22T10:53:40.007 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 7, 2023-06-22T10:53:40.007 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 28, 2023-06-22T10:53:40.007 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 27, 2023-06-22T10:53:40.007 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 14.167055675 2023-06-22T10:53:40.007 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-06-22T10:53:40.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.995+0000 7f23effff700 1 -- 172.21.15.40:0/1571504556 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f23cc06ace0 msgr2=0x7f23cc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:40.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.995+0000 7f23effff700 1 --2- 172.21.15.40:0/1571504556 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f23cc06ace0 0x7f23cc06d190 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f23e40090b0 tx=0x7f23e4008030 comp rx=0 tx=0).stop 2023-06-22T10:53:40.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.995+0000 7f23effff700 1 -- 172.21.15.40:0/1571504556 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23e815c720 msgr2=0x7f23e81f3060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:40.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.995+0000 7f23effff700 1 --2- 172.21.15.40:0/1571504556 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23e815c720 0x7f23e81f3060 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f23e000cc50 tx=0x7f23e000cf60 comp rx=0 tx=0).stop 2023-06-22T10:53:40.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.995+0000 7f23effff700 1 -- 172.21.15.40:0/1571504556 shutdown_connections 2023-06-22T10:53:40.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.995+0000 7f23effff700 1 --2- 172.21.15.40:0/1571504556 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f23cc06ace0 0x7f23cc06d190 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:40.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.995+0000 7f23effff700 1 --2- 172.21.15.40:0/1571504556 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f23e80b4e30 0x7f23e81f1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:40.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.995+0000 7f23effff700 1 --2- 172.21.15.40:0/1571504556 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23e815c720 0x7f23e81f3060 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:40.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.995+0000 7f23effff700 1 --2- 172.21.15.40:0/1571504556 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23e80d2830 0x7f23e80b8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:40.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.995+0000 7f23effff700 1 -- 172.21.15.40:0/1571504556 >> 172.21.15.40:0/1571504556 conn(0x7f23e80cf720 msgr2=0x7f23e80d1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:40.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.995+0000 7f23effff700 1 -- 172.21.15.40:0/1571504556 shutdown_connections 2023-06-22T10:53:40.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:39.995+0000 7f23effff700 1 -- 172.21.15.40:0/1571504556 wait complete. 2023-06-22T10:53:40.015 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-06-22T10:53:40.016 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-06-22T10:53:40.016 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-22T10:53:40.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.213+0000 7f46a75ff700 1 Processor -- start 2023-06-22T10:53:40.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.213+0000 7f46a75ff700 1 -- start start 2023-06-22T10:53:40.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.214+0000 7f46a75ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f46a015c720 0x7f46a00b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:40.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.214+0000 7f46a75ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f46a00b4e30 0x7f46a00d0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:40.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.214+0000 7f46a75ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46a00b2130 con 0x7f46a00d2830 2023-06-22T10:53:40.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.214+0000 7f46a75ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46a0160d60 con 0x7f46a015c720 2023-06-22T10:53:40.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.214+0000 7f46a75ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46a0161180 con 0x7f46a00b4e30 2023-06-22T10:53:40.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.215+0000 7f46a539b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f46a015c720 0x7f46a00b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:40.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.215+0000 7f46a4b9a700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f46a00d2830 0x7f46a00b4720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45346/0 (socket says 172.21.15.40:45346) 2023-06-22T10:53:40.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.215+0000 7f46a4b9a700 1 -- 172.21.15.40:0/1809287063 learned_addr learned my addr 172.21.15.40:0/1809287063 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:53:40.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.215+0000 7f46a5b9c700 1 --2- 172.21.15.40:0/1809287063 >> v2:172.21.15.45:3300/0 conn(0x7f46a00b4e30 0x7f46a00d0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:40.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.215+0000 7f46a539b700 1 -- 172.21.15.40:0/1809287063 >> v2:172.21.15.45:3300/0 conn(0x7f46a00b4e30 msgr2=0x7f46a00d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:40.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.215+0000 7f46a539b700 1 --2- 172.21.15.40:0/1809287063 >> v2:172.21.15.45:3300/0 conn(0x7f46a00b4e30 0x7f46a00d0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:40.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.215+0000 7f46a539b700 1 -- 172.21.15.40:0/1809287063 >> v1:172.21.15.40:6789/0 conn(0x7f46a00d2830 legacy=0x7f46a00b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:40.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.215+0000 7f46a539b700 1 -- 172.21.15.40:0/1809287063 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a01603c0 con 0x7f46a015c720 2023-06-22T10:53:40.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.215+0000 7f4697fff700 1 -- 172.21.15.40:0/1809287063 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1748380281 0 0) 0x7f46a00b2130 con 0x7f46a00d2830 2023-06-22T10:53:40.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.215+0000 7f46a539b700 1 --2- 172.21.15.40:0/1809287063 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46a015c720 0x7f46a00b1870 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f469c009840 tx=0x7f469c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce3b8cb31639a8c6 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:40.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.216+0000 7f4697fff700 1 -- 172.21.15.40:0/1809287063 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469c011830 con 0x7f46a015c720 2023-06-22T10:53:40.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.216+0000 7f4697fff700 1 -- 172.21.15.40:0/1809287063 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f469c011990 con 0x7f46a015c720 2023-06-22T10:53:40.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.216+0000 7f4697fff700 1 -- 172.21.15.40:0/1809287063 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469c011d20 con 0x7f46a015c720 2023-06-22T10:53:40.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.216+0000 7f46a75ff700 1 -- 172.21.15.40:0/1809287063 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46a015c720 msgr2=0x7f46a00b1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:40.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.216+0000 7f46a75ff700 1 --2- 172.21.15.40:0/1809287063 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46a015c720 0x7f46a00b1870 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f469c009840 tx=0x7f469c009b50 comp rx=0 tx=0).stop 2023-06-22T10:53:40.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.216+0000 7f46a75ff700 1 -- 172.21.15.40:0/1809287063 shutdown_connections 2023-06-22T10:53:40.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.216+0000 7f46a75ff700 1 --2- 172.21.15.40:0/1809287063 >> v2:172.21.15.45:3300/0 conn(0x7f46a00b4e30 0x7f46a00d0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:40.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.216+0000 7f46a75ff700 1 --2- 172.21.15.40:0/1809287063 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46a015c720 0x7f46a00b1870 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:40.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.216+0000 7f46a75ff700 1 -- 172.21.15.40:0/1809287063 >> 172.21.15.40:0/1809287063 conn(0x7f46a00cf720 msgr2=0x7f46a00cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:40.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.217+0000 7f46a75ff700 1 -- 172.21.15.40:0/1809287063 shutdown_connections 2023-06-22T10:53:40.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.217+0000 7f46a75ff700 1 -- 172.21.15.40:0/1809287063 wait complete. 2023-06-22T10:53:40.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.218+0000 7f46a75ff700 1 Processor -- start 2023-06-22T10:53:40.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.218+0000 7f46a75ff700 1 -- start start 2023-06-22T10:53:40.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.219+0000 7f46a75ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46a00b4e30 0x7f46a0155620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:40.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.219+0000 7f46a75ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f46a00d2830 0x7f46a015f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:40.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.219+0000 7f46a75ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46a015c720 0x7f46a0157630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:40.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.219+0000 7f46a75ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a015cd90 con 0x7f46a015c720 2023-06-22T10:53:40.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.219+0000 7f46a75ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a015f220 con 0x7f46a00b4e30 2023-06-22T10:53:40.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.219+0000 7f46a75ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46a01569c0 con 0x7f46a00d2830 2023-06-22T10:53:40.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.219+0000 7f46a5b9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46a015c720 0x7f46a0157630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:40.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.220+0000 7f46a5b9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46a015c720 0x7f46a0157630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55556/0 (socket says 172.21.15.40:55556) 2023-06-22T10:53:40.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.220+0000 7f46a5b9c700 1 -- 172.21.15.40:0/4063432331 learned_addr learned my addr 172.21.15.40:0/4063432331 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:40.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.220+0000 7f46a539b700 1 --2- 172.21.15.40:0/4063432331 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46a00b4e30 0x7f46a0155620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:40.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.220+0000 7f46a4b9a700 1 --2- 172.21.15.40:0/4063432331 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f46a00d2830 0x7f46a015f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:40.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.220+0000 7f46a5b9c700 1 -- 172.21.15.40:0/4063432331 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f46a00d2830 msgr2=0x7f46a015f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:40.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.220+0000 7f46a5b9c700 1 --2- 172.21.15.40:0/4063432331 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f46a00d2830 0x7f46a015f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:40.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.220+0000 7f46a5b9c700 1 -- 172.21.15.40:0/4063432331 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46a00b4e30 msgr2=0x7f46a0155620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:40.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.220+0000 7f46a5b9c700 1 --2- 172.21.15.40:0/4063432331 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46a00b4e30 0x7f46a0155620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:40.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.220+0000 7f46a5b9c700 1 -- 172.21.15.40:0/4063432331 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f469c0094a0 con 0x7f46a015c720 2023-06-22T10:53:40.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.220+0000 7f46a539b700 1 --2- 172.21.15.40:0/4063432331 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46a00b4e30 0x7f46a0155620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-22T10:53:40.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.220+0000 7f46a4b9a700 1 --2- 172.21.15.40:0/4063432331 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f46a00d2830 0x7f46a015f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-22T10:53:40.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.220+0000 7f46a5b9c700 1 --2- 172.21.15.40:0/4063432331 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46a015c720 0x7f46a0157630 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f469800efc0 tx=0x7f469800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:40.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.220+0000 7f4695ffb700 1 -- 172.21.15.40:0/4063432331 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4698009b20 con 0x7f46a015c720 2023-06-22T10:53:40.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.220+0000 7f4695ffb700 1 -- 172.21.15.40:0/4063432331 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f469800f040 con 0x7f46a015c720 2023-06-22T10:53:40.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.220+0000 7f4695ffb700 1 -- 172.21.15.40:0/4063432331 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4698009e50 con 0x7f46a015c720 2023-06-22T10:53:40.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.220+0000 7f46a75ff700 1 -- 172.21.15.40:0/4063432331 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46a0156ca0 con 0x7f46a015c720 2023-06-22T10:53:40.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.221+0000 7f46a75ff700 1 -- 172.21.15.40:0/4063432331 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46a0157260 con 0x7f46a015c720 2023-06-22T10:53:40.228 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.222+0000 7f46a75ff700 1 -- 172.21.15.40:0/4063432331 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46a015cf40 con 0x7f46a015c720 2023-06-22T10:53:40.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.223+0000 7f4695ffb700 1 -- 172.21.15.40:0/4063432331 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4698014480 con 0x7f46a015c720 2023-06-22T10:53:40.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.224+0000 7f4695ffb700 1 --2- 172.21.15.40:0/4063432331 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f468406ace0 0x7f468406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:40.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.224+0000 7f4695ffb700 1 -- 172.21.15.40:0/4063432331 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f469808a380 con 0x7f46a015c720 2023-06-22T10:53:40.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.224+0000 7f46a539b700 1 --2- 172.21.15.40:0/4063432331 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f468406ace0 0x7f468406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:40.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.224+0000 7f46a539b700 1 --2- 172.21.15.40:0/4063432331 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f468406ace0 0x7f468406d190 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f469c000c00 tx=0x7f469c010000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:40.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.228+0000 7f4695ffb700 1 -- 172.21.15.40:0/4063432331 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f46a015cf40 con 0x7f46a015c720 2023-06-22T10:53:40.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.479+0000 7f46a75ff700 1 -- 172.21.15.40:0/4063432331 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f46a015cf40 con 0x7f46a015c720 2023-06-22T10:53:40.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.479+0000 7f4695ffb700 1 -- 172.21.15.40:0/4063432331 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f46a015cf40 con 0x7f46a015c720 2023-06-22T10:53:40.483 INFO:teuthology.orchestra.run.smithi040.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-06-22T10:53:40.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.481+0000 7f46a75ff700 1 -- 172.21.15.40:0/4063432331 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f468406ace0 msgr2=0x7f468406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:40.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.481+0000 7f46a75ff700 1 --2- 172.21.15.40:0/4063432331 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f468406ace0 0x7f468406d190 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f469c000c00 tx=0x7f469c010000 comp rx=0 tx=0).stop 2023-06-22T10:53:40.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.481+0000 7f46a75ff700 1 -- 172.21.15.40:0/4063432331 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46a015c720 msgr2=0x7f46a0157630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:40.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.481+0000 7f46a75ff700 1 --2- 172.21.15.40:0/4063432331 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46a015c720 0x7f46a0157630 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f469800efc0 tx=0x7f469800c3a0 comp rx=0 tx=0).stop 2023-06-22T10:53:40.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.481+0000 7f46a75ff700 1 -- 172.21.15.40:0/4063432331 shutdown_connections 2023-06-22T10:53:40.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.481+0000 7f46a75ff700 1 --2- 172.21.15.40:0/4063432331 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f468406ace0 0x7f468406d190 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:40.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.481+0000 7f46a75ff700 1 --2- 172.21.15.40:0/4063432331 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46a015c720 0x7f46a0157630 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:40.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.481+0000 7f46a75ff700 1 --2- 172.21.15.40:0/4063432331 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46a00b4e30 0x7f46a0155620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:40.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.481+0000 7f46a75ff700 1 --2- 172.21.15.40:0/4063432331 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f46a00d2830 0x7f46a015f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:40.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.481+0000 7f46a75ff700 1 -- 172.21.15.40:0/4063432331 >> 172.21.15.40:0/4063432331 conn(0x7f46a00cf720 msgr2=0x7f46a00cfaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:40.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.481+0000 7f46a75ff700 1 -- 172.21.15.40:0/4063432331 shutdown_connections 2023-06-22T10:53:40.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:40.482+0000 7f46a75ff700 1 -- 172.21.15.40:0/4063432331 wait complete. 2023-06-22T10:53:40.503 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-06-22T10:53:40.503 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-22T10:53:40.504 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi040.front.sepia.ceph.com 2023-06-22T10:53:40.504 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-06-22T10:53:40.504 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-06-22T10:53:40.505 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-06-22T10:53:40.505 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-22T10:53:40.505 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-22T10:53:40.505 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-06-22T10:53:40.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:53:40.506 DEBUG:teuthology.orchestra.run.smithi040:> ip addr 2023-06-22T10:53:40.552 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-22T10:53:40.553 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-22T10:53:40.553 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2023-06-22T10:53:40.553 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-06-22T10:53:40.553 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2023-06-22T10:53:40.554 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-06-22T10:53:40.554 INFO:teuthology.orchestra.run.smithi040.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-22T10:53:40.554 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:16 brd ff:ff:ff:ff:ff:ff 2023-06-22T10:53:40.554 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f0 2023-06-22T10:53:40.554 INFO:teuthology.orchestra.run.smithi040.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-22T10:53:40.554 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:17 brd ff:ff:ff:ff:ff:ff 2023-06-22T10:53:40.554 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f1 2023-06-22T10:53:40.554 INFO:teuthology.orchestra.run.smithi040.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-22T10:53:40.555 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cc brd ff:ff:ff:ff:ff:ff 2023-06-22T10:53:40.555 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f0 2023-06-22T10:53:40.555 INFO:teuthology.orchestra.run.smithi040.stdout: inet 172.21.15.40/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-06-22T10:53:40.555 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft 42327sec preferred_lft 42327sec 2023-06-22T10:53:40.555 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::ec4:7aff:febd:12cc/64 scope link 2023-06-22T10:53:40.555 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-06-22T10:53:40.555 INFO:teuthology.orchestra.run.smithi040.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-22T10:53:40.556 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cd brd ff:ff:ff:ff:ff:ff 2023-06-22T10:53:40.556 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f1 2023-06-22T10:53:40.557 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-06-22T10:53:40.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:53:40.558 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-06-22T10:53:40.558 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-06-22T10:53:40.559 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link add name ceph-brx type bridge 2023-06-22T10:53:40.559 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip addr flush dev ceph-brx 2023-06-22T10:53:40.559 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set ceph-brx up 2023-06-22T10:53:40.560 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-06-22T10:53:40.560 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-06-22T10:53:41.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:53:41.029 DEBUG:teuthology.orchestra.run.smithi040:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-22T10:53:41.133 INFO:teuthology.orchestra.run.smithi040.stdout:1 2023-06-22T10:53:41.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:53:41.136 DEBUG:teuthology.orchestra.run.smithi040:> route 2023-06-22T10:53:41.203 INFO:teuthology.orchestra.run.smithi040.stdout:Kernel IP routing table 2023-06-22T10:53:41.204 INFO:teuthology.orchestra.run.smithi040.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-22T10:53:41.204 INFO:teuthology.orchestra.run.smithi040.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-06-22T10:53:41.204 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-06-22T10:53:41.204 INFO:teuthology.orchestra.run.smithi040.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-22T10:53:41.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:53:41.206 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-06-22T10:53:41.206 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-06-22T10:53:41.206 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-06-22T10:53:41.207 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-06-22T10:53:41.207 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-06-22T10:53:41.208 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-06-22T10:53:41.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:53:41.907 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2023-06-22T10:53:41.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:53:41.965 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list-id 2023-06-22T10:53:42.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:53:42.059 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-06-22T10:53:42.059 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-06-22T10:53:42.059 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-06-22T10:53:42.060 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-06-22T10:53:42.060 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-06-22T10:53:42.242 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-06-22T10:53:42.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:53:42.245 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-06-22T10:53:42.245 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-06-22T10:53:42.246 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-06-22T10:53:42.247 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-06-22T10:53:42.248 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-06-22T10:53:42.249 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-06-22T10:53:42.249 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-06-22T10:53:42.249 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-06-22T10:53:42.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:53:42.518 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-06-22T10:53:42.519 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-06-22T10:53:42.519 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set brx.0 up 2023-06-22T10:53:42.519 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set dev brx.0 master ceph-brx 2023-06-22T10:53:42.520 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-06-22T10:53:42.703 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-06-22T10:53:42.704 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-22T10:53:42.704 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-06-22T10:53:42.752 INFO:teuthology.orchestra.run.smithi040.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-06-22T10:53:42.752 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-22T10:53:42.754 DEBUG:teuthology.orchestra.run.smithi040:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-06-22T10:53:42.838 DEBUG:teuthology.orchestra.run.smithi040:> sudo modprobe fuse 2023-06-22T10:53:42.949 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-22T10:53:42.950 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-22T10:53:43.020 INFO:teuthology.orchestra.run.smithi040.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-22T10:53:43.022 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-22T10:53:43.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:53:43.024 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2023-06-22T10:53:43.070 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-06-22T10:53:43.071 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-06-22T10:53:43.115 DEBUG:teuthology.orchestra.run.smithi040:> sudo modprobe fuse 2023-06-22T10:53:43.190 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-22T10:53:43.190 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-22T10:53:43.261 INFO:teuthology.orchestra.run.smithi040.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-22T10:53:43.264 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-22T10:53:43.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:53:43.265 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2023-06-22T10:53:43.289 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi040.stderr:2023-06-22T10:53:43.286+0000 7f1223d915c0 -1 init, newargv = 0x555cc35f1330 newargc=15 2023-06-22T10:53:43.290 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi040.stderr:ceph-fuse[117810]: starting ceph client 2023-06-22T10:53:43.300 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi040.stderr:ceph-fuse[117810]: starting fuse 2023-06-22T10:53:43.324 INFO:teuthology.orchestra.run.smithi040.stdout:42 2023-06-22T10:53:43.325 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2023-06-22T10:53:43.325 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-22T10:53:43.326 DEBUG:teuthology.orchestra.run.smithi040:> import glob 2023-06-22T10:53:43.326 DEBUG:teuthology.orchestra.run.smithi040:> import re 2023-06-22T10:53:43.326 DEBUG:teuthology.orchestra.run.smithi040:> import os 2023-06-22T10:53:43.326 DEBUG:teuthology.orchestra.run.smithi040:> import subprocess 2023-06-22T10:53:43.327 DEBUG:teuthology.orchestra.run.smithi040:> 2023-06-22T10:53:43.327 DEBUG:teuthology.orchestra.run.smithi040:> def _find_admin_socket(client_name): 2023-06-22T10:53:43.327 DEBUG:teuthology.orchestra.run.smithi040:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-06-22T10:53:43.327 DEBUG:teuthology.orchestra.run.smithi040:> files = glob.glob(asok_path) 2023-06-22T10:53:43.328 DEBUG:teuthology.orchestra.run.smithi040:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-06-22T10:53:43.328 DEBUG:teuthology.orchestra.run.smithi040:> 2023-06-22T10:53:43.328 DEBUG:teuthology.orchestra.run.smithi040:> # Given a non-glob path, it better be there 2023-06-22T10:53:43.329 DEBUG:teuthology.orchestra.run.smithi040:> if "*" not in asok_path: 2023-06-22T10:53:43.329 DEBUG:teuthology.orchestra.run.smithi040:> assert(len(files) == 1) 2023-06-22T10:53:43.329 DEBUG:teuthology.orchestra.run.smithi040:> return files[0] 2023-06-22T10:53:43.329 DEBUG:teuthology.orchestra.run.smithi040:> 2023-06-22T10:53:43.330 DEBUG:teuthology.orchestra.run.smithi040:> for f in files: 2023-06-22T10:53:43.330 DEBUG:teuthology.orchestra.run.smithi040:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-22T10:53:43.330 DEBUG:teuthology.orchestra.run.smithi040:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-22T10:53:43.331 DEBUG:teuthology.orchestra.run.smithi040:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-22T10:53:43.331 DEBUG:teuthology.orchestra.run.smithi040:> contents = proc_f.read() 2023-06-22T10:53:43.331 DEBUG:teuthology.orchestra.run.smithi040:> if mountpoint in contents: 2023-06-22T10:53:43.331 DEBUG:teuthology.orchestra.run.smithi040:> return f 2023-06-22T10:53:43.332 DEBUG:teuthology.orchestra.run.smithi040:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-22T10:53:43.332 DEBUG:teuthology.orchestra.run.smithi040:> 2023-06-22T10:53:43.332 DEBUG:teuthology.orchestra.run.smithi040:> print(_find_admin_socket("client.admin")) 2023-06-22T10:53:43.332 DEBUG:teuthology.orchestra.run.smithi040:> ' 2023-06-22T10:53:43.512 INFO:teuthology.orchestra.run.smithi040.stdout:/var/run/ceph/ceph-client.admin.117810.asok 2023-06-22T10:53:43.689 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.117810.asok 2023-06-22T10:53:43.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:53:43.690 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.117810.asok status 2023-06-22T10:53:43.919 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-06-22T10:53:43.919 INFO:teuthology.orchestra.run.smithi040.stdout: "metadata": { 2023-06-22T10:53:43.920 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_sha1": "2016e3af238feea2bbee7eb0e99c925a041afbfb", 2023-06-22T10:53:43.920 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_version": "ceph version 18.0.0-4512-g2016e3af (2016e3af238feea2bbee7eb0e99c925a041afbfb) reef (dev)", 2023-06-22T10:53:43.920 INFO:teuthology.orchestra.run.smithi040.stdout: "entity_id": "admin", 2023-06-22T10:53:43.920 INFO:teuthology.orchestra.run.smithi040.stdout: "hostname": "smithi040", 2023-06-22T10:53:43.920 INFO:teuthology.orchestra.run.smithi040.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-06-22T10:53:43.920 INFO:teuthology.orchestra.run.smithi040.stdout: "pid": "117810", 2023-06-22T10:53:43.921 INFO:teuthology.orchestra.run.smithi040.stdout: "root": "/" 2023-06-22T10:53:43.921 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-06-22T10:53:43.921 INFO:teuthology.orchestra.run.smithi040.stdout: "dentry_count": 0, 2023-06-22T10:53:43.921 INFO:teuthology.orchestra.run.smithi040.stdout: "dentry_pinned_count": 0, 2023-06-22T10:53:43.921 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 4470, 2023-06-22T10:53:43.921 INFO:teuthology.orchestra.run.smithi040.stdout: "inst": { 2023-06-22T10:53:43.921 INFO:teuthology.orchestra.run.smithi040.stdout: "name": { 2023-06-22T10:53:43.921 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "client", 2023-06-22T10:53:43.922 INFO:teuthology.orchestra.run.smithi040.stdout: "num": 4470 2023-06-22T10:53:43.922 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-06-22T10:53:43.922 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": { 2023-06-22T10:53:43.922 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2023-06-22T10:53:43.922 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "192.168.0.1:0", 2023-06-22T10:53:43.922 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 3427730267 2023-06-22T10:53:43.922 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-06-22T10:53:43.922 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-06-22T10:53:43.923 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": { 2023-06-22T10:53:43.923 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2023-06-22T10:53:43.923 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "192.168.0.1:0", 2023-06-22T10:53:43.923 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 3427730267 2023-06-22T10:53:43.923 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-06-22T10:53:43.923 INFO:teuthology.orchestra.run.smithi040.stdout: "inst_str": "client.4470 192.168.0.1:0/3427730267", 2023-06-22T10:53:43.923 INFO:teuthology.orchestra.run.smithi040.stdout: "addr_str": "192.168.0.1:0/3427730267", 2023-06-22T10:53:43.924 INFO:teuthology.orchestra.run.smithi040.stdout: "inode_count": 1, 2023-06-22T10:53:43.924 INFO:teuthology.orchestra.run.smithi040.stdout: "mds_epoch": 7, 2023-06-22T10:53:43.924 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_epoch": 28, 2023-06-22T10:53:43.924 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_epoch_barrier": 0, 2023-06-22T10:53:43.924 INFO:teuthology.orchestra.run.smithi040.stdout: "blocklisted": false, 2023-06-22T10:53:43.924 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs" 2023-06-22T10:53:43.924 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-06-22T10:53:43.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:53:43.933 DEBUG:teuthology.orchestra.run.smithi040:> stat --file-system '--printf=%T 2023-06-22T10:53:43.934 DEBUG:teuthology.orchestra.run.smithi040:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-06-22T10:53:43.981 INFO:teuthology.orchestra.run.smithi040.stdout:fuseblk 2023-06-22T10:53:43.981 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-06-22T10:53:43.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:53:43.982 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-06-22T10:53:44.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:53:44.055 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-06-22T10:53:44.201 INFO:teuthology.orchestra.run.smithi040.stdout:# file: . 2023-06-22T10:53:44.201 INFO:teuthology.orchestra.run.smithi040.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-06-22T10:53:44.201 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:53:44.202 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-06-22T10:53:44.203 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-22T10:53:44.249 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-22T10:53:44.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.486+0000 7f720f1ff700 1 Processor -- start 2023-06-22T10:53:44.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.487+0000 7f720f1ff700 1 -- start start 2023-06-22T10:53:44.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.488+0000 7f720f1ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f72080b3120 0x7f720815cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:44.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.488+0000 7f720f1ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f72080add30 0x7f7208159f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:44.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.488+0000 7f720f1ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f720815d560 con 0x7f72080b3910 2023-06-22T10:53:44.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.488+0000 7f720f1ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7208153bc0 con 0x7f72080b3120 2023-06-22T10:53:44.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.488+0000 7f720f1ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f720815d840 con 0x7f72080add30 2023-06-22T10:53:44.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.489+0000 7f720cf9b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f72080b3120 0x7f720815cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:44.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.489+0000 7f7207fff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f72080add30 0x7f7208159f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:44.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.489+0000 7f720cf9b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f72080b3120 0x7f720815cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.40:46884/0 (socket says 172.21.15.40:46884) 2023-06-22T10:53:44.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.489+0000 7f7207fff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f72080add30 0x7f7208159f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3301/0 says I am v2:172.21.15.40:56218/0 (socket says 172.21.15.40:56218) 2023-06-22T10:53:44.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.489+0000 7f720cf9b700 1 -- 172.21.15.40:0/224980681 learned_addr learned my addr 172.21.15.40:0/224980681 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:44.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.489+0000 7f720cf9b700 1 -- 172.21.15.40:0/224980681 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f72080add30 msgr2=0x7f7208159f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:44.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.489+0000 7f720cf9b700 1 --2- 172.21.15.40:0/224980681 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f72080add30 0x7f7208159f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:44.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.489+0000 7f720cf9b700 1 -- 172.21.15.40:0/224980681 >> v1:172.21.15.45:6789/0 conn(0x7f72080b3910 legacy=0x7f72080b1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:44.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.489+0000 7f720cf9b700 1 -- 172.21.15.40:0/224980681 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f720815db20 con 0x7f72080b3120 2023-06-22T10:53:44.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.489+0000 7f720cf9b700 1 --2- 172.21.15.40:0/224980681 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72080b3120 0x7f720815cc60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f71fc0098f0 tx=0x7f71fc009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6090af3bf37fc4fe server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:44.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.490+0000 7f72077fe700 1 -- 172.21.15.40:0/224980681 <== mon.1 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71fc011830 con 0x7f72080b3120 2023-06-22T10:53:44.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.490+0000 7f72077fe700 1 -- 172.21.15.40:0/224980681 <== mon.1 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71fc011990 con 0x7f72080b3120 2023-06-22T10:53:44.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.490+0000 7f72077fe700 1 -- 172.21.15.40:0/224980681 <== mon.1 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71fc011d20 con 0x7f72080b3120 2023-06-22T10:53:44.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.490+0000 7f720f1ff700 1 -- 172.21.15.40:0/224980681 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72080b3120 msgr2=0x7f720815cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:44.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.490+0000 7f720f1ff700 1 --2- 172.21.15.40:0/224980681 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72080b3120 0x7f720815cc60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f71fc0098f0 tx=0x7f71fc009c00 comp rx=0 tx=0).stop 2023-06-22T10:53:44.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.490+0000 7f720f1ff700 1 -- 172.21.15.40:0/224980681 shutdown_connections 2023-06-22T10:53:44.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.490+0000 7f720f1ff700 1 --2- 172.21.15.40:0/224980681 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72080b3120 0x7f720815cc60 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:44.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.490+0000 7f720f1ff700 1 --2- 172.21.15.40:0/224980681 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f72080add30 0x7f7208159f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:44.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.490+0000 7f720f1ff700 1 -- 172.21.15.40:0/224980681 >> 172.21.15.40:0/224980681 conn(0x7f7208069f30 msgr2=0x7f720806a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:44.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.491+0000 7f720f1ff700 1 -- 172.21.15.40:0/224980681 shutdown_connections 2023-06-22T10:53:44.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.491+0000 7f720f1ff700 1 -- 172.21.15.40:0/224980681 wait complete. 2023-06-22T10:53:44.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.493+0000 7f720f1ff700 1 Processor -- start 2023-06-22T10:53:44.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.493+0000 7f720f1ff700 1 -- start start 2023-06-22T10:53:44.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.494+0000 7f720f1ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72080add30 0x7f720814ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:44.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.494+0000 7f720f1ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f72080b3120 0x7f7208152620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:44.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.494+0000 7f720f1ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72080b3910 0x7f7208150a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:44.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.494+0000 7f720f1ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7208154710 con 0x7f72080b3910 2023-06-22T10:53:44.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.494+0000 7f720f1ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f720814d4a0 con 0x7f72080add30 2023-06-22T10:53:44.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.494+0000 7f720f1ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7208151580 con 0x7f72080b3120 2023-06-22T10:53:44.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.494+0000 7f720d79c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72080b3910 0x7f7208150a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:44.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.494+0000 7f720d79c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72080b3910 0x7f7208150a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55566/0 (socket says 172.21.15.40:55566) 2023-06-22T10:53:44.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.494+0000 7f720cf9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72080add30 0x7f720814ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:44.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.494+0000 7f720d79c700 1 -- 172.21.15.40:0/3003491617 learned_addr learned my addr 172.21.15.40:0/3003491617 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:44.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.494+0000 7f7207fff700 1 --2- 172.21.15.40:0/3003491617 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f72080b3120 0x7f7208152620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:44.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.495+0000 7f720d79c700 1 -- 172.21.15.40:0/3003491617 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f72080b3120 msgr2=0x7f7208152620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:44.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.495+0000 7f720d79c700 1 --2- 172.21.15.40:0/3003491617 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f72080b3120 0x7f7208152620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:44.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.495+0000 7f720d79c700 1 -- 172.21.15.40:0/3003491617 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72080add30 msgr2=0x7f720814ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:44.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.495+0000 7f720d79c700 1 --2- 172.21.15.40:0/3003491617 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72080add30 0x7f720814ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:44.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.495+0000 7f720d79c700 1 -- 172.21.15.40:0/3003491617 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71fc009550 con 0x7f72080b3910 2023-06-22T10:53:44.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.495+0000 7f720cf9b700 1 --2- 172.21.15.40:0/3003491617 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72080add30 0x7f720814ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-22T10:53:44.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.495+0000 7f720d79c700 1 --2- 172.21.15.40:0/3003491617 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72080b3910 0x7f7208150a10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f720000cb50 tx=0x7f720000ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:44.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.495+0000 7f72057fa700 1 -- 172.21.15.40:0/3003491617 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7200003c00 con 0x7f72080b3910 2023-06-22T10:53:44.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.495+0000 7f72057fa700 1 -- 172.21.15.40:0/3003491617 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7200003d60 con 0x7f72080b3910 2023-06-22T10:53:44.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.495+0000 7f72057fa700 1 -- 172.21.15.40:0/3003491617 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720000aa20 con 0x7f72080b3910 2023-06-22T10:53:44.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.495+0000 7f720f1ff700 1 -- 172.21.15.40:0/3003491617 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7208151860 con 0x7f72080b3910 2023-06-22T10:53:44.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.495+0000 7f720f1ff700 1 -- 172.21.15.40:0/3003491617 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7208151e20 con 0x7f72080b3910 2023-06-22T10:53:44.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.496+0000 7f720f1ff700 1 -- 172.21.15.40:0/3003491617 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7208067580 con 0x7f72080b3910 2023-06-22T10:53:44.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.497+0000 7f72057fa700 1 -- 172.21.15.40:0/3003491617 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f720000ab80 con 0x7f72080b3910 2023-06-22T10:53:44.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.498+0000 7f72057fa700 1 --2- 172.21.15.40:0/3003491617 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f71ec06ace0 0x7f71ec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:44.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.499+0000 7f72057fa700 1 -- 172.21.15.40:0/3003491617 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7200089790 con 0x7f72080b3910 2023-06-22T10:53:44.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.499+0000 7f720cf9b700 1 --2- 172.21.15.40:0/3003491617 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f71ec06ace0 0x7f71ec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:44.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.499+0000 7f720cf9b700 1 --2- 172.21.15.40:0/3003491617 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f71ec06ace0 0x7f71ec06d190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f71fc009c40 tx=0x7f71fc008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:44.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.503+0000 7f72057fa700 1 -- 172.21.15.40:0/3003491617 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f72000544b0 con 0x7f72080b3910 2023-06-22T10:53:44.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.714+0000 7f720f1ff700 1 -- 172.21.15.40:0/3003491617 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f72081507f0 con 0x7f72080b3910 2023-06-22T10:53:44.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.716+0000 7f72057fa700 1 -- 172.21.15.40:0/3003491617 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20036 (secure 0 0 0) 0x7f7200057ad0 con 0x7f72080b3910 2023-06-22T10:53:44.720 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:53:44.721 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":28,"fsid":"475560bc-1a7c-4a75-b3b6-6fc6b20bdc52","created":"2023-06-22T10:53:03.784568+0000","modified":"2023-06-22T10:53:36.483308+0000","last_up_change":"2023-06-22T10:53:17.830348+0000","last_in_change":"2023-06-22T10:53:07.329974+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-22T10:53:17.182228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-22T10:53:23.874432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-22T10:53:29.812963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-22T10:53:30.404021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-22T10:53:33.982289+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"918db6b4-053a-46ba-976d-6e1a0104017f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6809","nonce":2400162888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6811","nonce":2400162888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6815","nonce":2400162888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6813","nonce":2400162888}]},"public_addr":"172.21.15.40:6809/2400162888","cluster_addr":"172.21.15.40:6811/2400162888","heartbeat_back_addr":"172.21.15.40:6815/2400162888","heartbeat_front_addr":"172.21.15.40:6813/2400162888","state":["exists","up"]},{"osd":1,"uuid":"0c146e2b-1725-4dae-9b5c-38795943b9d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6801","nonce":230885800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6803","nonce":230885800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6807","nonce":230885800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6805","nonce":230885800}]},"public_addr":"172.21.15.40:6801/230885800","cluster_addr":"172.21.15.40:6803/230885800","heartbeat_back_addr":"172.21.15.40:6807/230885800","heartbeat_front_addr":"172.21.15.40:6805/230885800","state":["exists","up"]},{"osd":2,"uuid":"0b3727fd-f281-46d5-a675-86c8c5ab269e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6817","nonce":2681404929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6819","nonce":2681404929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6823","nonce":2681404929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6821","nonce":2681404929}]},"public_addr":"172.21.15.40:6817/2681404929","cluster_addr":"172.21.15.40:6819/2681404929","heartbeat_back_addr":"172.21.15.40:6823/2681404929","heartbeat_front_addr":"172.21.15.40:6821/2681404929","state":["exists","up"]},{"osd":3,"uuid":"2969c698-7039-4bbb-beda-f756f7a368a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6825","nonce":111110981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6827","nonce":111110981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6831","nonce":111110981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6829","nonce":111110981}]},"public_addr":"172.21.15.40:6825/111110981","cluster_addr":"172.21.15.40:6827/111110981","heartbeat_back_addr":"172.21.15.40:6831/111110981","heartbeat_front_addr":"172.21.15.40:6829/111110981","state":["exists","up"]},{"osd":4,"uuid":"3bb1d9c8-8e42-4a6b-998d-04834f34be5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6801","nonce":3625455711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6803","nonce":3625455711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6807","nonce":3625455711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6805","nonce":3625455711}]},"public_addr":"172.21.15.45:6801/3625455711","cluster_addr":"172.21.15.45:6803/3625455711","heartbeat_back_addr":"172.21.15.45:6807/3625455711","heartbeat_front_addr":"172.21.15.45:6805/3625455711","state":["exists","up"]},{"osd":5,"uuid":"f9854ee4-302c-41be-977b-bedda090a3d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6817","nonce":3354411217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6819","nonce":3354411217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6823","nonce":3354411217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6821","nonce":3354411217}]},"public_addr":"172.21.15.45:6817/3354411217","cluster_addr":"172.21.15.45:6819/3354411217","heartbeat_back_addr":"172.21.15.45:6823/3354411217","heartbeat_front_addr":"172.21.15.45:6821/3354411217","state":["exists","up"]},{"osd":6,"uuid":"bbdb1989-f6ac-4954-9b85-b8b540d683c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6809","nonce":320111074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6811","nonce":320111074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6815","nonce":320111074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6813","nonce":320111074}]},"public_addr":"172.21.15.45:6809/320111074","cluster_addr":"172.21.15.45:6811/320111074","heartbeat_back_addr":"172.21.15.45:6815/320111074","heartbeat_front_addr":"172.21.15.45:6813/320111074","state":["exists","up"]},{"osd":7,"uuid":"823d44e3-58f1-4d1d-8263-a4e4a69d4327","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6825","nonce":643617680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6827","nonce":643617680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6831","nonce":643617680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6829","nonce":643617680}]},"public_addr":"172.21.15.45:6825/643617680","cluster_addr":"172.21.15.45:6827/643617680","heartbeat_back_addr":"172.21.15.45:6831/643617680","heartbeat_front_addr":"172.21.15.45:6829/643617680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.731262+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.873226+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.898936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.666578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.645990+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.953699+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.642823+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.693395+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-22T10:53:44.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.718+0000 7f720f1ff700 1 -- 172.21.15.40:0/3003491617 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f71ec06ace0 msgr2=0x7f71ec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:44.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.718+0000 7f720f1ff700 1 --2- 172.21.15.40:0/3003491617 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f71ec06ace0 0x7f71ec06d190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f71fc009c40 tx=0x7f71fc008030 comp rx=0 tx=0).stop 2023-06-22T10:53:44.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.718+0000 7f720f1ff700 1 -- 172.21.15.40:0/3003491617 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72080b3910 msgr2=0x7f7208150a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:44.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.718+0000 7f720f1ff700 1 --2- 172.21.15.40:0/3003491617 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72080b3910 0x7f7208150a10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f720000cb50 tx=0x7f720000ce60 comp rx=0 tx=0).stop 2023-06-22T10:53:44.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.718+0000 7f720f1ff700 1 -- 172.21.15.40:0/3003491617 shutdown_connections 2023-06-22T10:53:44.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.718+0000 7f720f1ff700 1 --2- 172.21.15.40:0/3003491617 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f71ec06ace0 0x7f71ec06d190 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:44.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.718+0000 7f720f1ff700 1 --2- 172.21.15.40:0/3003491617 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72080b3910 0x7f7208150a10 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:44.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.718+0000 7f720f1ff700 1 --2- 172.21.15.40:0/3003491617 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72080add30 0x7f720814ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:44.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.718+0000 7f720f1ff700 1 --2- 172.21.15.40:0/3003491617 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f72080b3120 0x7f7208152620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:44.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.718+0000 7f720f1ff700 1 -- 172.21.15.40:0/3003491617 >> 172.21.15.40:0/3003491617 conn(0x7f7208069f30 msgr2=0x7f72080b0900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:44.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.719+0000 7f720f1ff700 1 -- 172.21.15.40:0/3003491617 shutdown_connections 2023-06-22T10:53:44.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.719+0000 7f720f1ff700 1 -- 172.21.15.40:0/3003491617 wait complete. 2023-06-22T10:53:44.740 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-22T10:53:17.182228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-22T10:53:23.874432+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-22T10:53:29.812963+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-22T10:53:30.404021+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-22T10:53:33.982289+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-22T10:53:44.741 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-22T10:53:44.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.940+0000 7f4ffd9ff700 1 Processor -- start 2023-06-22T10:53:44.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.940+0000 7f4ffd9ff700 1 -- start start 2023-06-22T10:53:44.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.941+0000 7f4ffd9ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4ff80b45d0 0x7f4ff80b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:44.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.941+0000 7f4ffd9ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4ff80b59a0 0x7f4ff80b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:44.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.941+0000 7f4ffd9ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ff80d1be0 con 0x7f4ff80d2130 2023-06-22T10:53:44.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.941+0000 7f4ffd9ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ff80d17f0 con 0x7f4ff80b59a0 2023-06-22T10:53:44.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.941+0000 7f4ffd9ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ff80d1360 con 0x7f4ff80b45d0 2023-06-22T10:53:44.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.942+0000 7f4ff67fc700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f4ff80d2130 0x7f4ff80cd1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45362/0 (socket says 172.21.15.40:45362) 2023-06-22T10:53:44.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.942+0000 7f4ff67fc700 1 -- 172.21.15.40:0/2085070329 learned_addr learned my addr 172.21.15.40:0/2085070329 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:53:44.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.942+0000 7f4ff77fe700 1 --2- 172.21.15.40:0/2085070329 >> v2:172.21.15.40:3300/0 conn(0x7f4ff80b59a0 0x7f4ff80b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:44.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.942+0000 7f4ff6ffd700 1 --2- 172.21.15.40:0/2085070329 >> v2:172.21.15.45:3300/0 conn(0x7f4ff80b45d0 0x7f4ff80b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:44.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.942+0000 7f4ff5ffb700 1 -- 172.21.15.40:0/2085070329 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1348249045 0 0) 0x7f4ff80d1be0 con 0x7f4ff80d2130 2023-06-22T10:53:44.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.942+0000 7f4ff5ffb700 1 -- 172.21.15.40:0/2085070329 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fe00035b0 con 0x7f4ff80d2130 2023-06-22T10:53:44.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.942+0000 7f4ff77fe700 1 -- 172.21.15.40:0/2085070329 >> v2:172.21.15.45:3300/0 conn(0x7f4ff80b45d0 msgr2=0x7f4ff80b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:44.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.942+0000 7f4ff77fe700 1 --2- 172.21.15.40:0/2085070329 >> v2:172.21.15.45:3300/0 conn(0x7f4ff80b45d0 0x7f4ff80b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:44.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.942+0000 7f4ff77fe700 1 -- 172.21.15.40:0/2085070329 >> v1:172.21.15.40:6789/0 conn(0x7f4ff80d2130 legacy=0x7f4ff80cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:44.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.942+0000 7f4ff77fe700 1 -- 172.21.15.40:0/2085070329 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff80b4ee0 con 0x7f4ff80b59a0 2023-06-22T10:53:44.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.942+0000 7f4ff77fe700 1 --2- 172.21.15.40:0/2085070329 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ff80b59a0 0x7f4ff80b5e40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4ff80668f0 tx=0x7f4ff000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70d444283c3de78a server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:44.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.943+0000 7f4ff5ffb700 1 -- 172.21.15.40:0/2085070329 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff000e070 con 0x7f4ff80b59a0 2023-06-22T10:53:44.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.943+0000 7f4ff5ffb700 1 -- 172.21.15.40:0/2085070329 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff000bb20 con 0x7f4ff80b59a0 2023-06-22T10:53:44.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.943+0000 7f4ff5ffb700 1 -- 172.21.15.40:0/2085070329 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff0012430 con 0x7f4ff80b59a0 2023-06-22T10:53:44.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.943+0000 7f4ffd9ff700 1 -- 172.21.15.40:0/2085070329 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ff80b59a0 msgr2=0x7f4ff80b5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:44.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.943+0000 7f4ffd9ff700 1 --2- 172.21.15.40:0/2085070329 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ff80b59a0 0x7f4ff80b5e40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4ff80668f0 tx=0x7f4ff000b330 comp rx=0 tx=0).stop 2023-06-22T10:53:44.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.943+0000 7f4ffd9ff700 1 -- 172.21.15.40:0/2085070329 shutdown_connections 2023-06-22T10:53:44.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.943+0000 7f4ffd9ff700 1 --2- 172.21.15.40:0/2085070329 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ff80b59a0 0x7f4ff80b5e40 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:44.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.943+0000 7f4ffd9ff700 1 --2- 172.21.15.40:0/2085070329 >> v2:172.21.15.45:3300/0 conn(0x7f4ff80b45d0 0x7f4ff80b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:44.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.943+0000 7f4ffd9ff700 1 -- 172.21.15.40:0/2085070329 >> 172.21.15.40:0/2085070329 conn(0x7f4ff80cf5d0 msgr2=0x7f4ff80cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:44.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.943+0000 7f4ffd9ff700 1 -- 172.21.15.40:0/2085070329 shutdown_connections 2023-06-22T10:53:44.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.943+0000 7f4ffd9ff700 1 -- 172.21.15.40:0/2085070329 wait complete. 2023-06-22T10:53:44.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.945+0000 7f4ffd9ff700 1 Processor -- start 2023-06-22T10:53:44.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.945+0000 7f4ffd9ff700 1 -- start start 2023-06-22T10:53:44.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.946+0000 7f4ffd9ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ff80b45d0 0x7f4ff815b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:44.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.946+0000 7f4ffd9ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ff80b59a0 0x7f4ff80aa490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:44.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.946+0000 7f4ffd9ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f4ff80d2130 0x7f4ff81f52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:44.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.946+0000 7f4ffd9ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff81f5d30 con 0x7f4ff80b45d0 2023-06-22T10:53:44.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.946+0000 7f4ffd9ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff81f6010 con 0x7f4ff80b59a0 2023-06-22T10:53:44.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.946+0000 7f4ffd9ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ff80a9c90 con 0x7f4ff80d2130 2023-06-22T10:53:44.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.946+0000 7f4ff6ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ff80b45d0 0x7f4ff815b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:44.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.946+0000 7f4ff6ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ff80b45d0 0x7f4ff815b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55584/0 (socket says 172.21.15.40:55584) 2023-06-22T10:53:44.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.946+0000 7f4ff6ffd700 1 -- 172.21.15.40:0/2597847482 learned_addr learned my addr 172.21.15.40:0/2597847482 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:44.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.947+0000 7f4ff67fc700 1 --2- 172.21.15.40:0/2597847482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ff80b59a0 0x7f4ff80aa490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:44.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.947+0000 7f4ff77fe700 1 --2- 172.21.15.40:0/2597847482 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f4ff80d2130 0x7f4ff81f52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:44.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.947+0000 7f4ff6ffd700 1 -- 172.21.15.40:0/2597847482 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f4ff80d2130 msgr2=0x7f4ff81f52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:44.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.947+0000 7f4ff6ffd700 1 --2- 172.21.15.40:0/2597847482 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f4ff80d2130 0x7f4ff81f52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:44.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.947+0000 7f4ff6ffd700 1 -- 172.21.15.40:0/2597847482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ff80b59a0 msgr2=0x7f4ff80aa490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:44.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.947+0000 7f4ff6ffd700 1 --2- 172.21.15.40:0/2597847482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ff80b59a0 0x7f4ff80aa490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:44.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.947+0000 7f4ff6ffd700 1 -- 172.21.15.40:0/2597847482 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff0009a70 con 0x7f4ff80b45d0 2023-06-22T10:53:44.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.947+0000 7f4ff77fe700 1 --2- 172.21.15.40:0/2597847482 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f4ff80d2130 0x7f4ff81f52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-22T10:53:44.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.947+0000 7f4ff67fc700 1 --2- 172.21.15.40:0/2597847482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ff80b59a0 0x7f4ff80aa490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-22T10:53:44.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.947+0000 7f4ff6ffd700 1 --2- 172.21.15.40:0/2597847482 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ff80b45d0 0x7f4ff815b200 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4fe800d800 tx=0x7f4fe800dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:44.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.947+0000 7f4fdffff700 1 -- 172.21.15.40:0/2597847482 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe80125f0 con 0x7f4ff80b45d0 2023-06-22T10:53:44.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.947+0000 7f4fdffff700 1 -- 172.21.15.40:0/2597847482 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fe8012750 con 0x7f4ff80b45d0 2023-06-22T10:53:44.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.947+0000 7f4fdffff700 1 -- 172.21.15.40:0/2597847482 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe8012b00 con 0x7f4ff80b45d0 2023-06-22T10:53:44.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.947+0000 7f4ffd9ff700 1 -- 172.21.15.40:0/2597847482 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ff80a9f70 con 0x7f4ff80b45d0 2023-06-22T10:53:44.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.948+0000 7f4ffd9ff700 1 -- 172.21.15.40:0/2597847482 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ff815b740 con 0x7f4ff80b45d0 2023-06-22T10:53:44.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.949+0000 7f4ffd9ff700 1 -- 172.21.15.40:0/2597847482 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ff80aa2e0 con 0x7f4ff80b45d0 2023-06-22T10:53:44.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.950+0000 7f4fdffff700 1 -- 172.21.15.40:0/2597847482 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4fe8012c60 con 0x7f4ff80b45d0 2023-06-22T10:53:44.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.950+0000 7f4fdffff700 1 --2- 172.21.15.40:0/2597847482 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f4fe406ace0 0x7f4fe406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:44.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.951+0000 7f4fdffff700 1 -- 172.21.15.40:0/2597847482 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4fe8089bc0 con 0x7f4ff80b45d0 2023-06-22T10:53:44.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.951+0000 7f4ff67fc700 1 --2- 172.21.15.40:0/2597847482 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f4fe406ace0 0x7f4fe406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:44.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.951+0000 7f4ff67fc700 1 --2- 172.21.15.40:0/2597847482 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f4fe406ace0 0x7f4fe406d190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4fec0011e0 tx=0x7f4fec009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:44.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:44.955+0000 7f4fdffff700 1 -- 172.21.15.40:0/2597847482 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4fe80548e0 con 0x7f4ff80b45d0 2023-06-22T10:53:45.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.158+0000 7f4ffd9ff700 1 -- 172.21.15.40:0/2597847482 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4ff8067580 con 0x7f4ff80b45d0 2023-06-22T10:53:45.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.158+0000 7f4fdffff700 1 -- 172.21.15.40:0/2597847482 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4fe8057f00 con 0x7f4ff80b45d0 2023-06-22T10:53:45.162 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-06-22T10:53:45.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.161+0000 7f4ffd9ff700 1 -- 172.21.15.40:0/2597847482 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f4fe406ace0 msgr2=0x7f4fe406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:45.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.161+0000 7f4ffd9ff700 1 --2- 172.21.15.40:0/2597847482 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f4fe406ace0 0x7f4fe406d190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4fec0011e0 tx=0x7f4fec009040 comp rx=0 tx=0).stop 2023-06-22T10:53:45.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.161+0000 7f4ffd9ff700 1 -- 172.21.15.40:0/2597847482 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ff80b45d0 msgr2=0x7f4ff815b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:45.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.161+0000 7f4ffd9ff700 1 --2- 172.21.15.40:0/2597847482 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ff80b45d0 0x7f4ff815b200 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4fe800d800 tx=0x7f4fe800dbc0 comp rx=0 tx=0).stop 2023-06-22T10:53:45.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.161+0000 7f4ffd9ff700 1 -- 172.21.15.40:0/2597847482 shutdown_connections 2023-06-22T10:53:45.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.161+0000 7f4ffd9ff700 1 --2- 172.21.15.40:0/2597847482 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f4fe406ace0 0x7f4fe406d190 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:45.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.161+0000 7f4ffd9ff700 1 --2- 172.21.15.40:0/2597847482 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f4ff80d2130 0x7f4ff81f52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:45.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.161+0000 7f4ffd9ff700 1 --2- 172.21.15.40:0/2597847482 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4ff80b45d0 0x7f4ff815b200 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:45.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.161+0000 7f4ffd9ff700 1 --2- 172.21.15.40:0/2597847482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ff80b59a0 0x7f4ff80aa490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:45.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.161+0000 7f4ffd9ff700 1 -- 172.21.15.40:0/2597847482 >> 172.21.15.40:0/2597847482 conn(0x7f4ff80cf5d0 msgr2=0x7f4ff80cbc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:45.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.161+0000 7f4ffd9ff700 1 -- 172.21.15.40:0/2597847482 shutdown_connections 2023-06-22T10:53:45.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.161+0000 7f4ffd9ff700 1 -- 172.21.15.40:0/2597847482 wait complete. 2023-06-22T10:53:45.182 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-22T10:53:45.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.383+0000 7f973b9ff700 1 Processor -- start 2023-06-22T10:53:45.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.383+0000 7f973b9ff700 1 -- start start 2023-06-22T10:53:45.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.385+0000 7f973b9ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f97340d2130 0x7f97340cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:45.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.385+0000 7f973b9ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f97340cd6e0 0x7f97340b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:45.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.385+0000 7f973b9ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97340d1be0 con 0x7f97340b45d0 2023-06-22T10:53:45.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.385+0000 7f973b9ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97340d17f0 con 0x7f97340d2130 2023-06-22T10:53:45.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.385+0000 7f973b9ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97340d1360 con 0x7f97340cd6e0 2023-06-22T10:53:45.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.385+0000 7f973979b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f97340b45d0 0x7f97340b49a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45372/0 (socket says 172.21.15.40:45372) 2023-06-22T10:53:45.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.385+0000 7f973979b700 1 -- 172.21.15.40:0/1994095785 learned_addr learned my addr 172.21.15.40:0/1994095785 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:53:45.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.385+0000 7f9739f9c700 1 --2- 172.21.15.40:0/1994095785 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f97340cd6e0 0x7f97340b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:45.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.385+0000 7f9738f9a700 1 --2- 172.21.15.40:0/1994095785 >> v2:172.21.15.45:3300/0 conn(0x7f97340d2130 0x7f97340cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:45.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.385+0000 7f972bfff700 1 -- 172.21.15.40:0/1994095785 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3108477876 0 0) 0x7f97340d1be0 con 0x7f97340b45d0 2023-06-22T10:53:45.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.385+0000 7f972bfff700 1 -- 172.21.15.40:0/1994095785 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97200035b0 con 0x7f97340b45d0 2023-06-22T10:53:45.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.386+0000 7f9739f9c700 1 -- 172.21.15.40:0/1994095785 >> v2:172.21.15.45:3300/0 conn(0x7f97340d2130 msgr2=0x7f97340cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:45.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.386+0000 7f9739f9c700 1 --2- 172.21.15.40:0/1994095785 >> v2:172.21.15.45:3300/0 conn(0x7f97340d2130 0x7f97340cd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:45.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.386+0000 7f9739f9c700 1 -- 172.21.15.40:0/1994095785 >> v1:172.21.15.40:6789/0 conn(0x7f97340b45d0 legacy=0x7f97340b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:45.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.386+0000 7f9739f9c700 1 -- 172.21.15.40:0/1994095785 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97340cef40 con 0x7f97340cd6e0 2023-06-22T10:53:45.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.386+0000 7f9738f9a700 1 --2- 172.21.15.40:0/1994095785 >> v2:172.21.15.45:3300/0 conn(0x7f97340d2130 0x7f97340cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-22T10:53:45.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.386+0000 7f9739f9c700 1 --2- 172.21.15.40:0/1994095785 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f97340cd6e0 0x7f97340b59a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f972c009d90 tx=0x7f972c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a48f2422d0ecdcf server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:45.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.386+0000 7f972bfff700 1 -- 172.21.15.40:0/1994095785 <== mon.2 v2:172.21.15.45:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972c00e070 con 0x7f97340cd6e0 2023-06-22T10:53:45.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.386+0000 7f972bfff700 1 -- 172.21.15.40:0/1994095785 <== mon.2 v2:172.21.15.45:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f972c00bb20 con 0x7f97340cd6e0 2023-06-22T10:53:45.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.386+0000 7f972bfff700 1 -- 172.21.15.40:0/1994095785 <== mon.2 v2:172.21.15.45:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972c00be90 con 0x7f97340cd6e0 2023-06-22T10:53:45.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.387+0000 7f973b9ff700 1 -- 172.21.15.40:0/1994095785 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f97340cd6e0 msgr2=0x7f97340b59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:45.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.387+0000 7f973b9ff700 1 --2- 172.21.15.40:0/1994095785 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f97340cd6e0 0x7f97340b59a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f972c009d90 tx=0x7f972c00b330 comp rx=0 tx=0).stop 2023-06-22T10:53:45.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.387+0000 7f973b9ff700 1 -- 172.21.15.40:0/1994095785 shutdown_connections 2023-06-22T10:53:45.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.387+0000 7f973b9ff700 1 --2- 172.21.15.40:0/1994095785 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f97340cd6e0 0x7f97340b59a0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:45.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.387+0000 7f973b9ff700 1 --2- 172.21.15.40:0/1994095785 >> v2:172.21.15.45:3300/0 conn(0x7f97340d2130 0x7f97340cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:45.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.387+0000 7f973b9ff700 1 -- 172.21.15.40:0/1994095785 >> 172.21.15.40:0/1994095785 conn(0x7f97340cf5d0 msgr2=0x7f97340cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:45.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.387+0000 7f973b9ff700 1 -- 172.21.15.40:0/1994095785 shutdown_connections 2023-06-22T10:53:45.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.387+0000 7f973b9ff700 1 -- 172.21.15.40:0/1994095785 wait complete. 2023-06-22T10:53:45.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.389+0000 7f973b9ff700 1 Processor -- start 2023-06-22T10:53:45.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.390+0000 7f973b9ff700 1 -- start start 2023-06-22T10:53:45.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.391+0000 7f973b9ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97340b45d0 0x7f97341f1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:45.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.391+0000 7f973b9ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97340cd6e0 0x7f973415c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:45.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.391+0000 7f973b9ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f97340d2130 0x7f97340b5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:45.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.391+0000 7f973b9ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973415cba0 con 0x7f97340cd6e0 2023-06-22T10:53:45.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.391+0000 7f973b9ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973415ce40 con 0x7f97340b45d0 2023-06-22T10:53:45.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.391+0000 7f973b9ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f973415d120 con 0x7f97340d2130 2023-06-22T10:53:45.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.391+0000 7f9738f9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97340cd6e0 0x7f973415c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:45.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.391+0000 7f9738f9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97340cd6e0 0x7f973415c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55586/0 (socket says 172.21.15.40:55586) 2023-06-22T10:53:45.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.391+0000 7f9738f9a700 1 -- 172.21.15.40:0/3823230193 learned_addr learned my addr 172.21.15.40:0/3823230193 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:45.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.392+0000 7f9739f9c700 1 --2- 172.21.15.40:0/3823230193 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f97340d2130 0x7f97340b5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:45.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.392+0000 7f973979b700 1 --2- 172.21.15.40:0/3823230193 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97340b45d0 0x7f97341f1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:45.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.392+0000 7f9738f9a700 1 -- 172.21.15.40:0/3823230193 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f97340d2130 msgr2=0x7f97340b5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:45.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.392+0000 7f9738f9a700 1 --2- 172.21.15.40:0/3823230193 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f97340d2130 0x7f97340b5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:45.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.392+0000 7f9738f9a700 1 -- 172.21.15.40:0/3823230193 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97340b45d0 msgr2=0x7f97341f1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:45.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.392+0000 7f9738f9a700 1 --2- 172.21.15.40:0/3823230193 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97340b45d0 0x7f97341f1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:45.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.392+0000 7f9738f9a700 1 -- 172.21.15.40:0/3823230193 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97240094a0 con 0x7f97340cd6e0 2023-06-22T10:53:45.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.392+0000 7f9738f9a700 1 --2- 172.21.15.40:0/3823230193 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97340cd6e0 0x7f973415c660 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f972400ebe0 tx=0x7f9724009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:45.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.392+0000 7f9729ffb700 1 -- 172.21.15.40:0/3823230193 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972400c910 con 0x7f97340cd6e0 2023-06-22T10:53:45.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.392+0000 7f9729ffb700 1 -- 172.21.15.40:0/3823230193 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f972400ca70 con 0x7f97340cd6e0 2023-06-22T10:53:45.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.392+0000 7f973b9ff700 1 -- 172.21.15.40:0/3823230193 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f972c009a70 con 0x7f97340cd6e0 2023-06-22T10:53:45.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.392+0000 7f9729ffb700 1 -- 172.21.15.40:0/3823230193 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972400cde0 con 0x7f97340cd6e0 2023-06-22T10:53:45.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.392+0000 7f973b9ff700 1 -- 172.21.15.40:0/3823230193 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f973415d6e0 con 0x7f97340cd6e0 2023-06-22T10:53:45.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.393+0000 7f973b9ff700 1 -- 172.21.15.40:0/3823230193 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f973415dd30 con 0x7f97340cd6e0 2023-06-22T10:53:45.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.394+0000 7f9729ffb700 1 -- 172.21.15.40:0/3823230193 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9724013470 con 0x7f97340cd6e0 2023-06-22T10:53:45.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.395+0000 7f9729ffb700 1 --2- 172.21.15.40:0/3823230193 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f971806ace0 0x7f971806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:45.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.395+0000 7f9729ffb700 1 -- 172.21.15.40:0/3823230193 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f97240899d0 con 0x7f97340cd6e0 2023-06-22T10:53:45.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.396+0000 7f973979b700 1 --2- 172.21.15.40:0/3823230193 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f971806ace0 0x7f971806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:45.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.396+0000 7f973979b700 1 --2- 172.21.15.40:0/3823230193 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f971806ace0 0x7f971806d190 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9730005910 tx=0x7f9730009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:45.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.400+0000 7f9729ffb700 1 -- 172.21.15.40:0/3823230193 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9724054780 con 0x7f97340cd6e0 2023-06-22T10:53:45.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.602+0000 7f973b9ff700 1 -- 172.21.15.40:0/3823230193 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9734067580 con 0x7f97340cd6e0 2023-06-22T10:53:45.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.602+0000 7f9729ffb700 1 -- 172.21.15.40:0/3823230193 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9724057da0 con 0x7f97340cd6e0 2023-06-22T10:53:45.606 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 8 2023-06-22T10:53:45.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.604+0000 7f973b9ff700 1 -- 172.21.15.40:0/3823230193 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f971806ace0 msgr2=0x7f971806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:45.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.604+0000 7f973b9ff700 1 --2- 172.21.15.40:0/3823230193 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f971806ace0 0x7f971806d190 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9730005910 tx=0x7f9730009040 comp rx=0 tx=0).stop 2023-06-22T10:53:45.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.604+0000 7f973b9ff700 1 -- 172.21.15.40:0/3823230193 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97340cd6e0 msgr2=0x7f973415c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:45.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.604+0000 7f973b9ff700 1 --2- 172.21.15.40:0/3823230193 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97340cd6e0 0x7f973415c660 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f972400ebe0 tx=0x7f9724009ec0 comp rx=0 tx=0).stop 2023-06-22T10:53:45.608 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.605+0000 7f973b9ff700 1 -- 172.21.15.40:0/3823230193 shutdown_connections 2023-06-22T10:53:45.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.605+0000 7f973b9ff700 1 --2- 172.21.15.40:0/3823230193 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f971806ace0 0x7f971806d190 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:45.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.605+0000 7f973b9ff700 1 --2- 172.21.15.40:0/3823230193 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f97340d2130 0x7f97340b5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:45.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.605+0000 7f973b9ff700 1 --2- 172.21.15.40:0/3823230193 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97340b45d0 0x7f97341f1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:45.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.605+0000 7f973b9ff700 1 --2- 172.21.15.40:0/3823230193 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97340cd6e0 0x7f973415c660 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:45.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.605+0000 7f973b9ff700 1 -- 172.21.15.40:0/3823230193 >> 172.21.15.40:0/3823230193 conn(0x7f97340cf5d0 msgr2=0x7f9734159990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:45.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.605+0000 7f973b9ff700 1 -- 172.21.15.40:0/3823230193 shutdown_connections 2023-06-22T10:53:45.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.605+0000 7f973b9ff700 1 -- 172.21.15.40:0/3823230193 wait complete. 2023-06-22T10:53:45.626 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-22T10:53:45.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.832+0000 7f2f03dff700 1 Processor -- start 2023-06-22T10:53:45.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.832+0000 7f2f03dff700 1 -- start start 2023-06-22T10:53:45.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.833+0000 7f2f03dff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2efc0c8df0 0x7f2efc0703b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:45.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.833+0000 7f2f03dff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2efc0cf460 con 0x7f2efc153730 2023-06-22T10:53:45.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.833+0000 7f2f03dff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2efc0ccfa0 con 0x7f2efc0708f0 2023-06-22T10:53:45.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.833+0000 7f2f03dff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2efc0c5000 con 0x7f2efc0c8df0 2023-06-22T10:53:45.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.833+0000 7f2f01b9b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f2efc153730 0x7f2efc0c3bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45388/0 (socket says 172.21.15.40:45388) 2023-06-22T10:53:45.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.833+0000 7f2f01b9b700 1 -- 172.21.15.40:0/845510516 learned_addr learned my addr 172.21.15.40:0/845510516 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:53:45.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.834+0000 7f2f0139a700 1 --2- 172.21.15.40:0/845510516 >> v2:172.21.15.45:3300/0 conn(0x7f2efc0c8df0 0x7f2efc0703b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:45.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.834+0000 7f2f00b99700 1 -- 172.21.15.40:0/845510516 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3330802685 0 0) 0x7f2efc0cf460 con 0x7f2efc153730 2023-06-22T10:53:45.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.834+0000 7f2f00b99700 1 -- 172.21.15.40:0/845510516 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ee80035b0 con 0x7f2efc153730 2023-06-22T10:53:45.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.834+0000 7f2f00b99700 1 -- 172.21.15.40:0/845510516 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 948554951 0 0) 0x7f2ee80035b0 con 0x7f2efc153730 2023-06-22T10:53:45.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.834+0000 7f2f00b99700 1 -- 172.21.15.40:0/845510516 >> v2:172.21.15.45:3300/0 conn(0x7f2efc0c8df0 msgr2=0x7f2efc0703b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:45.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.834+0000 7f2f00b99700 1 --2- 172.21.15.40:0/845510516 >> v2:172.21.15.45:3300/0 conn(0x7f2efc0c8df0 0x7f2efc0703b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:45.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.834+0000 7f2f00b99700 1 -- 172.21.15.40:0/845510516 >> v1:172.21.15.45:6789/0 conn(0x7f2efc0708f0 legacy=0x7f2efc0cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:45.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.834+0000 7f2f00b99700 1 -- 172.21.15.40:0/845510516 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2efc0c4760 con 0x7f2efc153730 2023-06-22T10:53:45.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.834+0000 7f2f00b99700 1 -- 172.21.15.40:0/845510516 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1490606486 0 0) 0x7f2ef8001670 con 0x7f2efc153730 2023-06-22T10:53:45.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.834+0000 7f2f0139a700 1 --2- 172.21.15.40:0/845510516 >> v2:172.21.15.45:3300/0 conn(0x7f2efc0c8df0 0x7f2efc0703b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-22T10:53:45.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.834+0000 7f2f00b99700 1 -- 172.21.15.40:0/845510516 >> v1:172.21.15.40:6789/0 conn(0x7f2efc153730 legacy=0x7f2efc0c3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:45.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.834+0000 7f2f00b99700 1 --2- 172.21.15.40:0/845510516 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ee8003a00 0x7f2ee8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:45.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.834+0000 7f2f00b99700 1 --2- 172.21.15.40:0/845510516 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f2ee8004850 0x7f2ee8004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:45.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.834+0000 7f2f00b99700 1 --2- 172.21.15.40:0/845510516 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ee8005200 0x7f2ee800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:45.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.835+0000 7f2f00b99700 1 -- 172.21.15.40:0/845510516 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc0c5000 con 0x7f2ee8005200 2023-06-22T10:53:45.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.835+0000 7f2f00b99700 1 -- 172.21.15.40:0/845510516 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee800c080 con 0x7f2ee8003a00 2023-06-22T10:53:45.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.835+0000 7f2f00b99700 1 -- 172.21.15.40:0/845510516 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee800c240 con 0x7f2ee8004850 2023-06-22T10:53:45.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.835+0000 7f2f0239c700 1 --2- 172.21.15.40:0/845510516 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ee8005200 0x7f2ee800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:45.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.835+0000 7f2f01b9b700 1 --2- 172.21.15.40:0/845510516 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ee8003a00 0x7f2ee8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:45.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.835+0000 7f2f0139a700 1 --2- 172.21.15.40:0/845510516 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f2ee8004850 0x7f2ee8004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:45.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.835+0000 7f2f0239c700 1 -- 172.21.15.40:0/845510516 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f2ee8004850 msgr2=0x7f2ee8004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:45.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.835+0000 7f2f0239c700 1 --2- 172.21.15.40:0/845510516 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f2ee8004850 0x7f2ee8004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:45.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.835+0000 7f2f0239c700 1 -- 172.21.15.40:0/845510516 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ee8003a00 msgr2=0x7f2ee8003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:45.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.835+0000 7f2f0239c700 1 --2- 172.21.15.40:0/845510516 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ee8003a00 0x7f2ee8003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:45.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.835+0000 7f2f0239c700 1 -- 172.21.15.40:0/845510516 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee80035b0 con 0x7f2ee8005200 2023-06-22T10:53:45.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.835+0000 7f2f0239c700 1 -- 172.21.15.40:0/845510516 reap_dead start 2023-06-22T10:53:45.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.835+0000 7f2f0239c700 1 --2- 172.21.15.40:0/845510516 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ee8005200 0x7f2ee800ba10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2ef4001ed0 tx=0x7f2ee8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5919a0fd5ecba3c5 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:45.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.836+0000 7f2f00b99700 1 -- 172.21.15.40:0/845510516 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef400cca0 con 0x7f2ee8005200 2023-06-22T10:53:45.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.836+0000 7f2f00b99700 1 -- 172.21.15.40:0/845510516 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef400ce20 con 0x7f2ee8005200 2023-06-22T10:53:45.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.836+0000 7f2f00b99700 1 -- 172.21.15.40:0/845510516 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef4003c40 con 0x7f2ee8005200 2023-06-22T10:53:45.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.836+0000 7f2f03dff700 1 -- 172.21.15.40:0/845510516 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ee8005200 msgr2=0x7f2ee800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:45.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.836+0000 7f2f03dff700 1 --2- 172.21.15.40:0/845510516 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ee8005200 0x7f2ee800ba10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2ef4001ed0 tx=0x7f2ee8005880 comp rx=0 tx=0).stop 2023-06-22T10:53:45.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.836+0000 7f2f03dff700 1 -- 172.21.15.40:0/845510516 shutdown_connections 2023-06-22T10:53:45.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.836+0000 7f2f03dff700 1 --2- 172.21.15.40:0/845510516 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ee8005200 0x7f2ee800ba10 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:45.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.836+0000 7f2f03dff700 1 -- 172.21.15.40:0/845510516 >> 172.21.15.40:0/845510516 conn(0x7f2efc0b1030 msgr2=0x7f2efc0ce7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:45.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.836+0000 7f2f03dff700 1 -- 172.21.15.40:0/845510516 shutdown_connections 2023-06-22T10:53:45.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.836+0000 7f2f03dff700 1 -- 172.21.15.40:0/845510516 wait complete. 2023-06-22T10:53:45.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.838+0000 7f2f03dff700 1 Processor -- start 2023-06-22T10:53:45.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.838+0000 7f2f03dff700 1 -- start start 2023-06-22T10:53:45.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.839+0000 7f2f03dff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ee8005200 0x7f2efc0b3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:45.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.839+0000 7f2f03dff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f2efc0b2330 0x7f2efc157fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:45.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.839+0000 7f2f03dff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2efc1584e0 0x7f2efc1f1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:45.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.839+0000 7f2f03dff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc0b27a0 con 0x7f2efc1584e0 2023-06-22T10:53:45.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.839+0000 7f2f03dff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc158950 con 0x7f2ee8005200 2023-06-22T10:53:45.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.839+0000 7f2f03dff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc1f2c40 con 0x7f2efc0b2330 2023-06-22T10:53:45.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.839+0000 7f2f0239c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2efc1584e0 0x7f2efc1f1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:45.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.840+0000 7f2f0239c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2efc1584e0 0x7f2efc1f1be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55604/0 (socket says 172.21.15.40:55604) 2023-06-22T10:53:45.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.840+0000 7f2f0239c700 1 -- 172.21.15.40:0/131041383 learned_addr learned my addr 172.21.15.40:0/131041383 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:45.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.840+0000 7f2f01b9b700 1 --2- 172.21.15.40:0/131041383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ee8005200 0x7f2efc0b3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:45.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.840+0000 7f2f0139a700 1 --2- 172.21.15.40:0/131041383 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f2efc0b2330 0x7f2efc157fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:45.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.840+0000 7f2f0239c700 1 -- 172.21.15.40:0/131041383 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f2efc0b2330 msgr2=0x7f2efc157fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:45.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.840+0000 7f2f0239c700 1 --2- 172.21.15.40:0/131041383 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f2efc0b2330 0x7f2efc157fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:45.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.840+0000 7f2f0239c700 1 -- 172.21.15.40:0/131041383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ee8005200 msgr2=0x7f2efc0b3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:45.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.840+0000 7f2f0239c700 1 --2- 172.21.15.40:0/131041383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ee8005200 0x7f2efc0b3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:45.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.840+0000 7f2f0239c700 1 -- 172.21.15.40:0/131041383 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2efc1f2960 con 0x7f2efc1584e0 2023-06-22T10:53:45.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.840+0000 7f2f01b9b700 1 --2- 172.21.15.40:0/131041383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ee8005200 0x7f2efc0b3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-22T10:53:45.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.840+0000 7f2f0239c700 1 --2- 172.21.15.40:0/131041383 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2efc1584e0 0x7f2efc1f1be0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2efc071630 tx=0x7f2ef40014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:45.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.841+0000 7f2ef27fc700 1 -- 172.21.15.40:0/131041383 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef4003e10 con 0x7f2efc1584e0 2023-06-22T10:53:45.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.841+0000 7f2ef27fc700 1 -- 172.21.15.40:0/131041383 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef4005740 con 0x7f2efc1584e0 2023-06-22T10:53:45.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.841+0000 7f2f03dff700 1 -- 172.21.15.40:0/131041383 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2efc0b1850 con 0x7f2efc1584e0 2023-06-22T10:53:45.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.841+0000 7f2ef27fc700 1 -- 172.21.15.40:0/131041383 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef40116b0 con 0x7f2efc1584e0 2023-06-22T10:53:45.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.841+0000 7f2f03dff700 1 -- 172.21.15.40:0/131041383 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2efc0b1e10 con 0x7f2efc1584e0 2023-06-22T10:53:45.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.842+0000 7f2f03dff700 1 -- 172.21.15.40:0/131041383 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2efc0b16b0 con 0x7f2efc1584e0 2023-06-22T10:53:45.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.843+0000 7f2ef27fc700 1 -- 172.21.15.40:0/131041383 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2ef4011810 con 0x7f2efc1584e0 2023-06-22T10:53:45.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.844+0000 7f2ef27fc700 1 --2- 172.21.15.40:0/131041383 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f2ee006ace0 0x7f2ee006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:45.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.844+0000 7f2ef27fc700 1 -- 172.21.15.40:0/131041383 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2ef408a820 con 0x7f2efc1584e0 2023-06-22T10:53:45.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.844+0000 7f2f01b9b700 1 --2- 172.21.15.40:0/131041383 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f2ee006ace0 0x7f2ee006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:45.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.844+0000 7f2f01b9b700 1 --2- 172.21.15.40:0/131041383 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f2ee006ace0 0x7f2ee006d190 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2ef8001c90 tx=0x7f2ef8001b20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:45.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:45.848+0000 7f2ef27fc700 1 -- 172.21.15.40:0/131041383 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2efc0b16b0 con 0x7f2efc1584e0 2023-06-22T10:53:46.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.051+0000 7f2f03dff700 1 -- 172.21.15.40:0/131041383 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2efc0b16b0 con 0x7f2efc1584e0 2023-06-22T10:53:46.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.052+0000 7f2ef27fc700 1 -- 172.21.15.40:0/131041383 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2efc0b16b0 con 0x7f2efc1584e0 2023-06-22T10:53:46.055 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-06-22T10:53:46.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.054+0000 7f2f03dff700 1 -- 172.21.15.40:0/131041383 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f2ee006ace0 msgr2=0x7f2ee006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:46.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.054+0000 7f2f03dff700 1 --2- 172.21.15.40:0/131041383 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f2ee006ace0 0x7f2ee006d190 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2ef8001c90 tx=0x7f2ef8001b20 comp rx=0 tx=0).stop 2023-06-22T10:53:46.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.054+0000 7f2f03dff700 1 -- 172.21.15.40:0/131041383 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2efc1584e0 msgr2=0x7f2efc1f1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:46.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.054+0000 7f2f03dff700 1 --2- 172.21.15.40:0/131041383 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2efc1584e0 0x7f2efc1f1be0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2efc071630 tx=0x7f2ef40014a0 comp rx=0 tx=0).stop 2023-06-22T10:53:46.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.054+0000 7f2f03dff700 1 -- 172.21.15.40:0/131041383 shutdown_connections 2023-06-22T10:53:46.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.054+0000 7f2f03dff700 1 --2- 172.21.15.40:0/131041383 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f2ee006ace0 0x7f2ee006d190 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:46.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.054+0000 7f2f03dff700 1 --2- 172.21.15.40:0/131041383 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2efc1584e0 0x7f2efc1f1be0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:46.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.054+0000 7f2f03dff700 1 --2- 172.21.15.40:0/131041383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ee8005200 0x7f2efc0b3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:46.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.054+0000 7f2f03dff700 1 --2- 172.21.15.40:0/131041383 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f2efc0b2330 0x7f2efc157fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:46.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.054+0000 7f2f03dff700 1 -- 172.21.15.40:0/131041383 >> 172.21.15.40:0/131041383 conn(0x7f2efc0b1030 msgr2=0x7f2efc0ae370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:46.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.054+0000 7f2f03dff700 1 -- 172.21.15.40:0/131041383 shutdown_connections 2023-06-22T10:53:46.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.054+0000 7f2f03dff700 1 -- 172.21.15.40:0/131041383 wait complete. 2023-06-22T10:53:46.076 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-22T10:53:46.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.279+0000 7f379efff700 1 Processor -- start 2023-06-22T10:53:46.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.279+0000 7f379efff700 1 -- start start 2023-06-22T10:53:46.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.280+0000 7f379efff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f3798153730 0x7f37980c3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:46.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.280+0000 7f379efff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3798070ac0 0x7f37980c4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:46.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.280+0000 7f379efff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37980cf460 con 0x7f37980c8df0 2023-06-22T10:53:46.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.280+0000 7f379efff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37980c5000 con 0x7f3798070ac0 2023-06-22T10:53:46.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.280+0000 7f379efff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37980ccfa0 con 0x7f3798153730 2023-06-22T10:53:46.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.281+0000 7f379d59c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3798070ac0 0x7f37980c4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:46.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.281+0000 7f379d59c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3798070ac0 0x7f37980c4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55610/0 (socket says 172.21.15.40:55610) 2023-06-22T10:53:46.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.281+0000 7f379d59c700 1 -- 172.21.15.40:0/42614293 learned_addr learned my addr 172.21.15.40:0/42614293 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:46.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.281+0000 7f379cd9b700 1 --2- 172.21.15.40:0/42614293 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f3798153730 0x7f37980c3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:46.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.281+0000 7f379d59c700 1 -- 172.21.15.40:0/42614293 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f3798153730 msgr2=0x7f37980c3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:46.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.281+0000 7f379d59c700 1 --2- 172.21.15.40:0/42614293 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f3798153730 0x7f37980c3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:46.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.281+0000 7f379d59c700 1 -- 172.21.15.40:0/42614293 >> v1:172.21.15.45:6789/0 conn(0x7f37980c8df0 legacy=0x7f37980703b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:46.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.281+0000 7f379d59c700 1 -- 172.21.15.40:0/42614293 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37980c4760 con 0x7f3798070ac0 2023-06-22T10:53:46.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.281+0000 7f379cd9b700 1 --2- 172.21.15.40:0/42614293 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f3798153730 0x7f37980c3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:53:46.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.281+0000 7f379d59c700 1 --2- 172.21.15.40:0/42614293 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3798070ac0 0x7f37980c4130 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3790009e50 tx=0x7f379000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50023b2e44ef3f9c server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:46.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.282+0000 7f37977fe700 1 -- 172.21.15.40:0/42614293 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379000e070 con 0x7f3798070ac0 2023-06-22T10:53:46.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.282+0000 7f37977fe700 1 -- 172.21.15.40:0/42614293 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f379000b9c0 con 0x7f3798070ac0 2023-06-22T10:53:46.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.282+0000 7f37977fe700 1 -- 172.21.15.40:0/42614293 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379000bd70 con 0x7f3798070ac0 2023-06-22T10:53:46.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.282+0000 7f379efff700 1 -- 172.21.15.40:0/42614293 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3798070ac0 msgr2=0x7f37980c4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:46.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.282+0000 7f379efff700 1 --2- 172.21.15.40:0/42614293 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3798070ac0 0x7f37980c4130 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3790009e50 tx=0x7f379000b330 comp rx=0 tx=0).stop 2023-06-22T10:53:46.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.282+0000 7f379efff700 1 -- 172.21.15.40:0/42614293 shutdown_connections 2023-06-22T10:53:46.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.282+0000 7f379efff700 1 --2- 172.21.15.40:0/42614293 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3798070ac0 0x7f37980c4130 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:46.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.282+0000 7f379efff700 1 --2- 172.21.15.40:0/42614293 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f3798153730 0x7f37980c3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:46.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.282+0000 7f379efff700 1 -- 172.21.15.40:0/42614293 >> 172.21.15.40:0/42614293 conn(0x7f37980b1030 msgr2=0x7f37980ce7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:46.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.282+0000 7f379efff700 1 -- 172.21.15.40:0/42614293 shutdown_connections 2023-06-22T10:53:46.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.282+0000 7f379efff700 1 -- 172.21.15.40:0/42614293 wait complete. 2023-06-22T10:53:46.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.284+0000 7f379efff700 1 Processor -- start 2023-06-22T10:53:46.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.284+0000 7f379efff700 1 -- start start 2023-06-22T10:53:46.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.285+0000 7f379efff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3798070ac0 0x7f37981469c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:46.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.285+0000 7f379efff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f37980c8df0 0x7f37980c5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:46.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.285+0000 7f379efff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3798153730 0x7f37980c7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:46.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.285+0000 7f379efff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37980ad380 con 0x7f3798153730 2023-06-22T10:53:46.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.285+0000 7f379efff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3798145c00 con 0x7f3798070ac0 2023-06-22T10:53:46.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.285+0000 7f379efff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3798145ee0 con 0x7f37980c8df0 2023-06-22T10:53:46.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.285+0000 7f379d59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3798153730 0x7f37980c7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:46.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.286+0000 7f379d59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3798153730 0x7f37980c7e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55622/0 (socket says 172.21.15.40:55622) 2023-06-22T10:53:46.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.286+0000 7f379d59c700 1 -- 172.21.15.40:0/1668957647 learned_addr learned my addr 172.21.15.40:0/1668957647 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:46.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.286+0000 7f3797fff700 1 --2- 172.21.15.40:0/1668957647 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f37980c8df0 0x7f37980c5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:46.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.286+0000 7f379cd9b700 1 --2- 172.21.15.40:0/1668957647 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3798070ac0 0x7f37981469c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:46.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.286+0000 7f379d59c700 1 -- 172.21.15.40:0/1668957647 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f37980c8df0 msgr2=0x7f37980c5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:46.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.286+0000 7f379d59c700 1 --2- 172.21.15.40:0/1668957647 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f37980c8df0 0x7f37980c5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:46.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.286+0000 7f379d59c700 1 -- 172.21.15.40:0/1668957647 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3798070ac0 msgr2=0x7f37981469c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:46.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.286+0000 7f379d59c700 1 --2- 172.21.15.40:0/1668957647 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3798070ac0 0x7f37981469c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:46.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.286+0000 7f379d59c700 1 -- 172.21.15.40:0/1668957647 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3790009b30 con 0x7f3798153730 2023-06-22T10:53:46.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.286+0000 7f379d59c700 1 --2- 172.21.15.40:0/1668957647 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3798153730 0x7f37980c7e40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3790012000 tx=0x7f3790004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:46.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.286+0000 7f37957fa700 1 -- 172.21.15.40:0/1668957647 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3790003ea0 con 0x7f3798153730 2023-06-22T10:53:46.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.286+0000 7f37957fa700 1 -- 172.21.15.40:0/1668957647 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37900099b0 con 0x7f3798153730 2023-06-22T10:53:46.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.286+0000 7f37957fa700 1 -- 172.21.15.40:0/1668957647 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379001b670 con 0x7f3798153730 2023-06-22T10:53:46.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.286+0000 7f379efff700 1 -- 172.21.15.40:0/1668957647 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37981461c0 con 0x7f3798153730 2023-06-22T10:53:46.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.287+0000 7f379efff700 1 -- 172.21.15.40:0/1668957647 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37980c62c0 con 0x7f3798153730 2023-06-22T10:53:46.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.288+0000 7f379efff700 1 -- 172.21.15.40:0/1668957647 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37980c6450 con 0x7f3798153730 2023-06-22T10:53:46.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.289+0000 7f37957fa700 1 -- 172.21.15.40:0/1668957647 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f379001b7d0 con 0x7f3798153730 2023-06-22T10:53:46.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.290+0000 7f37957fa700 1 --2- 172.21.15.40:0/1668957647 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f377c06ace0 0x7f377c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:46.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.290+0000 7f37957fa700 1 -- 172.21.15.40:0/1668957647 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f379008b1d0 con 0x7f3798153730 2023-06-22T10:53:46.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.290+0000 7f379cd9b700 1 --2- 172.21.15.40:0/1668957647 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f377c06ace0 0x7f377c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:46.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.291+0000 7f379cd9b700 1 --2- 172.21.15.40:0/1668957647 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f377c06ace0 0x7f377c06d190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f378c009930 tx=0x7f378c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:46.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.293+0000 7f37957fa700 1 -- 172.21.15.40:0/1668957647 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3790056120 con 0x7f3798153730 2023-06-22T10:53:46.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.498+0000 7f379efff700 1 -- 172.21.15.40:0/1668957647 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3798066a60 con 0x7f3798153730 2023-06-22T10:53:46.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.499+0000 7f37957fa700 1 -- 172.21.15.40:0/1668957647 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3790059740 con 0x7f3798153730 2023-06-22T10:53:46.503 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-06-22T10:53:46.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.501+0000 7f379efff700 1 -- 172.21.15.40:0/1668957647 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f377c06ace0 msgr2=0x7f377c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:46.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.501+0000 7f379efff700 1 --2- 172.21.15.40:0/1668957647 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f377c06ace0 0x7f377c06d190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f378c009930 tx=0x7f378c008040 comp rx=0 tx=0).stop 2023-06-22T10:53:46.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.501+0000 7f379efff700 1 -- 172.21.15.40:0/1668957647 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3798153730 msgr2=0x7f37980c7e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:46.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.501+0000 7f379efff700 1 --2- 172.21.15.40:0/1668957647 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3798153730 0x7f37980c7e40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3790012000 tx=0x7f3790004ad0 comp rx=0 tx=0).stop 2023-06-22T10:53:46.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.501+0000 7f379efff700 1 -- 172.21.15.40:0/1668957647 shutdown_connections 2023-06-22T10:53:46.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.501+0000 7f379efff700 1 --2- 172.21.15.40:0/1668957647 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f377c06ace0 0x7f377c06d190 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:46.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.501+0000 7f379efff700 1 --2- 172.21.15.40:0/1668957647 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3798153730 0x7f37980c7e40 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:46.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.501+0000 7f379efff700 1 --2- 172.21.15.40:0/1668957647 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3798070ac0 0x7f37981469c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:46.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.501+0000 7f379efff700 1 --2- 172.21.15.40:0/1668957647 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f37980c8df0 0x7f37980c5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:46.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.501+0000 7f379efff700 1 -- 172.21.15.40:0/1668957647 >> 172.21.15.40:0/1668957647 conn(0x7f37980b1030 msgr2=0x7f37980cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:46.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.501+0000 7f379efff700 1 -- 172.21.15.40:0/1668957647 shutdown_connections 2023-06-22T10:53:46.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.501+0000 7f379efff700 1 -- 172.21.15.40:0/1668957647 wait complete. 2023-06-22T10:53:46.522 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-22T10:53:46.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.725+0000 7fc734fff700 1 Processor -- start 2023-06-22T10:53:46.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.725+0000 7fc734fff700 1 -- start start 2023-06-22T10:53:46.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.726+0000 7fc734fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc7300b59a0 0x7fc7300b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:46.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.726+0000 7fc734fff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7300d1be0 con 0x7fc7300d2130 2023-06-22T10:53:46.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.726+0000 7fc734fff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7300d1360 con 0x7fc7300b45d0 2023-06-22T10:53:46.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.726+0000 7fc734fff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7300d17f0 con 0x7fc7300b59a0 2023-06-22T10:53:46.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.727+0000 7fc727fff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc7300d2130 0x7fc7300cd1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45404/0 (socket says 172.21.15.40:45404) 2023-06-22T10:53:46.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.727+0000 7fc727fff700 1 -- 172.21.15.40:0/3264357669 learned_addr learned my addr 172.21.15.40:0/3264357669 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:53:46.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.727+0000 7fc72ed9d700 1 --2- 172.21.15.40:0/3264357669 >> v2:172.21.15.45:3300/0 conn(0x7fc7300b59a0 0x7fc7300b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:46.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.727+0000 7fc72dd9b700 1 -- 172.21.15.40:0/3264357669 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1747678351 0 0) 0x7fc7300d1be0 con 0x7fc7300d2130 2023-06-22T10:53:46.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.727+0000 7fc72dd9b700 1 -- 172.21.15.40:0/3264357669 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc71c0035b0 con 0x7fc7300d2130 2023-06-22T10:53:46.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.727+0000 7fc72ed9d700 1 -- 172.21.15.40:0/3264357669 >> v1:172.21.15.45:6789/0 conn(0x7fc7300b45d0 legacy=0x7fc7300b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:46.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.727+0000 7fc72ed9d700 1 -- 172.21.15.40:0/3264357669 >> v1:172.21.15.40:6789/0 conn(0x7fc7300d2130 legacy=0x7fc7300cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:46.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.727+0000 7fc72ed9d700 1 -- 172.21.15.40:0/3264357669 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7300cef40 con 0x7fc7300b59a0 2023-06-22T10:53:46.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.728+0000 7fc72ed9d700 1 --2- 172.21.15.40:0/3264357669 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7300b59a0 0x7fc7300b5e40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc728009d90 tx=0x7fc72800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c3913e81db18260 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:46.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.728+0000 7fc72dd9b700 1 -- 172.21.15.40:0/3264357669 <== mon.1 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72800e070 con 0x7fc7300b59a0 2023-06-22T10:53:46.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.728+0000 7fc72dd9b700 1 -- 172.21.15.40:0/3264357669 <== mon.1 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc72800bb20 con 0x7fc7300b59a0 2023-06-22T10:53:46.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.728+0000 7fc72dd9b700 1 -- 172.21.15.40:0/3264357669 <== mon.1 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc728012430 con 0x7fc7300b59a0 2023-06-22T10:53:46.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.728+0000 7fc734fff700 1 -- 172.21.15.40:0/3264357669 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7300b59a0 msgr2=0x7fc7300b5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:46.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.728+0000 7fc734fff700 1 --2- 172.21.15.40:0/3264357669 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7300b59a0 0x7fc7300b5e40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc728009d90 tx=0x7fc72800b330 comp rx=0 tx=0).stop 2023-06-22T10:53:46.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.728+0000 7fc734fff700 1 -- 172.21.15.40:0/3264357669 shutdown_connections 2023-06-22T10:53:46.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.728+0000 7fc734fff700 1 --2- 172.21.15.40:0/3264357669 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7300b59a0 0x7fc7300b5e40 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:46.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.729+0000 7fc734fff700 1 -- 172.21.15.40:0/3264357669 >> 172.21.15.40:0/3264357669 conn(0x7fc7300cf5d0 msgr2=0x7fc7300cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:46.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.729+0000 7fc734fff700 1 -- 172.21.15.40:0/3264357669 shutdown_connections 2023-06-22T10:53:46.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.729+0000 7fc734fff700 1 -- 172.21.15.40:0/3264357669 wait complete. 2023-06-22T10:53:46.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.730+0000 7fc734fff700 1 Processor -- start 2023-06-22T10:53:46.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.730+0000 7fc734fff700 1 -- start start 2023-06-22T10:53:46.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.731+0000 7fc734fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7300b45d0 0x7fc73006b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:46.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.731+0000 7fc734fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7300b59a0 0x7fc730158990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:46.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.731+0000 7fc734fff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fc7300d2130 0x7fc730158ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:46.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.731+0000 7fc734fff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc73015d6c0 con 0x7fc7300b59a0 2023-06-22T10:53:46.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.731+0000 7fc734fff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc73015cab0 con 0x7fc7300b45d0 2023-06-22T10:53:46.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.731+0000 7fc734fff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc73015cd90 con 0x7fc7300d2130 2023-06-22T10:53:46.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.732+0000 7fc727fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7300b59a0 0x7fc730158990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:46.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.732+0000 7fc727fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7300b59a0 0x7fc730158990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55634/0 (socket says 172.21.15.40:55634) 2023-06-22T10:53:46.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.732+0000 7fc727fff700 1 -- 172.21.15.40:0/2528251322 learned_addr learned my addr 172.21.15.40:0/2528251322 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:46.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.732+0000 7fc72e59c700 1 --2- 172.21.15.40:0/2528251322 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7300b45d0 0x7fc73006b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:46.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.732+0000 7fc72ed9d700 1 --2- 172.21.15.40:0/2528251322 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fc7300d2130 0x7fc730158ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:46.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.732+0000 7fc727fff700 1 -- 172.21.15.40:0/2528251322 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fc7300d2130 msgr2=0x7fc730158ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:46.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.732+0000 7fc727fff700 1 --2- 172.21.15.40:0/2528251322 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fc7300d2130 0x7fc730158ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:46.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.732+0000 7fc727fff700 1 -- 172.21.15.40:0/2528251322 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7300b45d0 msgr2=0x7fc73006b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:46.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.732+0000 7fc727fff700 1 --2- 172.21.15.40:0/2528251322 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7300b45d0 0x7fc73006b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:46.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.732+0000 7fc727fff700 1 -- 172.21.15.40:0/2528251322 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc728009a70 con 0x7fc7300b59a0 2023-06-22T10:53:46.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.732+0000 7fc72e59c700 1 --2- 172.21.15.40:0/2528251322 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7300b45d0 0x7fc73006b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-22T10:53:46.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.733+0000 7fc727fff700 1 --2- 172.21.15.40:0/2528251322 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7300b59a0 0x7fc730158990 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc71800c700 tx=0x7fc71800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:46.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.733+0000 7fc726ffd700 1 -- 172.21.15.40:0/2528251322 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc718005d70 con 0x7fc7300b59a0 2023-06-22T10:53:46.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.733+0000 7fc726ffd700 1 -- 172.21.15.40:0/2528251322 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7180070d0 con 0x7fc7300b59a0 2023-06-22T10:53:46.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.733+0000 7fc726ffd700 1 -- 172.21.15.40:0/2528251322 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc718007460 con 0x7fc7300b59a0 2023-06-22T10:53:46.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.733+0000 7fc734fff700 1 -- 172.21.15.40:0/2528251322 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc73015d070 con 0x7fc7300b59a0 2023-06-22T10:53:46.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.733+0000 7fc734fff700 1 -- 172.21.15.40:0/2528251322 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc73006bb10 con 0x7fc7300b59a0 2023-06-22T10:53:46.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.734+0000 7fc734fff700 1 -- 172.21.15.40:0/2528251322 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc73006bd00 con 0x7fc7300b59a0 2023-06-22T10:53:46.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.735+0000 7fc726ffd700 1 -- 172.21.15.40:0/2528251322 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc7180075c0 con 0x7fc7300b59a0 2023-06-22T10:53:46.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.736+0000 7fc726ffd700 1 --2- 172.21.15.40:0/2528251322 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fc71006ace0 0x7fc71006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:46.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.736+0000 7fc726ffd700 1 -- 172.21.15.40:0/2528251322 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc718088c00 con 0x7fc7300b59a0 2023-06-22T10:53:46.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.736+0000 7fc72e59c700 1 --2- 172.21.15.40:0/2528251322 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fc71006ace0 0x7fc71006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:46.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.737+0000 7fc72e59c700 1 --2- 172.21.15.40:0/2528251322 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fc71006ace0 0x7fc71006d190 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc720007fd0 tx=0x7fc720009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:46.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.740+0000 7fc726ffd700 1 -- 172.21.15.40:0/2528251322 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc7180539b0 con 0x7fc7300b59a0 2023-06-22T10:53:46.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.947+0000 7fc734fff700 1 -- 172.21.15.40:0/2528251322 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc730067580 con 0x7fc7300b59a0 2023-06-22T10:53:46.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.948+0000 7fc726ffd700 1 -- 172.21.15.40:0/2528251322 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc7180170a0 con 0x7fc7300b59a0 2023-06-22T10:53:46.951 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-06-22T10:53:46.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.950+0000 7fc734fff700 1 -- 172.21.15.40:0/2528251322 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fc71006ace0 msgr2=0x7fc71006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:46.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.950+0000 7fc734fff700 1 --2- 172.21.15.40:0/2528251322 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fc71006ace0 0x7fc71006d190 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc720007fd0 tx=0x7fc720009040 comp rx=0 tx=0).stop 2023-06-22T10:53:46.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.950+0000 7fc734fff700 1 -- 172.21.15.40:0/2528251322 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7300b59a0 msgr2=0x7fc730158990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:46.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.950+0000 7fc734fff700 1 --2- 172.21.15.40:0/2528251322 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7300b59a0 0x7fc730158990 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc71800c700 tx=0x7fc71800ca10 comp rx=0 tx=0).stop 2023-06-22T10:53:46.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.950+0000 7fc734fff700 1 -- 172.21.15.40:0/2528251322 shutdown_connections 2023-06-22T10:53:46.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.950+0000 7fc734fff700 1 --2- 172.21.15.40:0/2528251322 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fc71006ace0 0x7fc71006d190 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:46.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.950+0000 7fc734fff700 1 --2- 172.21.15.40:0/2528251322 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fc7300d2130 0x7fc730158ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:46.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.950+0000 7fc734fff700 1 --2- 172.21.15.40:0/2528251322 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7300b45d0 0x7fc73006b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:46.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.950+0000 7fc734fff700 1 --2- 172.21.15.40:0/2528251322 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7300b59a0 0x7fc730158990 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:46.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.950+0000 7fc734fff700 1 -- 172.21.15.40:0/2528251322 >> 172.21.15.40:0/2528251322 conn(0x7fc7300cf5d0 msgr2=0x7fc7300b2c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:46.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.950+0000 7fc734fff700 1 -- 172.21.15.40:0/2528251322 shutdown_connections 2023-06-22T10:53:46.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:46.951+0000 7fc734fff700 1 -- 172.21.15.40:0/2528251322 wait complete. 2023-06-22T10:53:46.972 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-22T10:53:47.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.172+0000 7f797f9ff700 1 Processor -- start 2023-06-22T10:53:47.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.172+0000 7f797f9ff700 1 -- start start 2023-06-22T10:53:47.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.173+0000 7f797f9ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f79780d2830 0x7f79780b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:47.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.173+0000 7f797f9ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f79780b4c60 0x7f79780d0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:47.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.173+0000 7f797f9ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79780b2130 con 0x7f797815c720 2023-06-22T10:53:47.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.173+0000 7f797f9ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7978160d60 con 0x7f79780b4c60 2023-06-22T10:53:47.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.173+0000 7f797f9ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79780b50e0 con 0x7f79780d2830 2023-06-22T10:53:47.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.173+0000 7f797df9c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f79780b4c60 0x7f79780d0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:47.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.173+0000 7f797df9c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f79780b4c60 0x7f79780d0d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55636/0 (socket says 172.21.15.40:55636) 2023-06-22T10:53:47.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.173+0000 7f797d79b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f797815c720 0x7f79780b1870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:45408/0 (socket says 172.21.15.40:45408) 2023-06-22T10:53:47.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.173+0000 7f797df9c700 1 -- 172.21.15.40:0/904080100 learned_addr learned my addr 172.21.15.40:0/904080100 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:47.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.174+0000 7f797cf9a700 1 --2- 172.21.15.40:0/904080100 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f79780d2830 0x7f79780b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:47.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.174+0000 7f797df9c700 1 -- 172.21.15.40:0/904080100 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f79780d2830 msgr2=0x7f79780b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:47.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.174+0000 7f797df9c700 1 --2- 172.21.15.40:0/904080100 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f79780d2830 0x7f79780b4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:47.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.174+0000 7f797df9c700 1 -- 172.21.15.40:0/904080100 >> v1:172.21.15.40:6789/0 conn(0x7f797815c720 legacy=0x7f79780b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:47.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.174+0000 7f797df9c700 1 -- 172.21.15.40:0/904080100 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7978161180 con 0x7f79780b4c60 2023-06-22T10:53:47.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.174+0000 7f796ffff700 1 -- 172.21.15.40:0/904080100 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 449480719 0 0) 0x7f79780b2130 con 0x7f797815c720 2023-06-22T10:53:47.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.174+0000 7f797df9c700 1 --2- 172.21.15.40:0/904080100 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79780b4c60 0x7f79780d0d00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7970009e50 tx=0x7f797000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cc37727767b5fba server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:47.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.174+0000 7f796ffff700 1 -- 172.21.15.40:0/904080100 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797000e070 con 0x7f79780b4c60 2023-06-22T10:53:47.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.174+0000 7f796ffff700 1 -- 172.21.15.40:0/904080100 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f797000b9c0 con 0x7f79780b4c60 2023-06-22T10:53:47.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.174+0000 7f796ffff700 1 -- 172.21.15.40:0/904080100 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797000bd70 con 0x7f79780b4c60 2023-06-22T10:53:47.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.175+0000 7f797f9ff700 1 -- 172.21.15.40:0/904080100 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79780b4c60 msgr2=0x7f79780d0d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:47.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.175+0000 7f797f9ff700 1 --2- 172.21.15.40:0/904080100 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79780b4c60 0x7f79780d0d00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7970009e50 tx=0x7f797000b330 comp rx=0 tx=0).stop 2023-06-22T10:53:47.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.175+0000 7f797f9ff700 1 -- 172.21.15.40:0/904080100 shutdown_connections 2023-06-22T10:53:47.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.175+0000 7f797f9ff700 1 --2- 172.21.15.40:0/904080100 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79780b4c60 0x7f79780d0d00 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:47.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.175+0000 7f797f9ff700 1 --2- 172.21.15.40:0/904080100 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f79780d2830 0x7f79780b4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:47.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.175+0000 7f797f9ff700 1 -- 172.21.15.40:0/904080100 >> 172.21.15.40:0/904080100 conn(0x7f79780cf720 msgr2=0x7f79780cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:47.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.175+0000 7f797f9ff700 1 -- 172.21.15.40:0/904080100 shutdown_connections 2023-06-22T10:53:47.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.175+0000 7f797f9ff700 1 -- 172.21.15.40:0/904080100 wait complete. 2023-06-22T10:53:47.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.177+0000 7f797f9ff700 1 Processor -- start 2023-06-22T10:53:47.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.177+0000 7f797f9ff700 1 -- start start 2023-06-22T10:53:47.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.178+0000 7f797f9ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79780b4c60 0x7f7978157180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:47.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.178+0000 7f797f9ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f79780d2830 0x7f79781f20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:47.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.178+0000 7f797f9ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f797815c720 0x7f79780b32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:47.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.178+0000 7f797f9ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79780b7b30 con 0x7f797815c720 2023-06-22T10:53:47.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.178+0000 7f797f9ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79780b6f20 con 0x7f79780b4c60 2023-06-22T10:53:47.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.178+0000 7f797f9ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79780b7200 con 0x7f79780d2830 2023-06-22T10:53:47.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.178+0000 7f797df9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f797815c720 0x7f79780b32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:47.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.178+0000 7f797df9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f797815c720 0x7f79780b32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55646/0 (socket says 172.21.15.40:55646) 2023-06-22T10:53:47.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.178+0000 7f797df9c700 1 -- 172.21.15.40:0/1539715565 learned_addr learned my addr 172.21.15.40:0/1539715565 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:47.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.178+0000 7f797d79b700 1 --2- 172.21.15.40:0/1539715565 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79780b4c60 0x7f7978157180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:47.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.178+0000 7f797cf9a700 1 --2- 172.21.15.40:0/1539715565 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f79780d2830 0x7f79781f20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:47.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.178+0000 7f797df9c700 1 -- 172.21.15.40:0/1539715565 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f79780d2830 msgr2=0x7f79781f20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:47.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.178+0000 7f797df9c700 1 --2- 172.21.15.40:0/1539715565 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f79780d2830 0x7f79781f20f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:47.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.178+0000 7f797df9c700 1 -- 172.21.15.40:0/1539715565 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79780b4c60 msgr2=0x7f7978157180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:47.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.178+0000 7f797df9c700 1 --2- 172.21.15.40:0/1539715565 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79780b4c60 0x7f7978157180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:47.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.178+0000 7f797df9c700 1 -- 172.21.15.40:0/1539715565 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7970009b30 con 0x7f797815c720 2023-06-22T10:53:47.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.179+0000 7f797df9c700 1 --2- 172.21.15.40:0/1539715565 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f797815c720 0x7f79780b32a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f797806b090 tx=0x7f7970004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:47.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.179+0000 7f796dffb700 1 -- 172.21.15.40:0/1539715565 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7970003ea0 con 0x7f797815c720 2023-06-22T10:53:47.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.179+0000 7f796dffb700 1 -- 172.21.15.40:0/1539715565 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79700099b0 con 0x7f797815c720 2023-06-22T10:53:47.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.179+0000 7f796dffb700 1 -- 172.21.15.40:0/1539715565 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797001c680 con 0x7f797815c720 2023-06-22T10:53:47.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.179+0000 7f797f9ff700 1 -- 172.21.15.40:0/1539715565 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79780b74e0 con 0x7f797815c720 2023-06-22T10:53:47.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.179+0000 7f797f9ff700 1 -- 172.21.15.40:0/1539715565 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79781576c0 con 0x7f797815c720 2023-06-22T10:53:47.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.180+0000 7f795b7fe700 1 -- 172.21.15.40:0/1539715565 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79540052f0 con 0x7f797815c720 2023-06-22T10:53:47.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.181+0000 7f796dffb700 1 -- 172.21.15.40:0/1539715565 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f797001c7e0 con 0x7f797815c720 2023-06-22T10:53:47.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.182+0000 7f796dffb700 1 --2- 172.21.15.40:0/1539715565 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f795c06ace0 0x7f795c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:47.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.182+0000 7f796dffb700 1 -- 172.21.15.40:0/1539715565 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f797008b4b0 con 0x7f797815c720 2023-06-22T10:53:47.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.182+0000 7f797d79b700 1 --2- 172.21.15.40:0/1539715565 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f795c06ace0 0x7f795c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:47.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.183+0000 7f797d79b700 1 --2- 172.21.15.40:0/1539715565 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f795c06ace0 0x7f795c06d190 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7974000f60 tx=0x7f7974007be0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:47.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.187+0000 7f796dffb700 1 -- 172.21.15.40:0/1539715565 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7970056260 con 0x7f797815c720 2023-06-22T10:53:47.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.409+0000 7f795b7fe700 1 -- 172.21.15.40:0/1539715565 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7954005b20 con 0x7f797815c720 2023-06-22T10:53:47.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.409+0000 7f796dffb700 1 -- 172.21.15.40:0/1539715565 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7970059880 con 0x7f797815c720 2023-06-22T10:53:47.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.411+0000 7f795b7fe700 1 -- 172.21.15.40:0/1539715565 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f795c06ace0 msgr2=0x7f795c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:47.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.411+0000 7f795b7fe700 1 --2- 172.21.15.40:0/1539715565 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f795c06ace0 0x7f795c06d190 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7974000f60 tx=0x7f7974007be0 comp rx=0 tx=0).stop 2023-06-22T10:53:47.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.412+0000 7f795b7fe700 1 -- 172.21.15.40:0/1539715565 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f797815c720 msgr2=0x7f79780b32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:47.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.412+0000 7f795b7fe700 1 --2- 172.21.15.40:0/1539715565 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f797815c720 0x7f79780b32a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f797806b090 tx=0x7f7970004ad0 comp rx=0 tx=0).stop 2023-06-22T10:53:47.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.412+0000 7f795b7fe700 1 -- 172.21.15.40:0/1539715565 shutdown_connections 2023-06-22T10:53:47.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.412+0000 7f795b7fe700 1 --2- 172.21.15.40:0/1539715565 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f795c06ace0 0x7f795c06d190 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:47.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.412+0000 7f795b7fe700 1 --2- 172.21.15.40:0/1539715565 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f797815c720 0x7f79780b32a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:47.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.412+0000 7f795b7fe700 1 --2- 172.21.15.40:0/1539715565 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79780b4c60 0x7f7978157180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:47.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.412+0000 7f795b7fe700 1 --2- 172.21.15.40:0/1539715565 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f79780d2830 0x7f79781f20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:47.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.412+0000 7f795b7fe700 1 -- 172.21.15.40:0/1539715565 >> 172.21.15.40:0/1539715565 conn(0x7f79780cf720 msgr2=0x7f797815b750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:47.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.412+0000 7f795b7fe700 1 -- 172.21.15.40:0/1539715565 shutdown_connections 2023-06-22T10:53:47.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.412+0000 7f795b7fe700 1 -- 172.21.15.40:0/1539715565 wait complete. 2023-06-22T10:53:47.418 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2023-06-22T10:53:47.433 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-06-22T10:53:47.434 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-22T10:53:47.480 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-22T10:53:47.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.717+0000 7ff259bff700 1 Processor -- start 2023-06-22T10:53:47.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.718+0000 7ff259bff700 1 -- start start 2023-06-22T10:53:47.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.719+0000 7ff259bff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff25415c720 0x7ff2540b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:47.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.719+0000 7ff259bff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff2540d2830 0x7ff2540b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:47.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.719+0000 7ff259bff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2540b50a0 con 0x7ff2540b4c60 2023-06-22T10:53:47.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.719+0000 7ff259bff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff254160d60 con 0x7ff2540d2830 2023-06-22T10:53:47.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.719+0000 7ff259bff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2540b2130 con 0x7ff25415c720 2023-06-22T10:53:47.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.719+0000 7ff252ffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff2540d2830 0x7ff2540b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:47.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.719+0000 7ff252ffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff2540d2830 0x7ff2540b4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55648/0 (socket says 172.21.15.40:55648) 2023-06-22T10:53:47.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.719+0000 7ff252ffd700 1 -- 172.21.15.40:0/1283787890 learned_addr learned my addr 172.21.15.40:0/1283787890 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:47.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.719+0000 7ff2537fe700 1 --2- 172.21.15.40:0/1283787890 >> v2:172.21.15.45:3300/0 conn(0x7ff25415c720 0x7ff2540b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:47.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.719+0000 7ff252ffd700 1 -- 172.21.15.40:0/1283787890 >> v2:172.21.15.45:3300/0 conn(0x7ff25415c720 msgr2=0x7ff2540b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:47.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.719+0000 7ff252ffd700 1 --2- 172.21.15.40:0/1283787890 >> v2:172.21.15.45:3300/0 conn(0x7ff25415c720 0x7ff2540b1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:47.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.719+0000 7ff252ffd700 1 -- 172.21.15.40:0/1283787890 >> v1:172.21.15.45:6789/0 conn(0x7ff2540b4c60 legacy=0x7ff25406b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:47.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.719+0000 7ff252ffd700 1 -- 172.21.15.40:0/1283787890 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff254161180 con 0x7ff2540d2830 2023-06-22T10:53:47.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.719+0000 7ff2537fe700 1 --2- 172.21.15.40:0/1283787890 >> v2:172.21.15.45:3300/0 conn(0x7ff25415c720 0x7ff2540b1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-22T10:53:47.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.720+0000 7ff252ffd700 1 --2- 172.21.15.40:0/1283787890 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2540d2830 0x7ff2540b4720 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff2480098f0 tx=0x7ff248009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fabb39fe48d1dfa server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:47.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.720+0000 7ff2527fc700 1 -- 172.21.15.40:0/1283787890 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff248004230 con 0x7ff2540d2830 2023-06-22T10:53:47.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.720+0000 7ff2527fc700 1 -- 172.21.15.40:0/1283787890 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff248004390 con 0x7ff2540d2830 2023-06-22T10:53:47.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.720+0000 7ff2527fc700 1 -- 172.21.15.40:0/1283787890 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2480036a0 con 0x7ff2540d2830 2023-06-22T10:53:47.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.720+0000 7ff259bff700 1 -- 172.21.15.40:0/1283787890 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2540d2830 msgr2=0x7ff2540b4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:47.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.720+0000 7ff259bff700 1 --2- 172.21.15.40:0/1283787890 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2540d2830 0x7ff2540b4720 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff2480098f0 tx=0x7ff248009c00 comp rx=0 tx=0).stop 2023-06-22T10:53:47.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.721+0000 7ff259bff700 1 -- 172.21.15.40:0/1283787890 shutdown_connections 2023-06-22T10:53:47.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.721+0000 7ff259bff700 1 --2- 172.21.15.40:0/1283787890 >> v2:172.21.15.45:3300/0 conn(0x7ff25415c720 0x7ff2540b1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:47.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.721+0000 7ff259bff700 1 --2- 172.21.15.40:0/1283787890 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2540d2830 0x7ff2540b4720 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:47.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.721+0000 7ff259bff700 1 -- 172.21.15.40:0/1283787890 >> 172.21.15.40:0/1283787890 conn(0x7ff2540cf720 msgr2=0x7ff2540cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:47.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.721+0000 7ff259bff700 1 -- 172.21.15.40:0/1283787890 shutdown_connections 2023-06-22T10:53:47.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.721+0000 7ff259bff700 1 -- 172.21.15.40:0/1283787890 wait complete. 2023-06-22T10:53:47.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.722+0000 7ff259bff700 1 Processor -- start 2023-06-22T10:53:47.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.723+0000 7ff259bff700 1 -- start start 2023-06-22T10:53:47.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.723+0000 7ff259bff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2540b4c60 0x7ff2540ceb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:47.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.723+0000 7ff259bff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff2540d2830 0x7ff2540cc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:47.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.724+0000 7ff259bff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff25415c720 0x7ff254158e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:47.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.724+0000 7ff259bff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2540a9df0 con 0x7ff2540b4c60 2023-06-22T10:53:47.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.724+0000 7ff259bff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff25415d500 con 0x7ff25415c720 2023-06-22T10:53:47.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.724+0000 7ff259bff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2540a95e0 con 0x7ff2540d2830 2023-06-22T10:53:47.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.724+0000 7ff2537fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2540b4c60 0x7ff2540ceb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:47.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.724+0000 7ff2537fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2540b4c60 0x7ff2540ceb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55654/0 (socket says 172.21.15.40:55654) 2023-06-22T10:53:47.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.724+0000 7ff2537fe700 1 -- 172.21.15.40:0/3597158313 learned_addr learned my addr 172.21.15.40:0/3597158313 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:47.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.724+0000 7ff253fff700 1 --2- 172.21.15.40:0/3597158313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff25415c720 0x7ff254158e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:47.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.724+0000 7ff252ffd700 1 --2- 172.21.15.40:0/3597158313 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff2540d2830 0x7ff2540cc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:47.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.724+0000 7ff2537fe700 1 -- 172.21.15.40:0/3597158313 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff2540d2830 msgr2=0x7ff2540cc1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:47.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.724+0000 7ff2537fe700 1 --2- 172.21.15.40:0/3597158313 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff2540d2830 0x7ff2540cc1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:47.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.724+0000 7ff2537fe700 1 -- 172.21.15.40:0/3597158313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff25415c720 msgr2=0x7ff254158e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:47.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.724+0000 7ff2537fe700 1 --2- 172.21.15.40:0/3597158313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff25415c720 0x7ff254158e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:47.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.724+0000 7ff2537fe700 1 -- 172.21.15.40:0/3597158313 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff248009550 con 0x7ff2540b4c60 2023-06-22T10:53:47.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.725+0000 7ff2537fe700 1 --2- 172.21.15.40:0/3597158313 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2540b4c60 0x7ff2540ceb60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff24400c750 tx=0x7ff24400ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:47.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.725+0000 7ff23bfff700 1 -- 172.21.15.40:0/3597158313 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff244011800 con 0x7ff2540b4c60 2023-06-22T10:53:47.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.725+0000 7ff23bfff700 1 -- 172.21.15.40:0/3597158313 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff244011960 con 0x7ff2540b4c60 2023-06-22T10:53:47.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.725+0000 7ff259bff700 1 -- 172.21.15.40:0/3597158313 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff25415efb0 con 0x7ff2540b4c60 2023-06-22T10:53:47.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.725+0000 7ff23bfff700 1 -- 172.21.15.40:0/3597158313 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff244011cd0 con 0x7ff2540b4c60 2023-06-22T10:53:47.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.725+0000 7ff259bff700 1 -- 172.21.15.40:0/3597158313 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2540a9830 con 0x7ff2540b4c60 2023-06-22T10:53:47.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.726+0000 7ff259bff700 1 -- 172.21.15.40:0/3597158313 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff25415d670 con 0x7ff2540b4c60 2023-06-22T10:53:47.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.727+0000 7ff23bfff700 1 -- 172.21.15.40:0/3597158313 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff244021350 con 0x7ff2540b4c60 2023-06-22T10:53:47.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.728+0000 7ff23bfff700 1 --2- 172.21.15.40:0/3597158313 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7ff24006ace0 0x7ff24006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:47.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.728+0000 7ff23bfff700 1 -- 172.21.15.40:0/3597158313 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff244089670 con 0x7ff2540b4c60 2023-06-22T10:53:47.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.728+0000 7ff252ffd700 1 --2- 172.21.15.40:0/3597158313 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7ff24006ace0 0x7ff24006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:47.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.729+0000 7ff252ffd700 1 --2- 172.21.15.40:0/3597158313 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7ff24006ace0 0x7ff24006d190 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff2540d2c70 tx=0x7ff248008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:47.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.732+0000 7ff23bfff700 1 -- 172.21.15.40:0/3597158313 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff244057e20 con 0x7ff2540b4c60 2023-06-22T10:53:47.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.943+0000 7ff259bff700 1 -- 172.21.15.40:0/3597158313 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff254067580 con 0x7ff2540b4c60 2023-06-22T10:53:47.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.945+0000 7ff23bfff700 1 -- 172.21.15.40:0/3597158313 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20036 (secure 0 0 0) 0x7ff2440579b0 con 0x7ff2540b4c60 2023-06-22T10:53:47.949 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:53:47.949 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":28,"fsid":"475560bc-1a7c-4a75-b3b6-6fc6b20bdc52","created":"2023-06-22T10:53:03.784568+0000","modified":"2023-06-22T10:53:36.483308+0000","last_up_change":"2023-06-22T10:53:17.830348+0000","last_in_change":"2023-06-22T10:53:07.329974+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-22T10:53:17.182228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-22T10:53:23.874432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-22T10:53:29.812963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-22T10:53:30.404021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-22T10:53:33.982289+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"918db6b4-053a-46ba-976d-6e1a0104017f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6809","nonce":2400162888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6811","nonce":2400162888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6815","nonce":2400162888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6813","nonce":2400162888}]},"public_addr":"172.21.15.40:6809/2400162888","cluster_addr":"172.21.15.40:6811/2400162888","heartbeat_back_addr":"172.21.15.40:6815/2400162888","heartbeat_front_addr":"172.21.15.40:6813/2400162888","state":["exists","up"]},{"osd":1,"uuid":"0c146e2b-1725-4dae-9b5c-38795943b9d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6801","nonce":230885800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6803","nonce":230885800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6807","nonce":230885800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6805","nonce":230885800}]},"public_addr":"172.21.15.40:6801/230885800","cluster_addr":"172.21.15.40:6803/230885800","heartbeat_back_addr":"172.21.15.40:6807/230885800","heartbeat_front_addr":"172.21.15.40:6805/230885800","state":["exists","up"]},{"osd":2,"uuid":"0b3727fd-f281-46d5-a675-86c8c5ab269e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6817","nonce":2681404929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6819","nonce":2681404929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6823","nonce":2681404929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6821","nonce":2681404929}]},"public_addr":"172.21.15.40:6817/2681404929","cluster_addr":"172.21.15.40:6819/2681404929","heartbeat_back_addr":"172.21.15.40:6823/2681404929","heartbeat_front_addr":"172.21.15.40:6821/2681404929","state":["exists","up"]},{"osd":3,"uuid":"2969c698-7039-4bbb-beda-f756f7a368a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6825","nonce":111110981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6827","nonce":111110981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6831","nonce":111110981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6829","nonce":111110981}]},"public_addr":"172.21.15.40:6825/111110981","cluster_addr":"172.21.15.40:6827/111110981","heartbeat_back_addr":"172.21.15.40:6831/111110981","heartbeat_front_addr":"172.21.15.40:6829/111110981","state":["exists","up"]},{"osd":4,"uuid":"3bb1d9c8-8e42-4a6b-998d-04834f34be5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6801","nonce":3625455711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6803","nonce":3625455711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6807","nonce":3625455711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6805","nonce":3625455711}]},"public_addr":"172.21.15.45:6801/3625455711","cluster_addr":"172.21.15.45:6803/3625455711","heartbeat_back_addr":"172.21.15.45:6807/3625455711","heartbeat_front_addr":"172.21.15.45:6805/3625455711","state":["exists","up"]},{"osd":5,"uuid":"f9854ee4-302c-41be-977b-bedda090a3d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6817","nonce":3354411217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6819","nonce":3354411217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6823","nonce":3354411217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6821","nonce":3354411217}]},"public_addr":"172.21.15.45:6817/3354411217","cluster_addr":"172.21.15.45:6819/3354411217","heartbeat_back_addr":"172.21.15.45:6823/3354411217","heartbeat_front_addr":"172.21.15.45:6821/3354411217","state":["exists","up"]},{"osd":6,"uuid":"bbdb1989-f6ac-4954-9b85-b8b540d683c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6809","nonce":320111074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6811","nonce":320111074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6815","nonce":320111074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6813","nonce":320111074}]},"public_addr":"172.21.15.45:6809/320111074","cluster_addr":"172.21.15.45:6811/320111074","heartbeat_back_addr":"172.21.15.45:6815/320111074","heartbeat_front_addr":"172.21.15.45:6813/320111074","state":["exists","up"]},{"osd":7,"uuid":"823d44e3-58f1-4d1d-8263-a4e4a69d4327","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6825","nonce":643617680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6827","nonce":643617680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6831","nonce":643617680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6829","nonce":643617680}]},"public_addr":"172.21.15.45:6825/643617680","cluster_addr":"172.21.15.45:6827/643617680","heartbeat_back_addr":"172.21.15.45:6831/643617680","heartbeat_front_addr":"172.21.15.45:6829/643617680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.731262+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.873226+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.898936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.666578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.645990+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.953699+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.642823+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.693395+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-22T10:53:47.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.947+0000 7ff259bff700 1 -- 172.21.15.40:0/3597158313 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7ff24006ace0 msgr2=0x7ff24006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:47.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.947+0000 7ff259bff700 1 --2- 172.21.15.40:0/3597158313 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7ff24006ace0 0x7ff24006d190 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff2540d2c70 tx=0x7ff248008030 comp rx=0 tx=0).stop 2023-06-22T10:53:47.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.947+0000 7ff259bff700 1 -- 172.21.15.40:0/3597158313 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2540b4c60 msgr2=0x7ff2540ceb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:47.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.947+0000 7ff259bff700 1 --2- 172.21.15.40:0/3597158313 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2540b4c60 0x7ff2540ceb60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff24400c750 tx=0x7ff24400ca60 comp rx=0 tx=0).stop 2023-06-22T10:53:47.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.948+0000 7ff259bff700 1 -- 172.21.15.40:0/3597158313 shutdown_connections 2023-06-22T10:53:47.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.948+0000 7ff259bff700 1 --2- 172.21.15.40:0/3597158313 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7ff24006ace0 0x7ff24006d190 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:47.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.948+0000 7ff259bff700 1 --2- 172.21.15.40:0/3597158313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff25415c720 0x7ff254158e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:47.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.948+0000 7ff259bff700 1 --2- 172.21.15.40:0/3597158313 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2540b4c60 0x7ff2540ceb60 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:47.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.948+0000 7ff259bff700 1 --2- 172.21.15.40:0/3597158313 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff2540d2830 0x7ff2540cc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:47.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.948+0000 7ff259bff700 1 -- 172.21.15.40:0/3597158313 >> 172.21.15.40:0/3597158313 conn(0x7ff2540cf720 msgr2=0x7ff2540d0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:47.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.948+0000 7ff259bff700 1 -- 172.21.15.40:0/3597158313 shutdown_connections 2023-06-22T10:53:47.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:47.948+0000 7ff259bff700 1 -- 172.21.15.40:0/3597158313 wait complete. 2023-06-22T10:53:47.970 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-22T10:53:17.182228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-22T10:53:23.874432+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-22T10:53:29.812963+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-22T10:53:30.404021+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-22T10:53:33.982289+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-22T10:53:47.972 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-22T10:53:48.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.171+0000 7f202c9ff700 1 Processor -- start 2023-06-22T10:53:48.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.172+0000 7f202c9ff700 1 -- start start 2023-06-22T10:53:48.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.173+0000 7f202c9ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f20280b45d0 0x7f20280b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:48.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.173+0000 7f202c9ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f20280d2130 0x7f20280cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:48.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.173+0000 7f202c9ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f20280cd6e0 0x7f20280b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:48.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.173+0000 7f202c9ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20280d17f0 con 0x7f20280cd6e0 2023-06-22T10:53:48.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.173+0000 7f202c9ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20280d1be0 con 0x7f20280b45d0 2023-06-22T10:53:48.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.173+0000 7f202c9ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20280d1360 con 0x7f20280d2130 2023-06-22T10:53:48.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.173+0000 7f2026d9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f20280cd6e0 0x7f20280b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:48.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.173+0000 7f2026d9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f20280cd6e0 0x7f20280b59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55662/0 (socket says 172.21.15.40:55662) 2023-06-22T10:53:48.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.173+0000 7f2026d9d700 1 -- 172.21.15.40:0/4148325680 learned_addr learned my addr 172.21.15.40:0/4148325680 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:48.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.173+0000 7f201ffff700 1 --2- 172.21.15.40:0/4148325680 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f20280d2130 0x7f20280cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:48.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.173+0000 7f202659c700 1 --2- 172.21.15.40:0/4148325680 >> v2:172.21.15.45:3300/0 conn(0x7f20280b45d0 0x7f20280b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:48.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.174+0000 7f2026d9d700 1 -- 172.21.15.40:0/4148325680 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f20280d2130 msgr2=0x7f20280cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:48.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.174+0000 7f2026d9d700 1 --2- 172.21.15.40:0/4148325680 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f20280d2130 0x7f20280cd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:48.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.174+0000 7f2026d9d700 1 -- 172.21.15.40:0/4148325680 >> v2:172.21.15.45:3300/0 conn(0x7f20280b45d0 msgr2=0x7f20280b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:48.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.174+0000 7f2026d9d700 1 --2- 172.21.15.40:0/4148325680 >> v2:172.21.15.45:3300/0 conn(0x7f20280b45d0 0x7f20280b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:48.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.174+0000 7f2026d9d700 1 -- 172.21.15.40:0/4148325680 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20280b4ee0 con 0x7f20280cd6e0 2023-06-22T10:53:48.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.174+0000 7f2026d9d700 1 --2- 172.21.15.40:0/4148325680 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20280cd6e0 0x7f20280b59a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f20280668f0 tx=0x7f202000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea1db0b2de046f06 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:48.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.174+0000 7f2025d9b700 1 -- 172.21.15.40:0/4148325680 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f202000e070 con 0x7f20280cd6e0 2023-06-22T10:53:48.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.174+0000 7f2025d9b700 1 -- 172.21.15.40:0/4148325680 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f202000b9c0 con 0x7f20280cd6e0 2023-06-22T10:53:48.180 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.174+0000 7f2025d9b700 1 -- 172.21.15.40:0/4148325680 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f202000bd70 con 0x7f20280cd6e0 2023-06-22T10:53:48.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.175+0000 7f202c9ff700 1 -- 172.21.15.40:0/4148325680 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20280cd6e0 msgr2=0x7f20280b59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:48.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.175+0000 7f202c9ff700 1 --2- 172.21.15.40:0/4148325680 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20280cd6e0 0x7f20280b59a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f20280668f0 tx=0x7f202000b330 comp rx=0 tx=0).stop 2023-06-22T10:53:48.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.175+0000 7f202c9ff700 1 -- 172.21.15.40:0/4148325680 shutdown_connections 2023-06-22T10:53:48.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.175+0000 7f202c9ff700 1 --2- 172.21.15.40:0/4148325680 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20280cd6e0 0x7f20280b59a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:48.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.175+0000 7f202c9ff700 1 --2- 172.21.15.40:0/4148325680 >> v2:172.21.15.45:3300/0 conn(0x7f20280b45d0 0x7f20280b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:48.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.175+0000 7f202c9ff700 1 --2- 172.21.15.40:0/4148325680 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f20280d2130 0x7f20280cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:48.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.175+0000 7f202c9ff700 1 -- 172.21.15.40:0/4148325680 >> 172.21.15.40:0/4148325680 conn(0x7f20280cf5d0 msgr2=0x7f20280cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:48.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.175+0000 7f202c9ff700 1 -- 172.21.15.40:0/4148325680 shutdown_connections 2023-06-22T10:53:48.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.175+0000 7f202c9ff700 1 -- 172.21.15.40:0/4148325680 wait complete. 2023-06-22T10:53:48.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.177+0000 7f202c9ff700 1 Processor -- start 2023-06-22T10:53:48.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.177+0000 7f202c9ff700 1 -- start start 2023-06-22T10:53:48.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.178+0000 7f202c9ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20280b45d0 0x7f20280c8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:48.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.178+0000 7f202c9ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20280cd6e0 0x7f20280b69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:48.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.178+0000 7f202c9ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f20280d2130 0x7f20280b6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:48.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.178+0000 7f202c9ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20281f1ea0 con 0x7f20280b45d0 2023-06-22T10:53:48.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.178+0000 7f202c9ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20281f2c20 con 0x7f20280cd6e0 2023-06-22T10:53:48.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.178+0000 7f202c9ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20281f2140 con 0x7f20280d2130 2023-06-22T10:53:48.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.178+0000 7f202659c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20280b45d0 0x7f20280c8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:48.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.178+0000 7f202659c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20280b45d0 0x7f20280c8ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55668/0 (socket says 172.21.15.40:55668) 2023-06-22T10:53:48.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.178+0000 7f202659c700 1 -- 172.21.15.40:0/3165979499 learned_addr learned my addr 172.21.15.40:0/3165979499 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:48.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.178+0000 7f201ffff700 1 --2- 172.21.15.40:0/3165979499 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20280cd6e0 0x7f20280b69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:48.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.178+0000 7f2026d9d700 1 --2- 172.21.15.40:0/3165979499 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f20280d2130 0x7f20280b6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:48.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.178+0000 7f202659c700 1 -- 172.21.15.40:0/3165979499 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f20280d2130 msgr2=0x7f20280b6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:48.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.178+0000 7f202659c700 1 --2- 172.21.15.40:0/3165979499 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f20280d2130 0x7f20280b6f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:48.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.178+0000 7f202659c700 1 -- 172.21.15.40:0/3165979499 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20280cd6e0 msgr2=0x7f20280b69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:48.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.178+0000 7f202659c700 1 --2- 172.21.15.40:0/3165979499 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20280cd6e0 0x7f20280b69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:48.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.178+0000 7f202659c700 1 -- 172.21.15.40:0/3165979499 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2020009b30 con 0x7f20280b45d0 2023-06-22T10:53:48.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.179+0000 7f202659c700 1 --2- 172.21.15.40:0/3165979499 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20280b45d0 0x7f20280c8ea0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f201800d800 tx=0x7f201800db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:48.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.179+0000 7f201effd700 1 -- 172.21.15.40:0/3165979499 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20180125f0 con 0x7f20280b45d0 2023-06-22T10:53:48.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.179+0000 7f201effd700 1 -- 172.21.15.40:0/3165979499 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2018012750 con 0x7f20280b45d0 2023-06-22T10:53:48.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.179+0000 7f201effd700 1 -- 172.21.15.40:0/3165979499 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2018012ae0 con 0x7f20280b45d0 2023-06-22T10:53:48.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.179+0000 7f202c9ff700 1 -- 172.21.15.40:0/3165979499 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20281f2420 con 0x7f20280b45d0 2023-06-22T10:53:48.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.179+0000 7f202c9ff700 1 -- 172.21.15.40:0/3165979499 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20280ccc70 con 0x7f20280b45d0 2023-06-22T10:53:48.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.180+0000 7f202c9ff700 1 -- 172.21.15.40:0/3165979499 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20281f2940 con 0x7f20280b45d0 2023-06-22T10:53:48.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.181+0000 7f201effd700 1 -- 172.21.15.40:0/3165979499 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2018012c40 con 0x7f20280b45d0 2023-06-22T10:53:48.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.182+0000 7f201effd700 1 --2- 172.21.15.40:0/3165979499 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f200806ace0 0x7f200806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:48.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.182+0000 7f201effd700 1 -- 172.21.15.40:0/3165979499 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2018089800 con 0x7f20280b45d0 2023-06-22T10:53:48.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.182+0000 7f201ffff700 1 --2- 172.21.15.40:0/3165979499 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f200806ace0 0x7f200806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:48.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.183+0000 7f201ffff700 1 --2- 172.21.15.40:0/3165979499 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f200806ace0 0x7f200806d190 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f202815b940 tx=0x7f2010008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:48.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.187+0000 7f201effd700 1 -- 172.21.15.40:0/3165979499 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f20180545d0 con 0x7f20280b45d0 2023-06-22T10:53:48.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.391+0000 7f202c9ff700 1 -- 172.21.15.40:0/3165979499 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2028067580 con 0x7f20280b45d0 2023-06-22T10:53:48.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.391+0000 7f201effd700 1 -- 172.21.15.40:0/3165979499 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2018057bf0 con 0x7f20280b45d0 2023-06-22T10:53:48.395 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-06-22T10:53:48.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.393+0000 7f202c9ff700 1 -- 172.21.15.40:0/3165979499 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f200806ace0 msgr2=0x7f200806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:48.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.393+0000 7f202c9ff700 1 --2- 172.21.15.40:0/3165979499 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f200806ace0 0x7f200806d190 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f202815b940 tx=0x7f2010008040 comp rx=0 tx=0).stop 2023-06-22T10:53:48.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.393+0000 7f202c9ff700 1 -- 172.21.15.40:0/3165979499 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20280b45d0 msgr2=0x7f20280c8ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:48.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.393+0000 7f202c9ff700 1 --2- 172.21.15.40:0/3165979499 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20280b45d0 0x7f20280c8ea0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f201800d800 tx=0x7f201800db10 comp rx=0 tx=0).stop 2023-06-22T10:53:48.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.393+0000 7f202c9ff700 1 -- 172.21.15.40:0/3165979499 shutdown_connections 2023-06-22T10:53:48.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.393+0000 7f202c9ff700 1 --2- 172.21.15.40:0/3165979499 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f200806ace0 0x7f200806d190 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:48.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.393+0000 7f202c9ff700 1 --2- 172.21.15.40:0/3165979499 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f20280d2130 0x7f20280b6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:48.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.393+0000 7f202c9ff700 1 --2- 172.21.15.40:0/3165979499 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20280b45d0 0x7f20280c8ea0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:48.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.393+0000 7f202c9ff700 1 --2- 172.21.15.40:0/3165979499 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20280cd6e0 0x7f20280b69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:48.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.393+0000 7f202c9ff700 1 -- 172.21.15.40:0/3165979499 >> 172.21.15.40:0/3165979499 conn(0x7f20280cf5d0 msgr2=0x7f202815aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:48.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.393+0000 7f202c9ff700 1 -- 172.21.15.40:0/3165979499 shutdown_connections 2023-06-22T10:53:48.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.393+0000 7f202c9ff700 1 -- 172.21.15.40:0/3165979499 wait complete. 2023-06-22T10:53:48.415 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-22T10:53:48.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.615+0000 7f9070bff700 1 Processor -- start 2023-06-22T10:53:48.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.615+0000 7f9070bff700 1 -- start start 2023-06-22T10:53:48.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.617+0000 7f9070bff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f906c0b45d0 0x7f906c0b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:48.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.617+0000 7f9070bff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f906c0b59a0 0x7f906c0b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:48.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.617+0000 7f9070bff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f906c0d1be0 con 0x7f906c0d2130 2023-06-22T10:53:48.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.617+0000 7f9070bff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f906c0d17f0 con 0x7f906c0b45d0 2023-06-22T10:53:48.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.617+0000 7f9070bff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f906c0d1360 con 0x7f906c0b59a0 2023-06-22T10:53:48.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.617+0000 7f9069d9b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f906c0d2130 0x7f906c0cd1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37982/0 (socket says 172.21.15.40:37982) 2023-06-22T10:53:48.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.617+0000 7f9069d9b700 1 -- 172.21.15.40:0/2022829034 learned_addr learned my addr 172.21.15.40:0/2022829034 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:53:48.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.617+0000 7f906a59c700 1 --2- 172.21.15.40:0/2022829034 >> v2:172.21.15.45:3300/0 conn(0x7f906c0b45d0 0x7f906c0b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:48.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.617+0000 7f906ad9d700 1 --2- 172.21.15.40:0/2022829034 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f906c0b59a0 0x7f906c0b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:48.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.618+0000 7f906a59c700 1 -- 172.21.15.40:0/2022829034 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f906c0b59a0 msgr2=0x7f906c0b5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:48.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.618+0000 7f906a59c700 1 --2- 172.21.15.40:0/2022829034 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f906c0b59a0 0x7f906c0b5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:48.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.618+0000 7f906a59c700 1 -- 172.21.15.40:0/2022829034 >> v1:172.21.15.40:6789/0 conn(0x7f906c0d2130 legacy=0x7f906c0cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:48.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.618+0000 7f906a59c700 1 -- 172.21.15.40:0/2022829034 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f906c0b4ee0 con 0x7f906c0b45d0 2023-06-22T10:53:48.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.618+0000 7f906a59c700 1 --2- 172.21.15.40:0/2022829034 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f906c0b45d0 0x7f906c0b49a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f905c009840 tx=0x7f905c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42ac0eefd1622ab7 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:48.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.619+0000 7f906959a700 1 -- 172.21.15.40:0/2022829034 <== mon.1 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905c011830 con 0x7f906c0b45d0 2023-06-22T10:53:48.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.620+0000 7f906959a700 1 -- 172.21.15.40:0/2022829034 <== mon.1 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f905c011990 con 0x7f906c0b45d0 2023-06-22T10:53:48.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.620+0000 7f906959a700 1 -- 172.21.15.40:0/2022829034 <== mon.1 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905c011d20 con 0x7f906c0b45d0 2023-06-22T10:53:48.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.620+0000 7f9070bff700 1 -- 172.21.15.40:0/2022829034 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f906c0b45d0 msgr2=0x7f906c0b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:48.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.620+0000 7f9070bff700 1 --2- 172.21.15.40:0/2022829034 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f906c0b45d0 0x7f906c0b49a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f905c009840 tx=0x7f905c009b50 comp rx=0 tx=0).stop 2023-06-22T10:53:48.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.620+0000 7f9070bff700 1 -- 172.21.15.40:0/2022829034 shutdown_connections 2023-06-22T10:53:48.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.620+0000 7f9070bff700 1 --2- 172.21.15.40:0/2022829034 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f906c0b59a0 0x7f906c0b5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:48.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.620+0000 7f9070bff700 1 --2- 172.21.15.40:0/2022829034 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f906c0b45d0 0x7f906c0b49a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:48.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.620+0000 7f9070bff700 1 -- 172.21.15.40:0/2022829034 >> 172.21.15.40:0/2022829034 conn(0x7f906c0cf5d0 msgr2=0x7f906c0cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:48.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.620+0000 7f9070bff700 1 -- 172.21.15.40:0/2022829034 shutdown_connections 2023-06-22T10:53:48.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.620+0000 7f9070bff700 1 -- 172.21.15.40:0/2022829034 wait complete. 2023-06-22T10:53:48.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.622+0000 7f9070bff700 1 Processor -- start 2023-06-22T10:53:48.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.622+0000 7f9070bff700 1 -- start start 2023-06-22T10:53:48.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.623+0000 7f9070bff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f906c0b45d0 0x7f906c159030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:48.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.623+0000 7f9070bff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f906c0b59a0 0x7f906c0b6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:48.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.623+0000 7f9070bff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f906c0d2130 0x7f906c0b6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:48.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.623+0000 7f9070bff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f906c159570 con 0x7f906c0b59a0 2023-06-22T10:53:48.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.623+0000 7f9070bff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f906c1e8600 con 0x7f906c0d2130 2023-06-22T10:53:48.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.623+0000 7f9070bff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f906c0ca6e0 con 0x7f906c0b45d0 2023-06-22T10:53:48.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.623+0000 7f9069d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f906c0b59a0 0x7f906c0b6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:48.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.624+0000 7f9069d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f906c0b59a0 0x7f906c0b6410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37582/0 (socket says 172.21.15.40:37582) 2023-06-22T10:53:48.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.624+0000 7f9069d9b700 1 -- 172.21.15.40:0/960796833 learned_addr learned my addr 172.21.15.40:0/960796833 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:48.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.624+0000 7f906ad9d700 1 --2- 172.21.15.40:0/960796833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f906c0d2130 0x7f906c0b6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:48.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.624+0000 7f906a59c700 1 --2- 172.21.15.40:0/960796833 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f906c0b45d0 0x7f906c159030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:48.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.624+0000 7f9069d9b700 1 -- 172.21.15.40:0/960796833 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f906c0b45d0 msgr2=0x7f906c159030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:48.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.624+0000 7f9069d9b700 1 --2- 172.21.15.40:0/960796833 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f906c0b45d0 0x7f906c159030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:48.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.624+0000 7f9069d9b700 1 -- 172.21.15.40:0/960796833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f906c0d2130 msgr2=0x7f906c0b6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:48.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.624+0000 7f9069d9b700 1 --2- 172.21.15.40:0/960796833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f906c0d2130 0x7f906c0b6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:48.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.624+0000 7f9069d9b700 1 -- 172.21.15.40:0/960796833 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f905c0094a0 con 0x7f906c0b59a0 2023-06-22T10:53:48.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.624+0000 7f9069d9b700 1 --2- 172.21.15.40:0/960796833 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f906c0b59a0 0x7f906c0b6410 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f906000c520 tx=0x7f906000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:48.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.624+0000 7f905affd700 1 -- 172.21.15.40:0/960796833 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9060005d70 con 0x7f906c0b59a0 2023-06-22T10:53:48.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.624+0000 7f905affd700 1 -- 172.21.15.40:0/960796833 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90600070d0 con 0x7f906c0b59a0 2023-06-22T10:53:48.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.624+0000 7f905affd700 1 -- 172.21.15.40:0/960796833 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9060007440 con 0x7f906c0b59a0 2023-06-22T10:53:48.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.625+0000 7f9070bff700 1 -- 172.21.15.40:0/960796833 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f906c0ca9c0 con 0x7f906c0b59a0 2023-06-22T10:53:48.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.625+0000 7f9070bff700 1 -- 172.21.15.40:0/960796833 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f906c0caf80 con 0x7f906c0b59a0 2023-06-22T10:53:48.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.626+0000 7f9070bff700 1 -- 172.21.15.40:0/960796833 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f906c067580 con 0x7f906c0b59a0 2023-06-22T10:53:48.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.627+0000 7f905affd700 1 -- 172.21.15.40:0/960796833 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f90600075a0 con 0x7f906c0b59a0 2023-06-22T10:53:48.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.628+0000 7f905affd700 1 --2- 172.21.15.40:0/960796833 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f904c06ace0 0x7f904c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:48.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.628+0000 7f905affd700 1 -- 172.21.15.40:0/960796833 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f90600889f0 con 0x7f906c0b59a0 2023-06-22T10:53:48.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.628+0000 7f906a59c700 1 --2- 172.21.15.40:0/960796833 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f904c06ace0 0x7f904c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:48.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.629+0000 7f906a59c700 1 --2- 172.21.15.40:0/960796833 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f904c06ace0 0x7f904c06d190 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f905c000c00 tx=0x7f905c01c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:48.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.633+0000 7f905affd700 1 -- 172.21.15.40:0/960796833 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f90600538f0 con 0x7f906c0b59a0 2023-06-22T10:53:48.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.839+0000 7f9070bff700 1 -- 172.21.15.40:0/960796833 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f906c0cb170 con 0x7f906c0b59a0 2023-06-22T10:53:48.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.839+0000 7f905affd700 1 -- 172.21.15.40:0/960796833 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9060056f10 con 0x7f906c0b59a0 2023-06-22T10:53:48.843 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 8 2023-06-22T10:53:48.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.841+0000 7f9070bff700 1 -- 172.21.15.40:0/960796833 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f904c06ace0 msgr2=0x7f904c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:48.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.841+0000 7f9070bff700 1 --2- 172.21.15.40:0/960796833 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f904c06ace0 0x7f904c06d190 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f905c000c00 tx=0x7f905c01c040 comp rx=0 tx=0).stop 2023-06-22T10:53:48.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.841+0000 7f9070bff700 1 -- 172.21.15.40:0/960796833 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f906c0b59a0 msgr2=0x7f906c0b6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:48.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.841+0000 7f9070bff700 1 --2- 172.21.15.40:0/960796833 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f906c0b59a0 0x7f906c0b6410 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f906000c520 tx=0x7f906000c830 comp rx=0 tx=0).stop 2023-06-22T10:53:48.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.842+0000 7f9070bff700 1 -- 172.21.15.40:0/960796833 shutdown_connections 2023-06-22T10:53:48.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.842+0000 7f9070bff700 1 --2- 172.21.15.40:0/960796833 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f904c06ace0 0x7f904c06d190 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:48.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.842+0000 7f9070bff700 1 --2- 172.21.15.40:0/960796833 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f906c0b45d0 0x7f906c159030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:48.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.842+0000 7f9070bff700 1 --2- 172.21.15.40:0/960796833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f906c0d2130 0x7f906c0b6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:48.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.842+0000 7f9070bff700 1 --2- 172.21.15.40:0/960796833 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f906c0b59a0 0x7f906c0b6410 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:48.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.842+0000 7f9070bff700 1 -- 172.21.15.40:0/960796833 >> 172.21.15.40:0/960796833 conn(0x7f906c0cf5d0 msgr2=0x7f906c15b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:48.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.842+0000 7f9070bff700 1 -- 172.21.15.40:0/960796833 shutdown_connections 2023-06-22T10:53:48.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:48.842+0000 7f9070bff700 1 -- 172.21.15.40:0/960796833 wait complete. 2023-06-22T10:53:48.863 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-22T10:53:49.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.062+0000 7fd2b0bff700 1 Processor -- start 2023-06-22T10:53:49.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.062+0000 7fd2b0bff700 1 -- start start 2023-06-22T10:53:49.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.063+0000 7fd2b0bff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd2ac0b45d0 0x7fd2ac0b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:49.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.063+0000 7fd2b0bff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd2ac0d2130 0x7fd2ac0cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:49.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.063+0000 7fd2b0bff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2ac0d1be0 con 0x7fd2ac0cd6e0 2023-06-22T10:53:49.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.063+0000 7fd2b0bff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2ac0d17f0 con 0x7fd2ac0d2130 2023-06-22T10:53:49.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.063+0000 7fd2b0bff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ac0d1360 con 0x7fd2ac0b45d0 2023-06-22T10:53:49.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.063+0000 7fd2a9d9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd2ac0d2130 0x7fd2ac0cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:49.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.064+0000 7fd2a9d9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd2ac0d2130 0x7fd2ac0cd1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37594/0 (socket says 172.21.15.40:37594) 2023-06-22T10:53:49.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.064+0000 7fd2a9d9b700 1 -- 172.21.15.40:0/744948394 learned_addr learned my addr 172.21.15.40:0/744948394 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:49.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.064+0000 7fd2aa59c700 1 --2- 172.21.15.40:0/744948394 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd2ac0b45d0 0x7fd2ac0b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:49.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.064+0000 7fd2a9d9b700 1 -- 172.21.15.40:0/744948394 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd2ac0b45d0 msgr2=0x7fd2ac0b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:49.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.064+0000 7fd2a9d9b700 1 --2- 172.21.15.40:0/744948394 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd2ac0b45d0 0x7fd2ac0b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:49.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.064+0000 7fd2a9d9b700 1 -- 172.21.15.40:0/744948394 >> v1:172.21.15.45:6789/0 conn(0x7fd2ac0cd6e0 legacy=0x7fd2ac0b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:49.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.064+0000 7fd2a9d9b700 1 -- 172.21.15.40:0/744948394 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2ac0b4ee0 con 0x7fd2ac0d2130 2023-06-22T10:53:49.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.064+0000 7fd2aa59c700 1 --2- 172.21.15.40:0/744948394 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd2ac0b45d0 0x7fd2ac0b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-22T10:53:49.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.064+0000 7fd2a9d9b700 1 --2- 172.21.15.40:0/744948394 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd2ac0d2130 0x7fd2ac0cd1a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd2a00098f0 tx=0x7fd2a0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4b19abafd87212e server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:49.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.065+0000 7fd2a959a700 1 -- 172.21.15.40:0/744948394 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a000b8a0 con 0x7fd2ac0d2130 2023-06-22T10:53:49.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.065+0000 7fd2a959a700 1 -- 172.21.15.40:0/744948394 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2a000ba00 con 0x7fd2ac0d2130 2023-06-22T10:53:49.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.065+0000 7fd2a959a700 1 -- 172.21.15.40:0/744948394 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a000bd90 con 0x7fd2ac0d2130 2023-06-22T10:53:49.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.065+0000 7fd2b0bff700 1 -- 172.21.15.40:0/744948394 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd2ac0d2130 msgr2=0x7fd2ac0cd1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:49.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.065+0000 7fd2b0bff700 1 --2- 172.21.15.40:0/744948394 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd2ac0d2130 0x7fd2ac0cd1a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd2a00098f0 tx=0x7fd2a0009c00 comp rx=0 tx=0).stop 2023-06-22T10:53:49.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.065+0000 7fd2b0bff700 1 -- 172.21.15.40:0/744948394 shutdown_connections 2023-06-22T10:53:49.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.065+0000 7fd2b0bff700 1 --2- 172.21.15.40:0/744948394 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd2ac0b45d0 0x7fd2ac0b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:49.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.065+0000 7fd2b0bff700 1 --2- 172.21.15.40:0/744948394 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd2ac0d2130 0x7fd2ac0cd1a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:49.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.065+0000 7fd2b0bff700 1 -- 172.21.15.40:0/744948394 >> 172.21.15.40:0/744948394 conn(0x7fd2ac0cf5d0 msgr2=0x7fd2ac0cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:49.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.065+0000 7fd2b0bff700 1 -- 172.21.15.40:0/744948394 shutdown_connections 2023-06-22T10:53:49.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.065+0000 7fd2b0bff700 1 -- 172.21.15.40:0/744948394 wait complete. 2023-06-22T10:53:49.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.067+0000 7fd2b0bff700 1 Processor -- start 2023-06-22T10:53:49.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.067+0000 7fd2b0bff700 1 -- start start 2023-06-22T10:53:49.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.068+0000 7fd2b0bff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd2ac0b45d0 0x7fd2ac1f23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:49.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.068+0000 7fd2b0bff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2ac0cd6e0 0x7fd2ac0ccca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:49.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.068+0000 7fd2b0bff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd2ac0d2130 0x7fd2ac0c8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:49.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.068+0000 7fd2b0bff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ac0c9fd0 con 0x7fd2ac0b45d0 2023-06-22T10:53:49.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.068+0000 7fd2b0bff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ac1f28e0 con 0x7fd2ac0cd6e0 2023-06-22T10:53:49.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.068+0000 7fd2b0bff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2ac0c83c0 con 0x7fd2ac0d2130 2023-06-22T10:53:49.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.068+0000 7fd2aa59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd2ac0b45d0 0x7fd2ac1f23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:49.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.068+0000 7fd2aa59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd2ac0b45d0 0x7fd2ac1f23a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37610/0 (socket says 172.21.15.40:37610) 2023-06-22T10:53:49.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.068+0000 7fd2aa59c700 1 -- 172.21.15.40:0/1574987332 learned_addr learned my addr 172.21.15.40:0/1574987332 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:49.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.069+0000 7fd2a9d9b700 1 --2- 172.21.15.40:0/1574987332 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2ac0cd6e0 0x7fd2ac0ccca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:49.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.069+0000 7fd2aad9d700 1 --2- 172.21.15.40:0/1574987332 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd2ac0d2130 0x7fd2ac0c8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:49.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.069+0000 7fd2aa59c700 1 -- 172.21.15.40:0/1574987332 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd2ac0d2130 msgr2=0x7fd2ac0c8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:49.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.069+0000 7fd2aa59c700 1 --2- 172.21.15.40:0/1574987332 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd2ac0d2130 0x7fd2ac0c8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:49.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.069+0000 7fd2aa59c700 1 -- 172.21.15.40:0/1574987332 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2ac0cd6e0 msgr2=0x7fd2ac0ccca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:49.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.069+0000 7fd2aa59c700 1 --2- 172.21.15.40:0/1574987332 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2ac0cd6e0 0x7fd2ac0ccca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:49.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.069+0000 7fd2aa59c700 1 -- 172.21.15.40:0/1574987332 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a0009550 con 0x7fd2ac0b45d0 2023-06-22T10:53:49.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.069+0000 7fd2aad9d700 1 --2- 172.21.15.40:0/1574987332 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd2ac0d2130 0x7fd2ac0c8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-22T10:53:49.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.069+0000 7fd2a9d9b700 1 --2- 172.21.15.40:0/1574987332 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2ac0cd6e0 0x7fd2ac0ccca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:53:49.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.069+0000 7fd2aa59c700 1 --2- 172.21.15.40:0/1574987332 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd2ac0b45d0 0x7fd2ac1f23a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd29c00c7f0 tx=0x7fd29c00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:49.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.069+0000 7fd29affd700 1 -- 172.21.15.40:0/1574987332 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29c011800 con 0x7fd2ac0b45d0 2023-06-22T10:53:49.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.069+0000 7fd29affd700 1 -- 172.21.15.40:0/1574987332 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd29c011960 con 0x7fd2ac0b45d0 2023-06-22T10:53:49.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.069+0000 7fd2b0bff700 1 -- 172.21.15.40:0/1574987332 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2ac0c7320 con 0x7fd2ac0b45d0 2023-06-22T10:53:49.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.069+0000 7fd29affd700 1 -- 172.21.15.40:0/1574987332 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29c011d10 con 0x7fd2ac0b45d0 2023-06-22T10:53:49.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.069+0000 7fd2b0bff700 1 -- 172.21.15.40:0/1574987332 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2ac0c78e0 con 0x7fd2ac0b45d0 2023-06-22T10:53:49.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.071+0000 7fd2b0bff700 1 -- 172.21.15.40:0/1574987332 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2ac067580 con 0x7fd2ac0b45d0 2023-06-22T10:53:49.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.072+0000 7fd29affd700 1 -- 172.21.15.40:0/1574987332 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd29c018360 con 0x7fd2ac0b45d0 2023-06-22T10:53:49.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.073+0000 7fd29affd700 1 --2- 172.21.15.40:0/1574987332 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fd28c06ace0 0x7fd28c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:49.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.073+0000 7fd29affd700 1 -- 172.21.15.40:0/1574987332 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd29c089710 con 0x7fd2ac0b45d0 2023-06-22T10:53:49.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.073+0000 7fd2a9d9b700 1 --2- 172.21.15.40:0/1574987332 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fd28c06ace0 0x7fd28c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:49.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.073+0000 7fd2a9d9b700 1 --2- 172.21.15.40:0/1574987332 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fd28c06ace0 0x7fd28c06d190 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd2a0000c00 tx=0x7fd2a0008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:49.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.077+0000 7fd29affd700 1 -- 172.21.15.40:0/1574987332 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd29c057ff0 con 0x7fd2ac0b45d0 2023-06-22T10:53:49.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.285+0000 7fd2b0bff700 1 -- 172.21.15.40:0/1574987332 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd2ac0cd4c0 con 0x7fd2ac0b45d0 2023-06-22T10:53:49.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.285+0000 7fd29affd700 1 -- 172.21.15.40:0/1574987332 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd29c057b80 con 0x7fd2ac0b45d0 2023-06-22T10:53:49.289 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-06-22T10:53:49.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.287+0000 7fd2b0bff700 1 -- 172.21.15.40:0/1574987332 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fd28c06ace0 msgr2=0x7fd28c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:49.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.287+0000 7fd2b0bff700 1 --2- 172.21.15.40:0/1574987332 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fd28c06ace0 0x7fd28c06d190 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd2a0000c00 tx=0x7fd2a0008030 comp rx=0 tx=0).stop 2023-06-22T10:53:49.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.287+0000 7fd2b0bff700 1 -- 172.21.15.40:0/1574987332 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd2ac0b45d0 msgr2=0x7fd2ac1f23a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:49.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.287+0000 7fd2b0bff700 1 --2- 172.21.15.40:0/1574987332 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd2ac0b45d0 0x7fd2ac1f23a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd29c00c7f0 tx=0x7fd29c00cbb0 comp rx=0 tx=0).stop 2023-06-22T10:53:49.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.287+0000 7fd2b0bff700 1 -- 172.21.15.40:0/1574987332 shutdown_connections 2023-06-22T10:53:49.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.287+0000 7fd2b0bff700 1 --2- 172.21.15.40:0/1574987332 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fd28c06ace0 0x7fd28c06d190 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:49.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.287+0000 7fd2b0bff700 1 --2- 172.21.15.40:0/1574987332 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd2ac0d2130 0x7fd2ac0c8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:49.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.287+0000 7fd2b0bff700 1 --2- 172.21.15.40:0/1574987332 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd2ac0b45d0 0x7fd2ac1f23a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:49.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.288+0000 7fd2b0bff700 1 --2- 172.21.15.40:0/1574987332 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2ac0cd6e0 0x7fd2ac0ccca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:49.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.288+0000 7fd2b0bff700 1 -- 172.21.15.40:0/1574987332 >> 172.21.15.40:0/1574987332 conn(0x7fd2ac0cf5d0 msgr2=0x7fd2ac15a160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:49.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.288+0000 7fd2b0bff700 1 -- 172.21.15.40:0/1574987332 shutdown_connections 2023-06-22T10:53:49.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.288+0000 7fd2b0bff700 1 -- 172.21.15.40:0/1574987332 wait complete. 2023-06-22T10:53:49.309 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-22T10:53:49.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.509+0000 7f9f675ff700 1 Processor -- start 2023-06-22T10:53:49.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.509+0000 7f9f675ff700 1 -- start start 2023-06-22T10:53:49.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.510+0000 7f9f675ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9f600b45d0 0x7f9f600b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:49.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.510+0000 7f9f675ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9f600d2130 0x7f9f600cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:49.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.510+0000 7f9f675ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f600d1be0 con 0x7f9f600cd6e0 2023-06-22T10:53:49.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.510+0000 7f9f675ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f600d17f0 con 0x7f9f600b45d0 2023-06-22T10:53:49.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.510+0000 7f9f675ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f600d1360 con 0x7f9f600d2130 2023-06-22T10:53:49.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.510+0000 7f9f65b9c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f9f600cd6e0 0x7f9f600b59a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37984/0 (socket says 172.21.15.40:37984) 2023-06-22T10:53:49.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.510+0000 7f9f65b9c700 1 -- 172.21.15.40:0/3223971419 learned_addr learned my addr 172.21.15.40:0/3223971419 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:53:49.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.510+0000 7f9f6539b700 1 --2- 172.21.15.40:0/3223971419 >> v2:172.21.15.45:3300/0 conn(0x7f9f600b45d0 0x7f9f600b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:49.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.510+0000 7f9f64b9a700 1 --2- 172.21.15.40:0/3223971419 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9f600d2130 0x7f9f600cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:49.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.511+0000 7f9f57fff700 1 -- 172.21.15.40:0/3223971419 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1314448795 0 0) 0x7f9f600d1be0 con 0x7f9f600cd6e0 2023-06-22T10:53:49.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.511+0000 7f9f57fff700 1 -- 172.21.15.40:0/3223971419 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f4c0035b0 con 0x7f9f600cd6e0 2023-06-22T10:53:49.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.511+0000 7f9f6539b700 1 -- 172.21.15.40:0/3223971419 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9f600d2130 msgr2=0x7f9f600cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:49.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.511+0000 7f9f6539b700 1 --2- 172.21.15.40:0/3223971419 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9f600d2130 0x7f9f600cd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:49.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.511+0000 7f9f6539b700 1 -- 172.21.15.40:0/3223971419 >> v1:172.21.15.40:6789/0 conn(0x7f9f600cd6e0 legacy=0x7f9f600b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:49.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.511+0000 7f9f6539b700 1 -- 172.21.15.40:0/3223971419 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f600b4ee0 con 0x7f9f600b45d0 2023-06-22T10:53:49.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.511+0000 7f9f6539b700 1 --2- 172.21.15.40:0/3223971419 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f600b45d0 0x7f9f600b49a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c009840 tx=0x7f9f5c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86b2d3c9f213ec1a server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:49.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.511+0000 7f9f57fff700 1 -- 172.21.15.40:0/3223971419 <== mon.1 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f5c011830 con 0x7f9f600b45d0 2023-06-22T10:53:49.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.511+0000 7f9f57fff700 1 -- 172.21.15.40:0/3223971419 <== mon.1 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f5c011990 con 0x7f9f600b45d0 2023-06-22T10:53:49.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.511+0000 7f9f57fff700 1 -- 172.21.15.40:0/3223971419 <== mon.1 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f5c011d20 con 0x7f9f600b45d0 2023-06-22T10:53:49.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.512+0000 7f9f675ff700 1 -- 172.21.15.40:0/3223971419 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f600b45d0 msgr2=0x7f9f600b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:49.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.512+0000 7f9f675ff700 1 --2- 172.21.15.40:0/3223971419 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f600b45d0 0x7f9f600b49a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c009840 tx=0x7f9f5c009b50 comp rx=0 tx=0).stop 2023-06-22T10:53:49.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.512+0000 7f9f675ff700 1 -- 172.21.15.40:0/3223971419 shutdown_connections 2023-06-22T10:53:49.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.512+0000 7f9f675ff700 1 --2- 172.21.15.40:0/3223971419 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f600b45d0 0x7f9f600b49a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:49.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.512+0000 7f9f675ff700 1 --2- 172.21.15.40:0/3223971419 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9f600d2130 0x7f9f600cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:49.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.512+0000 7f9f675ff700 1 -- 172.21.15.40:0/3223971419 >> 172.21.15.40:0/3223971419 conn(0x7f9f600cf5d0 msgr2=0x7f9f600cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:49.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.512+0000 7f9f675ff700 1 -- 172.21.15.40:0/3223971419 shutdown_connections 2023-06-22T10:53:49.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.512+0000 7f9f675ff700 1 -- 172.21.15.40:0/3223971419 wait complete. 2023-06-22T10:53:49.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.514+0000 7f9f675ff700 1 Processor -- start 2023-06-22T10:53:49.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.514+0000 7f9f675ff700 1 -- start start 2023-06-22T10:53:49.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.515+0000 7f9f675ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f600b45d0 0x7f9f60154130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:49.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.515+0000 7f9f675ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f600cd6e0 0x7f9f601f5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:49.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.515+0000 7f9f675ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9f600d2130 0x7f9f601f5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:49.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.515+0000 7f9f675ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6015e010 con 0x7f9f600b45d0 2023-06-22T10:53:49.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.515+0000 7f9f675ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f601f3300 con 0x7f9f600cd6e0 2023-06-22T10:53:49.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.515+0000 7f9f675ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6015dd30 con 0x7f9f600d2130 2023-06-22T10:53:49.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.515+0000 7f9f6539b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f600b45d0 0x7f9f60154130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:49.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.515+0000 7f9f6539b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f600b45d0 0x7f9f60154130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37626/0 (socket says 172.21.15.40:37626) 2023-06-22T10:53:49.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.515+0000 7f9f6539b700 1 -- 172.21.15.40:0/622475683 learned_addr learned my addr 172.21.15.40:0/622475683 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:49.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.516+0000 7f9f6539b700 1 -- 172.21.15.40:0/622475683 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9f600d2130 msgr2=0x7f9f601f5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:49.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.516+0000 7f9f6539b700 1 --2- 172.21.15.40:0/622475683 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9f600d2130 0x7f9f601f5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:49.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.516+0000 7f9f6539b700 1 -- 172.21.15.40:0/622475683 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f600cd6e0 msgr2=0x7f9f601f5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:49.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.516+0000 7f9f6539b700 1 --2- 172.21.15.40:0/622475683 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f600cd6e0 0x7f9f601f5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:49.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.516+0000 7f9f6539b700 1 -- 172.21.15.40:0/622475683 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f5c0094a0 con 0x7f9f600b45d0 2023-06-22T10:53:49.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.516+0000 7f9f6539b700 1 --2- 172.21.15.40:0/622475683 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f600b45d0 0x7f9f60154130 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c000c00 tx=0x7f9f5c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:49.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.516+0000 7f9f55ffb700 1 -- 172.21.15.40:0/622475683 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f5c0036a0 con 0x7f9f600b45d0 2023-06-22T10:53:49.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.516+0000 7f9f55ffb700 1 -- 172.21.15.40:0/622475683 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f5c01e070 con 0x7f9f600b45d0 2023-06-22T10:53:49.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.516+0000 7f9f55ffb700 1 -- 172.21.15.40:0/622475683 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f5c003a60 con 0x7f9f600b45d0 2023-06-22T10:53:49.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.516+0000 7f9f675ff700 1 -- 172.21.15.40:0/622475683 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f601f2cb0 con 0x7f9f600b45d0 2023-06-22T10:53:49.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.516+0000 7f9f675ff700 1 -- 172.21.15.40:0/622475683 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f60154670 con 0x7f9f600b45d0 2023-06-22T10:53:49.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.517+0000 7f9f675ff700 1 -- 172.21.15.40:0/622475683 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f60067580 con 0x7f9f600b45d0 2023-06-22T10:53:49.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.518+0000 7f9f55ffb700 1 -- 172.21.15.40:0/622475683 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9f5c003bc0 con 0x7f9f600b45d0 2023-06-22T10:53:49.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.519+0000 7f9f55ffb700 1 --2- 172.21.15.40:0/622475683 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f9f4406ace0 0x7f9f4406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:49.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.519+0000 7f9f55ffb700 1 -- 172.21.15.40:0/622475683 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9f5c08a690 con 0x7f9f600b45d0 2023-06-22T10:53:49.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.519+0000 7f9f64b9a700 1 --2- 172.21.15.40:0/622475683 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f9f4406ace0 0x7f9f4406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:49.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.520+0000 7f9f64b9a700 1 --2- 172.21.15.40:0/622475683 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f9f4406ace0 0x7f9f4406d190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9f50006b20 tx=0x7f9f50006ab0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:49.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.523+0000 7f9f55ffb700 1 -- 172.21.15.40:0/622475683 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9f5c0554e0 con 0x7f9f600b45d0 2023-06-22T10:53:49.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.732+0000 7f9f675ff700 1 -- 172.21.15.40:0/622475683 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9f600cd4c0 con 0x7f9f600b45d0 2023-06-22T10:53:49.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.733+0000 7f9f55ffb700 1 -- 172.21.15.40:0/622475683 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9f5c058b00 con 0x7f9f600b45d0 2023-06-22T10:53:49.737 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-06-22T10:53:49.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.735+0000 7f9f675ff700 1 -- 172.21.15.40:0/622475683 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f9f4406ace0 msgr2=0x7f9f4406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:49.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.735+0000 7f9f675ff700 1 --2- 172.21.15.40:0/622475683 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f9f4406ace0 0x7f9f4406d190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9f50006b20 tx=0x7f9f50006ab0 comp rx=0 tx=0).stop 2023-06-22T10:53:49.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.735+0000 7f9f675ff700 1 -- 172.21.15.40:0/622475683 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f600b45d0 msgr2=0x7f9f60154130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:49.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.735+0000 7f9f675ff700 1 --2- 172.21.15.40:0/622475683 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f600b45d0 0x7f9f60154130 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c000c00 tx=0x7f9f5c004750 comp rx=0 tx=0).stop 2023-06-22T10:53:49.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.735+0000 7f9f675ff700 1 -- 172.21.15.40:0/622475683 shutdown_connections 2023-06-22T10:53:49.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.735+0000 7f9f675ff700 1 --2- 172.21.15.40:0/622475683 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f9f4406ace0 0x7f9f4406d190 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:49.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.735+0000 7f9f675ff700 1 --2- 172.21.15.40:0/622475683 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9f600d2130 0x7f9f601f5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:49.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.735+0000 7f9f675ff700 1 --2- 172.21.15.40:0/622475683 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f600b45d0 0x7f9f60154130 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:49.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.735+0000 7f9f675ff700 1 --2- 172.21.15.40:0/622475683 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f600cd6e0 0x7f9f601f5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:49.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.735+0000 7f9f675ff700 1 -- 172.21.15.40:0/622475683 >> 172.21.15.40:0/622475683 conn(0x7f9f600cf5d0 msgr2=0x7f9f600b2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:49.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.735+0000 7f9f675ff700 1 -- 172.21.15.40:0/622475683 shutdown_connections 2023-06-22T10:53:49.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.735+0000 7f9f675ff700 1 -- 172.21.15.40:0/622475683 wait complete. 2023-06-22T10:53:49.756 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-22T10:53:49.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.957+0000 7f4028bff700 1 Processor -- start 2023-06-22T10:53:49.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.957+0000 7f4028bff700 1 -- start start 2023-06-22T10:53:49.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.958+0000 7f4028bff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f40240b45d0 0x7f40240b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:49.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.958+0000 7f4028bff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f40240b59a0 0x7f40240b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:49.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.958+0000 7f4028bff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40240d1be0 con 0x7f40240d2130 2023-06-22T10:53:49.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.958+0000 7f4028bff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40240d17f0 con 0x7f40240b45d0 2023-06-22T10:53:49.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.958+0000 7f4028bff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40240d1360 con 0x7f40240b59a0 2023-06-22T10:53:49.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.959+0000 7f402259c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f40240b45d0 0x7f40240b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:49.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.959+0000 7f402259c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f40240b45d0 0x7f40240b49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37628/0 (socket says 172.21.15.40:37628) 2023-06-22T10:53:49.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.959+0000 7f402259c700 1 -- 172.21.15.40:0/152787712 learned_addr learned my addr 172.21.15.40:0/152787712 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:49.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.959+0000 7f4022d9d700 1 --2- 172.21.15.40:0/152787712 >> v2:172.21.15.45:3300/0 conn(0x7f40240b59a0 0x7f40240b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:49.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.959+0000 7f402259c700 1 -- 172.21.15.40:0/152787712 >> v2:172.21.15.45:3300/0 conn(0x7f40240b59a0 msgr2=0x7f40240b5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:49.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.959+0000 7f402259c700 1 --2- 172.21.15.40:0/152787712 >> v2:172.21.15.45:3300/0 conn(0x7f40240b59a0 0x7f40240b5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:49.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.959+0000 7f402259c700 1 -- 172.21.15.40:0/152787712 >> v1:172.21.15.40:6789/0 conn(0x7f40240d2130 legacy=0x7f40240cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:49.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.959+0000 7f402259c700 1 -- 172.21.15.40:0/152787712 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40240b4ee0 con 0x7f40240b45d0 2023-06-22T10:53:49.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.959+0000 7f4022d9d700 1 --2- 172.21.15.40:0/152787712 >> v2:172.21.15.45:3300/0 conn(0x7f40240b59a0 0x7f40240b5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:53:49.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.959+0000 7f402259c700 1 --2- 172.21.15.40:0/152787712 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40240b45d0 0x7f40240b49a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f40240b1aa0 tx=0x7f4014009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57096754f899bd72 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:49.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.960+0000 7f4021d9b700 1 -- 172.21.15.40:0/152787712 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f401400b870 con 0x7f40240b45d0 2023-06-22T10:53:49.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.960+0000 7f4021d9b700 1 -- 172.21.15.40:0/152787712 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f401400b9d0 con 0x7f40240b45d0 2023-06-22T10:53:49.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.960+0000 7f4021d9b700 1 -- 172.21.15.40:0/152787712 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f401400bd60 con 0x7f40240b45d0 2023-06-22T10:53:49.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.960+0000 7f4028bff700 1 -- 172.21.15.40:0/152787712 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40240b45d0 msgr2=0x7f40240b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:49.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.960+0000 7f4028bff700 1 --2- 172.21.15.40:0/152787712 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40240b45d0 0x7f40240b49a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f40240b1aa0 tx=0x7f4014009bd0 comp rx=0 tx=0).stop 2023-06-22T10:53:49.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.960+0000 7f4028bff700 1 -- 172.21.15.40:0/152787712 shutdown_connections 2023-06-22T10:53:49.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.960+0000 7f4028bff700 1 --2- 172.21.15.40:0/152787712 >> v2:172.21.15.45:3300/0 conn(0x7f40240b59a0 0x7f40240b5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:49.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.960+0000 7f4028bff700 1 --2- 172.21.15.40:0/152787712 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40240b45d0 0x7f40240b49a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:49.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.960+0000 7f4028bff700 1 -- 172.21.15.40:0/152787712 >> 172.21.15.40:0/152787712 conn(0x7f40240cf5d0 msgr2=0x7f40240cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:49.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.960+0000 7f4028bff700 1 -- 172.21.15.40:0/152787712 shutdown_connections 2023-06-22T10:53:49.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.960+0000 7f4028bff700 1 -- 172.21.15.40:0/152787712 wait complete. 2023-06-22T10:53:49.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.962+0000 7f4028bff700 1 Processor -- start 2023-06-22T10:53:49.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.962+0000 7f4028bff700 1 -- start start 2023-06-22T10:53:49.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.963+0000 7f4028bff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f40240b45d0 0x7f40240a9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:49.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.963+0000 7f4028bff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40240b59a0 0x7f4024148660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:49.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.963+0000 7f4028bff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40240d2130 0x7f4024148ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:49.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.963+0000 7f4028bff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f402415f5d0 con 0x7f40240b59a0 2023-06-22T10:53:49.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.963+0000 7f4028bff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40240cac10 con 0x7f40240d2130 2023-06-22T10:53:49.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.963+0000 7f4028bff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40240cbc20 con 0x7f40240b45d0 2023-06-22T10:53:49.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.964+0000 7f401bfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40240b59a0 0x7f4024148660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:49.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.964+0000 7f402259c700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f40240b45d0 0x7f40240a9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:49.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.964+0000 7f401bfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40240b59a0 0x7f4024148660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37640/0 (socket says 172.21.15.40:37640) 2023-06-22T10:53:49.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.964+0000 7f401bfff700 1 -- 172.21.15.40:0/137363137 learned_addr learned my addr 172.21.15.40:0/137363137 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:49.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.964+0000 7f4022d9d700 1 --2- 172.21.15.40:0/137363137 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40240d2130 0x7f4024148ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:49.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.964+0000 7f401bfff700 1 -- 172.21.15.40:0/137363137 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f40240b45d0 msgr2=0x7f40240a9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:49.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.964+0000 7f401bfff700 1 --2- 172.21.15.40:0/137363137 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f40240b45d0 0x7f40240a9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:49.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.964+0000 7f401bfff700 1 -- 172.21.15.40:0/137363137 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40240d2130 msgr2=0x7f4024148ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:49.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.964+0000 7f401bfff700 1 --2- 172.21.15.40:0/137363137 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40240d2130 0x7f4024148ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:49.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.964+0000 7f401bfff700 1 -- 172.21.15.40:0/137363137 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4014009550 con 0x7f40240b59a0 2023-06-22T10:53:49.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.964+0000 7f401bfff700 1 --2- 172.21.15.40:0/137363137 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40240b59a0 0x7f4024148660 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f400c00c4e0 tx=0x7f400c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:49.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.965+0000 7f401affd700 1 -- 172.21.15.40:0/137363137 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400c0052d0 con 0x7f40240b59a0 2023-06-22T10:53:49.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.965+0000 7f401affd700 1 -- 172.21.15.40:0/137363137 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f400c005430 con 0x7f40240b59a0 2023-06-22T10:53:49.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.965+0000 7f401affd700 1 -- 172.21.15.40:0/137363137 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400c0038c0 con 0x7f40240b59a0 2023-06-22T10:53:49.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.965+0000 7f4028bff700 1 -- 172.21.15.40:0/137363137 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40240cae60 con 0x7f40240b59a0 2023-06-22T10:53:49.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.965+0000 7f4028bff700 1 -- 172.21.15.40:0/137363137 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40240cb420 con 0x7f40240b59a0 2023-06-22T10:53:49.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.966+0000 7f4028bff700 1 -- 172.21.15.40:0/137363137 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4024067580 con 0x7f40240b59a0 2023-06-22T10:53:49.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.967+0000 7f401affd700 1 -- 172.21.15.40:0/137363137 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f400c003a20 con 0x7f40240b59a0 2023-06-22T10:53:49.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.968+0000 7f401affd700 1 --2- 172.21.15.40:0/137363137 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f400406ace0 0x7f400406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:49.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.968+0000 7f401affd700 1 -- 172.21.15.40:0/137363137 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f400c088ae0 con 0x7f40240b59a0 2023-06-22T10:53:49.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.968+0000 7f402259c700 1 --2- 172.21.15.40:0/137363137 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f400406ace0 0x7f400406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:49.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.969+0000 7f402259c700 1 --2- 172.21.15.40:0/137363137 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f400406ace0 0x7f400406d190 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4014000c00 tx=0x7f4014008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:49.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:49.972+0000 7f401affd700 1 -- 172.21.15.40:0/137363137 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f400c053890 con 0x7f40240b59a0 2023-06-22T10:53:50.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.180+0000 7f4028bff700 1 -- 172.21.15.40:0/137363137 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f40240cd860 con 0x7f40240b59a0 2023-06-22T10:53:50.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.180+0000 7f401affd700 1 -- 172.21.15.40:0/137363137 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f400c056eb0 con 0x7f40240b59a0 2023-06-22T10:53:50.184 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-06-22T10:53:50.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.183+0000 7f4028bff700 1 -- 172.21.15.40:0/137363137 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f400406ace0 msgr2=0x7f400406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:50.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.183+0000 7f4028bff700 1 --2- 172.21.15.40:0/137363137 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f400406ace0 0x7f400406d190 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4014000c00 tx=0x7f4014008030 comp rx=0 tx=0).stop 2023-06-22T10:53:50.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.183+0000 7f4028bff700 1 -- 172.21.15.40:0/137363137 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40240b59a0 msgr2=0x7f4024148660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:50.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.183+0000 7f4028bff700 1 --2- 172.21.15.40:0/137363137 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40240b59a0 0x7f4024148660 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f400c00c4e0 tx=0x7f400c00c7f0 comp rx=0 tx=0).stop 2023-06-22T10:53:50.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.183+0000 7f4028bff700 1 -- 172.21.15.40:0/137363137 shutdown_connections 2023-06-22T10:53:50.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.183+0000 7f4028bff700 1 --2- 172.21.15.40:0/137363137 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f400406ace0 0x7f400406d190 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:50.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.183+0000 7f4028bff700 1 --2- 172.21.15.40:0/137363137 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f40240b45d0 0x7f40240a9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:50.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.183+0000 7f4028bff700 1 --2- 172.21.15.40:0/137363137 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40240d2130 0x7f4024148ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:50.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.183+0000 7f4028bff700 1 --2- 172.21.15.40:0/137363137 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40240b59a0 0x7f4024148660 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:50.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.183+0000 7f4028bff700 1 -- 172.21.15.40:0/137363137 >> 172.21.15.40:0/137363137 conn(0x7f40240cf5d0 msgr2=0x7f402415b910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:50.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.183+0000 7f4028bff700 1 -- 172.21.15.40:0/137363137 shutdown_connections 2023-06-22T10:53:50.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.183+0000 7f4028bff700 1 -- 172.21.15.40:0/137363137 wait complete. 2023-06-22T10:53:50.208 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-22T10:53:50.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.406+0000 7f224c1ff700 1 Processor -- start 2023-06-22T10:53:50.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.407+0000 7f224c1ff700 1 -- start start 2023-06-22T10:53:50.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.408+0000 7f224c1ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f22440d2830 0x7f22440b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:50.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.408+0000 7f224c1ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f22440b4c60 0x7f22440d0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:50.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.408+0000 7f224c1ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22440b50a0 con 0x7f224415c720 2023-06-22T10:53:50.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.408+0000 7f224c1ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2244160d60 con 0x7f22440b4c60 2023-06-22T10:53:50.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.408+0000 7f224c1ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22440b2130 con 0x7f22440d2830 2023-06-22T10:53:50.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.408+0000 7f224a79c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f22440b4c60 0x7f22440d0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:50.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.408+0000 7f224a79c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f22440b4c60 0x7f22440d0d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37644/0 (socket says 172.21.15.40:37644) 2023-06-22T10:53:50.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.408+0000 7f224a79c700 1 -- 172.21.15.40:0/365062829 learned_addr learned my addr 172.21.15.40:0/365062829 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:50.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.408+0000 7f224979a700 1 --2- 172.21.15.40:0/365062829 >> v2:172.21.15.45:3300/0 conn(0x7f22440d2830 0x7f22440b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:50.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.408+0000 7f224a79c700 1 -- 172.21.15.40:0/365062829 >> v2:172.21.15.45:3300/0 conn(0x7f22440d2830 msgr2=0x7f22440b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:50.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.408+0000 7f224a79c700 1 --2- 172.21.15.40:0/365062829 >> v2:172.21.15.45:3300/0 conn(0x7f22440d2830 0x7f22440b4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:50.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.408+0000 7f224a79c700 1 -- 172.21.15.40:0/365062829 >> v1:172.21.15.45:6789/0 conn(0x7f224415c720 legacy=0x7f22440b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:50.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.409+0000 7f224a79c700 1 -- 172.21.15.40:0/365062829 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2244161180 con 0x7f22440b4c60 2023-06-22T10:53:50.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.409+0000 7f224a79c700 1 --2- 172.21.15.40:0/365062829 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22440b4c60 0x7f22440d0d00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f223c009e50 tx=0x7f223c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=851b05e4cdd5f5a0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:50.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.409+0000 7f2248f99700 1 -- 172.21.15.40:0/365062829 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223c00e070 con 0x7f22440b4c60 2023-06-22T10:53:50.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.409+0000 7f2248f99700 1 -- 172.21.15.40:0/365062829 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f223c00b980 con 0x7f22440b4c60 2023-06-22T10:53:50.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.409+0000 7f2248f99700 1 -- 172.21.15.40:0/365062829 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223c00bd30 con 0x7f22440b4c60 2023-06-22T10:53:50.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.410+0000 7f224c1ff700 1 -- 172.21.15.40:0/365062829 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22440b4c60 msgr2=0x7f22440d0d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:50.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.410+0000 7f224c1ff700 1 --2- 172.21.15.40:0/365062829 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22440b4c60 0x7f22440d0d00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f223c009e50 tx=0x7f223c00b330 comp rx=0 tx=0).stop 2023-06-22T10:53:50.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.410+0000 7f224c1ff700 1 -- 172.21.15.40:0/365062829 shutdown_connections 2023-06-22T10:53:50.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.410+0000 7f224c1ff700 1 --2- 172.21.15.40:0/365062829 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22440b4c60 0x7f22440d0d00 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:50.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.410+0000 7f224c1ff700 1 --2- 172.21.15.40:0/365062829 >> v2:172.21.15.45:3300/0 conn(0x7f22440d2830 0x7f22440b4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:50.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.410+0000 7f224c1ff700 1 -- 172.21.15.40:0/365062829 >> 172.21.15.40:0/365062829 conn(0x7f22440cf720 msgr2=0x7f22440cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:50.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.410+0000 7f224c1ff700 1 -- 172.21.15.40:0/365062829 shutdown_connections 2023-06-22T10:53:50.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.410+0000 7f224c1ff700 1 -- 172.21.15.40:0/365062829 wait complete. 2023-06-22T10:53:50.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.411+0000 7f224c1ff700 1 Processor -- start 2023-06-22T10:53:50.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.412+0000 7f224c1ff700 1 -- start start 2023-06-22T10:53:50.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.413+0000 7f224c1ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22440b4c60 0x7f224415f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:50.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.413+0000 7f224c1ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f22440d2830 0x7f224414c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:50.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.413+0000 7f224c1ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f224415c720 0x7f22440c9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:50.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.413+0000 7f224c1ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22440b89c0 con 0x7f22440b4c60 2023-06-22T10:53:50.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.413+0000 7f224c1ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f224415f660 con 0x7f224415c720 2023-06-22T10:53:50.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.413+0000 7f224c1ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f224415e680 con 0x7f22440d2830 2023-06-22T10:53:50.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.413+0000 7f2249f9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22440b4c60 0x7f224415f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:50.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.413+0000 7f2249f9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22440b4c60 0x7f224415f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37648/0 (socket says 172.21.15.40:37648) 2023-06-22T10:53:50.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.413+0000 7f2249f9b700 1 -- 172.21.15.40:0/4186521118 learned_addr learned my addr 172.21.15.40:0/4186521118 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:50.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.413+0000 7f224a79c700 1 --2- 172.21.15.40:0/4186521118 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f224415c720 0x7f22440c9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:50.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.413+0000 7f224979a700 1 --2- 172.21.15.40:0/4186521118 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f22440d2830 0x7f224414c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:50.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.413+0000 7f2249f9b700 1 -- 172.21.15.40:0/4186521118 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f22440d2830 msgr2=0x7f224414c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:50.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.413+0000 7f2249f9b700 1 --2- 172.21.15.40:0/4186521118 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f22440d2830 0x7f224414c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:50.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.413+0000 7f2249f9b700 1 -- 172.21.15.40:0/4186521118 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f224415c720 msgr2=0x7f22440c9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:50.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.413+0000 7f2249f9b700 1 --2- 172.21.15.40:0/4186521118 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f224415c720 0x7f22440c9d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:50.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.413+0000 7f2249f9b700 1 -- 172.21.15.40:0/4186521118 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f223c009b30 con 0x7f22440b4c60 2023-06-22T10:53:50.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.413+0000 7f224979a700 1 --2- 172.21.15.40:0/4186521118 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f22440d2830 0x7f224414c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-22T10:53:50.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.414+0000 7f2249f9b700 1 --2- 172.21.15.40:0/4186521118 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22440b4c60 0x7f224415f120 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f224000c490 tx=0x7f224000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:50.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.414+0000 7f223a7fc700 1 -- 172.21.15.40:0/4186521118 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22400052d0 con 0x7f22440b4c60 2023-06-22T10:53:50.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.414+0000 7f223a7fc700 1 -- 172.21.15.40:0/4186521118 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2240005450 con 0x7f22440b4c60 2023-06-22T10:53:50.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.414+0000 7f224c1ff700 1 -- 172.21.15.40:0/4186521118 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22440ccbd0 con 0x7f22440b4c60 2023-06-22T10:53:50.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.414+0000 7f223a7fc700 1 -- 172.21.15.40:0/4186521118 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2240006aa0 con 0x7f22440b4c60 2023-06-22T10:53:50.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.414+0000 7f224c1ff700 1 -- 172.21.15.40:0/4186521118 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f224415e920 con 0x7f22440b4c60 2023-06-22T10:53:50.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.415+0000 7f224c1ff700 1 -- 172.21.15.40:0/4186521118 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f224415beb0 con 0x7f22440b4c60 2023-06-22T10:53:50.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.416+0000 7f223a7fc700 1 -- 172.21.15.40:0/4186521118 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2240003680 con 0x7f22440b4c60 2023-06-22T10:53:50.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.418+0000 7f223a7fc700 1 --2- 172.21.15.40:0/4186521118 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f222806ace0 0x7f222806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:50.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.418+0000 7f223a7fc700 1 -- 172.21.15.40:0/4186521118 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2240088b10 con 0x7f22440b4c60 2023-06-22T10:53:50.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.418+0000 7f224979a700 1 --2- 172.21.15.40:0/4186521118 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f222806ace0 0x7f222806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:50.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.418+0000 7f224979a700 1 --2- 172.21.15.40:0/4186521118 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f222806ace0 0x7f222806d190 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f22441f5800 tx=0x7f2234008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:50.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.422+0000 7f223a7fc700 1 -- 172.21.15.40:0/4186521118 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2240053830 con 0x7f22440b4c60 2023-06-22T10:53:50.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.643+0000 7f224c1ff700 1 -- 172.21.15.40:0/4186521118 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2244067580 con 0x7f22440b4c60 2023-06-22T10:53:50.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.643+0000 7f223a7fc700 1 -- 172.21.15.40:0/4186521118 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2240056e50 con 0x7f22440b4c60 2023-06-22T10:53:50.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.645+0000 7f224c1ff700 1 -- 172.21.15.40:0/4186521118 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f222806ace0 msgr2=0x7f222806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:50.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.646+0000 7f224c1ff700 1 --2- 172.21.15.40:0/4186521118 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f222806ace0 0x7f222806d190 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f22441f5800 tx=0x7f2234008040 comp rx=0 tx=0).stop 2023-06-22T10:53:50.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.646+0000 7f224c1ff700 1 -- 172.21.15.40:0/4186521118 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22440b4c60 msgr2=0x7f224415f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:50.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.646+0000 7f224c1ff700 1 --2- 172.21.15.40:0/4186521118 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22440b4c60 0x7f224415f120 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f224000c490 tx=0x7f224000c850 comp rx=0 tx=0).stop 2023-06-22T10:53:50.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.646+0000 7f224c1ff700 1 -- 172.21.15.40:0/4186521118 shutdown_connections 2023-06-22T10:53:50.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.646+0000 7f224c1ff700 1 --2- 172.21.15.40:0/4186521118 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f222806ace0 0x7f222806d190 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:50.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.646+0000 7f224c1ff700 1 --2- 172.21.15.40:0/4186521118 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f224415c720 0x7f22440c9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:50.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.646+0000 7f224c1ff700 1 --2- 172.21.15.40:0/4186521118 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22440b4c60 0x7f224415f120 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:50.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.646+0000 7f224c1ff700 1 --2- 172.21.15.40:0/4186521118 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f22440d2830 0x7f224414c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:50.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.646+0000 7f224c1ff700 1 -- 172.21.15.40:0/4186521118 >> 172.21.15.40:0/4186521118 conn(0x7f22440cf720 msgr2=0x7f22440d1570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:50.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.646+0000 7f224c1ff700 1 -- 172.21.15.40:0/4186521118 shutdown_connections 2023-06-22T10:53:50.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:50.646+0000 7f224c1ff700 1 -- 172.21.15.40:0/4186521118 wait complete. 2023-06-22T10:53:50.651 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2023-06-22T10:53:50.667 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi040.front.sepia.ceph.com... 2023-06-22T10:53:50.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:53:50.668 DEBUG:teuthology.orchestra.run.smithi040:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-06-22T10:53:50.736 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi040.stderr:ceph-fuse[117810]: fuse finished with error 0 and tester_r 0 2023-06-22T10:53:50.739 INFO:teuthology.orchestra.run:waiting for 300 2023-06-22T10:53:54.648 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T10:53:54.653 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T10:53:56.841 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi040.front.sepia.ceph.com 2023-06-22T10:53:56.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:53:56.842 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-06-22T10:53:56.913 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-22T10:53:57.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.116+0000 7fc3089ff700 1 Processor -- start 2023-06-22T10:53:57.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.117+0000 7fc3089ff700 1 -- start start 2023-06-22T10:53:57.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.118+0000 7fc3089ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc30415c720 0x7fc3040b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:57.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.118+0000 7fc3089ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fc3040d2830 0x7fc3040b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:57.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.118+0000 7fc3089ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3040b2130 con 0x7fc3040b4c60 2023-06-22T10:53:57.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.118+0000 7fc3089ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc304160d60 con 0x7fc30415c720 2023-06-22T10:53:57.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.118+0000 7fc3089ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3040b50e0 con 0x7fc3040d2830 2023-06-22T10:53:57.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.118+0000 7fc301d9b700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fc3040d2830 0x7fc3040b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:57.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.118+0000 7fc30259c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc30415c720 0x7fc3040b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:57.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.118+0000 7fc30259c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc30415c720 0x7fc3040b1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.40:48196/0 (socket says 172.21.15.40:48196) 2023-06-22T10:53:57.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.118+0000 7fc30259c700 1 -- 172.21.15.40:0/3326502328 learned_addr learned my addr 172.21.15.40:0/3326502328 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:57.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.119+0000 7fc30259c700 1 -- 172.21.15.40:0/3326502328 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fc3040d2830 msgr2=0x7fc3040b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:57.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.119+0000 7fc30259c700 1 --2- 172.21.15.40:0/3326502328 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fc3040d2830 0x7fc3040b4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:57.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.119+0000 7fc30259c700 1 -- 172.21.15.40:0/3326502328 >> v1:172.21.15.45:6789/0 conn(0x7fc3040b4c60 legacy=0x7fc30406b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:57.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.119+0000 7fc30259c700 1 -- 172.21.15.40:0/3326502328 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc304161180 con 0x7fc30415c720 2023-06-22T10:53:57.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.119+0000 7fc30259c700 1 --2- 172.21.15.40:0/3326502328 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc30415c720 0x7fc3040b1870 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc2f40098f0 tx=0x7fc2f4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63d10b695345b5fb server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:57.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.119+0000 7fc30159a700 1 -- 172.21.15.40:0/3326502328 <== mon.1 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f4011830 con 0x7fc30415c720 2023-06-22T10:53:57.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.119+0000 7fc30159a700 1 -- 172.21.15.40:0/3326502328 <== mon.1 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f4011990 con 0x7fc30415c720 2023-06-22T10:53:57.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.119+0000 7fc30159a700 1 -- 172.21.15.40:0/3326502328 <== mon.1 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f4011d20 con 0x7fc30415c720 2023-06-22T10:53:57.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.120+0000 7fc3089ff700 1 -- 172.21.15.40:0/3326502328 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc30415c720 msgr2=0x7fc3040b1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:57.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.120+0000 7fc3089ff700 1 --2- 172.21.15.40:0/3326502328 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc30415c720 0x7fc3040b1870 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc2f40098f0 tx=0x7fc2f4009c00 comp rx=0 tx=0).stop 2023-06-22T10:53:57.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.120+0000 7fc3089ff700 1 -- 172.21.15.40:0/3326502328 shutdown_connections 2023-06-22T10:53:57.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.120+0000 7fc3089ff700 1 --2- 172.21.15.40:0/3326502328 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc30415c720 0x7fc3040b1870 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:57.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.120+0000 7fc3089ff700 1 --2- 172.21.15.40:0/3326502328 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fc3040d2830 0x7fc3040b4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:57.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.120+0000 7fc3089ff700 1 -- 172.21.15.40:0/3326502328 >> 172.21.15.40:0/3326502328 conn(0x7fc3040cf720 msgr2=0x7fc3040cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:57.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.120+0000 7fc3089ff700 1 -- 172.21.15.40:0/3326502328 shutdown_connections 2023-06-22T10:53:57.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.120+0000 7fc3089ff700 1 -- 172.21.15.40:0/3326502328 wait complete. 2023-06-22T10:53:57.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.122+0000 7fc3089ff700 1 Processor -- start 2023-06-22T10:53:57.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.122+0000 7fc3089ff700 1 -- start start 2023-06-22T10:53:57.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.123+0000 7fc3089ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3040b4c60 0x7fc3040c7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:57.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.123+0000 7fc3089ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fc3040d2830 0x7fc3041f29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:57.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.123+0000 7fc3089ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc30415c720 0x7fc304156b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:57.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.123+0000 7fc3089ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3041f1e50 con 0x7fc30415c720 2023-06-22T10:53:57.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.123+0000 7fc3089ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc304157760 con 0x7fc3040b4c60 2023-06-22T10:53:57.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.123+0000 7fc3089ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3040ca2a0 con 0x7fc3040d2830 2023-06-22T10:53:57.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.123+0000 7fc302d9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc30415c720 0x7fc304156b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:57.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.123+0000 7fc302d9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc30415c720 0x7fc304156b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37650/0 (socket says 172.21.15.40:37650) 2023-06-22T10:53:57.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.123+0000 7fc302d9d700 1 -- 172.21.15.40:0/518151188 learned_addr learned my addr 172.21.15.40:0/518151188 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:57.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.124+0000 7fc301d9b700 1 --2- 172.21.15.40:0/518151188 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fc3040d2830 0x7fc3041f29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:57.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.124+0000 7fc30259c700 1 --2- 172.21.15.40:0/518151188 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3040b4c60 0x7fc3040c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:57.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.124+0000 7fc302d9d700 1 -- 172.21.15.40:0/518151188 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fc3040d2830 msgr2=0x7fc3041f29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:57.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.124+0000 7fc302d9d700 1 --2- 172.21.15.40:0/518151188 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fc3040d2830 0x7fc3041f29b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:57.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.124+0000 7fc302d9d700 1 -- 172.21.15.40:0/518151188 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3040b4c60 msgr2=0x7fc3040c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:57.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.124+0000 7fc302d9d700 1 --2- 172.21.15.40:0/518151188 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3040b4c60 0x7fc3040c7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:57.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.124+0000 7fc302d9d700 1 -- 172.21.15.40:0/518151188 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f4009550 con 0x7fc30415c720 2023-06-22T10:53:57.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.124+0000 7fc302d9d700 1 --2- 172.21.15.40:0/518151188 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc30415c720 0x7fc304156b00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc00cb50 tx=0x7fc2fc00ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:57.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.124+0000 7fc2f2ffd700 1 -- 172.21.15.40:0/518151188 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2fc003c00 con 0x7fc30415c720 2023-06-22T10:53:57.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.124+0000 7fc2f2ffd700 1 -- 172.21.15.40:0/518151188 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2fc003d60 con 0x7fc30415c720 2023-06-22T10:53:57.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.124+0000 7fc2f2ffd700 1 -- 172.21.15.40:0/518151188 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2fc00aa20 con 0x7fc30415c720 2023-06-22T10:53:57.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.124+0000 7fc3089ff700 1 -- 172.21.15.40:0/518151188 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3041f2ef0 con 0x7fc30415c720 2023-06-22T10:53:57.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.125+0000 7fc3089ff700 1 -- 172.21.15.40:0/518151188 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3040c6fc0 con 0x7fc30415c720 2023-06-22T10:53:57.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.126+0000 7fc3089ff700 1 -- 172.21.15.40:0/518151188 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3040ca430 con 0x7fc30415c720 2023-06-22T10:53:57.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.127+0000 7fc2f2ffd700 1 -- 172.21.15.40:0/518151188 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc2fc00ab80 con 0x7fc30415c720 2023-06-22T10:53:57.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.128+0000 7fc2f2ffd700 1 --2- 172.21.15.40:0/518151188 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fc2e406ace0 0x7fc2e406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:57.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.128+0000 7fc2f2ffd700 1 -- 172.21.15.40:0/518151188 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc2fc089820 con 0x7fc30415c720 2023-06-22T10:53:57.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.128+0000 7fc30259c700 1 --2- 172.21.15.40:0/518151188 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fc2e406ace0 0x7fc2e406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:57.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.129+0000 7fc30259c700 1 --2- 172.21.15.40:0/518151188 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fc2e406ace0 0x7fc2e406d190 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc2f4009c40 tx=0x7fc2f4008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:57.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.132+0000 7fc2f2ffd700 1 -- 172.21.15.40:0/518151188 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc2fc054540 con 0x7fc30415c720 2023-06-22T10:53:57.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.341+0000 7fc3089ff700 1 -- 172.21.15.40:0/518151188 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc304067580 con 0x7fc30415c720 2023-06-22T10:53:57.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.342+0000 7fc2f2ffd700 1 -- 172.21.15.40:0/518151188 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20036 (secure 0 0 0) 0x7fc2fc057b60 con 0x7fc30415c720 2023-06-22T10:53:57.347 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:53:57.347 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":28,"fsid":"475560bc-1a7c-4a75-b3b6-6fc6b20bdc52","created":"2023-06-22T10:53:03.784568+0000","modified":"2023-06-22T10:53:36.483308+0000","last_up_change":"2023-06-22T10:53:17.830348+0000","last_in_change":"2023-06-22T10:53:07.329974+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-22T10:53:17.182228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-22T10:53:23.874432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-22T10:53:29.812963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-22T10:53:30.404021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-22T10:53:33.982289+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"918db6b4-053a-46ba-976d-6e1a0104017f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6809","nonce":2400162888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6811","nonce":2400162888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6815","nonce":2400162888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6813","nonce":2400162888}]},"public_addr":"172.21.15.40:6809/2400162888","cluster_addr":"172.21.15.40:6811/2400162888","heartbeat_back_addr":"172.21.15.40:6815/2400162888","heartbeat_front_addr":"172.21.15.40:6813/2400162888","state":["exists","up"]},{"osd":1,"uuid":"0c146e2b-1725-4dae-9b5c-38795943b9d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6801","nonce":230885800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6803","nonce":230885800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6807","nonce":230885800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6805","nonce":230885800}]},"public_addr":"172.21.15.40:6801/230885800","cluster_addr":"172.21.15.40:6803/230885800","heartbeat_back_addr":"172.21.15.40:6807/230885800","heartbeat_front_addr":"172.21.15.40:6805/230885800","state":["exists","up"]},{"osd":2,"uuid":"0b3727fd-f281-46d5-a675-86c8c5ab269e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6817","nonce":2681404929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6819","nonce":2681404929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6823","nonce":2681404929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6821","nonce":2681404929}]},"public_addr":"172.21.15.40:6817/2681404929","cluster_addr":"172.21.15.40:6819/2681404929","heartbeat_back_addr":"172.21.15.40:6823/2681404929","heartbeat_front_addr":"172.21.15.40:6821/2681404929","state":["exists","up"]},{"osd":3,"uuid":"2969c698-7039-4bbb-beda-f756f7a368a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6825","nonce":111110981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6827","nonce":111110981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6831","nonce":111110981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6829","nonce":111110981}]},"public_addr":"172.21.15.40:6825/111110981","cluster_addr":"172.21.15.40:6827/111110981","heartbeat_back_addr":"172.21.15.40:6831/111110981","heartbeat_front_addr":"172.21.15.40:6829/111110981","state":["exists","up"]},{"osd":4,"uuid":"3bb1d9c8-8e42-4a6b-998d-04834f34be5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6801","nonce":3625455711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6803","nonce":3625455711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6807","nonce":3625455711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6805","nonce":3625455711}]},"public_addr":"172.21.15.45:6801/3625455711","cluster_addr":"172.21.15.45:6803/3625455711","heartbeat_back_addr":"172.21.15.45:6807/3625455711","heartbeat_front_addr":"172.21.15.45:6805/3625455711","state":["exists","up"]},{"osd":5,"uuid":"f9854ee4-302c-41be-977b-bedda090a3d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6817","nonce":3354411217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6819","nonce":3354411217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6823","nonce":3354411217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6821","nonce":3354411217}]},"public_addr":"172.21.15.45:6817/3354411217","cluster_addr":"172.21.15.45:6819/3354411217","heartbeat_back_addr":"172.21.15.45:6823/3354411217","heartbeat_front_addr":"172.21.15.45:6821/3354411217","state":["exists","up"]},{"osd":6,"uuid":"bbdb1989-f6ac-4954-9b85-b8b540d683c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6809","nonce":320111074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6811","nonce":320111074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6815","nonce":320111074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6813","nonce":320111074}]},"public_addr":"172.21.15.45:6809/320111074","cluster_addr":"172.21.15.45:6811/320111074","heartbeat_back_addr":"172.21.15.45:6815/320111074","heartbeat_front_addr":"172.21.15.45:6813/320111074","state":["exists","up"]},{"osd":7,"uuid":"823d44e3-58f1-4d1d-8263-a4e4a69d4327","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6825","nonce":643617680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6827","nonce":643617680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6831","nonce":643617680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6829","nonce":643617680}]},"public_addr":"172.21.15.45:6825/643617680","cluster_addr":"172.21.15.45:6827/643617680","heartbeat_back_addr":"172.21.15.45:6831/643617680","heartbeat_front_addr":"172.21.15.45:6829/643617680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.731262+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.873226+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.898936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.666578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.645990+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.953699+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.642823+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.693395+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-22T10:53:57.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.344+0000 7fc3089ff700 1 -- 172.21.15.40:0/518151188 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fc2e406ace0 msgr2=0x7fc2e406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:57.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.344+0000 7fc3089ff700 1 --2- 172.21.15.40:0/518151188 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fc2e406ace0 0x7fc2e406d190 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc2f4009c40 tx=0x7fc2f4008030 comp rx=0 tx=0).stop 2023-06-22T10:53:57.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.344+0000 7fc3089ff700 1 -- 172.21.15.40:0/518151188 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc30415c720 msgr2=0x7fc304156b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:57.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.344+0000 7fc3089ff700 1 --2- 172.21.15.40:0/518151188 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc30415c720 0x7fc304156b00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc00cb50 tx=0x7fc2fc00ce60 comp rx=0 tx=0).stop 2023-06-22T10:53:57.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.344+0000 7fc3089ff700 1 -- 172.21.15.40:0/518151188 shutdown_connections 2023-06-22T10:53:57.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.344+0000 7fc3089ff700 1 --2- 172.21.15.40:0/518151188 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fc2e406ace0 0x7fc2e406d190 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:57.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.344+0000 7fc3089ff700 1 --2- 172.21.15.40:0/518151188 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc30415c720 0x7fc304156b00 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:57.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.344+0000 7fc3089ff700 1 --2- 172.21.15.40:0/518151188 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3040b4c60 0x7fc3040c7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:57.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.344+0000 7fc3089ff700 1 --2- 172.21.15.40:0/518151188 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fc3040d2830 0x7fc3041f29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:57.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.344+0000 7fc3089ff700 1 -- 172.21.15.40:0/518151188 >> 172.21.15.40:0/518151188 conn(0x7fc3040cf720 msgr2=0x7fc3040b3710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:57.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.344+0000 7fc3089ff700 1 -- 172.21.15.40:0/518151188 shutdown_connections 2023-06-22T10:53:57.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.344+0000 7fc3089ff700 1 -- 172.21.15.40:0/518151188 wait complete. 2023-06-22T10:53:57.366 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-22T10:53:57.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.562+0000 7fb71cbff700 1 Processor -- start 2023-06-22T10:53:57.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.563+0000 7fb71cbff700 1 -- start start 2023-06-22T10:53:57.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.564+0000 7fb71cbff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb71815c470 0x7fb7180cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:57.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.564+0000 7fb71cbff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fb7180d26f0 0x7fb7180d14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:57.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.564+0000 7fb71cbff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7180d0780 con 0x7fb7180cd200 2023-06-22T10:53:57.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.564+0000 7fb71cbff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb71815c840 con 0x7fb71815c470 2023-06-22T10:53:57.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.564+0000 7fb71cbff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7180cd770 con 0x7fb7180d26f0 2023-06-22T10:53:57.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.564+0000 7fb716d9d700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb7180cd200 0x7fb7180b4630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38002/0 (socket says 172.21.15.40:38002) 2023-06-22T10:53:57.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.564+0000 7fb716d9d700 1 -- 172.21.15.40:0/1989308456 learned_addr learned my addr 172.21.15.40:0/1989308456 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:53:57.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.564+0000 7fb71659c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb71815c470 0x7fb7180cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:57.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.564+0000 7fb70ffff700 1 --2- 172.21.15.40:0/1989308456 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fb7180d26f0 0x7fb7180d14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:57.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.565+0000 7fb715d9b700 1 -- 172.21.15.40:0/1989308456 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1305869037 0 0) 0x7fb7180d0780 con 0x7fb7180cd200 2023-06-22T10:53:57.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.565+0000 7fb715d9b700 1 -- 172.21.15.40:0/1989308456 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7040035b0 con 0x7fb7180cd200 2023-06-22T10:53:57.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.565+0000 7fb71659c700 1 -- 172.21.15.40:0/1989308456 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fb7180d26f0 msgr2=0x7fb7180d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:57.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.565+0000 7fb71659c700 1 --2- 172.21.15.40:0/1989308456 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fb7180d26f0 0x7fb7180d14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:57.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.565+0000 7fb71659c700 1 -- 172.21.15.40:0/1989308456 >> v1:172.21.15.40:6789/0 conn(0x7fb7180cd200 legacy=0x7fb7180b4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:57.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.565+0000 7fb71659c700 1 -- 172.21.15.40:0/1989308456 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7180d09d0 con 0x7fb71815c470 2023-06-22T10:53:57.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.565+0000 7fb70ffff700 1 --2- 172.21.15.40:0/1989308456 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fb7180d26f0 0x7fb7180d14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-22T10:53:57.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.565+0000 7fb71659c700 1 --2- 172.21.15.40:0/1989308456 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb71815c470 0x7fb7180cee00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb708009840 tx=0x7fb708009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89963d3d26c6434e server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:57.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.565+0000 7fb715d9b700 1 -- 172.21.15.40:0/1989308456 <== mon.1 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb708011830 con 0x7fb71815c470 2023-06-22T10:53:57.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.565+0000 7fb715d9b700 1 -- 172.21.15.40:0/1989308456 <== mon.1 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb708011990 con 0x7fb71815c470 2023-06-22T10:53:57.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.565+0000 7fb715d9b700 1 -- 172.21.15.40:0/1989308456 <== mon.1 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb708011d20 con 0x7fb71815c470 2023-06-22T10:53:57.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.566+0000 7fb71cbff700 1 -- 172.21.15.40:0/1989308456 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb71815c470 msgr2=0x7fb7180cee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:57.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.566+0000 7fb71cbff700 1 --2- 172.21.15.40:0/1989308456 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb71815c470 0x7fb7180cee00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb708009840 tx=0x7fb708009b50 comp rx=0 tx=0).stop 2023-06-22T10:53:57.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.566+0000 7fb71cbff700 1 -- 172.21.15.40:0/1989308456 shutdown_connections 2023-06-22T10:53:57.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.566+0000 7fb71cbff700 1 --2- 172.21.15.40:0/1989308456 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb71815c470 0x7fb7180cee00 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:57.571 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.566+0000 7fb71cbff700 1 --2- 172.21.15.40:0/1989308456 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fb7180d26f0 0x7fb7180d14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:57.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.566+0000 7fb71cbff700 1 -- 172.21.15.40:0/1989308456 >> 172.21.15.40:0/1989308456 conn(0x7fb7180cf630 msgr2=0x7fb7180cfa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:57.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.566+0000 7fb71cbff700 1 -- 172.21.15.40:0/1989308456 shutdown_connections 2023-06-22T10:53:57.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.566+0000 7fb71cbff700 1 -- 172.21.15.40:0/1989308456 wait complete. 2023-06-22T10:53:57.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.568+0000 7fb71cbff700 1 Processor -- start 2023-06-22T10:53:57.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.568+0000 7fb71cbff700 1 -- start start 2023-06-22T10:53:57.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.569+0000 7fb71cbff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7180cd200 0x7fb7180cad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:57.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.569+0000 7fb71cbff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fb7180d26f0 0x7fb7180b59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:57.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.569+0000 7fb71cbff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb71815c470 0x7fb718152040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:57.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.569+0000 7fb71cbff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7180b5f20 con 0x7fb7180cd200 2023-06-22T10:53:57.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.569+0000 7fb71cbff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7180b6130 con 0x7fb71815c470 2023-06-22T10:53:57.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.569+0000 7fb71cbff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7180b6410 con 0x7fb7180d26f0 2023-06-22T10:53:57.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.569+0000 7fb71659c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7180cd200 0x7fb7180cad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:57.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.569+0000 7fb71659c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7180cd200 0x7fb7180cad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37664/0 (socket says 172.21.15.40:37664) 2023-06-22T10:53:57.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.569+0000 7fb71659c700 1 -- 172.21.15.40:0/2158320856 learned_addr learned my addr 172.21.15.40:0/2158320856 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:57.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.569+0000 7fb70ffff700 1 --2- 172.21.15.40:0/2158320856 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fb7180d26f0 0x7fb7180b59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:57.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.569+0000 7fb716d9d700 1 --2- 172.21.15.40:0/2158320856 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb71815c470 0x7fb718152040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:57.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.569+0000 7fb71659c700 1 -- 172.21.15.40:0/2158320856 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fb7180d26f0 msgr2=0x7fb7180b59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:57.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.569+0000 7fb71659c700 1 --2- 172.21.15.40:0/2158320856 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fb7180d26f0 0x7fb7180b59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:57.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.569+0000 7fb71659c700 1 -- 172.21.15.40:0/2158320856 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb71815c470 msgr2=0x7fb718152040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:57.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.569+0000 7fb71659c700 1 --2- 172.21.15.40:0/2158320856 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb71815c470 0x7fb718152040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:57.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.569+0000 7fb71659c700 1 -- 172.21.15.40:0/2158320856 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7000094a0 con 0x7fb7180cd200 2023-06-22T10:53:57.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.569+0000 7fb70ffff700 1 --2- 172.21.15.40:0/2158320856 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fb7180d26f0 0x7fb7180b59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:53:57.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.570+0000 7fb71659c700 1 --2- 172.21.15.40:0/2158320856 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7180cd200 0x7fb7180cad50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb708009fd0 tx=0x7fb708004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:57.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.570+0000 7fb70effd700 1 -- 172.21.15.40:0/2158320856 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7080036a0 con 0x7fb7180cd200 2023-06-22T10:53:57.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.570+0000 7fb70effd700 1 -- 172.21.15.40:0/2158320856 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb70801e070 con 0x7fb7180cd200 2023-06-22T10:53:57.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.570+0000 7fb70effd700 1 -- 172.21.15.40:0/2158320856 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb708003a60 con 0x7fb7180cd200 2023-06-22T10:53:57.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.570+0000 7fb71cbff700 1 -- 172.21.15.40:0/2158320856 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7080094a0 con 0x7fb7180cd200 2023-06-22T10:53:57.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.570+0000 7fb71cbff700 1 -- 172.21.15.40:0/2158320856 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7180b69d0 con 0x7fb7180cd200 2023-06-22T10:53:57.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.571+0000 7fb71cbff700 1 -- 172.21.15.40:0/2158320856 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb718067580 con 0x7fb7180cd200 2023-06-22T10:53:57.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.572+0000 7fb70effd700 1 -- 172.21.15.40:0/2158320856 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb708003bc0 con 0x7fb7180cd200 2023-06-22T10:53:57.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.573+0000 7fb70effd700 1 --2- 172.21.15.40:0/2158320856 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fb6f806ace0 0x7fb6f806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:57.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.573+0000 7fb70effd700 1 -- 172.21.15.40:0/2158320856 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb70808a6e0 con 0x7fb7180cd200 2023-06-22T10:53:57.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.573+0000 7fb70ffff700 1 --2- 172.21.15.40:0/2158320856 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fb6f806ace0 0x7fb6f806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:57.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.574+0000 7fb70ffff700 1 --2- 172.21.15.40:0/2158320856 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fb6f806ace0 0x7fb6f806d190 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb718159380 tx=0x7fb700008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:57.580 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.577+0000 7fb70effd700 1 -- 172.21.15.40:0/2158320856 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb708055540 con 0x7fb7180cd200 2023-06-22T10:53:57.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.787+0000 7fb71cbff700 1 -- 172.21.15.40:0/2158320856 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb71815a830 con 0x7fb7180cd200 2023-06-22T10:53:57.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.789+0000 7fb70effd700 1 -- 172.21.15.40:0/2158320856 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20036 (secure 0 0 0) 0x7fb708058b60 con 0x7fb7180cd200 2023-06-22T10:53:57.792 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:53:57.793 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":28,"fsid":"475560bc-1a7c-4a75-b3b6-6fc6b20bdc52","created":"2023-06-22T10:53:03.784568+0000","modified":"2023-06-22T10:53:36.483308+0000","last_up_change":"2023-06-22T10:53:17.830348+0000","last_in_change":"2023-06-22T10:53:07.329974+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-22T10:53:17.182228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-22T10:53:23.874432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-22T10:53:29.812963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-22T10:53:30.404021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-22T10:53:33.982289+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"918db6b4-053a-46ba-976d-6e1a0104017f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6809","nonce":2400162888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6811","nonce":2400162888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6815","nonce":2400162888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6813","nonce":2400162888}]},"public_addr":"172.21.15.40:6809/2400162888","cluster_addr":"172.21.15.40:6811/2400162888","heartbeat_back_addr":"172.21.15.40:6815/2400162888","heartbeat_front_addr":"172.21.15.40:6813/2400162888","state":["exists","up"]},{"osd":1,"uuid":"0c146e2b-1725-4dae-9b5c-38795943b9d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6801","nonce":230885800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6803","nonce":230885800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6807","nonce":230885800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6805","nonce":230885800}]},"public_addr":"172.21.15.40:6801/230885800","cluster_addr":"172.21.15.40:6803/230885800","heartbeat_back_addr":"172.21.15.40:6807/230885800","heartbeat_front_addr":"172.21.15.40:6805/230885800","state":["exists","up"]},{"osd":2,"uuid":"0b3727fd-f281-46d5-a675-86c8c5ab269e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6817","nonce":2681404929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6819","nonce":2681404929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6823","nonce":2681404929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6821","nonce":2681404929}]},"public_addr":"172.21.15.40:6817/2681404929","cluster_addr":"172.21.15.40:6819/2681404929","heartbeat_back_addr":"172.21.15.40:6823/2681404929","heartbeat_front_addr":"172.21.15.40:6821/2681404929","state":["exists","up"]},{"osd":3,"uuid":"2969c698-7039-4bbb-beda-f756f7a368a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6825","nonce":111110981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6827","nonce":111110981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6831","nonce":111110981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6829","nonce":111110981}]},"public_addr":"172.21.15.40:6825/111110981","cluster_addr":"172.21.15.40:6827/111110981","heartbeat_back_addr":"172.21.15.40:6831/111110981","heartbeat_front_addr":"172.21.15.40:6829/111110981","state":["exists","up"]},{"osd":4,"uuid":"3bb1d9c8-8e42-4a6b-998d-04834f34be5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6801","nonce":3625455711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6803","nonce":3625455711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6807","nonce":3625455711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6805","nonce":3625455711}]},"public_addr":"172.21.15.45:6801/3625455711","cluster_addr":"172.21.15.45:6803/3625455711","heartbeat_back_addr":"172.21.15.45:6807/3625455711","heartbeat_front_addr":"172.21.15.45:6805/3625455711","state":["exists","up"]},{"osd":5,"uuid":"f9854ee4-302c-41be-977b-bedda090a3d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6817","nonce":3354411217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6819","nonce":3354411217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6823","nonce":3354411217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6821","nonce":3354411217}]},"public_addr":"172.21.15.45:6817/3354411217","cluster_addr":"172.21.15.45:6819/3354411217","heartbeat_back_addr":"172.21.15.45:6823/3354411217","heartbeat_front_addr":"172.21.15.45:6821/3354411217","state":["exists","up"]},{"osd":6,"uuid":"bbdb1989-f6ac-4954-9b85-b8b540d683c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6809","nonce":320111074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6811","nonce":320111074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6815","nonce":320111074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6813","nonce":320111074}]},"public_addr":"172.21.15.45:6809/320111074","cluster_addr":"172.21.15.45:6811/320111074","heartbeat_back_addr":"172.21.15.45:6815/320111074","heartbeat_front_addr":"172.21.15.45:6813/320111074","state":["exists","up"]},{"osd":7,"uuid":"823d44e3-58f1-4d1d-8263-a4e4a69d4327","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6825","nonce":643617680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6827","nonce":643617680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6831","nonce":643617680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6829","nonce":643617680}]},"public_addr":"172.21.15.45:6825/643617680","cluster_addr":"172.21.15.45:6827/643617680","heartbeat_back_addr":"172.21.15.45:6831/643617680","heartbeat_front_addr":"172.21.15.45:6829/643617680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.731262+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.873226+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.898936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.666578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.645990+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.953699+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.642823+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.693395+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-22T10:53:57.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.791+0000 7fb71cbff700 1 -- 172.21.15.40:0/2158320856 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fb6f806ace0 msgr2=0x7fb6f806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:57.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.791+0000 7fb71cbff700 1 --2- 172.21.15.40:0/2158320856 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fb6f806ace0 0x7fb6f806d190 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb718159380 tx=0x7fb700008040 comp rx=0 tx=0).stop 2023-06-22T10:53:57.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.791+0000 7fb71cbff700 1 -- 172.21.15.40:0/2158320856 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7180cd200 msgr2=0x7fb7180cad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:57.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.791+0000 7fb71cbff700 1 --2- 172.21.15.40:0/2158320856 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7180cd200 0x7fb7180cad50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb708009fd0 tx=0x7fb708004750 comp rx=0 tx=0).stop 2023-06-22T10:53:57.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.791+0000 7fb71cbff700 1 -- 172.21.15.40:0/2158320856 shutdown_connections 2023-06-22T10:53:57.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.791+0000 7fb71cbff700 1 --2- 172.21.15.40:0/2158320856 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fb6f806ace0 0x7fb6f806d190 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:57.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.791+0000 7fb71cbff700 1 --2- 172.21.15.40:0/2158320856 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb71815c470 0x7fb718152040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:57.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.791+0000 7fb71cbff700 1 --2- 172.21.15.40:0/2158320856 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb7180cd200 0x7fb7180cad50 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:57.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.791+0000 7fb71cbff700 1 --2- 172.21.15.40:0/2158320856 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fb7180d26f0 0x7fb7180b59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:57.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.791+0000 7fb71cbff700 1 -- 172.21.15.40:0/2158320856 >> 172.21.15.40:0/2158320856 conn(0x7fb7180cf630 msgr2=0x7fb7180b4670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:57.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.792+0000 7fb71cbff700 1 -- 172.21.15.40:0/2158320856 shutdown_connections 2023-06-22T10:53:57.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:57.792+0000 7fb71cbff700 1 -- 172.21.15.40:0/2158320856 wait complete. 2023-06-22T10:53:57.814 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-06-22T10:53:58.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.014+0000 7fab263ff700 1 Processor -- start 2023-06-22T10:53:58.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.014+0000 7fab263ff700 1 -- start start 2023-06-22T10:53:58.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.015+0000 7fab263ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fab200b45d0 0x7fab200b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:58.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.015+0000 7fab263ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fab200b59a0 0x7fab200b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:58.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.015+0000 7fab263ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab200d1be0 con 0x7fab200d2130 2023-06-22T10:53:58.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.015+0000 7fab263ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab200d17f0 con 0x7fab200b45d0 2023-06-22T10:53:58.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.015+0000 7fab263ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab200d1360 con 0x7fab200b59a0 2023-06-22T10:53:58.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.016+0000 7fab17fff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fab200d2130 0x7fab200cd1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38008/0 (socket says 172.21.15.40:38008) 2023-06-22T10:53:58.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.016+0000 7fab17fff700 1 -- 172.21.15.40:0/3727378132 learned_addr learned my addr 172.21.15.40:0/3727378132 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:53:58.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.016+0000 7fab1ffff700 1 --2- 172.21.15.40:0/3727378132 >> v2:172.21.15.45:3300/0 conn(0x7fab200b45d0 0x7fab200b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:58.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.016+0000 7fab2499c700 1 --2- 172.21.15.40:0/3727378132 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fab200b59a0 0x7fab200b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:58.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.016+0000 7fab1f7fe700 1 -- 172.21.15.40:0/3727378132 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1233639689 0 0) 0x7fab200d1be0 con 0x7fab200d2130 2023-06-22T10:53:58.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.016+0000 7fab1f7fe700 1 -- 172.21.15.40:0/3727378132 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab0c0035b0 con 0x7fab200d2130 2023-06-22T10:53:58.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.016+0000 7fab2499c700 1 -- 172.21.15.40:0/3727378132 >> v2:172.21.15.45:3300/0 conn(0x7fab200b45d0 msgr2=0x7fab200b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:58.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.016+0000 7fab2499c700 1 --2- 172.21.15.40:0/3727378132 >> v2:172.21.15.45:3300/0 conn(0x7fab200b45d0 0x7fab200b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:58.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.016+0000 7fab2499c700 1 -- 172.21.15.40:0/3727378132 >> v1:172.21.15.40:6789/0 conn(0x7fab200d2130 legacy=0x7fab200cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:58.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.016+0000 7fab2499c700 1 -- 172.21.15.40:0/3727378132 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab200b4ee0 con 0x7fab200b59a0 2023-06-22T10:53:58.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.016+0000 7fab1ffff700 1 --2- 172.21.15.40:0/3727378132 >> v2:172.21.15.45:3300/0 conn(0x7fab200b45d0 0x7fab200b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-22T10:53:58.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.017+0000 7fab2499c700 1 --2- 172.21.15.40:0/3727378132 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fab200b59a0 0x7fab200b5e40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fab18009d90 tx=0x7fab1800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d802f699f51528e server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:58.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.017+0000 7fab1f7fe700 1 -- 172.21.15.40:0/3727378132 <== mon.2 v2:172.21.15.45:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1800e070 con 0x7fab200b59a0 2023-06-22T10:53:58.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.017+0000 7fab1f7fe700 1 -- 172.21.15.40:0/3727378132 <== mon.2 v2:172.21.15.45:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab1800bb20 con 0x7fab200b59a0 2023-06-22T10:53:58.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.017+0000 7fab1f7fe700 1 -- 172.21.15.40:0/3727378132 <== mon.2 v2:172.21.15.45:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab18012430 con 0x7fab200b59a0 2023-06-22T10:53:58.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.017+0000 7fab263ff700 1 -- 172.21.15.40:0/3727378132 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fab200b59a0 msgr2=0x7fab200b5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:58.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.017+0000 7fab263ff700 1 --2- 172.21.15.40:0/3727378132 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fab200b59a0 0x7fab200b5e40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fab18009d90 tx=0x7fab1800b330 comp rx=0 tx=0).stop 2023-06-22T10:53:58.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.018+0000 7fab263ff700 1 -- 172.21.15.40:0/3727378132 shutdown_connections 2023-06-22T10:53:58.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.018+0000 7fab263ff700 1 --2- 172.21.15.40:0/3727378132 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fab200b59a0 0x7fab200b5e40 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:58.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.018+0000 7fab263ff700 1 --2- 172.21.15.40:0/3727378132 >> v2:172.21.15.45:3300/0 conn(0x7fab200b45d0 0x7fab200b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:58.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.018+0000 7fab263ff700 1 -- 172.21.15.40:0/3727378132 >> 172.21.15.40:0/3727378132 conn(0x7fab200cf5d0 msgr2=0x7fab200cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:58.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.018+0000 7fab263ff700 1 -- 172.21.15.40:0/3727378132 shutdown_connections 2023-06-22T10:53:58.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.018+0000 7fab263ff700 1 -- 172.21.15.40:0/3727378132 wait complete. 2023-06-22T10:53:58.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.020+0000 7fab263ff700 1 Processor -- start 2023-06-22T10:53:58.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.020+0000 7fab263ff700 1 -- start start 2023-06-22T10:53:58.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.021+0000 7fab263ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fab200b45d0 0x7fab20159d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:58.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.021+0000 7fab263ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab200b59a0 0x7fab201566e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:58.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.022+0000 7fab263ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab200d2130 0x7fab200b3000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:58.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.022+0000 7fab263ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab20156c20 con 0x7fab200d2130 2023-06-22T10:53:58.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.022+0000 7fab263ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab20153da0 con 0x7fab200b59a0 2023-06-22T10:53:58.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.022+0000 7fab263ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab20154080 con 0x7fab200b45d0 2023-06-22T10:53:58.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.022+0000 7fab2499c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab200d2130 0x7fab200b3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:58.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.022+0000 7fab1ffff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fab200b45d0 0x7fab20159d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:58.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.022+0000 7fab2499c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab200d2130 0x7fab200b3000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:37666/0 (socket says 172.21.15.40:37666) 2023-06-22T10:53:58.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.022+0000 7fab2499c700 1 -- 172.21.15.40:0/82680833 learned_addr learned my addr 172.21.15.40:0/82680833 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:58.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.022+0000 7fab17fff700 1 --2- 172.21.15.40:0/82680833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab200b59a0 0x7fab201566e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:58.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.022+0000 7fab2499c700 1 -- 172.21.15.40:0/82680833 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fab200b45d0 msgr2=0x7fab20159d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:58.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.022+0000 7fab2499c700 1 --2- 172.21.15.40:0/82680833 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fab200b45d0 0x7fab20159d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:58.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.022+0000 7fab2499c700 1 -- 172.21.15.40:0/82680833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab200b59a0 msgr2=0x7fab201566e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:58.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.022+0000 7fab2499c700 1 --2- 172.21.15.40:0/82680833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab200b59a0 0x7fab201566e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:58.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.022+0000 7fab2499c700 1 -- 172.21.15.40:0/82680833 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab100094a0 con 0x7fab200d2130 2023-06-22T10:53:58.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.023+0000 7fab2499c700 1 --2- 172.21.15.40:0/82680833 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab200d2130 0x7fab200b3000 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fab18014040 tx=0x7fab18004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:58.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.023+0000 7fab1d7fa700 1 -- 172.21.15.40:0/82680833 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab180129f0 con 0x7fab200d2130 2023-06-22T10:53:58.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.023+0000 7fab1d7fa700 1 -- 172.21.15.40:0/82680833 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab18020070 con 0x7fab200d2130 2023-06-22T10:53:58.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.023+0000 7fab1d7fa700 1 -- 172.21.15.40:0/82680833 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab18012dd0 con 0x7fab200d2130 2023-06-22T10:53:58.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.023+0000 7fab263ff700 1 -- 172.21.15.40:0/82680833 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab18009a70 con 0x7fab200d2130 2023-06-22T10:53:58.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.023+0000 7fab263ff700 1 -- 172.21.15.40:0/82680833 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab20154640 con 0x7fab200d2130 2023-06-22T10:53:58.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.024+0000 7fab263ff700 1 -- 172.21.15.40:0/82680833 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab20067580 con 0x7fab200d2130 2023-06-22T10:53:58.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.025+0000 7fab1d7fa700 1 -- 172.21.15.40:0/82680833 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fab18004040 con 0x7fab200d2130 2023-06-22T10:53:58.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.026+0000 7fab1d7fa700 1 --2- 172.21.15.40:0/82680833 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fab0006ace0 0x7fab0006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:58.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.026+0000 7fab1d7fa700 1 -- 172.21.15.40:0/82680833 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fab18022070 con 0x7fab200d2130 2023-06-22T10:53:58.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.026+0000 7fab1ffff700 1 --2- 172.21.15.40:0/82680833 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fab0006ace0 0x7fab0006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:58.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.027+0000 7fab1ffff700 1 --2- 172.21.15.40:0/82680833 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fab0006ace0 0x7fab0006d190 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fab10009cd0 tx=0x7fab10009210 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:58.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.030+0000 7fab1d7fa700 1 -- 172.21.15.40:0/82680833 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fab180561b0 con 0x7fab200d2130 2023-06-22T10:53:58.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.286+0000 7fab263ff700 1 -- 172.21.15.40:0/82680833 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fab20157f50 con 0x7fab200d2130 2023-06-22T10:53:58.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.667+0000 7fab1d7fa700 1 -- 172.21.15.40:0/82680833 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7fab180597d0 con 0x7fab200d2130 2023-06-22T10:53:58.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.669+0000 7fab263ff700 1 -- 172.21.15.40:0/82680833 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fab0006ace0 msgr2=0x7fab0006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:58.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.669+0000 7fab263ff700 1 --2- 172.21.15.40:0/82680833 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fab0006ace0 0x7fab0006d190 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fab10009cd0 tx=0x7fab10009210 comp rx=0 tx=0).stop 2023-06-22T10:53:58.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.669+0000 7fab263ff700 1 -- 172.21.15.40:0/82680833 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab200d2130 msgr2=0x7fab200b3000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:58.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.669+0000 7fab263ff700 1 --2- 172.21.15.40:0/82680833 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab200d2130 0x7fab200b3000 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fab18014040 tx=0x7fab18004ad0 comp rx=0 tx=0).stop 2023-06-22T10:53:58.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.670+0000 7fab263ff700 1 -- 172.21.15.40:0/82680833 shutdown_connections 2023-06-22T10:53:58.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.670+0000 7fab263ff700 1 --2- 172.21.15.40:0/82680833 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fab0006ace0 0x7fab0006d190 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:58.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.670+0000 7fab263ff700 1 --2- 172.21.15.40:0/82680833 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fab200b45d0 0x7fab20159d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:58.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.670+0000 7fab263ff700 1 --2- 172.21.15.40:0/82680833 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fab200d2130 0x7fab200b3000 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:58.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.670+0000 7fab263ff700 1 --2- 172.21.15.40:0/82680833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab200b59a0 0x7fab201566e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:58.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.670+0000 7fab263ff700 1 -- 172.21.15.40:0/82680833 >> 172.21.15.40:0/82680833 conn(0x7fab200cf5d0 msgr2=0x7fab200ccd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:58.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.670+0000 7fab263ff700 1 -- 172.21.15.40:0/82680833 shutdown_connections 2023-06-22T10:53:58.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.670+0000 7fab263ff700 1 -- 172.21.15.40:0/82680833 wait complete. 2023-06-22T10:53:58.692 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-06-22T10:53:58.693 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-06-22T10:53:58.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.895+0000 7fac4b3ff700 1 Processor -- start 2023-06-22T10:53:58.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.895+0000 7fac4b3ff700 1 -- start start 2023-06-22T10:53:58.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.896+0000 7fac4b3ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fac440d2130 0x7fac440cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:58.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.897+0000 7fac4b3ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fac440cd6e0 0x7fac440b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:58.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.897+0000 7fac4b3ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac440d1be0 con 0x7fac440b45d0 2023-06-22T10:53:58.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.897+0000 7fac4b3ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac440d17f0 con 0x7fac440d2130 2023-06-22T10:53:58.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.897+0000 7fac4b3ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac440d1360 con 0x7fac440cd6e0 2023-06-22T10:53:58.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.897+0000 7fac4899a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fac440d2130 0x7fac440cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:58.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.897+0000 7fac4919b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fac440b45d0 0x7fac440b49a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:58446/0 (socket says 172.21.15.40:58446) 2023-06-22T10:53:58.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.897+0000 7fac4919b700 1 -- 172.21.15.40:0/3810413899 learned_addr learned my addr 172.21.15.40:0/3810413899 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:53:58.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.897+0000 7fac4999c700 1 --2- 172.21.15.40:0/3810413899 >> v2:172.21.15.45:3300/0 conn(0x7fac440cd6e0 0x7fac440b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:58.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.897+0000 7fac4899a700 1 -- 172.21.15.40:0/3810413899 >> v2:172.21.15.45:3300/0 conn(0x7fac440cd6e0 msgr2=0x7fac440b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:58.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.897+0000 7fac4899a700 1 --2- 172.21.15.40:0/3810413899 >> v2:172.21.15.45:3300/0 conn(0x7fac440cd6e0 0x7fac440b59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:58.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.897+0000 7fac4899a700 1 -- 172.21.15.40:0/3810413899 >> v1:172.21.15.40:6789/0 conn(0x7fac440b45d0 legacy=0x7fac440b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:58.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.897+0000 7fac4899a700 1 -- 172.21.15.40:0/3810413899 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac440cef40 con 0x7fac440d2130 2023-06-22T10:53:58.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.897+0000 7fac3bfff700 1 -- 172.21.15.40:0/3810413899 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 433585320 0 0) 0x7fac440d1be0 con 0x7fac440b45d0 2023-06-22T10:53:58.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.898+0000 7fac4899a700 1 --2- 172.21.15.40:0/3810413899 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac440d2130 0x7fac440cd1a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fac440b8ca0 tx=0x7fac34009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7242162cd89c69b server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:58.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.898+0000 7fac3bfff700 1 -- 172.21.15.40:0/3810413899 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac34011830 con 0x7fac440d2130 2023-06-22T10:53:58.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.898+0000 7fac3bfff700 1 -- 172.21.15.40:0/3810413899 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac34011990 con 0x7fac440d2130 2023-06-22T10:53:58.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.898+0000 7fac3bfff700 1 -- 172.21.15.40:0/3810413899 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac34011d20 con 0x7fac440d2130 2023-06-22T10:53:58.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.898+0000 7fac4b3ff700 1 -- 172.21.15.40:0/3810413899 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac440d2130 msgr2=0x7fac440cd1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:58.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.898+0000 7fac4b3ff700 1 --2- 172.21.15.40:0/3810413899 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac440d2130 0x7fac440cd1a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fac440b8ca0 tx=0x7fac34009b20 comp rx=0 tx=0).stop 2023-06-22T10:53:58.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.898+0000 7fac4b3ff700 1 -- 172.21.15.40:0/3810413899 shutdown_connections 2023-06-22T10:53:58.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.898+0000 7fac4b3ff700 1 --2- 172.21.15.40:0/3810413899 >> v2:172.21.15.45:3300/0 conn(0x7fac440cd6e0 0x7fac440b59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:58.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.898+0000 7fac4b3ff700 1 --2- 172.21.15.40:0/3810413899 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac440d2130 0x7fac440cd1a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:58.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.898+0000 7fac4b3ff700 1 -- 172.21.15.40:0/3810413899 >> 172.21.15.40:0/3810413899 conn(0x7fac440cf5d0 msgr2=0x7fac440cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:58.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.898+0000 7fac4b3ff700 1 -- 172.21.15.40:0/3810413899 shutdown_connections 2023-06-22T10:53:58.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.899+0000 7fac4b3ff700 1 -- 172.21.15.40:0/3810413899 wait complete. 2023-06-22T10:53:58.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.900+0000 7fac4b3ff700 1 Processor -- start 2023-06-22T10:53:58.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.900+0000 7fac4b3ff700 1 -- start start 2023-06-22T10:53:58.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.901+0000 7fac4b3ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fac440b45d0 0x7fac44156d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:58.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.901+0000 7fac4b3ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac440cd6e0 0x7fac440cacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:58.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.901+0000 7fac4b3ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac440d2130 0x7fac4406b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:58.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.901+0000 7fac4b3ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac4415d130 con 0x7fac440d2130 2023-06-22T10:53:58.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.901+0000 7fac4b3ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac440cb790 con 0x7fac440cd6e0 2023-06-22T10:53:58.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.901+0000 7fac4b3ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac4415c790 con 0x7fac440b45d0 2023-06-22T10:53:58.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.902+0000 7fac4999c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac440d2130 0x7fac4406b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:58.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.902+0000 7fac4899a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac440cd6e0 0x7fac440cacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:58.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.902+0000 7fac4899a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac440cd6e0 0x7fac440cacd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.40:46802/0 (socket says 172.21.15.40:46802) 2023-06-22T10:53:58.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.902+0000 7fac4999c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac440d2130 0x7fac4406b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50468/0 (socket says 172.21.15.40:50468) 2023-06-22T10:53:58.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.902+0000 7fac4899a700 1 -- 172.21.15.40:0/1108634068 learned_addr learned my addr 172.21.15.40:0/1108634068 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:58.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.902+0000 7fac4919b700 1 --2- 172.21.15.40:0/1108634068 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fac440b45d0 0x7fac44156d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:58.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.902+0000 7fac4999c700 1 -- 172.21.15.40:0/1108634068 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fac440b45d0 msgr2=0x7fac44156d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:58.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.902+0000 7fac4999c700 1 --2- 172.21.15.40:0/1108634068 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fac440b45d0 0x7fac44156d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:58.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.902+0000 7fac4999c700 1 -- 172.21.15.40:0/1108634068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac440cd6e0 msgr2=0x7fac440cacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:58.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.902+0000 7fac4999c700 1 --2- 172.21.15.40:0/1108634068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac440cd6e0 0x7fac440cacd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:58.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.902+0000 7fac4999c700 1 -- 172.21.15.40:0/1108634068 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac340094a0 con 0x7fac440d2130 2023-06-22T10:53:58.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.902+0000 7fac4999c700 1 --2- 172.21.15.40:0/1108634068 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac440d2130 0x7fac4406b360 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fac4408bff0 tx=0x7fac3c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:58.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.903+0000 7fac39ffb700 1 -- 172.21.15.40:0/1108634068 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac3c018070 con 0x7fac440d2130 2023-06-22T10:53:58.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.903+0000 7fac39ffb700 1 -- 172.21.15.40:0/1108634068 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac3c007e80 con 0x7fac440d2130 2023-06-22T10:53:58.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.903+0000 7fac4b3ff700 1 -- 172.21.15.40:0/1108634068 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac4415ca70 con 0x7fac440d2130 2023-06-22T10:53:58.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.903+0000 7fac39ffb700 1 -- 172.21.15.40:0/1108634068 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac3c00ed50 con 0x7fac440d2130 2023-06-22T10:53:58.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.903+0000 7fac4b3ff700 1 -- 172.21.15.40:0/1108634068 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac4415d550 con 0x7fac440d2130 2023-06-22T10:53:58.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.904+0000 7fac4b3ff700 1 -- 172.21.15.40:0/1108634068 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac4415d270 con 0x7fac440d2130 2023-06-22T10:53:58.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.905+0000 7fac39ffb700 1 -- 172.21.15.40:0/1108634068 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fac3c014420 con 0x7fac440d2130 2023-06-22T10:53:58.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.906+0000 7fac39ffb700 1 --2- 172.21.15.40:0/1108634068 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fac2806ace0 0x7fac2806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:58.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.906+0000 7fac39ffb700 1 -- 172.21.15.40:0/1108634068 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fac3c089400 con 0x7fac440d2130 2023-06-22T10:53:58.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.906+0000 7fac4919b700 1 --2- 172.21.15.40:0/1108634068 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fac2806ace0 0x7fac2806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:58.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.907+0000 7fac4919b700 1 --2- 172.21.15.40:0/1108634068 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fac2806ace0 0x7fac2806d190 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fac40007fd0 tx=0x7fac40007de0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:58.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:58.910+0000 7fac39ffb700 1 -- 172.21.15.40:0/1108634068 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fac4415d270 con 0x7fac440d2130 2023-06-22T10:53:59.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.163+0000 7fac4b3ff700 1 -- 172.21.15.40:0/1108634068 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fac4415d270 con 0x7fac440d2130 2023-06-22T10:53:59.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.669+0000 7fac39ffb700 1 -- 172.21.15.40:0/1108634068 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7fac4415d270 con 0x7fac440d2130 2023-06-22T10:53:59.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.672+0000 7fac4b3ff700 1 -- 172.21.15.40:0/1108634068 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fac2806ace0 msgr2=0x7fac2806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:59.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.672+0000 7fac4b3ff700 1 --2- 172.21.15.40:0/1108634068 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fac2806ace0 0x7fac2806d190 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fac40007fd0 tx=0x7fac40007de0 comp rx=0 tx=0).stop 2023-06-22T10:53:59.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.673+0000 7fac4b3ff700 1 -- 172.21.15.40:0/1108634068 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac440d2130 msgr2=0x7fac4406b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:59.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.673+0000 7fac4b3ff700 1 --2- 172.21.15.40:0/1108634068 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac440d2130 0x7fac4406b360 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fac4408bff0 tx=0x7fac3c00e3c0 comp rx=0 tx=0).stop 2023-06-22T10:53:59.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.673+0000 7fac4b3ff700 1 -- 172.21.15.40:0/1108634068 shutdown_connections 2023-06-22T10:53:59.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.673+0000 7fac4b3ff700 1 --2- 172.21.15.40:0/1108634068 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fac2806ace0 0x7fac2806d190 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:59.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.673+0000 7fac4b3ff700 1 --2- 172.21.15.40:0/1108634068 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fac440b45d0 0x7fac44156d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:59.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.673+0000 7fac4b3ff700 1 --2- 172.21.15.40:0/1108634068 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac440d2130 0x7fac4406b360 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:59.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.673+0000 7fac4b3ff700 1 --2- 172.21.15.40:0/1108634068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac440cd6e0 0x7fac440cacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:59.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.673+0000 7fac4b3ff700 1 -- 172.21.15.40:0/1108634068 >> 172.21.15.40:0/1108634068 conn(0x7fac440cf5d0 msgr2=0x7fac440b7990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:59.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.673+0000 7fac4b3ff700 1 -- 172.21.15.40:0/1108634068 shutdown_connections 2023-06-22T10:53:59.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.673+0000 7fac4b3ff700 1 -- 172.21.15.40:0/1108634068 wait complete. 2023-06-22T10:53:59.697 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-06-22T10:53:59.698 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-22T10:53:59.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.899+0000 7fe54e7ff700 1 Processor -- start 2023-06-22T10:53:59.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.900+0000 7fe54e7ff700 1 -- start start 2023-06-22T10:53:59.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.901+0000 7fe54e7ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe5480d2830 0x7fe5480b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:59.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.901+0000 7fe54e7ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe5480b4c60 0x7fe5480d0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:59.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.901+0000 7fe54e7ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5480b50a0 con 0x7fe54815c720 2023-06-22T10:53:59.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.901+0000 7fe54e7ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe548160d60 con 0x7fe5480d2830 2023-06-22T10:53:59.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.901+0000 7fe54e7ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5480b2130 con 0x7fe5480b4c60 2023-06-22T10:53:59.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.901+0000 7fe5477fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe5480d2830 0x7fe5480b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:59.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.901+0000 7fe5477fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe5480d2830 0x7fe5480b4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50480/0 (socket says 172.21.15.40:50480) 2023-06-22T10:53:59.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.901+0000 7fe5477fe700 1 -- 172.21.15.40:0/2233782928 learned_addr learned my addr 172.21.15.40:0/2233782928 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:59.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.901+0000 7fe54cd9c700 1 --2- 172.21.15.40:0/2233782928 >> v2:172.21.15.45:3300/0 conn(0x7fe5480b4c60 0x7fe5480d0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:59.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.901+0000 7fe5477fe700 1 -- 172.21.15.40:0/2233782928 >> v2:172.21.15.45:3300/0 conn(0x7fe5480b4c60 msgr2=0x7fe5480d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:53:59.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.901+0000 7fe5477fe700 1 --2- 172.21.15.40:0/2233782928 >> v2:172.21.15.45:3300/0 conn(0x7fe5480b4c60 0x7fe5480d0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:59.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.902+0000 7fe5477fe700 1 -- 172.21.15.40:0/2233782928 >> v1:172.21.15.45:6789/0 conn(0x7fe54815c720 legacy=0x7fe5480b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:59.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.902+0000 7fe5477fe700 1 -- 172.21.15.40:0/2233782928 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe548161180 con 0x7fe5480d2830 2023-06-22T10:53:59.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.902+0000 7fe5477fe700 1 --2- 172.21.15.40:0/2233782928 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5480d2830 0x7fe5480b4720 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe53c0098f0 tx=0x7fe53c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cac9c62e5ec07571 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:59.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.902+0000 7fe546ffd700 1 -- 172.21.15.40:0/2233782928 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53c00b860 con 0x7fe5480d2830 2023-06-22T10:53:59.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.902+0000 7fe546ffd700 1 -- 172.21.15.40:0/2233782928 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe53c00b9c0 con 0x7fe5480d2830 2023-06-22T10:53:59.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.902+0000 7fe546ffd700 1 -- 172.21.15.40:0/2233782928 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53c00bd50 con 0x7fe5480d2830 2023-06-22T10:53:59.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.903+0000 7fe54e7ff700 1 -- 172.21.15.40:0/2233782928 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5480d2830 msgr2=0x7fe5480b4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:59.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.903+0000 7fe54e7ff700 1 --2- 172.21.15.40:0/2233782928 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5480d2830 0x7fe5480b4720 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe53c0098f0 tx=0x7fe53c009c00 comp rx=0 tx=0).stop 2023-06-22T10:53:59.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.903+0000 7fe54e7ff700 1 -- 172.21.15.40:0/2233782928 shutdown_connections 2023-06-22T10:53:59.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.903+0000 7fe54e7ff700 1 --2- 172.21.15.40:0/2233782928 >> v2:172.21.15.45:3300/0 conn(0x7fe5480b4c60 0x7fe5480d0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:59.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.903+0000 7fe54e7ff700 1 --2- 172.21.15.40:0/2233782928 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5480d2830 0x7fe5480b4720 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:59.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.903+0000 7fe54e7ff700 1 -- 172.21.15.40:0/2233782928 >> 172.21.15.40:0/2233782928 conn(0x7fe5480cf720 msgr2=0x7fe5480cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:53:59.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.903+0000 7fe54e7ff700 1 -- 172.21.15.40:0/2233782928 shutdown_connections 2023-06-22T10:53:59.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.903+0000 7fe54e7ff700 1 -- 172.21.15.40:0/2233782928 wait complete. 2023-06-22T10:53:59.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.905+0000 7fe54e7ff700 1 Processor -- start 2023-06-22T10:53:59.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.905+0000 7fe54e7ff700 1 -- start start 2023-06-22T10:53:59.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.906+0000 7fe54e7ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5480b4c60 0x7fe5481f4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:59.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.906+0000 7fe54e7ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe5480d2830 0x7fe5481f1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:59.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.906+0000 7fe54e7ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe54815c720 0x7fe5480ca780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:59.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.906+0000 7fe54e7ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5480cb0f0 con 0x7fe54815c720 2023-06-22T10:53:59.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.906+0000 7fe54e7ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5481f5100 con 0x7fe5480b4c60 2023-06-22T10:53:59.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.906+0000 7fe54e7ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5480b5c00 con 0x7fe5480d2830 2023-06-22T10:53:59.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.906+0000 7fe54cd9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe54815c720 0x7fe5480ca780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:59.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.906+0000 7fe54cd9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe54815c720 0x7fe5480ca780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50496/0 (socket says 172.21.15.40:50496) 2023-06-22T10:53:59.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.906+0000 7fe54cd9c700 1 -- 172.21.15.40:0/1007495149 learned_addr learned my addr 172.21.15.40:0/1007495149 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:53:59.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.906+0000 7fe547fff700 1 --2- 172.21.15.40:0/1007495149 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5480b4c60 0x7fe5481f4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:59.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.906+0000 7fe5477fe700 1 --2- 172.21.15.40:0/1007495149 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe5480d2830 0x7fe5481f1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:59.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.906+0000 7fe54cd9c700 1 -- 172.21.15.40:0/1007495149 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe5480d2830 msgr2=0x7fe5481f1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:59.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.906+0000 7fe54cd9c700 1 --2- 172.21.15.40:0/1007495149 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe5480d2830 0x7fe5481f1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:59.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.906+0000 7fe54cd9c700 1 -- 172.21.15.40:0/1007495149 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5480b4c60 msgr2=0x7fe5481f4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:53:59.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.906+0000 7fe54cd9c700 1 --2- 172.21.15.40:0/1007495149 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5480b4c60 0x7fe5481f4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:53:59.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.907+0000 7fe54cd9c700 1 -- 172.21.15.40:0/1007495149 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe53c009550 con 0x7fe54815c720 2023-06-22T10:53:59.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.907+0000 7fe547fff700 1 --2- 172.21.15.40:0/1007495149 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5480b4c60 0x7fe5481f4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:53:59.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.907+0000 7fe5477fe700 1 --2- 172.21.15.40:0/1007495149 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe5480d2830 0x7fe5481f1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:53:59.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.907+0000 7fe54cd9c700 1 --2- 172.21.15.40:0/1007495149 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe54815c720 0x7fe5480ca780 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe540007e60 tx=0x7fe54000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:59.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.907+0000 7fe544ff9700 1 -- 172.21.15.40:0/1007495149 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54000ede0 con 0x7fe54815c720 2023-06-22T10:53:59.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.907+0000 7fe544ff9700 1 -- 172.21.15.40:0/1007495149 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe540014420 con 0x7fe54815c720 2023-06-22T10:53:59.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.907+0000 7fe54e7ff700 1 -- 172.21.15.40:0/1007495149 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5480b5ee0 con 0x7fe54815c720 2023-06-22T10:53:59.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.907+0000 7fe544ff9700 1 -- 172.21.15.40:0/1007495149 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5400147d0 con 0x7fe54815c720 2023-06-22T10:53:59.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.907+0000 7fe54e7ff700 1 -- 172.21.15.40:0/1007495149 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5480b64a0 con 0x7fe54815c720 2023-06-22T10:53:59.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.908+0000 7fe54e7ff700 1 -- 172.21.15.40:0/1007495149 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe548067580 con 0x7fe54815c720 2023-06-22T10:53:59.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.909+0000 7fe544ff9700 1 -- 172.21.15.40:0/1007495149 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe540014930 con 0x7fe54815c720 2023-06-22T10:53:59.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.910+0000 7fe544ff9700 1 --2- 172.21.15.40:0/1007495149 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe53406ace0 0x7fe53406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:53:59.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.911+0000 7fe544ff9700 1 -- 172.21.15.40:0/1007495149 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe540089f40 con 0x7fe54815c720 2023-06-22T10:53:59.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.911+0000 7fe547fff700 1 --2- 172.21.15.40:0/1007495149 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe53406ace0 0x7fe53406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:53:59.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.911+0000 7fe547fff700 1 --2- 172.21.15.40:0/1007495149 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe53406ace0 0x7fe53406d190 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe54806b3a0 tx=0x7fe538009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:53:59.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:53:59.915+0000 7fe544ff9700 1 -- 172.21.15.40:0/1007495149 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe540058780 con 0x7fe54815c720 2023-06-22T10:54:00.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.170+0000 7fe54e7ff700 1 -- 172.21.15.40:0/1007495149 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe5480b6690 con 0x7fe54815c720 2023-06-22T10:54:00.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.171+0000 7fe544ff9700 1 -- 172.21.15.40:0/1007495149 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4664 (secure 0 0 0) 0x7fe540058310 con 0x7fe54815c720 2023-06-22T10:54:00.175 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:54:00.175 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/627935577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":627935577},{"type":"v1","addr":"172.21.15.40:6835","nonce":627935577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3018871402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3018871402},{"type":"v1","addr":"172.21.15.40:6837","nonce":3018871402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/4036649607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":4036649607},{"type":"v1","addr":"172.21.15.45:6834","nonce":4036649607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-22T10:53:31.430326+0000","modified":"2023-06-22T10:53:59.666730+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4303},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4303":{"gid":4303,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/1579627519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":1579627519},{"type":"v1","addr":"172.21.15.45:6835","nonce":1579627519}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-22T10:54:00.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.173+0000 7fe54e7ff700 1 -- 172.21.15.40:0/1007495149 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe53406ace0 msgr2=0x7fe53406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:00.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.173+0000 7fe54e7ff700 1 --2- 172.21.15.40:0/1007495149 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe53406ace0 0x7fe53406d190 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe54806b3a0 tx=0x7fe538009040 comp rx=0 tx=0).stop 2023-06-22T10:54:00.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.173+0000 7fe54e7ff700 1 -- 172.21.15.40:0/1007495149 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe54815c720 msgr2=0x7fe5480ca780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:00.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.173+0000 7fe54e7ff700 1 --2- 172.21.15.40:0/1007495149 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe54815c720 0x7fe5480ca780 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe540007e60 tx=0x7fe54000e3c0 comp rx=0 tx=0).stop 2023-06-22T10:54:00.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.174+0000 7fe54e7ff700 1 -- 172.21.15.40:0/1007495149 shutdown_connections 2023-06-22T10:54:00.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.174+0000 7fe54e7ff700 1 --2- 172.21.15.40:0/1007495149 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe53406ace0 0x7fe53406d190 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:00.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.174+0000 7fe54e7ff700 1 --2- 172.21.15.40:0/1007495149 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe54815c720 0x7fe5480ca780 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:00.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.174+0000 7fe54e7ff700 1 --2- 172.21.15.40:0/1007495149 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe5480b4c60 0x7fe5481f4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:00.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.174+0000 7fe54e7ff700 1 --2- 172.21.15.40:0/1007495149 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe5480d2830 0x7fe5481f1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:00.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.174+0000 7fe54e7ff700 1 -- 172.21.15.40:0/1007495149 >> 172.21.15.40:0/1007495149 conn(0x7fe5480cf720 msgr2=0x7fe5480d1570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:00.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.174+0000 7fe54e7ff700 1 -- 172.21.15.40:0/1007495149 shutdown_connections 2023-06-22T10:54:00.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.174+0000 7fe54e7ff700 1 -- 172.21.15.40:0/1007495149 wait complete. 2023-06-22T10:54:00.179 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 9 2023-06-22T10:54:00.195 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-22T10:54:00.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.390+0000 7f7ed21ff700 1 Processor -- start 2023-06-22T10:54:00.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.391+0000 7f7ed21ff700 1 -- start start 2023-06-22T10:54:00.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.392+0000 7f7ed21ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7ecc0d2830 0x7f7ecc0b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:00.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.392+0000 7f7ed21ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7ecc0b4c60 0x7f7ecc0d0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:00.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.392+0000 7f7ed21ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ecc0b50a0 con 0x7f7ecc15c720 2023-06-22T10:54:00.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.392+0000 7f7ed21ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ecc160d60 con 0x7f7ecc0d2830 2023-06-22T10:54:00.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.392+0000 7f7ed21ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ecc0b2130 con 0x7f7ecc0b4c60 2023-06-22T10:54:00.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.392+0000 7f7ecb7fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f7ecc15c720 0x7f7ecc0b1870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:58454/0 (socket says 172.21.15.40:58454) 2023-06-22T10:54:00.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.392+0000 7f7ecb7fe700 1 -- 172.21.15.40:0/3965096751 learned_addr learned my addr 172.21.15.40:0/3965096751 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:00.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.392+0000 7f7ecaffd700 1 --2- 172.21.15.40:0/3965096751 >> v2:172.21.15.40:3300/0 conn(0x7f7ecc0d2830 0x7f7ecc0b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:00.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.392+0000 7f7ecbfff700 1 --2- 172.21.15.40:0/3965096751 >> v2:172.21.15.45:3300/0 conn(0x7f7ecc0b4c60 0x7f7ecc0d0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:00.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.393+0000 7f7eca7fc700 1 -- 172.21.15.40:0/3965096751 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 683938789 0 0) 0x7f7ecc0b50a0 con 0x7f7ecc15c720 2023-06-22T10:54:00.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.393+0000 7f7eca7fc700 1 -- 172.21.15.40:0/3965096751 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7eb40035b0 con 0x7f7ecc15c720 2023-06-22T10:54:00.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.393+0000 7f7ecaffd700 1 -- 172.21.15.40:0/3965096751 >> v2:172.21.15.45:3300/0 conn(0x7f7ecc0b4c60 msgr2=0x7f7ecc0d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:00.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.393+0000 7f7ecaffd700 1 --2- 172.21.15.40:0/3965096751 >> v2:172.21.15.45:3300/0 conn(0x7f7ecc0b4c60 0x7f7ecc0d0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:00.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.393+0000 7f7ecaffd700 1 -- 172.21.15.40:0/3965096751 >> v1:172.21.15.40:6789/0 conn(0x7f7ecc15c720 legacy=0x7f7ecc0b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:00.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.393+0000 7f7ecaffd700 1 -- 172.21.15.40:0/3965096751 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ecc161180 con 0x7f7ecc0d2830 2023-06-22T10:54:00.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.393+0000 7f7ecaffd700 1 --2- 172.21.15.40:0/3965096751 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ecc0d2830 0x7f7ecc0b4720 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0009840 tx=0x7f7ec0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2231e80dec2ca2c6 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:00.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.393+0000 7f7eca7fc700 1 -- 172.21.15.40:0/3965096751 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec0011830 con 0x7f7ecc0d2830 2023-06-22T10:54:00.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.393+0000 7f7eca7fc700 1 -- 172.21.15.40:0/3965096751 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ec0011990 con 0x7f7ecc0d2830 2023-06-22T10:54:00.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.393+0000 7f7eca7fc700 1 -- 172.21.15.40:0/3965096751 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec0011d20 con 0x7f7ecc0d2830 2023-06-22T10:54:00.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.394+0000 7f7ed21ff700 1 -- 172.21.15.40:0/3965096751 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ecc0d2830 msgr2=0x7f7ecc0b4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:00.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.394+0000 7f7ed21ff700 1 --2- 172.21.15.40:0/3965096751 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ecc0d2830 0x7f7ecc0b4720 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0009840 tx=0x7f7ec0009b50 comp rx=0 tx=0).stop 2023-06-22T10:54:00.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.394+0000 7f7ed21ff700 1 -- 172.21.15.40:0/3965096751 shutdown_connections 2023-06-22T10:54:00.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.394+0000 7f7ed21ff700 1 --2- 172.21.15.40:0/3965096751 >> v2:172.21.15.45:3300/0 conn(0x7f7ecc0b4c60 0x7f7ecc0d0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:00.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.394+0000 7f7ed21ff700 1 --2- 172.21.15.40:0/3965096751 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ecc0d2830 0x7f7ecc0b4720 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:00.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.394+0000 7f7ed21ff700 1 -- 172.21.15.40:0/3965096751 >> 172.21.15.40:0/3965096751 conn(0x7f7ecc0cf720 msgr2=0x7f7ecc0cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:00.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.394+0000 7f7ed21ff700 1 -- 172.21.15.40:0/3965096751 shutdown_connections 2023-06-22T10:54:00.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.394+0000 7f7ed21ff700 1 -- 172.21.15.40:0/3965096751 wait complete. 2023-06-22T10:54:00.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.396+0000 7f7ed21ff700 1 Processor -- start 2023-06-22T10:54:00.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.396+0000 7f7ed21ff700 1 -- start start 2023-06-22T10:54:00.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.397+0000 7f7ed21ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f7ecc0b4c60 0x7f7ecc0b69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:00.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.397+0000 7f7ed21ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ecc0d2830 0x7f7ecc0b6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:00.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.397+0000 7f7ed21ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ecc15c720 0x7f7ecc0b7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:00.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.397+0000 7f7ed21ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ecc0b7470 con 0x7f7ecc0d2830 2023-06-22T10:54:00.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.397+0000 7f7ed21ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ecc0c9d70 con 0x7f7ecc15c720 2023-06-22T10:54:00.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.397+0000 7f7ed21ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ecc0ca050 con 0x7f7ecc0b4c60 2023-06-22T10:54:00.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.397+0000 7f7ecaffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ecc0d2830 0x7f7ecc0b6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:00.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.397+0000 7f7ecaffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ecc0d2830 0x7f7ecc0b6f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50516/0 (socket says 172.21.15.40:50516) 2023-06-22T10:54:00.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.397+0000 7f7ecaffd700 1 -- 172.21.15.40:0/2257892554 learned_addr learned my addr 172.21.15.40:0/2257892554 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:00.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.397+0000 7f7ecb7fe700 1 --2- 172.21.15.40:0/2257892554 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f7ecc0b4c60 0x7f7ecc0b69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:00.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.397+0000 7f7ecbfff700 1 --2- 172.21.15.40:0/2257892554 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ecc15c720 0x7f7ecc0b7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:00.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.397+0000 7f7ecaffd700 1 -- 172.21.15.40:0/2257892554 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f7ecc0b4c60 msgr2=0x7f7ecc0b69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:00.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.397+0000 7f7ecaffd700 1 --2- 172.21.15.40:0/2257892554 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f7ecc0b4c60 0x7f7ecc0b69f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:00.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.397+0000 7f7ecaffd700 1 -- 172.21.15.40:0/2257892554 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ecc15c720 msgr2=0x7f7ecc0b7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:00.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.397+0000 7f7ecaffd700 1 --2- 172.21.15.40:0/2257892554 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ecc15c720 0x7f7ecc0b7730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:00.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.397+0000 7f7ecaffd700 1 -- 172.21.15.40:0/2257892554 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec00094a0 con 0x7f7ecc0d2830 2023-06-22T10:54:00.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.398+0000 7f7ecaffd700 1 --2- 172.21.15.40:0/2257892554 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ecc0d2830 0x7f7ecc0b6f30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0009b90 tx=0x7f7ec0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:00.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.398+0000 7f7eb3fff700 1 -- 172.21.15.40:0/2257892554 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec0004510 con 0x7f7ecc0d2830 2023-06-22T10:54:00.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.398+0000 7f7eb3fff700 1 -- 172.21.15.40:0/2257892554 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ec001e070 con 0x7f7ecc0d2830 2023-06-22T10:54:00.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.398+0000 7f7eb3fff700 1 -- 172.21.15.40:0/2257892554 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec00038e0 con 0x7f7ecc0d2830 2023-06-22T10:54:00.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.398+0000 7f7ed21ff700 1 -- 172.21.15.40:0/2257892554 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ecc0ca330 con 0x7f7ecc0d2830 2023-06-22T10:54:00.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.398+0000 7f7ed21ff700 1 -- 172.21.15.40:0/2257892554 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ecc0ca8f0 con 0x7f7ecc0d2830 2023-06-22T10:54:00.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.399+0000 7f7ed21ff700 1 -- 172.21.15.40:0/2257892554 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ecc0caae0 con 0x7f7ecc0d2830 2023-06-22T10:54:00.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.400+0000 7f7eb3fff700 1 -- 172.21.15.40:0/2257892554 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7ec0003a40 con 0x7f7ecc0d2830 2023-06-22T10:54:00.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.401+0000 7f7eb3fff700 1 --2- 172.21.15.40:0/2257892554 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f7eb806ace0 0x7f7eb806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:00.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.401+0000 7f7eb3fff700 1 -- 172.21.15.40:0/2257892554 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7ec008a4a0 con 0x7f7ecc0d2830 2023-06-22T10:54:00.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.401+0000 7f7ecb7fe700 1 --2- 172.21.15.40:0/2257892554 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f7eb806ace0 0x7f7eb806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:00.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.402+0000 7f7ecb7fe700 1 --2- 172.21.15.40:0/2257892554 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f7eb806ace0 0x7f7eb806d190 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc007fd0 tx=0x7f7ebc007dc0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:00.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.405+0000 7f7eb3fff700 1 -- 172.21.15.40:0/2257892554 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7ec0055250 con 0x7f7ecc0d2830 2023-06-22T10:54:00.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.614+0000 7f7ed21ff700 1 -- 172.21.15.40:0/2257892554 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ecc067580 con 0x7f7ecc0d2830 2023-06-22T10:54:00.619 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.616+0000 7f7eb3fff700 1 -- 172.21.15.40:0/2257892554 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20036 (secure 0 0 0) 0x7f7ec0018310 con 0x7f7ecc0d2830 2023-06-22T10:54:00.620 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:54:00.620 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":28,"fsid":"475560bc-1a7c-4a75-b3b6-6fc6b20bdc52","created":"2023-06-22T10:53:03.784568+0000","modified":"2023-06-22T10:53:36.483308+0000","last_up_change":"2023-06-22T10:53:17.830348+0000","last_in_change":"2023-06-22T10:53:07.329974+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-22T10:53:17.182228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-22T10:53:23.874432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-22T10:53:29.812963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-22T10:53:30.404021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-22T10:53:33.982289+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"918db6b4-053a-46ba-976d-6e1a0104017f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6809","nonce":2400162888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6811","nonce":2400162888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6815","nonce":2400162888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6813","nonce":2400162888}]},"public_addr":"172.21.15.40:6809/2400162888","cluster_addr":"172.21.15.40:6811/2400162888","heartbeat_back_addr":"172.21.15.40:6815/2400162888","heartbeat_front_addr":"172.21.15.40:6813/2400162888","state":["exists","up"]},{"osd":1,"uuid":"0c146e2b-1725-4dae-9b5c-38795943b9d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6801","nonce":230885800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6803","nonce":230885800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6807","nonce":230885800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6805","nonce":230885800}]},"public_addr":"172.21.15.40:6801/230885800","cluster_addr":"172.21.15.40:6803/230885800","heartbeat_back_addr":"172.21.15.40:6807/230885800","heartbeat_front_addr":"172.21.15.40:6805/230885800","state":["exists","up"]},{"osd":2,"uuid":"0b3727fd-f281-46d5-a675-86c8c5ab269e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6817","nonce":2681404929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6819","nonce":2681404929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6823","nonce":2681404929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6821","nonce":2681404929}]},"public_addr":"172.21.15.40:6817/2681404929","cluster_addr":"172.21.15.40:6819/2681404929","heartbeat_back_addr":"172.21.15.40:6823/2681404929","heartbeat_front_addr":"172.21.15.40:6821/2681404929","state":["exists","up"]},{"osd":3,"uuid":"2969c698-7039-4bbb-beda-f756f7a368a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6825","nonce":111110981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6827","nonce":111110981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6831","nonce":111110981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6829","nonce":111110981}]},"public_addr":"172.21.15.40:6825/111110981","cluster_addr":"172.21.15.40:6827/111110981","heartbeat_back_addr":"172.21.15.40:6831/111110981","heartbeat_front_addr":"172.21.15.40:6829/111110981","state":["exists","up"]},{"osd":4,"uuid":"3bb1d9c8-8e42-4a6b-998d-04834f34be5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6801","nonce":3625455711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6803","nonce":3625455711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6807","nonce":3625455711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6805","nonce":3625455711}]},"public_addr":"172.21.15.45:6801/3625455711","cluster_addr":"172.21.15.45:6803/3625455711","heartbeat_back_addr":"172.21.15.45:6807/3625455711","heartbeat_front_addr":"172.21.15.45:6805/3625455711","state":["exists","up"]},{"osd":5,"uuid":"f9854ee4-302c-41be-977b-bedda090a3d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6817","nonce":3354411217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6819","nonce":3354411217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6823","nonce":3354411217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6821","nonce":3354411217}]},"public_addr":"172.21.15.45:6817/3354411217","cluster_addr":"172.21.15.45:6819/3354411217","heartbeat_back_addr":"172.21.15.45:6823/3354411217","heartbeat_front_addr":"172.21.15.45:6821/3354411217","state":["exists","up"]},{"osd":6,"uuid":"bbdb1989-f6ac-4954-9b85-b8b540d683c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6809","nonce":320111074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6811","nonce":320111074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6815","nonce":320111074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6813","nonce":320111074}]},"public_addr":"172.21.15.45:6809/320111074","cluster_addr":"172.21.15.45:6811/320111074","heartbeat_back_addr":"172.21.15.45:6815/320111074","heartbeat_front_addr":"172.21.15.45:6813/320111074","state":["exists","up"]},{"osd":7,"uuid":"823d44e3-58f1-4d1d-8263-a4e4a69d4327","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6825","nonce":643617680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6827","nonce":643617680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6831","nonce":643617680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6829","nonce":643617680}]},"public_addr":"172.21.15.45:6825/643617680","cluster_addr":"172.21.15.45:6827/643617680","heartbeat_back_addr":"172.21.15.45:6831/643617680","heartbeat_front_addr":"172.21.15.45:6829/643617680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.731262+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.873226+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.898936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.666578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.645990+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.953699+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.642823+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.693395+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-22T10:54:00.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.619+0000 7f7ed21ff700 1 -- 172.21.15.40:0/2257892554 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f7eb806ace0 msgr2=0x7f7eb806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:00.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.619+0000 7f7ed21ff700 1 --2- 172.21.15.40:0/2257892554 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f7eb806ace0 0x7f7eb806d190 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc007fd0 tx=0x7f7ebc007dc0 comp rx=0 tx=0).stop 2023-06-22T10:54:00.622 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.619+0000 7f7ed21ff700 1 -- 172.21.15.40:0/2257892554 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ecc0d2830 msgr2=0x7f7ecc0b6f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:00.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.619+0000 7f7ed21ff700 1 --2- 172.21.15.40:0/2257892554 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ecc0d2830 0x7f7ecc0b6f30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0009b90 tx=0x7f7ec0004750 comp rx=0 tx=0).stop 2023-06-22T10:54:00.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.619+0000 7f7ed21ff700 1 -- 172.21.15.40:0/2257892554 shutdown_connections 2023-06-22T10:54:00.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.619+0000 7f7ed21ff700 1 --2- 172.21.15.40:0/2257892554 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f7eb806ace0 0x7f7eb806d190 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:00.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.619+0000 7f7ed21ff700 1 --2- 172.21.15.40:0/2257892554 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f7ecc0b4c60 0x7f7ecc0b69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:00.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.619+0000 7f7ed21ff700 1 --2- 172.21.15.40:0/2257892554 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ecc15c720 0x7f7ecc0b7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:00.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.619+0000 7f7ed21ff700 1 --2- 172.21.15.40:0/2257892554 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7ecc0d2830 0x7f7ecc0b6f30 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:00.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.619+0000 7f7ed21ff700 1 -- 172.21.15.40:0/2257892554 >> 172.21.15.40:0/2257892554 conn(0x7f7ecc0cf720 msgr2=0x7f7ecc0d1570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:00.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.619+0000 7f7ed21ff700 1 -- 172.21.15.40:0/2257892554 shutdown_connections 2023-06-22T10:54:00.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.619+0000 7f7ed21ff700 1 -- 172.21.15.40:0/2257892554 wait complete. 2023-06-22T10:54:00.641 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-06-22T10:54:00.642 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-22T10:54:00.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.840+0000 7ff5a65ff700 1 Processor -- start 2023-06-22T10:54:00.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.841+0000 7ff5a65ff700 1 -- start start 2023-06-22T10:54:00.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.842+0000 7ff5a65ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff5a015c720 0x7ff5a00b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:00.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.842+0000 7ff5a65ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff5a00d2830 0x7ff5a00b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:00.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.842+0000 7ff5a65ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5a00b2130 con 0x7ff5a00b4c60 2023-06-22T10:54:00.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.842+0000 7ff5a65ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5a0160d60 con 0x7ff5a00d2830 2023-06-22T10:54:00.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.842+0000 7ff5a65ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a00b50e0 con 0x7ff5a015c720 2023-06-22T10:54:00.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.842+0000 7ff59f7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff5a00d2830 0x7ff5a00b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:00.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.842+0000 7ff59f7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff5a00d2830 0x7ff5a00b4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50526/0 (socket says 172.21.15.40:50526) 2023-06-22T10:54:00.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.842+0000 7ff59f7fe700 1 -- 172.21.15.40:0/3352790617 learned_addr learned my addr 172.21.15.40:0/3352790617 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:00.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.842+0000 7ff59ffff700 1 --2- 172.21.15.40:0/3352790617 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff5a015c720 0x7ff5a00b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:00.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.842+0000 7ff59f7fe700 1 -- 172.21.15.40:0/3352790617 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff5a015c720 msgr2=0x7ff5a00b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:00.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.842+0000 7ff59f7fe700 1 --2- 172.21.15.40:0/3352790617 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff5a015c720 0x7ff5a00b1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:00.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.842+0000 7ff59f7fe700 1 -- 172.21.15.40:0/3352790617 >> v1:172.21.15.45:6789/0 conn(0x7ff5a00b4c60 legacy=0x7ff5a006b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:00.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.843+0000 7ff59f7fe700 1 -- 172.21.15.40:0/3352790617 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a0161180 con 0x7ff5a00d2830 2023-06-22T10:54:00.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.843+0000 7ff59f7fe700 1 --2- 172.21.15.40:0/3352790617 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5a00d2830 0x7ff5a00b4720 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff5940098f0 tx=0x7ff594009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce40a883b4ef6490 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:00.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.843+0000 7ff59effd700 1 -- 172.21.15.40:0/3352790617 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff594004230 con 0x7ff5a00d2830 2023-06-22T10:54:00.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.843+0000 7ff59effd700 1 -- 172.21.15.40:0/3352790617 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff594004390 con 0x7ff5a00d2830 2023-06-22T10:54:00.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.843+0000 7ff59effd700 1 -- 172.21.15.40:0/3352790617 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5940036a0 con 0x7ff5a00d2830 2023-06-22T10:54:00.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.843+0000 7ff5a65ff700 1 -- 172.21.15.40:0/3352790617 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5a00d2830 msgr2=0x7ff5a00b4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:00.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.843+0000 7ff5a65ff700 1 --2- 172.21.15.40:0/3352790617 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5a00d2830 0x7ff5a00b4720 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff5940098f0 tx=0x7ff594009c00 comp rx=0 tx=0).stop 2023-06-22T10:54:00.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.844+0000 7ff5a65ff700 1 -- 172.21.15.40:0/3352790617 shutdown_connections 2023-06-22T10:54:00.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.844+0000 7ff5a65ff700 1 --2- 172.21.15.40:0/3352790617 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff5a015c720 0x7ff5a00b1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:00.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.844+0000 7ff5a65ff700 1 --2- 172.21.15.40:0/3352790617 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5a00d2830 0x7ff5a00b4720 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:00.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.844+0000 7ff5a65ff700 1 -- 172.21.15.40:0/3352790617 >> 172.21.15.40:0/3352790617 conn(0x7ff5a00cf720 msgr2=0x7ff5a00cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:00.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.844+0000 7ff5a65ff700 1 -- 172.21.15.40:0/3352790617 shutdown_connections 2023-06-22T10:54:00.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.844+0000 7ff5a65ff700 1 -- 172.21.15.40:0/3352790617 wait complete. 2023-06-22T10:54:00.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.845+0000 7ff5a65ff700 1 Processor -- start 2023-06-22T10:54:00.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.846+0000 7ff5a65ff700 1 -- start start 2023-06-22T10:54:00.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.846+0000 7ff5a65ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5a00b4c60 0x7ff5a0153860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:00.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.846+0000 7ff5a65ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff5a00d2830 0x7ff5a01f5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:00.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.846+0000 7ff5a65ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5a015c720 0x7ff5a015f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:00.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.846+0000 7ff5a65ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a015d000 con 0x7ff5a015c720 2023-06-22T10:54:00.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.846+0000 7ff5a65ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a01f3200 con 0x7ff5a00b4c60 2023-06-22T10:54:00.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.846+0000 7ff5a65ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a01f6560 con 0x7ff5a00d2830 2023-06-22T10:54:00.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.847+0000 7ff5a4b9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5a015c720 0x7ff5a015f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:00.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.847+0000 7ff5a4b9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5a015c720 0x7ff5a015f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50530/0 (socket says 172.21.15.40:50530) 2023-06-22T10:54:00.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.847+0000 7ff5a4b9c700 1 -- 172.21.15.40:0/164689271 learned_addr learned my addr 172.21.15.40:0/164689271 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:00.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.847+0000 7ff59ffff700 1 --2- 172.21.15.40:0/164689271 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5a00b4c60 0x7ff5a0153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:00.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.847+0000 7ff59f7fe700 1 --2- 172.21.15.40:0/164689271 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff5a00d2830 0x7ff5a01f5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:00.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.847+0000 7ff5a4b9c700 1 -- 172.21.15.40:0/164689271 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff5a00d2830 msgr2=0x7ff5a01f5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:00.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.847+0000 7ff5a4b9c700 1 --2- 172.21.15.40:0/164689271 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff5a00d2830 0x7ff5a01f5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:00.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.847+0000 7ff5a4b9c700 1 -- 172.21.15.40:0/164689271 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5a00b4c60 msgr2=0x7ff5a0153860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:00.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.847+0000 7ff5a4b9c700 1 --2- 172.21.15.40:0/164689271 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5a00b4c60 0x7ff5a0153860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:00.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.847+0000 7ff5a4b9c700 1 -- 172.21.15.40:0/164689271 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff594009550 con 0x7ff5a015c720 2023-06-22T10:54:00.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.847+0000 7ff5a4b9c700 1 --2- 172.21.15.40:0/164689271 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5a015c720 0x7ff5a015f100 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff59800cc40 tx=0x7ff59800cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:00.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.848+0000 7ff59cff9700 1 -- 172.21.15.40:0/164689271 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59800aa80 con 0x7ff5a015c720 2023-06-22T10:54:00.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.848+0000 7ff59cff9700 1 -- 172.21.15.40:0/164689271 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff59800abe0 con 0x7ff5a015c720 2023-06-22T10:54:00.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.848+0000 7ff5a65ff700 1 -- 172.21.15.40:0/164689271 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5a0153da0 con 0x7ff5a015c720 2023-06-22T10:54:00.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.848+0000 7ff59cff9700 1 -- 172.21.15.40:0/164689271 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff598012420 con 0x7ff5a015c720 2023-06-22T10:54:00.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.848+0000 7ff5a65ff700 1 -- 172.21.15.40:0/164689271 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5a01f6280 con 0x7ff5a015c720 2023-06-22T10:54:00.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.849+0000 7ff5a65ff700 1 -- 172.21.15.40:0/164689271 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5a015d140 con 0x7ff5a015c720 2023-06-22T10:54:00.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.850+0000 7ff59cff9700 1 -- 172.21.15.40:0/164689271 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff598012580 con 0x7ff5a015c720 2023-06-22T10:54:00.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.851+0000 7ff59cff9700 1 --2- 172.21.15.40:0/164689271 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7ff58c06ace0 0x7ff58c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:00.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.851+0000 7ff59cff9700 1 -- 172.21.15.40:0/164689271 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff598089d70 con 0x7ff5a015c720 2023-06-22T10:54:00.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.851+0000 7ff59ffff700 1 --2- 172.21.15.40:0/164689271 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7ff58c06ace0 0x7ff58c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:00.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.852+0000 7ff59ffff700 1 --2- 172.21.15.40:0/164689271 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7ff58c06ace0 0x7ff58c06d190 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff5a015ee80 tx=0x7ff590008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:00.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:00.855+0000 7ff59cff9700 1 -- 172.21.15.40:0/164689271 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff5a015d140 con 0x7ff5a015c720 2023-06-22T10:54:01.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.059+0000 7ff5a65ff700 1 -- 172.21.15.40:0/164689271 --> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff5a01606a0 con 0x7ff58c06ace0 2023-06-22T10:54:01.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.072+0000 7ff59cff9700 1 -- 172.21.15.40:0/164689271 <== mgr.4110 v2:172.21.15.40:6832/1803669772 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367364 (secure 0 0 0) 0x7ff5900076d0 con 0x7ff58c06ace0 2023-06-22T10:54:01.079 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:54:01.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.076+0000 7ff5a65ff700 1 -- 172.21.15.40:0/164689271 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7ff58c06ace0 msgr2=0x7ff58c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:01.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.076+0000 7ff5a65ff700 1 --2- 172.21.15.40:0/164689271 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7ff58c06ace0 0x7ff58c06d190 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff5a015ee80 tx=0x7ff590008040 comp rx=0 tx=0).stop 2023-06-22T10:54:01.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.076+0000 7ff5a65ff700 1 -- 172.21.15.40:0/164689271 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5a015c720 msgr2=0x7ff5a015f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:01.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.076+0000 7ff5a65ff700 1 --2- 172.21.15.40:0/164689271 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5a015c720 0x7ff5a015f100 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff59800cc40 tx=0x7ff59800cf50 comp rx=0 tx=0).stop 2023-06-22T10:54:01.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.076+0000 7ff5a65ff700 1 -- 172.21.15.40:0/164689271 shutdown_connections 2023-06-22T10:54:01.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.077+0000 7ff5a65ff700 1 --2- 172.21.15.40:0/164689271 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7ff58c06ace0 0x7ff58c06d190 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:01.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.077+0000 7ff5a65ff700 1 --2- 172.21.15.40:0/164689271 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5a015c720 0x7ff5a015f100 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:01.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.077+0000 7ff5a65ff700 1 --2- 172.21.15.40:0/164689271 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5a00b4c60 0x7ff5a0153860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:01.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.077+0000 7ff5a65ff700 1 --2- 172.21.15.40:0/164689271 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff5a00d2830 0x7ff5a01f5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:01.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.077+0000 7ff5a65ff700 1 -- 172.21.15.40:0/164689271 >> 172.21.15.40:0/164689271 conn(0x7ff5a00cf720 msgr2=0x7ff5a00b7ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:01.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.077+0000 7ff5a65ff700 1 -- 172.21.15.40:0/164689271 shutdown_connections 2023-06-22T10:54:01.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.077+0000 7ff5a65ff700 1 -- 172.21.15.40:0/164689271 wait complete. 2023-06-22T10:54:01.083 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-06-22T10:54:01.098 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":43,"stamp":"2023-06-22T10:53:59.131087+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219176,"kb_used_data":3560,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755544,"statfs":{"total":773094113280,"available":772869677056,"internally_reserved":0,"allocated":3645440,"data_stored":2175296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003206"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.540129+0000","last_change":"2023-06-22T10:53:31.946165+0000","last_active":"2023-06-22T10:53:37.540129+0000","last_peered":"2023-06-22T10:53:37.540129+0000","last_clean":"2023-06-22T10:53:37.540129+0000","last_became_active":"2023-06-22T10:53:31.945515+0000","last_became_peered":"2023-06-22T10:53:31.945515+0000","last_unstale":"2023-06-22T10:53:37.540129+0000","last_undegraded":"2023-06-22T10:53:37.540129+0000","last_fullsized":"2023-06-22T10:53:37.540129+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T13:02:07.560484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958797+0000","last_change":"2023-06-22T10:53:31.943630+0000","last_active":"2023-06-22T10:53:36.958797+0000","last_peered":"2023-06-22T10:53:36.958797+0000","last_clean":"2023-06-22T10:53:36.958797+0000","last_became_active":"2023-06-22T10:53:31.943233+0000","last_became_peered":"2023-06-22T10:53:31.943233+0000","last_unstale":"2023-06-22T10:53:36.958797+0000","last_undegraded":"2023-06-22T10:53:36.958797+0000","last_fullsized":"2023-06-22T10:53:36.958797+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:15:20.227426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.959406+0000","last_change":"2023-06-22T10:53:31.951823+0000","last_active":"2023-06-22T10:53:36.959406+0000","last_peered":"2023-06-22T10:53:36.959406+0000","last_clean":"2023-06-22T10:53:36.959406+0000","last_became_active":"2023-06-22T10:53:31.951456+0000","last_became_peered":"2023-06-22T10:53:31.951456+0000","last_unstale":"2023-06-22T10:53:36.959406+0000","last_undegraded":"2023-06-22T10:53:36.959406+0000","last_fullsized":"2023-06-22T10:53:36.959406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T17:57:40.473883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.280096+0000","last_change":"2023-06-22T10:53:31.941895+0000","last_active":"2023-06-22T10:53:37.280096+0000","last_peered":"2023-06-22T10:53:37.280096+0000","last_clean":"2023-06-22T10:53:37.280096+0000","last_became_active":"2023-06-22T10:53:31.941630+0000","last_became_peered":"2023-06-22T10:53:31.941630+0000","last_unstale":"2023-06-22T10:53:37.280096+0000","last_undegraded":"2023-06-22T10:53:37.280096+0000","last_fullsized":"2023-06-22T10:53:37.280096+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T17:25:39.331517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.956556+0000","last_change":"2023-06-22T10:53:31.945358+0000","last_active":"2023-06-22T10:53:36.956556+0000","last_peered":"2023-06-22T10:53:36.956556+0000","last_clean":"2023-06-22T10:53:36.956556+0000","last_became_active":"2023-06-22T10:53:31.945078+0000","last_became_peered":"2023-06-22T10:53:31.945078+0000","last_unstale":"2023-06-22T10:53:36.956556+0000","last_undegraded":"2023-06-22T10:53:36.956556+0000","last_fullsized":"2023-06-22T10:53:36.956556+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T13:04:27.917981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958367+0000","last_change":"2023-06-22T10:53:31.950691+0000","last_active":"2023-06-22T10:53:36.958367+0000","last_peered":"2023-06-22T10:53:36.958367+0000","last_clean":"2023-06-22T10:53:36.958367+0000","last_became_active":"2023-06-22T10:53:31.950418+0000","last_became_peered":"2023-06-22T10:53:31.950418+0000","last_unstale":"2023-06-22T10:53:36.958367+0000","last_undegraded":"2023-06-22T10:53:36.958367+0000","last_fullsized":"2023-06-22T10:53:36.958367+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:27:48.848591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.732456+0000","last_change":"2023-06-22T10:53:31.947663+0000","last_active":"2023-06-22T10:53:37.732456+0000","last_peered":"2023-06-22T10:53:37.732456+0000","last_clean":"2023-06-22T10:53:37.732456+0000","last_became_active":"2023-06-22T10:53:31.945462+0000","last_became_peered":"2023-06-22T10:53:31.945462+0000","last_unstale":"2023-06-22T10:53:37.732456+0000","last_undegraded":"2023-06-22T10:53:37.732456+0000","last_fullsized":"2023-06-22T10:53:37.732456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:37:31.693376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957438+0000","last_change":"2023-06-22T10:53:31.953829+0000","last_active":"2023-06-22T10:53:36.957438+0000","last_peered":"2023-06-22T10:53:36.957438+0000","last_clean":"2023-06-22T10:53:36.957438+0000","last_became_active":"2023-06-22T10:53:31.953479+0000","last_became_peered":"2023-06-22T10:53:31.953479+0000","last_unstale":"2023-06-22T10:53:36.957438+0000","last_undegraded":"2023-06-22T10:53:36.957438+0000","last_fullsized":"2023-06-22T10:53:36.957438+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:56:30.123428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.956661+0000","last_change":"2023-06-22T10:53:31.944979+0000","last_active":"2023-06-22T10:53:36.956661+0000","last_peered":"2023-06-22T10:53:36.956661+0000","last_clean":"2023-06-22T10:53:36.956661+0000","last_became_active":"2023-06-22T10:53:31.944596+0000","last_became_peered":"2023-06-22T10:53:31.944596+0000","last_unstale":"2023-06-22T10:53:36.956661+0000","last_undegraded":"2023-06-22T10:53:36.956661+0000","last_fullsized":"2023-06-22T10:53:36.956661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T18:57:56.828299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.959118+0000","last_change":"2023-06-22T10:53:31.935384+0000","last_active":"2023-06-22T10:53:36.959118+0000","last_peered":"2023-06-22T10:53:36.959118+0000","last_clean":"2023-06-22T10:53:36.959118+0000","last_became_active":"2023-06-22T10:53:31.935038+0000","last_became_peered":"2023-06-22T10:53:31.935038+0000","last_unstale":"2023-06-22T10:53:36.959118+0000","last_undegraded":"2023-06-22T10:53:36.959118+0000","last_fullsized":"2023-06-22T10:53:36.959118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T17:38:24.000272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.959531+0000","last_change":"2023-06-22T10:53:31.952559+0000","last_active":"2023-06-22T10:53:36.959531+0000","last_peered":"2023-06-22T10:53:36.959531+0000","last_clean":"2023-06-22T10:53:36.959531+0000","last_became_active":"2023-06-22T10:53:31.952213+0000","last_became_peered":"2023-06-22T10:53:31.952213+0000","last_unstale":"2023-06-22T10:53:36.959531+0000","last_undegraded":"2023-06-22T10:53:36.959531+0000","last_fullsized":"2023-06-22T10:53:36.959531+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T18:02:23.289710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.539887+0000","last_change":"2023-06-22T10:53:31.957089+0000","last_active":"2023-06-22T10:53:37.539887+0000","last_peered":"2023-06-22T10:53:37.539887+0000","last_clean":"2023-06-22T10:53:37.539887+0000","last_became_active":"2023-06-22T10:53:31.956521+0000","last_became_peered":"2023-06-22T10:53:31.956521+0000","last_unstale":"2023-06-22T10:53:37.539887+0000","last_undegraded":"2023-06-22T10:53:37.539887+0000","last_fullsized":"2023-06-22T10:53:37.539887+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T11:34:19.856827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.540314+0000","last_change":"2023-06-22T10:53:31.945942+0000","last_active":"2023-06-22T10:53:37.540314+0000","last_peered":"2023-06-22T10:53:37.540314+0000","last_clean":"2023-06-22T10:53:37.540314+0000","last_became_active":"2023-06-22T10:53:31.945443+0000","last_became_peered":"2023-06-22T10:53:31.945443+0000","last_unstale":"2023-06-22T10:53:37.540314+0000","last_undegraded":"2023-06-22T10:53:37.540314+0000","last_fullsized":"2023-06-22T10:53:37.540314+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:53:17.921814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957777+0000","last_change":"2023-06-22T10:53:31.942412+0000","last_active":"2023-06-22T10:53:36.957777+0000","last_peered":"2023-06-22T10:53:36.957777+0000","last_clean":"2023-06-22T10:53:36.957777+0000","last_became_active":"2023-06-22T10:53:31.942136+0000","last_became_peered":"2023-06-22T10:53:31.942136+0000","last_unstale":"2023-06-22T10:53:36.957777+0000","last_undegraded":"2023-06-22T10:53:36.957777+0000","last_fullsized":"2023-06-22T10:53:36.957777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T18:31:17.457352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.732252+0000","last_change":"2023-06-22T10:53:31.947458+0000","last_active":"2023-06-22T10:53:37.732252+0000","last_peered":"2023-06-22T10:53:37.732252+0000","last_clean":"2023-06-22T10:53:37.732252+0000","last_became_active":"2023-06-22T10:53:31.947174+0000","last_became_peered":"2023-06-22T10:53:31.947174+0000","last_unstale":"2023-06-22T10:53:37.732252+0000","last_undegraded":"2023-06-22T10:53:37.732252+0000","last_fullsized":"2023-06-22T10:53:37.732252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:19:58.431004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957495+0000","last_change":"2023-06-22T10:53:31.952787+0000","last_active":"2023-06-22T10:53:36.957495+0000","last_peered":"2023-06-22T10:53:36.957495+0000","last_clean":"2023-06-22T10:53:36.957495+0000","last_became_active":"2023-06-22T10:53:31.951585+0000","last_became_peered":"2023-06-22T10:53:31.951585+0000","last_unstale":"2023-06-22T10:53:36.957495+0000","last_undegraded":"2023-06-22T10:53:36.957495+0000","last_fullsized":"2023-06-22T10:53:36.957495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T13:31:48.249498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.956661+0000","last_change":"2023-06-22T10:53:31.944865+0000","last_active":"2023-06-22T10:53:36.956661+0000","last_peered":"2023-06-22T10:53:36.956661+0000","last_clean":"2023-06-22T10:53:36.956661+0000","last_became_active":"2023-06-22T10:53:31.944263+0000","last_became_peered":"2023-06-22T10:53:31.944263+0000","last_unstale":"2023-06-22T10:53:36.956661+0000","last_undegraded":"2023-06-22T10:53:36.956661+0000","last_fullsized":"2023-06-22T10:53:36.956661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:47:02.983369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958024+0000","last_change":"2023-06-22T10:53:31.954328+0000","last_active":"2023-06-22T10:53:36.958024+0000","last_peered":"2023-06-22T10:53:36.958024+0000","last_clean":"2023-06-22T10:53:36.958024+0000","last_became_active":"2023-06-22T10:53:31.953823+0000","last_became_peered":"2023-06-22T10:53:31.953823+0000","last_unstale":"2023-06-22T10:53:36.958024+0000","last_undegraded":"2023-06-22T10:53:36.958024+0000","last_fullsized":"2023-06-22T10:53:36.958024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:58:30.886558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.539896+0000","last_change":"2023-06-22T10:53:31.943196+0000","last_active":"2023-06-22T10:53:37.539896+0000","last_peered":"2023-06-22T10:53:37.539896+0000","last_clean":"2023-06-22T10:53:37.539896+0000","last_became_active":"2023-06-22T10:53:31.942920+0000","last_became_peered":"2023-06-22T10:53:31.942920+0000","last_unstale":"2023-06-22T10:53:37.539896+0000","last_undegraded":"2023-06-22T10:53:37.539896+0000","last_fullsized":"2023-06-22T10:53:37.539896+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T20:10:55.019762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958201+0000","last_change":"2023-06-22T10:53:31.951020+0000","last_active":"2023-06-22T10:53:36.958201+0000","last_peered":"2023-06-22T10:53:36.958201+0000","last_clean":"2023-06-22T10:53:36.958201+0000","last_became_active":"2023-06-22T10:53:31.950755+0000","last_became_peered":"2023-06-22T10:53:31.950755+0000","last_unstale":"2023-06-22T10:53:36.958201+0000","last_undegraded":"2023-06-22T10:53:36.958201+0000","last_fullsized":"2023-06-22T10:53:36.958201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:15:38.583741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.732513+0000","last_change":"2023-06-22T10:53:31.942953+0000","last_active":"2023-06-22T10:53:37.732513+0000","last_peered":"2023-06-22T10:53:37.732513+0000","last_clean":"2023-06-22T10:53:37.732513+0000","last_became_active":"2023-06-22T10:53:31.942724+0000","last_became_peered":"2023-06-22T10:53:31.942724+0000","last_unstale":"2023-06-22T10:53:37.732513+0000","last_undegraded":"2023-06-22T10:53:37.732513+0000","last_fullsized":"2023-06-22T10:53:37.732513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T13:38:17.711538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.955830+0000","last_change":"2023-06-22T10:53:31.943005+0000","last_active":"2023-06-22T10:53:36.955830+0000","last_peered":"2023-06-22T10:53:36.955830+0000","last_clean":"2023-06-22T10:53:36.955830+0000","last_became_active":"2023-06-22T10:53:31.942716+0000","last_became_peered":"2023-06-22T10:53:31.942716+0000","last_unstale":"2023-06-22T10:53:36.955830+0000","last_undegraded":"2023-06-22T10:53:36.955830+0000","last_fullsized":"2023-06-22T10:53:36.955830+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:59:14.357071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.298489+0000","last_change":"2023-06-22T10:53:31.935496+0000","last_active":"2023-06-22T10:53:39.298489+0000","last_peered":"2023-06-22T10:53:39.298489+0000","last_clean":"2023-06-22T10:53:39.298489+0000","last_became_active":"2023-06-22T10:53:31.935201+0000","last_became_peered":"2023-06-22T10:53:31.935201+0000","last_unstale":"2023-06-22T10:53:39.298489+0000","last_undegraded":"2023-06-22T10:53:39.298489+0000","last_fullsized":"2023-06-22T10:53:39.298489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:37:31.693376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.732169+0000","last_change":"2023-06-22T10:53:31.947093+0000","last_active":"2023-06-22T10:53:37.732169+0000","last_peered":"2023-06-22T10:53:37.732169+0000","last_clean":"2023-06-22T10:53:37.732169+0000","last_became_active":"2023-06-22T10:53:31.946566+0000","last_became_peered":"2023-06-22T10:53:31.946566+0000","last_unstale":"2023-06-22T10:53:37.732169+0000","last_undegraded":"2023-06-22T10:53:37.732169+0000","last_fullsized":"2023-06-22T10:53:37.732169+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T17:02:38.568336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421688+0000","last_change":"2023-06-22T10:53:31.954476+0000","last_active":"2023-06-22T10:53:38.421688+0000","last_peered":"2023-06-22T10:53:38.421688+0000","last_clean":"2023-06-22T10:53:38.421688+0000","last_became_active":"2023-06-22T10:53:31.954161+0000","last_became_peered":"2023-06-22T10:53:31.954161+0000","last_unstale":"2023-06-22T10:53:38.421688+0000","last_undegraded":"2023-06-22T10:53:38.421688+0000","last_fullsized":"2023-06-22T10:53:38.421688+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:59:50.197538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421712+0000","last_change":"2023-06-22T10:53:31.933946+0000","last_active":"2023-06-22T10:53:38.421712+0000","last_peered":"2023-06-22T10:53:38.421712+0000","last_clean":"2023-06-22T10:53:38.421712+0000","last_became_active":"2023-06-22T10:53:31.933657+0000","last_became_peered":"2023-06-22T10:53:31.933657+0000","last_unstale":"2023-06-22T10:53:38.421712+0000","last_undegraded":"2023-06-22T10:53:38.421712+0000","last_fullsized":"2023-06-22T10:53:38.421712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T17:19:23.835283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958575+0000","last_change":"2023-06-22T10:53:31.949726+0000","last_active":"2023-06-22T10:53:36.958575+0000","last_peered":"2023-06-22T10:53:36.958575+0000","last_clean":"2023-06-22T10:53:36.958575+0000","last_became_active":"2023-06-22T10:53:31.949378+0000","last_became_peered":"2023-06-22T10:53:31.949378+0000","last_unstale":"2023-06-22T10:53:36.958575+0000","last_undegraded":"2023-06-22T10:53:36.958575+0000","last_fullsized":"2023-06-22T10:53:36.958575+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:01:37.811790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.959265+0000","last_change":"2023-06-22T10:53:35.993727+0000","last_active":"2023-06-22T10:53:36.959265+0000","last_peered":"2023-06-22T10:53:36.959265+0000","last_clean":"2023-06-22T10:53:36.959265+0000","last_became_active":"2023-06-22T10:53:35.993292+0000","last_became_peered":"2023-06-22T10:53:35.993292+0000","last_unstale":"2023-06-22T10:53:36.959265+0000","last_undegraded":"2023-06-22T10:53:36.959265+0000","last_fullsized":"2023-06-22T10:53:36.959265+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:53:08.402503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958353+0000","last_change":"2023-06-22T10:53:30.935533+0000","last_active":"2023-06-22T10:53:36.958353+0000","last_peered":"2023-06-22T10:53:36.958353+0000","last_clean":"2023-06-22T10:53:36.958353+0000","last_became_active":"2023-06-22T10:53:30.935260+0000","last_became_peered":"2023-06-22T10:53:30.935260+0000","last_unstale":"2023-06-22T10:53:36.958353+0000","last_undegraded":"2023-06-22T10:53:36.958353+0000","last_fullsized":"2023-06-22T10:53:36.958353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T11:57:57.902900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.299328+0000","last_change":"2023-06-22T10:53:31.940482+0000","last_active":"2023-06-22T10:53:39.299328+0000","last_peered":"2023-06-22T10:53:39.299328+0000","last_clean":"2023-06-22T10:53:39.299328+0000","last_became_active":"2023-06-22T10:53:31.940185+0000","last_became_peered":"2023-06-22T10:53:31.940185+0000","last_unstale":"2023-06-22T10:53:39.299328+0000","last_undegraded":"2023-06-22T10:53:39.299328+0000","last_fullsized":"2023-06-22T10:53:39.299328+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:16:58.055706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.280322+0000","last_change":"2023-06-22T10:53:35.980222+0000","last_active":"2023-06-22T10:53:37.280322+0000","last_peered":"2023-06-22T10:53:37.280322+0000","last_clean":"2023-06-22T10:53:37.280322+0000","last_became_active":"2023-06-22T10:53:35.979767+0000","last_became_peered":"2023-06-22T10:53:35.979767+0000","last_unstale":"2023-06-22T10:53:37.280322+0000","last_undegraded":"2023-06-22T10:53:37.280322+0000","last_fullsized":"2023-06-22T10:53:37.280322+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:52:53.767824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421003+0000","last_change":"2023-06-22T10:53:30.945420+0000","last_active":"2023-06-22T10:53:38.421003+0000","last_peered":"2023-06-22T10:53:38.421003+0000","last_clean":"2023-06-22T10:53:38.421003+0000","last_became_active":"2023-06-22T10:53:30.945124+0000","last_became_peered":"2023-06-22T10:53:30.945124+0000","last_unstale":"2023-06-22T10:53:38.421003+0000","last_undegraded":"2023-06-22T10:53:38.421003+0000","last_fullsized":"2023-06-22T10:53:38.421003+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T20:10:12.732255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.956493+0000","last_change":"2023-06-22T10:53:31.946696+0000","last_active":"2023-06-22T10:53:36.956493+0000","last_peered":"2023-06-22T10:53:36.956493+0000","last_clean":"2023-06-22T10:53:36.956493+0000","last_became_active":"2023-06-22T10:53:31.946424+0000","last_became_peered":"2023-06-22T10:53:31.946424+0000","last_unstale":"2023-06-22T10:53:36.956493+0000","last_undegraded":"2023-06-22T10:53:36.956493+0000","last_fullsized":"2023-06-22T10:53:36.956493+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:38:31.209670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.956801+0000","last_change":"2023-06-22T10:53:35.983086+0000","last_active":"2023-06-22T10:53:36.956801+0000","last_peered":"2023-06-22T10:53:36.956801+0000","last_clean":"2023-06-22T10:53:36.956801+0000","last_became_active":"2023-06-22T10:53:35.980183+0000","last_became_peered":"2023-06-22T10:53:35.980183+0000","last_unstale":"2023-06-22T10:53:36.956801+0000","last_undegraded":"2023-06-22T10:53:36.956801+0000","last_fullsized":"2023-06-22T10:53:36.956801+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:04:18.976819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.298108+0000","last_change":"2023-06-22T10:53:30.939562+0000","last_active":"2023-06-22T10:53:39.298108+0000","last_peered":"2023-06-22T10:53:39.298108+0000","last_clean":"2023-06-22T10:53:39.298108+0000","last_became_active":"2023-06-22T10:53:30.939268+0000","last_became_peered":"2023-06-22T10:53:30.939268+0000","last_unstale":"2023-06-22T10:53:39.298108+0000","last_undegraded":"2023-06-22T10:53:39.298108+0000","last_fullsized":"2023-06-22T10:53:39.298108+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:35:50.219987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.280368+0000","last_change":"2023-06-22T10:53:31.943624+0000","last_active":"2023-06-22T10:53:37.280368+0000","last_peered":"2023-06-22T10:53:37.280368+0000","last_clean":"2023-06-22T10:53:37.280368+0000","last_became_active":"2023-06-22T10:53:31.943277+0000","last_became_peered":"2023-06-22T10:53:31.943277+0000","last_unstale":"2023-06-22T10:53:37.280368+0000","last_undegraded":"2023-06-22T10:53:37.280368+0000","last_fullsized":"2023-06-22T10:53:37.280368+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:09:48.895446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.279534+0000","last_change":"2023-06-22T10:53:35.989354+0000","last_active":"2023-06-22T10:53:37.279534+0000","last_peered":"2023-06-22T10:53:37.279534+0000","last_clean":"2023-06-22T10:53:37.279534+0000","last_became_active":"2023-06-22T10:53:35.988867+0000","last_became_peered":"2023-06-22T10:53:35.988867+0000","last_unstale":"2023-06-22T10:53:37.279534+0000","last_undegraded":"2023-06-22T10:53:37.279534+0000","last_fullsized":"2023-06-22T10:53:37.279534+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:53:21.959666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.956819+0000","last_change":"2023-06-22T10:53:30.938551+0000","last_active":"2023-06-22T10:53:36.956819+0000","last_peered":"2023-06-22T10:53:36.956819+0000","last_clean":"2023-06-22T10:53:36.956819+0000","last_became_active":"2023-06-22T10:53:30.938065+0000","last_became_peered":"2023-06-22T10:53:30.938065+0000","last_unstale":"2023-06-22T10:53:36.956819+0000","last_undegraded":"2023-06-22T10:53:36.956819+0000","last_fullsized":"2023-06-22T10:53:36.956819+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:08:20.088422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.298566+0000","last_change":"2023-06-22T10:53:31.944695+0000","last_active":"2023-06-22T10:53:39.298566+0000","last_peered":"2023-06-22T10:53:39.298566+0000","last_clean":"2023-06-22T10:53:39.298566+0000","last_became_active":"2023-06-22T10:53:31.944401+0000","last_became_peered":"2023-06-22T10:53:31.944401+0000","last_unstale":"2023-06-22T10:53:39.298566+0000","last_undegraded":"2023-06-22T10:53:39.298566+0000","last_fullsized":"2023-06-22T10:53:39.298566+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:15:20.227426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.731901+0000","last_change":"2023-06-22T10:53:35.977551+0000","last_active":"2023-06-22T10:53:37.731901+0000","last_peered":"2023-06-22T10:53:37.731901+0000","last_clean":"2023-06-22T10:53:37.731901+0000","last_became_active":"2023-06-22T10:53:35.976931+0000","last_became_peered":"2023-06-22T10:53:35.976931+0000","last_unstale":"2023-06-22T10:53:37.731901+0000","last_undegraded":"2023-06-22T10:53:37.731901+0000","last_fullsized":"2023-06-22T10:53:37.731901+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:58:45.151109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958943+0000","last_change":"2023-06-22T10:53:30.926577+0000","last_active":"2023-06-22T10:53:36.958943+0000","last_peered":"2023-06-22T10:53:36.958943+0000","last_clean":"2023-06-22T10:53:36.958943+0000","last_became_active":"2023-06-22T10:53:30.926220+0000","last_became_peered":"2023-06-22T10:53:30.926220+0000","last_unstale":"2023-06-22T10:53:36.958943+0000","last_undegraded":"2023-06-22T10:53:36.958943+0000","last_fullsized":"2023-06-22T10:53:36.958943+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:16:41.854261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.298455+0000","last_change":"2023-06-22T10:53:31.943837+0000","last_active":"2023-06-22T10:53:39.298455+0000","last_peered":"2023-06-22T10:53:39.298455+0000","last_clean":"2023-06-22T10:53:39.298455+0000","last_became_active":"2023-06-22T10:53:31.943561+0000","last_became_peered":"2023-06-22T10:53:31.943561+0000","last_unstale":"2023-06-22T10:53:39.298455+0000","last_undegraded":"2023-06-22T10:53:39.298455+0000","last_fullsized":"2023-06-22T10:53:39.298455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T13:38:17.711538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.298880+0000","last_change":"2023-06-22T10:53:35.980240+0000","last_active":"2023-06-22T10:53:39.298880+0000","last_peered":"2023-06-22T10:53:39.298880+0000","last_clean":"2023-06-22T10:53:39.298880+0000","last_became_active":"2023-06-22T10:53:35.979760+0000","last_became_peered":"2023-06-22T10:53:35.979760+0000","last_unstale":"2023-06-22T10:53:39.298880+0000","last_undegraded":"2023-06-22T10:53:39.298880+0000","last_fullsized":"2023-06-22T10:53:39.298880+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T17:38:28.038125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.732712+0000","last_change":"2023-06-22T10:53:30.942222+0000","last_active":"2023-06-22T10:53:37.732712+0000","last_peered":"2023-06-22T10:53:37.732712+0000","last_clean":"2023-06-22T10:53:37.732712+0000","last_became_active":"2023-06-22T10:53:30.941843+0000","last_became_peered":"2023-06-22T10:53:30.941843+0000","last_unstale":"2023-06-22T10:53:37.732712+0000","last_undegraded":"2023-06-22T10:53:37.732712+0000","last_fullsized":"2023-06-22T10:53:37.732712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:54:13.524784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421339+0000","last_change":"2023-06-22T10:53:31.940635+0000","last_active":"2023-06-22T10:53:38.421339+0000","last_peered":"2023-06-22T10:53:38.421339+0000","last_clean":"2023-06-22T10:53:38.421339+0000","last_became_active":"2023-06-22T10:53:31.940144+0000","last_became_peered":"2023-06-22T10:53:31.940144+0000","last_unstale":"2023-06-22T10:53:38.421339+0000","last_undegraded":"2023-06-22T10:53:38.421339+0000","last_fullsized":"2023-06-22T10:53:38.421339+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T18:57:56.828299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421113+0000","last_change":"2023-06-22T10:53:35.981516+0000","last_active":"2023-06-22T10:53:38.421113+0000","last_peered":"2023-06-22T10:53:38.421113+0000","last_clean":"2023-06-22T10:53:38.421113+0000","last_became_active":"2023-06-22T10:53:35.981085+0000","last_became_peered":"2023-06-22T10:53:35.981085+0000","last_unstale":"2023-06-22T10:53:38.421113+0000","last_undegraded":"2023-06-22T10:53:38.421113+0000","last_fullsized":"2023-06-22T10:53:38.421113+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:49:24.206495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'10","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:50.736031+0000","last_change":"2023-06-22T10:53:30.929674+0000","last_active":"2023-06-22T10:53:50.736031+0000","last_peered":"2023-06-22T10:53:50.736031+0000","last_clean":"2023-06-22T10:53:50.736031+0000","last_became_active":"2023-06-22T10:53:30.929103+0000","last_became_peered":"2023-06-22T10:53:30.929103+0000","last_unstale":"2023-06-22T10:53:50.736031+0000","last_undegraded":"2023-06-22T10:53:50.736031+0000","last_fullsized":"2023-06-22T10:53:50.736031+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T11:24:25.762617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958280+0000","last_change":"2023-06-22T10:53:31.950427+0000","last_active":"2023-06-22T10:53:36.958280+0000","last_peered":"2023-06-22T10:53:36.958280+0000","last_clean":"2023-06-22T10:53:36.958280+0000","last_became_active":"2023-06-22T10:53:31.950139+0000","last_became_peered":"2023-06-22T10:53:31.950139+0000","last_unstale":"2023-06-22T10:53:36.958280+0000","last_undegraded":"2023-06-22T10:53:36.958280+0000","last_fullsized":"2023-06-22T10:53:36.958280+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:32:48.965556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958792+0000","last_change":"2023-06-22T10:53:35.974441+0000","last_active":"2023-06-22T10:53:36.958792+0000","last_peered":"2023-06-22T10:53:36.958792+0000","last_clean":"2023-06-22T10:53:36.958792+0000","last_became_active":"2023-06-22T10:53:35.973542+0000","last_became_peered":"2023-06-22T10:53:35.973542+0000","last_unstale":"2023-06-22T10:53:36.958792+0000","last_undegraded":"2023-06-22T10:53:36.958792+0000","last_fullsized":"2023-06-22T10:53:36.958792+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:37:35.731228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.732330+0000","last_change":"2023-06-22T10:53:30.940712+0000","last_active":"2023-06-22T10:53:37.732330+0000","last_peered":"2023-06-22T10:53:37.732330+0000","last_clean":"2023-06-22T10:53:37.732330+0000","last_became_active":"2023-06-22T10:53:30.940318+0000","last_became_peered":"2023-06-22T10:53:30.940318+0000","last_unstale":"2023-06-22T10:53:37.732330+0000","last_undegraded":"2023-06-22T10:53:37.732330+0000","last_fullsized":"2023-06-22T10:53:37.732330+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:15:19.221249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.299326+0000","last_change":"2023-06-22T10:53:31.942026+0000","last_active":"2023-06-22T10:53:39.299326+0000","last_peered":"2023-06-22T10:53:39.299326+0000","last_clean":"2023-06-22T10:53:39.299326+0000","last_became_active":"2023-06-22T10:53:31.941695+0000","last_became_peered":"2023-06-22T10:53:31.941695+0000","last_unstale":"2023-06-22T10:53:39.299326+0000","last_undegraded":"2023-06-22T10:53:39.299326+0000","last_fullsized":"2023-06-22T10:53:39.299326+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:49:21.017446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.299153+0000","last_change":"2023-06-22T10:53:35.984076+0000","last_active":"2023-06-22T10:53:39.299153+0000","last_peered":"2023-06-22T10:53:39.299153+0000","last_clean":"2023-06-22T10:53:39.299153+0000","last_became_active":"2023-06-22T10:53:35.983702+0000","last_became_peered":"2023-06-22T10:53:35.983702+0000","last_unstale":"2023-06-22T10:53:39.299153+0000","last_undegraded":"2023-06-22T10:53:39.299153+0000","last_fullsized":"2023-06-22T10:53:39.299153+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:39:18.877636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.955629+0000","last_change":"2023-06-22T10:53:30.937271+0000","last_active":"2023-06-22T10:53:36.955629+0000","last_peered":"2023-06-22T10:53:36.955629+0000","last_clean":"2023-06-22T10:53:36.955629+0000","last_became_active":"2023-06-22T10:53:30.936656+0000","last_became_peered":"2023-06-22T10:53:30.936656+0000","last_unstale":"2023-06-22T10:53:36.955629+0000","last_undegraded":"2023-06-22T10:53:36.955629+0000","last_fullsized":"2023-06-22T10:53:36.955629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T20:35:09.275456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958456+0000","last_change":"2023-06-22T10:53:31.937743+0000","last_active":"2023-06-22T10:53:36.958456+0000","last_peered":"2023-06-22T10:53:36.958456+0000","last_clean":"2023-06-22T10:53:36.958456+0000","last_became_active":"2023-06-22T10:53:31.937458+0000","last_became_peered":"2023-06-22T10:53:31.937458+0000","last_unstale":"2023-06-22T10:53:36.958456+0000","last_undegraded":"2023-06-22T10:53:36.958456+0000","last_fullsized":"2023-06-22T10:53:36.958456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:09:14.741666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.299475+0000","last_change":"2023-06-22T10:53:35.988689+0000","last_active":"2023-06-22T10:53:39.299475+0000","last_peered":"2023-06-22T10:53:39.299475+0000","last_clean":"2023-06-22T10:53:39.299475+0000","last_became_active":"2023-06-22T10:53:35.988266+0000","last_became_peered":"2023-06-22T10:53:35.988266+0000","last_unstale":"2023-06-22T10:53:39.299475+0000","last_undegraded":"2023-06-22T10:53:39.299475+0000","last_fullsized":"2023-06-22T10:53:39.299475+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:00:09.093418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.732168+0000","last_change":"2023-06-22T10:53:30.941102+0000","last_active":"2023-06-22T10:53:37.732168+0000","last_peered":"2023-06-22T10:53:37.732168+0000","last_clean":"2023-06-22T10:53:37.732168+0000","last_became_active":"2023-06-22T10:53:30.940822+0000","last_became_peered":"2023-06-22T10:53:30.940822+0000","last_unstale":"2023-06-22T10:53:37.732168+0000","last_undegraded":"2023-06-22T10:53:37.732168+0000","last_fullsized":"2023-06-22T10:53:37.732168+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:09:13.735489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.956701+0000","last_change":"2023-06-22T10:53:31.944224+0000","last_active":"2023-06-22T10:53:36.956701+0000","last_peered":"2023-06-22T10:53:36.956701+0000","last_clean":"2023-06-22T10:53:36.956701+0000","last_became_active":"2023-06-22T10:53:31.943836+0000","last_became_peered":"2023-06-22T10:53:31.943836+0000","last_unstale":"2023-06-22T10:53:36.956701+0000","last_undegraded":"2023-06-22T10:53:36.956701+0000","last_fullsized":"2023-06-22T10:53:36.956701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:06:51.541995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958768+0000","last_change":"2023-06-22T10:53:35.972031+0000","last_active":"2023-06-22T10:53:36.958768+0000","last_peered":"2023-06-22T10:53:36.958768+0000","last_clean":"2023-06-22T10:53:36.958768+0000","last_became_active":"2023-06-22T10:53:35.971550+0000","last_became_peered":"2023-06-22T10:53:35.971550+0000","last_unstale":"2023-06-22T10:53:36.958768+0000","last_undegraded":"2023-06-22T10:53:36.958768+0000","last_fullsized":"2023-06-22T10:53:36.958768+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T13:38:21.749390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.279619+0000","last_change":"2023-06-22T10:53:30.937109+0000","last_active":"2023-06-22T10:53:37.279619+0000","last_peered":"2023-06-22T10:53:37.279619+0000","last_clean":"2023-06-22T10:53:37.279619+0000","last_became_active":"2023-06-22T10:53:30.936757+0000","last_became_peered":"2023-06-22T10:53:30.936757+0000","last_unstale":"2023-06-22T10:53:37.279619+0000","last_undegraded":"2023-06-22T10:53:37.279619+0000","last_fullsized":"2023-06-22T10:53:37.279619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T13:33:41.336023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.299478+0000","last_change":"2023-06-22T10:53:31.948662+0000","last_active":"2023-06-22T10:53:39.299478+0000","last_peered":"2023-06-22T10:53:39.299478+0000","last_clean":"2023-06-22T10:53:39.299478+0000","last_became_active":"2023-06-22T10:53:31.948201+0000","last_became_peered":"2023-06-22T10:53:31.948201+0000","last_unstale":"2023-06-22T10:53:39.299478+0000","last_undegraded":"2023-06-22T10:53:39.299478+0000","last_fullsized":"2023-06-22T10:53:39.299478+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T15:52:35.480952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.732657+0000","last_change":"2023-06-22T10:53:35.977231+0000","last_active":"2023-06-22T10:53:37.732657+0000","last_peered":"2023-06-22T10:53:37.732657+0000","last_clean":"2023-06-22T10:53:37.732657+0000","last_became_active":"2023-06-22T10:53:35.976777+0000","last_became_peered":"2023-06-22T10:53:35.976777+0000","last_unstale":"2023-06-22T10:53:37.732657+0000","last_undegraded":"2023-06-22T10:53:37.732657+0000","last_fullsized":"2023-06-22T10:53:37.732657+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:16:46.898291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.733132+0000","last_change":"2023-06-22T10:53:30.941433+0000","last_active":"2023-06-22T10:53:37.733132+0000","last_peered":"2023-06-22T10:53:37.733132+0000","last_clean":"2023-06-22T10:53:37.733132+0000","last_became_active":"2023-06-22T10:53:30.941122+0000","last_became_peered":"2023-06-22T10:53:30.941122+0000","last_unstale":"2023-06-22T10:53:37.733132+0000","last_undegraded":"2023-06-22T10:53:37.733132+0000","last_fullsized":"2023-06-22T10:53:37.733132+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:49:20.011268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957286+0000","last_change":"2023-06-22T10:53:31.946014+0000","last_active":"2023-06-22T10:53:36.957286+0000","last_peered":"2023-06-22T10:53:36.957286+0000","last_clean":"2023-06-22T10:53:36.957286+0000","last_became_active":"2023-06-22T10:53:31.945733+0000","last_became_peered":"2023-06-22T10:53:31.945733+0000","last_unstale":"2023-06-22T10:53:36.957286+0000","last_undegraded":"2023-06-22T10:53:36.957286+0000","last_fullsized":"2023-06-22T10:53:36.957286+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:54:20.603411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.539641+0000","last_change":"2023-06-22T10:53:35.976548+0000","last_active":"2023-06-22T10:53:37.539641+0000","last_peered":"2023-06-22T10:53:37.539641+0000","last_clean":"2023-06-22T10:53:37.539641+0000","last_became_active":"2023-06-22T10:53:35.975282+0000","last_became_peered":"2023-06-22T10:53:35.975282+0000","last_unstale":"2023-06-22T10:53:37.539641+0000","last_undegraded":"2023-06-22T10:53:37.539641+0000","last_fullsized":"2023-06-22T10:53:37.539641+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:47:49.439479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.733034+0000","last_change":"2023-06-22T10:53:30.940936+0000","last_active":"2023-06-22T10:53:37.733034+0000","last_peered":"2023-06-22T10:53:37.733034+0000","last_clean":"2023-06-22T10:53:37.733034+0000","last_became_active":"2023-06-22T10:53:30.940494+0000","last_became_peered":"2023-06-22T10:53:30.940494+0000","last_unstale":"2023-06-22T10:53:37.733034+0000","last_undegraded":"2023-06-22T10:53:37.733034+0000","last_fullsized":"2023-06-22T10:53:37.733034+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:39:13.833606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957664+0000","last_change":"2023-06-22T10:53:31.953007+0000","last_active":"2023-06-22T10:53:36.957664+0000","last_peered":"2023-06-22T10:53:36.957664+0000","last_clean":"2023-06-22T10:53:36.957664+0000","last_became_active":"2023-06-22T10:53:31.952493+0000","last_became_peered":"2023-06-22T10:53:31.952493+0000","last_unstale":"2023-06-22T10:53:36.957664+0000","last_undegraded":"2023-06-22T10:53:36.957664+0000","last_fullsized":"2023-06-22T10:53:36.957664+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:46:07.563474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.539899+0000","last_change":"2023-06-22T10:53:35.975271+0000","last_active":"2023-06-22T10:53:37.539899+0000","last_peered":"2023-06-22T10:53:37.539899+0000","last_clean":"2023-06-22T10:53:37.539899+0000","last_became_active":"2023-06-22T10:53:35.974796+0000","last_became_peered":"2023-06-22T10:53:35.974796+0000","last_unstale":"2023-06-22T10:53:37.539899+0000","last_undegraded":"2023-06-22T10:53:37.539899+0000","last_fullsized":"2023-06-22T10:53:37.539899+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:55:38.296763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.732906+0000","last_change":"2023-06-22T10:53:30.935554+0000","last_active":"2023-06-22T10:53:37.732906+0000","last_peered":"2023-06-22T10:53:37.732906+0000","last_clean":"2023-06-22T10:53:37.732906+0000","last_became_active":"2023-06-22T10:53:30.935186+0000","last_became_peered":"2023-06-22T10:53:30.935186+0000","last_unstale":"2023-06-22T10:53:37.732906+0000","last_undegraded":"2023-06-22T10:53:37.732906+0000","last_fullsized":"2023-06-22T10:53:37.732906+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:12:31.122076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.279728+0000","last_change":"2023-06-22T10:53:31.939659+0000","last_active":"2023-06-22T10:53:37.279728+0000","last_peered":"2023-06-22T10:53:37.279728+0000","last_clean":"2023-06-22T10:53:37.279728+0000","last_became_active":"2023-06-22T10:53:31.939359+0000","last_became_peered":"2023-06-22T10:53:31.939359+0000","last_unstale":"2023-06-22T10:53:37.279728+0000","last_undegraded":"2023-06-22T10:53:37.279728+0000","last_fullsized":"2023-06-22T10:53:37.279728+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T20:49:06.159398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.539838+0000","last_change":"2023-06-22T10:53:35.986300+0000","last_active":"2023-06-22T10:53:37.539838+0000","last_peered":"2023-06-22T10:53:37.539838+0000","last_clean":"2023-06-22T10:53:37.539838+0000","last_became_active":"2023-06-22T10:53:35.985773+0000","last_became_peered":"2023-06-22T10:53:35.985773+0000","last_unstale":"2023-06-22T10:53:37.539838+0000","last_undegraded":"2023-06-22T10:53:37.539838+0000","last_fullsized":"2023-06-22T10:53:37.539838+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:02:57.117668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957836+0000","last_change":"2023-06-22T10:53:30.938410+0000","last_active":"2023-06-22T10:53:36.957836+0000","last_peered":"2023-06-22T10:53:36.957836+0000","last_clean":"2023-06-22T10:53:36.957836+0000","last_became_active":"2023-06-22T10:53:30.938082+0000","last_became_peered":"2023-06-22T10:53:30.938082+0000","last_unstale":"2023-06-22T10:53:36.957836+0000","last_undegraded":"2023-06-22T10:53:36.957836+0000","last_fullsized":"2023-06-22T10:53:36.957836+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:01:52.091411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.956128+0000","last_change":"2023-06-22T10:53:31.938625+0000","last_active":"2023-06-22T10:53:36.956128+0000","last_peered":"2023-06-22T10:53:36.956128+0000","last_clean":"2023-06-22T10:53:36.956128+0000","last_became_active":"2023-06-22T10:53:31.938266+0000","last_became_peered":"2023-06-22T10:53:31.938266+0000","last_unstale":"2023-06-22T10:53:36.956128+0000","last_undegraded":"2023-06-22T10:53:36.956128+0000","last_fullsized":"2023-06-22T10:53:36.956128+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:22:33.870719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.540124+0000","last_change":"2023-06-22T10:53:35.973789+0000","last_active":"2023-06-22T10:53:37.540124+0000","last_peered":"2023-06-22T10:53:37.540124+0000","last_clean":"2023-06-22T10:53:37.540124+0000","last_became_active":"2023-06-22T10:53:35.973221+0000","last_became_peered":"2023-06-22T10:53:35.973221+0000","last_unstale":"2023-06-22T10:53:37.540124+0000","last_undegraded":"2023-06-22T10:53:37.540124+0000","last_fullsized":"2023-06-22T10:53:37.540124+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:41:28.183007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.298246+0000","last_change":"2023-06-22T10:53:30.940317+0000","last_active":"2023-06-22T10:53:39.298246+0000","last_peered":"2023-06-22T10:53:39.298246+0000","last_clean":"2023-06-22T10:53:39.298246+0000","last_became_active":"2023-06-22T10:53:30.939695+0000","last_became_peered":"2023-06-22T10:53:30.939695+0000","last_unstale":"2023-06-22T10:53:39.298246+0000","last_undegraded":"2023-06-22T10:53:39.298246+0000","last_fullsized":"2023-06-22T10:53:39.298246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:19:57.424826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957974+0000","last_change":"2023-06-22T10:53:31.955337+0000","last_active":"2023-06-22T10:53:36.957974+0000","last_peered":"2023-06-22T10:53:36.957974+0000","last_clean":"2023-06-22T10:53:36.957974+0000","last_became_active":"2023-06-22T10:53:31.955009+0000","last_became_peered":"2023-06-22T10:53:31.955009+0000","last_unstale":"2023-06-22T10:53:36.957974+0000","last_undegraded":"2023-06-22T10:53:36.957974+0000","last_fullsized":"2023-06-22T10:53:36.957974+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:44:52.079657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421497+0000","last_change":"2023-06-22T10:53:35.992703+0000","last_active":"2023-06-22T10:53:38.421497+0000","last_peered":"2023-06-22T10:53:38.421497+0000","last_clean":"2023-06-22T10:53:38.421497+0000","last_became_active":"2023-06-22T10:53:35.991759+0000","last_became_peered":"2023-06-22T10:53:35.991759+0000","last_unstale":"2023-06-22T10:53:38.421497+0000","last_undegraded":"2023-06-22T10:53:38.421497+0000","last_fullsized":"2023-06-22T10:53:38.421497+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:06:55.579848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.279637+0000","last_change":"2023-06-22T10:53:30.942339+0000","last_active":"2023-06-22T10:53:37.279637+0000","last_peered":"2023-06-22T10:53:37.279637+0000","last_clean":"2023-06-22T10:53:37.279637+0000","last_became_active":"2023-06-22T10:53:30.942042+0000","last_became_peered":"2023-06-22T10:53:30.942042+0000","last_unstale":"2023-06-22T10:53:37.279637+0000","last_undegraded":"2023-06-22T10:53:37.279637+0000","last_fullsized":"2023-06-22T10:53:37.279637+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:03:54.160970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.959163+0000","last_change":"2023-06-22T10:53:31.946119+0000","last_active":"2023-06-22T10:53:36.959163+0000","last_peered":"2023-06-22T10:53:36.959163+0000","last_clean":"2023-06-22T10:53:36.959163+0000","last_became_active":"2023-06-22T10:53:31.945270+0000","last_became_peered":"2023-06-22T10:53:31.945270+0000","last_unstale":"2023-06-22T10:53:36.959163+0000","last_undegraded":"2023-06-22T10:53:36.959163+0000","last_fullsized":"2023-06-22T10:53:36.959163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:54:16.378747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958959+0000","last_change":"2023-06-22T10:53:35.981345+0000","last_active":"2023-06-22T10:53:36.958959+0000","last_peered":"2023-06-22T10:53:36.958959+0000","last_clean":"2023-06-22T10:53:36.958959+0000","last_became_active":"2023-06-22T10:53:35.980744+0000","last_became_peered":"2023-06-22T10:53:35.980744+0000","last_unstale":"2023-06-22T10:53:36.958959+0000","last_undegraded":"2023-06-22T10:53:36.958959+0000","last_fullsized":"2023-06-22T10:53:36.958959+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:54:18.568814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957001+0000","last_change":"2023-06-22T10:53:30.932306+0000","last_active":"2023-06-22T10:53:36.957001+0000","last_peered":"2023-06-22T10:53:36.957001+0000","last_clean":"2023-06-22T10:53:36.957001+0000","last_became_active":"2023-06-22T10:53:30.931997+0000","last_became_peered":"2023-06-22T10:53:30.931997+0000","last_unstale":"2023-06-22T10:53:36.957001+0000","last_undegraded":"2023-06-22T10:53:36.957001+0000","last_fullsized":"2023-06-22T10:53:36.957001+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:39:13.833606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958190+0000","last_change":"2023-06-22T10:53:31.954114+0000","last_active":"2023-06-22T10:53:36.958190+0000","last_peered":"2023-06-22T10:53:36.958190+0000","last_clean":"2023-06-22T10:53:36.958190+0000","last_became_active":"2023-06-22T10:53:31.953496+0000","last_became_peered":"2023-06-22T10:53:31.953496+0000","last_unstale":"2023-06-22T10:53:36.958190+0000","last_undegraded":"2023-06-22T10:53:36.958190+0000","last_fullsized":"2023-06-22T10:53:36.958190+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T15:22:38.636161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957711+0000","last_change":"2023-06-22T10:53:35.986282+0000","last_active":"2023-06-22T10:53:36.957711+0000","last_peered":"2023-06-22T10:53:36.957711+0000","last_clean":"2023-06-22T10:53:36.957711+0000","last_became_active":"2023-06-22T10:53:35.985805+0000","last_became_peered":"2023-06-22T10:53:35.985805+0000","last_unstale":"2023-06-22T10:53:36.957711+0000","last_undegraded":"2023-06-22T10:53:36.957711+0000","last_fullsized":"2023-06-22T10:53:36.957711+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:06:28.390109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.298108+0000","last_change":"2023-06-22T10:53:30.937943+0000","last_active":"2023-06-22T10:53:39.298108+0000","last_peered":"2023-06-22T10:53:39.298108+0000","last_clean":"2023-06-22T10:53:39.298108+0000","last_became_active":"2023-06-22T10:53:30.937648+0000","last_became_peered":"2023-06-22T10:53:30.937648+0000","last_unstale":"2023-06-22T10:53:39.298108+0000","last_undegraded":"2023-06-22T10:53:39.298108+0000","last_fullsized":"2023-06-22T10:53:39.298108+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T17:02:37.562158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421904+0000","last_change":"2023-06-22T10:53:31.930885+0000","last_active":"2023-06-22T10:53:38.421904+0000","last_peered":"2023-06-22T10:53:38.421904+0000","last_clean":"2023-06-22T10:53:38.421904+0000","last_became_active":"2023-06-22T10:53:31.930508+0000","last_became_peered":"2023-06-22T10:53:31.930508+0000","last_unstale":"2023-06-22T10:53:38.421904+0000","last_undegraded":"2023-06-22T10:53:38.421904+0000","last_fullsized":"2023-06-22T10:53:38.421904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:56:30.123428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.956198+0000","last_change":"2023-06-22T10:53:35.981990+0000","last_active":"2023-06-22T10:53:36.956198+0000","last_peered":"2023-06-22T10:53:36.956198+0000","last_clean":"2023-06-22T10:53:36.956198+0000","last_became_active":"2023-06-22T10:53:35.979743+0000","last_became_peered":"2023-06-22T10:53:35.979743+0000","last_unstale":"2023-06-22T10:53:36.956198+0000","last_undegraded":"2023-06-22T10:53:36.956198+0000","last_fullsized":"2023-06-22T10:53:36.956198+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:29:28.820265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421611+0000","last_change":"2023-06-22T10:53:25.624603+0000","last_active":"2023-06-22T10:53:38.421611+0000","last_peered":"2023-06-22T10:53:38.421611+0000","last_clean":"2023-06-22T10:53:38.421611+0000","last_became_active":"2023-06-22T10:53:25.624302+0000","last_became_peered":"2023-06-22T10:53:25.624302+0000","last_unstale":"2023-06-22T10:53:38.421611+0000","last_undegraded":"2023-06-22T10:53:38.421611+0000","last_fullsized":"2023-06-22T10:53:38.421611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_clean_scrub_stamp":"2023-06-22T10:53:24.612028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:46:56.694570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958314+0000","last_change":"2023-06-22T10:53:30.938529+0000","last_active":"2023-06-22T10:53:36.958314+0000","last_peered":"2023-06-22T10:53:36.958314+0000","last_clean":"2023-06-22T10:53:36.958314+0000","last_became_active":"2023-06-22T10:53:30.938128+0000","last_became_peered":"2023-06-22T10:53:30.938128+0000","last_unstale":"2023-06-22T10:53:36.958314+0000","last_undegraded":"2023-06-22T10:53:36.958314+0000","last_fullsized":"2023-06-22T10:53:36.958314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:19:57.424826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421209+0000","last_change":"2023-06-22T10:53:31.943591+0000","last_active":"2023-06-22T10:53:38.421209+0000","last_peered":"2023-06-22T10:53:38.421209+0000","last_clean":"2023-06-22T10:53:38.421209+0000","last_became_active":"2023-06-22T10:53:31.943246+0000","last_became_peered":"2023-06-22T10:53:31.943246+0000","last_unstale":"2023-06-22T10:53:38.421209+0000","last_undegraded":"2023-06-22T10:53:38.421209+0000","last_fullsized":"2023-06-22T10:53:38.421209+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:38:31.209670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.956370+0000","last_change":"2023-06-22T10:53:35.983928+0000","last_active":"2023-06-22T10:53:36.956370+0000","last_peered":"2023-06-22T10:53:36.956370+0000","last_clean":"2023-06-22T10:53:36.956370+0000","last_became_active":"2023-06-22T10:53:35.983547+0000","last_became_peered":"2023-06-22T10:53:35.983547+0000","last_unstale":"2023-06-22T10:53:36.956370+0000","last_undegraded":"2023-06-22T10:53:36.956370+0000","last_fullsized":"2023-06-22T10:53:36.956370+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T15:14:35.353462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957795+0000","last_change":"2023-06-22T10:53:25.624213+0000","last_active":"2023-06-22T10:53:36.957795+0000","last_peered":"2023-06-22T10:53:36.957795+0000","last_clean":"2023-06-22T10:53:36.957795+0000","last_became_active":"2023-06-22T10:53:25.623692+0000","last_became_peered":"2023-06-22T10:53:25.623692+0000","last_unstale":"2023-06-22T10:53:36.957795+0000","last_undegraded":"2023-06-22T10:53:36.957795+0000","last_fullsized":"2023-06-22T10:53:36.957795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_clean_scrub_stamp":"2023-06-22T10:53:24.612028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T11:10:32.309210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957903+0000","last_change":"2023-06-22T10:53:30.940331+0000","last_active":"2023-06-22T10:53:36.957903+0000","last_peered":"2023-06-22T10:53:36.957903+0000","last_clean":"2023-06-22T10:53:36.957903+0000","last_became_active":"2023-06-22T10:53:30.939881+0000","last_became_peered":"2023-06-22T10:53:30.939881+0000","last_unstale":"2023-06-22T10:53:36.957903+0000","last_undegraded":"2023-06-22T10:53:36.957903+0000","last_fullsized":"2023-06-22T10:53:36.957903+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:21:26.540035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421562+0000","last_change":"2023-06-22T10:53:31.934499+0000","last_active":"2023-06-22T10:53:38.421562+0000","last_peered":"2023-06-22T10:53:38.421562+0000","last_clean":"2023-06-22T10:53:38.421562+0000","last_became_active":"2023-06-22T10:53:31.934221+0000","last_became_peered":"2023-06-22T10:53:31.934221+0000","last_unstale":"2023-06-22T10:53:38.421562+0000","last_undegraded":"2023-06-22T10:53:38.421562+0000","last_fullsized":"2023-06-22T10:53:38.421562+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:08:21.094599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.540144+0000","last_change":"2023-06-22T10:53:35.973534+0000","last_active":"2023-06-22T10:53:37.540144+0000","last_peered":"2023-06-22T10:53:37.540144+0000","last_clean":"2023-06-22T10:53:37.540144+0000","last_became_active":"2023-06-22T10:53:35.973091+0000","last_became_peered":"2023-06-22T10:53:35.973091+0000","last_unstale":"2023-06-22T10:53:37.540144+0000","last_undegraded":"2023-06-22T10:53:37.540144+0000","last_fullsized":"2023-06-22T10:53:37.540144+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:21:55.271025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.539801+0000","last_change":"2023-06-22T10:53:25.679314+0000","last_active":"2023-06-22T10:53:37.539801+0000","last_peered":"2023-06-22T10:53:37.539801+0000","last_clean":"2023-06-22T10:53:37.539801+0000","last_became_active":"2023-06-22T10:53:25.678947+0000","last_became_peered":"2023-06-22T10:53:25.678947+0000","last_unstale":"2023-06-22T10:53:37.539801+0000","last_undegraded":"2023-06-22T10:53:37.539801+0000","last_fullsized":"2023-06-22T10:53:37.539801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_clean_scrub_stamp":"2023-06-22T10:53:24.612028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:08:41.570586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421091+0000","last_change":"2023-06-22T10:53:30.944583+0000","last_active":"2023-06-22T10:53:38.421091+0000","last_peered":"2023-06-22T10:53:38.421091+0000","last_clean":"2023-06-22T10:53:38.421091+0000","last_became_active":"2023-06-22T10:53:30.944251+0000","last_became_peered":"2023-06-22T10:53:30.944251+0000","last_unstale":"2023-06-22T10:53:38.421091+0000","last_undegraded":"2023-06-22T10:53:38.421091+0000","last_fullsized":"2023-06-22T10:53:38.421091+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:16:33.667495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421775+0000","last_change":"2023-06-22T10:53:31.939367+0000","last_active":"2023-06-22T10:53:38.421775+0000","last_peered":"2023-06-22T10:53:38.421775+0000","last_clean":"2023-06-22T10:53:38.421775+0000","last_became_active":"2023-06-22T10:53:31.939090+0000","last_became_peered":"2023-06-22T10:53:31.939090+0000","last_unstale":"2023-06-22T10:53:38.421775+0000","last_undegraded":"2023-06-22T10:53:38.421775+0000","last_fullsized":"2023-06-22T10:53:38.421775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:31:58.628207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.732375+0000","last_change":"2023-06-22T10:53:35.971334+0000","last_active":"2023-06-22T10:53:37.732375+0000","last_peered":"2023-06-22T10:53:37.732375+0000","last_clean":"2023-06-22T10:53:37.732375+0000","last_became_active":"2023-06-22T10:53:35.970663+0000","last_became_peered":"2023-06-22T10:53:35.970663+0000","last_unstale":"2023-06-22T10:53:37.732375+0000","last_undegraded":"2023-06-22T10:53:37.732375+0000","last_fullsized":"2023-06-22T10:53:37.732375+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T15:48:40.394252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958397+0000","last_change":"2023-06-22T10:53:25.624072+0000","last_active":"2023-06-22T10:53:36.958397+0000","last_peered":"2023-06-22T10:53:36.958397+0000","last_clean":"2023-06-22T10:53:36.958397+0000","last_became_active":"2023-06-22T10:53:25.623617+0000","last_became_peered":"2023-06-22T10:53:25.623617+0000","last_unstale":"2023-06-22T10:53:36.958397+0000","last_undegraded":"2023-06-22T10:53:36.958397+0000","last_fullsized":"2023-06-22T10:53:36.958397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_clean_scrub_stamp":"2023-06-22T10:53:24.612028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T15:48:30.067600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":183,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.732114+0000","last_change":"2023-06-22T10:53:19.693774+0000","last_active":"2023-06-22T10:53:37.732114+0000","last_peered":"2023-06-22T10:53:37.732114+0000","last_clean":"2023-06-22T10:53:37.732114+0000","last_became_active":"2023-06-22T10:53:19.692329+0000","last_became_peered":"2023-06-22T10:53:19.692329+0000","last_unstale":"2023-06-22T10:53:37.732114+0000","last_undegraded":"2023-06-22T10:53:37.732114+0000","last_fullsized":"2023-06-22T10:53:37.732114+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:17.830348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:17.830348+0000","last_clean_scrub_stamp":"2023-06-22T10:53:17.830348+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:35:38.155685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.298095+0000","last_change":"2023-06-22T10:53:30.939596+0000","last_active":"2023-06-22T10:53:39.298095+0000","last_peered":"2023-06-22T10:53:39.298095+0000","last_clean":"2023-06-22T10:53:39.298095+0000","last_became_active":"2023-06-22T10:53:30.939312+0000","last_became_peered":"2023-06-22T10:53:30.939312+0000","last_unstale":"2023-06-22T10:53:39.298095+0000","last_undegraded":"2023-06-22T10:53:39.298095+0000","last_fullsized":"2023-06-22T10:53:39.298095+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:58:40.107079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.279924+0000","last_change":"2023-06-22T10:53:31.953786+0000","last_active":"2023-06-22T10:53:37.279924+0000","last_peered":"2023-06-22T10:53:37.279924+0000","last_clean":"2023-06-22T10:53:37.279924+0000","last_became_active":"2023-06-22T10:53:31.953495+0000","last_became_peered":"2023-06-22T10:53:31.953495+0000","last_unstale":"2023-06-22T10:53:37.279924+0000","last_undegraded":"2023-06-22T10:53:37.279924+0000","last_fullsized":"2023-06-22T10:53:37.279924+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T18:35:18.801024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958642+0000","last_change":"2023-06-22T10:53:35.985942+0000","last_active":"2023-06-22T10:53:36.958642+0000","last_peered":"2023-06-22T10:53:36.958642+0000","last_clean":"2023-06-22T10:53:36.958642+0000","last_became_active":"2023-06-22T10:53:35.985552+0000","last_became_peered":"2023-06-22T10:53:35.985552+0000","last_unstale":"2023-06-22T10:53:36.958642+0000","last_undegraded":"2023-06-22T10:53:36.958642+0000","last_fullsized":"2023-06-22T10:53:36.958642+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:54:23.850496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.732378+0000","last_change":"2023-06-22T10:53:25.626890+0000","last_active":"2023-06-22T10:53:37.732378+0000","last_peered":"2023-06-22T10:53:37.732378+0000","last_clean":"2023-06-22T10:53:37.732378+0000","last_became_active":"2023-06-22T10:53:25.626558+0000","last_became_peered":"2023-06-22T10:53:25.626558+0000","last_unstale":"2023-06-22T10:53:37.732378+0000","last_undegraded":"2023-06-22T10:53:37.732378+0000","last_fullsized":"2023-06-22T10:53:37.732378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_clean_scrub_stamp":"2023-06-22T10:53:24.612028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:54:13.523844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.955533+0000","last_change":"2023-06-22T10:53:30.943578+0000","last_active":"2023-06-22T10:53:36.955533+0000","last_peered":"2023-06-22T10:53:36.955533+0000","last_clean":"2023-06-22T10:53:36.955533+0000","last_became_active":"2023-06-22T10:53:30.943117+0000","last_became_peered":"2023-06-22T10:53:30.943117+0000","last_unstale":"2023-06-22T10:53:36.955533+0000","last_undegraded":"2023-06-22T10:53:36.955533+0000","last_fullsized":"2023-06-22T10:53:36.955533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:00:06.067980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.956299+0000","last_change":"2023-06-22T10:53:31.943987+0000","last_active":"2023-06-22T10:53:36.956299+0000","last_peered":"2023-06-22T10:53:36.956299+0000","last_clean":"2023-06-22T10:53:36.956299+0000","last_became_active":"2023-06-22T10:53:31.943488+0000","last_became_peered":"2023-06-22T10:53:31.943488+0000","last_unstale":"2023-06-22T10:53:36.956299+0000","last_undegraded":"2023-06-22T10:53:36.956299+0000","last_fullsized":"2023-06-22T10:53:36.956299+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:31:56.049728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.280108+0000","last_change":"2023-06-22T10:53:35.989113+0000","last_active":"2023-06-22T10:53:37.280108+0000","last_peered":"2023-06-22T10:53:37.280108+0000","last_clean":"2023-06-22T10:53:37.280108+0000","last_became_active":"2023-06-22T10:53:35.988755+0000","last_became_peered":"2023-06-22T10:53:35.988755+0000","last_unstale":"2023-06-22T10:53:37.280108+0000","last_undegraded":"2023-06-22T10:53:37.280108+0000","last_fullsized":"2023-06-22T10:53:37.280108+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T18:28:31.706827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.732796+0000","last_change":"2023-06-22T10:53:25.626005+0000","last_active":"2023-06-22T10:53:37.732796+0000","last_peered":"2023-06-22T10:53:37.732796+0000","last_clean":"2023-06-22T10:53:37.732796+0000","last_became_active":"2023-06-22T10:53:25.625614+0000","last_became_peered":"2023-06-22T10:53:25.625614+0000","last_unstale":"2023-06-22T10:53:37.732796+0000","last_undegraded":"2023-06-22T10:53:37.732796+0000","last_fullsized":"2023-06-22T10:53:37.732796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_clean_scrub_stamp":"2023-06-22T10:53:24.612028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T17:38:17.711473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421888+0000","last_change":"2023-06-22T10:53:30.929933+0000","last_active":"2023-06-22T10:53:38.421888+0000","last_peered":"2023-06-22T10:53:38.421888+0000","last_clean":"2023-06-22T10:53:38.421888+0000","last_became_active":"2023-06-22T10:53:30.929555+0000","last_became_peered":"2023-06-22T10:53:30.929555+0000","last_unstale":"2023-06-22T10:53:38.421888+0000","last_undegraded":"2023-06-22T10:53:38.421888+0000","last_fullsized":"2023-06-22T10:53:38.421888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:54:19.597233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.956482+0000","last_change":"2023-06-22T10:53:31.947501+0000","last_active":"2023-06-22T10:53:36.956482+0000","last_peered":"2023-06-22T10:53:36.956482+0000","last_clean":"2023-06-22T10:53:36.956482+0000","last_became_active":"2023-06-22T10:53:31.947187+0000","last_became_peered":"2023-06-22T10:53:31.947187+0000","last_unstale":"2023-06-22T10:53:36.956482+0000","last_undegraded":"2023-06-22T10:53:36.956482+0000","last_fullsized":"2023-06-22T10:53:36.956482+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:16:34.673673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957362+0000","last_change":"2023-06-22T10:53:35.993805+0000","last_active":"2023-06-22T10:53:36.957362+0000","last_peered":"2023-06-22T10:53:36.957362+0000","last_clean":"2023-06-22T10:53:36.957362+0000","last_became_active":"2023-06-22T10:53:35.993328+0000","last_became_peered":"2023-06-22T10:53:35.993328+0000","last_unstale":"2023-06-22T10:53:36.957362+0000","last_undegraded":"2023-06-22T10:53:36.957362+0000","last_fullsized":"2023-06-22T10:53:36.957362+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:00:09.093418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.298382+0000","last_change":"2023-06-22T10:53:30.940900+0000","last_active":"2023-06-22T10:53:39.298382+0000","last_peered":"2023-06-22T10:53:39.298382+0000","last_clean":"2023-06-22T10:53:39.298382+0000","last_became_active":"2023-06-22T10:53:30.940629+0000","last_became_peered":"2023-06-22T10:53:30.940629+0000","last_unstale":"2023-06-22T10:53:39.298382+0000","last_undegraded":"2023-06-22T10:53:39.298382+0000","last_fullsized":"2023-06-22T10:53:39.298382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:09:13.735489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421554+0000","last_change":"2023-06-22T10:53:25.625427+0000","last_active":"2023-06-22T10:53:38.421554+0000","last_peered":"2023-06-22T10:53:38.421554+0000","last_clean":"2023-06-22T10:53:38.421554+0000","last_became_active":"2023-06-22T10:53:25.625237+0000","last_became_peered":"2023-06-22T10:53:25.625237+0000","last_unstale":"2023-06-22T10:53:38.421554+0000","last_undegraded":"2023-06-22T10:53:38.421554+0000","last_fullsized":"2023-06-22T10:53:38.421554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_clean_scrub_stamp":"2023-06-22T10:53:24.612028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:04:08.650168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.298446+0000","last_change":"2023-06-22T10:53:31.949224+0000","last_active":"2023-06-22T10:53:39.298446+0000","last_peered":"2023-06-22T10:53:39.298446+0000","last_clean":"2023-06-22T10:53:39.298446+0000","last_became_active":"2023-06-22T10:53:31.948912+0000","last_became_peered":"2023-06-22T10:53:31.948912+0000","last_unstale":"2023-06-22T10:53:39.298446+0000","last_undegraded":"2023-06-22T10:53:39.298446+0000","last_fullsized":"2023-06-22T10:53:39.298446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:54:19.812644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.298399+0000","last_change":"2023-06-22T10:53:35.983189+0000","last_active":"2023-06-22T10:53:39.298399+0000","last_peered":"2023-06-22T10:53:39.298399+0000","last_clean":"2023-06-22T10:53:39.298399+0000","last_became_active":"2023-06-22T10:53:35.982759+0000","last_became_peered":"2023-06-22T10:53:35.982759+0000","last_unstale":"2023-06-22T10:53:39.298399+0000","last_undegraded":"2023-06-22T10:53:39.298399+0000","last_fullsized":"2023-06-22T10:53:39.298399+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:01:41.849642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.280276+0000","last_change":"2023-06-22T10:53:25.625880+0000","last_active":"2023-06-22T10:53:37.280276+0000","last_peered":"2023-06-22T10:53:37.280276+0000","last_clean":"2023-06-22T10:53:37.280276+0000","last_became_active":"2023-06-22T10:53:25.625464+0000","last_became_peered":"2023-06-22T10:53:25.625464+0000","last_unstale":"2023-06-22T10:53:37.280276+0000","last_undegraded":"2023-06-22T10:53:37.280276+0000","last_fullsized":"2023-06-22T10:53:37.280276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_clean_scrub_stamp":"2023-06-22T10:53:24.612028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T18:21:03.851910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"26'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.956476+0000","last_change":"2023-06-22T10:53:30.938779+0000","last_active":"2023-06-22T10:53:36.956476+0000","last_peered":"2023-06-22T10:53:36.956476+0000","last_clean":"2023-06-22T10:53:36.956476+0000","last_became_active":"2023-06-22T10:53:30.938504+0000","last_became_peered":"2023-06-22T10:53:30.938504+0000","last_unstale":"2023-06-22T10:53:36.956476+0000","last_undegraded":"2023-06-22T10:53:36.956476+0000","last_fullsized":"2023-06-22T10:53:36.956476+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:49:19.162465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957157+0000","last_change":"2023-06-22T10:53:31.952763+0000","last_active":"2023-06-22T10:53:36.957157+0000","last_peered":"2023-06-22T10:53:36.957157+0000","last_clean":"2023-06-22T10:53:36.957157+0000","last_became_active":"2023-06-22T10:53:31.952142+0000","last_became_peered":"2023-06-22T10:53:31.952142+0000","last_unstale":"2023-06-22T10:53:36.957157+0000","last_undegraded":"2023-06-22T10:53:36.957157+0000","last_fullsized":"2023-06-22T10:53:36.957157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:16:58.055706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421993+0000","last_change":"2023-06-22T10:53:35.990183+0000","last_active":"2023-06-22T10:53:38.421993+0000","last_peered":"2023-06-22T10:53:38.421993+0000","last_clean":"2023-06-22T10:53:38.421993+0000","last_became_active":"2023-06-22T10:53:35.989752+0000","last_became_peered":"2023-06-22T10:53:35.989752+0000","last_unstale":"2023-06-22T10:53:38.421993+0000","last_undegraded":"2023-06-22T10:53:38.421993+0000","last_fullsized":"2023-06-22T10:53:38.421993+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T18:31:21.495204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.956332+0000","last_change":"2023-06-22T10:53:30.943481+0000","last_active":"2023-06-22T10:53:36.956332+0000","last_peered":"2023-06-22T10:53:36.956332+0000","last_clean":"2023-06-22T10:53:36.956332+0000","last_became_active":"2023-06-22T10:53:30.943176+0000","last_became_peered":"2023-06-22T10:53:30.943176+0000","last_unstale":"2023-06-22T10:53:36.956332+0000","last_undegraded":"2023-06-22T10:53:36.956332+0000","last_fullsized":"2023-06-22T10:53:36.956332+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T20:10:12.732255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.540111+0000","last_change":"2023-06-22T10:53:31.936896+0000","last_active":"2023-06-22T10:53:37.540111+0000","last_peered":"2023-06-22T10:53:37.540111+0000","last_clean":"2023-06-22T10:53:37.540111+0000","last_became_active":"2023-06-22T10:53:31.936564+0000","last_became_peered":"2023-06-22T10:53:31.936564+0000","last_unstale":"2023-06-22T10:53:37.540111+0000","last_undegraded":"2023-06-22T10:53:37.540111+0000","last_fullsized":"2023-06-22T10:53:37.540111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T13:21:48.372064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.732378+0000","last_change":"2023-06-22T10:53:35.978716+0000","last_active":"2023-06-22T10:53:37.732378+0000","last_peered":"2023-06-22T10:53:37.732378+0000","last_clean":"2023-06-22T10:53:37.732378+0000","last_became_active":"2023-06-22T10:53:35.978326+0000","last_became_peered":"2023-06-22T10:53:35.978326+0000","last_unstale":"2023-06-22T10:53:37.732378+0000","last_undegraded":"2023-06-22T10:53:37.732378+0000","last_fullsized":"2023-06-22T10:53:37.732378+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:01:41.849642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958008+0000","last_change":"2023-06-22T10:53:30.936749+0000","last_active":"2023-06-22T10:53:36.958008+0000","last_peered":"2023-06-22T10:53:36.958008+0000","last_clean":"2023-06-22T10:53:36.958008+0000","last_became_active":"2023-06-22T10:53:30.936447+0000","last_became_peered":"2023-06-22T10:53:30.936447+0000","last_unstale":"2023-06-22T10:53:36.958008+0000","last_undegraded":"2023-06-22T10:53:36.958008+0000","last_fullsized":"2023-06-22T10:53:36.958008+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:58:40.107079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957755+0000","last_change":"2023-06-22T10:53:31.955250+0000","last_active":"2023-06-22T10:53:36.957755+0000","last_peered":"2023-06-22T10:53:36.957755+0000","last_clean":"2023-06-22T10:53:36.957755+0000","last_became_active":"2023-06-22T10:53:31.954904+0000","last_became_peered":"2023-06-22T10:53:31.954904+0000","last_unstale":"2023-06-22T10:53:36.957755+0000","last_undegraded":"2023-06-22T10:53:36.957755+0000","last_fullsized":"2023-06-22T10:53:36.957755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:57:41.183955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958248+0000","last_change":"2023-06-22T10:53:35.977443+0000","last_active":"2023-06-22T10:53:36.958248+0000","last_peered":"2023-06-22T10:53:36.958248+0000","last_clean":"2023-06-22T10:53:36.958248+0000","last_became_active":"2023-06-22T10:53:35.977008+0000","last_became_peered":"2023-06-22T10:53:35.977008+0000","last_unstale":"2023-06-22T10:53:36.958248+0000","last_undegraded":"2023-06-22T10:53:36.958248+0000","last_fullsized":"2023-06-22T10:53:36.958248+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T17:02:42.606188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958133+0000","last_change":"2023-06-22T10:53:30.936289+0000","last_active":"2023-06-22T10:53:36.958133+0000","last_peered":"2023-06-22T10:53:36.958133+0000","last_clean":"2023-06-22T10:53:36.958133+0000","last_became_active":"2023-06-22T10:53:30.935990+0000","last_became_peered":"2023-06-22T10:53:30.935990+0000","last_unstale":"2023-06-22T10:53:36.958133+0000","last_undegraded":"2023-06-22T10:53:36.958133+0000","last_fullsized":"2023-06-22T10:53:36.958133+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:35:50.219987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957131+0000","last_change":"2023-06-22T10:53:31.941782+0000","last_active":"2023-06-22T10:53:36.957131+0000","last_peered":"2023-06-22T10:53:36.957131+0000","last_clean":"2023-06-22T10:53:36.957131+0000","last_became_active":"2023-06-22T10:53:31.940237+0000","last_became_peered":"2023-06-22T10:53:31.940237+0000","last_unstale":"2023-06-22T10:53:36.957131+0000","last_undegraded":"2023-06-22T10:53:36.957131+0000","last_fullsized":"2023-06-22T10:53:36.957131+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:49:21.017446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.956920+0000","last_change":"2023-06-22T10:53:35.989317+0000","last_active":"2023-06-22T10:53:36.956920+0000","last_peered":"2023-06-22T10:53:36.956920+0000","last_clean":"2023-06-22T10:53:36.956920+0000","last_became_active":"2023-06-22T10:53:35.988872+0000","last_became_peered":"2023-06-22T10:53:35.988872+0000","last_unstale":"2023-06-22T10:53:36.956920+0000","last_undegraded":"2023-06-22T10:53:36.956920+0000","last_fullsized":"2023-06-22T10:53:36.956920+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:12:36.166106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.298288+0000","last_change":"2023-06-22T10:53:30.936018+0000","last_active":"2023-06-22T10:53:39.298288+0000","last_peered":"2023-06-22T10:53:39.298288+0000","last_clean":"2023-06-22T10:53:39.298288+0000","last_became_active":"2023-06-22T10:53:30.935754+0000","last_became_peered":"2023-06-22T10:53:30.935754+0000","last_unstale":"2023-06-22T10:53:39.298288+0000","last_undegraded":"2023-06-22T10:53:39.298288+0000","last_fullsized":"2023-06-22T10:53:39.298288+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T15:48:35.350222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.298625+0000","last_change":"2023-06-22T10:53:31.927521+0000","last_active":"2023-06-22T10:53:39.298625+0000","last_peered":"2023-06-22T10:53:39.298625+0000","last_clean":"2023-06-22T10:53:39.298625+0000","last_became_active":"2023-06-22T10:53:31.927230+0000","last_became_peered":"2023-06-22T10:53:31.927230+0000","last_unstale":"2023-06-22T10:53:39.298625+0000","last_undegraded":"2023-06-22T10:53:39.298625+0000","last_fullsized":"2023-06-22T10:53:39.298625+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:16:42.860439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421325+0000","last_change":"2023-06-22T10:53:35.976634+0000","last_active":"2023-06-22T10:53:38.421325+0000","last_peered":"2023-06-22T10:53:38.421325+0000","last_clean":"2023-06-22T10:53:38.421325+0000","last_became_active":"2023-06-22T10:53:35.976193+0000","last_became_peered":"2023-06-22T10:53:35.976193+0000","last_unstale":"2023-06-22T10:53:38.421325+0000","last_undegraded":"2023-06-22T10:53:38.421325+0000","last_fullsized":"2023-06-22T10:53:38.421325+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T13:04:31.955833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957011+0000","last_change":"2023-06-22T10:53:30.938370+0000","last_active":"2023-06-22T10:53:36.957011+0000","last_peered":"2023-06-22T10:53:36.957011+0000","last_clean":"2023-06-22T10:53:36.957011+0000","last_became_active":"2023-06-22T10:53:30.937695+0000","last_became_peered":"2023-06-22T10:53:30.937695+0000","last_unstale":"2023-06-22T10:53:36.957011+0000","last_undegraded":"2023-06-22T10:53:36.957011+0000","last_fullsized":"2023-06-22T10:53:36.957011+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:59:49.191360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957346+0000","last_change":"2023-06-22T10:53:31.951892+0000","last_active":"2023-06-22T10:53:36.957346+0000","last_peered":"2023-06-22T10:53:36.957346+0000","last_clean":"2023-06-22T10:53:36.957346+0000","last_became_active":"2023-06-22T10:53:31.951200+0000","last_became_peered":"2023-06-22T10:53:31.951200+0000","last_unstale":"2023-06-22T10:53:36.957346+0000","last_undegraded":"2023-06-22T10:53:36.957346+0000","last_fullsized":"2023-06-22T10:53:36.957346+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T15:52:35.480952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.279886+0000","last_change":"2023-06-22T10:53:31.941076+0000","last_active":"2023-06-22T10:53:37.279886+0000","last_peered":"2023-06-22T10:53:37.279886+0000","last_clean":"2023-06-22T10:53:37.279886+0000","last_became_active":"2023-06-22T10:53:31.940796+0000","last_became_peered":"2023-06-22T10:53:31.940796+0000","last_unstale":"2023-06-22T10:53:37.279886+0000","last_undegraded":"2023-06-22T10:53:37.279886+0000","last_fullsized":"2023-06-22T10:53:37.279886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:04:33.641511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.298918+0000","last_change":"2023-06-22T10:53:31.940503+0000","last_active":"2023-06-22T10:53:39.298918+0000","last_peered":"2023-06-22T10:53:39.298918+0000","last_clean":"2023-06-22T10:53:39.298918+0000","last_became_active":"2023-06-22T10:53:31.939741+0000","last_became_peered":"2023-06-22T10:53:31.939741+0000","last_unstale":"2023-06-22T10:53:39.298918+0000","last_undegraded":"2023-06-22T10:53:39.298918+0000","last_fullsized":"2023-06-22T10:53:39.298918+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:12:32.128254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958527+0000","last_change":"2023-06-22T10:53:31.946176+0000","last_active":"2023-06-22T10:53:36.958527+0000","last_peered":"2023-06-22T10:53:36.958527+0000","last_clean":"2023-06-22T10:53:36.958527+0000","last_became_active":"2023-06-22T10:53:31.945842+0000","last_became_peered":"2023-06-22T10:53:31.945842+0000","last_unstale":"2023-06-22T10:53:36.958527+0000","last_undegraded":"2023-06-22T10:53:36.958527+0000","last_fullsized":"2023-06-22T10:53:36.958527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T18:41:56.633064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.298684+0000","last_change":"2023-06-22T10:53:31.949833+0000","last_active":"2023-06-22T10:53:39.298684+0000","last_peered":"2023-06-22T10:53:39.298684+0000","last_clean":"2023-06-22T10:53:39.298684+0000","last_became_active":"2023-06-22T10:53:31.949098+0000","last_became_peered":"2023-06-22T10:53:31.949098+0000","last_unstale":"2023-06-22T10:53:39.298684+0000","last_undegraded":"2023-06-22T10:53:39.298684+0000","last_fullsized":"2023-06-22T10:53:39.298684+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:54:14.530962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421731+0000","last_change":"2023-06-22T10:53:31.947493+0000","last_active":"2023-06-22T10:53:38.421731+0000","last_peered":"2023-06-22T10:53:38.421731+0000","last_clean":"2023-06-22T10:53:38.421731+0000","last_became_active":"2023-06-22T10:53:31.947154+0000","last_became_peered":"2023-06-22T10:53:31.947154+0000","last_unstale":"2023-06-22T10:53:38.421731+0000","last_undegraded":"2023-06-22T10:53:38.421731+0000","last_fullsized":"2023-06-22T10:53:38.421731+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T17:28:50.883566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":876,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":897024,"data_stored":714122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]}]},{"osd":7,"up_from":14,"seq":60129542156,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":900,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":921600,"data_stored":717550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":303104,"data_stored":123262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":123172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":319488,"data_stored":127022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":307200,"data_stored":123824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]}]},{"osd":2,"up_from":14,"seq":60129542154,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":123172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]}]},{"osd":6,"up_from":14,"seq":60129542155,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":123172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-22T10:54:01.107 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-22T10:54:01.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.336+0000 7fdf4f7ff700 1 Processor -- start 2023-06-22T10:54:01.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.336+0000 7fdf4f7ff700 1 -- start start 2023-06-22T10:54:01.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.337+0000 7fdf4f7ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdf4815c720 0x7fdf480b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:01.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.337+0000 7fdf4f7ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf480b2130 con 0x7fdf480d2830 2023-06-22T10:54:01.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.337+0000 7fdf4f7ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf48161180 con 0x7fdf480b4e30 2023-06-22T10:54:01.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.337+0000 7fdf4f7ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf48160d60 con 0x7fdf4815c720 2023-06-22T10:54:01.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.337+0000 7fdf4cd9a700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fdf480d2830 0x7fdf480b4720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:58460/0 (socket says 172.21.15.40:58460) 2023-06-22T10:54:01.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.337+0000 7fdf4cd9a700 1 -- 172.21.15.40:0/3986435829 learned_addr learned my addr 172.21.15.40:0/3986435829 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:01.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.337+0000 7fdf4d59b700 1 --2- 172.21.15.40:0/3986435829 >> v2:172.21.15.45:3300/0 conn(0x7fdf4815c720 0x7fdf480b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:01.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.338+0000 7fdf3ffff700 1 -- 172.21.15.40:0/3986435829 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3561431025 0 0) 0x7fdf480b2130 con 0x7fdf480d2830 2023-06-22T10:54:01.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.338+0000 7fdf3ffff700 1 -- 172.21.15.40:0/3986435829 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf340035b0 con 0x7fdf480d2830 2023-06-22T10:54:01.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.338+0000 7fdf3ffff700 1 -- 172.21.15.40:0/3986435829 <== mon.1 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1607158053 0 0) 0x7fdf48161180 con 0x7fdf480b4e30 2023-06-22T10:54:01.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.338+0000 7fdf3ffff700 1 -- 172.21.15.40:0/3986435829 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf480b2130 con 0x7fdf480b4e30 2023-06-22T10:54:01.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.338+0000 7fdf4d59b700 1 -- 172.21.15.40:0/3986435829 >> v1:172.21.15.45:6789/0 conn(0x7fdf480b4e30 legacy=0x7fdf480d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:01.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.338+0000 7fdf4d59b700 1 -- 172.21.15.40:0/3986435829 >> v1:172.21.15.40:6789/0 conn(0x7fdf480d2830 legacy=0x7fdf480b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:01.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.338+0000 7fdf4d59b700 1 -- 172.21.15.40:0/3986435829 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf481603c0 con 0x7fdf4815c720 2023-06-22T10:54:01.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.338+0000 7fdf4d59b700 1 --2- 172.21.15.40:0/3986435829 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf4815c720 0x7fdf480b1870 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdf44009870 tx=0x7fdf44009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a2b962ebe758e36 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:01.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.338+0000 7fdf3ffff700 1 -- 172.21.15.40:0/3986435829 <== mon.1 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf44011830 con 0x7fdf4815c720 2023-06-22T10:54:01.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.338+0000 7fdf3ffff700 1 -- 172.21.15.40:0/3986435829 <== mon.1 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf44011990 con 0x7fdf4815c720 2023-06-22T10:54:01.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.338+0000 7fdf3ffff700 1 -- 172.21.15.40:0/3986435829 <== mon.1 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf44011d20 con 0x7fdf4815c720 2023-06-22T10:54:01.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.339+0000 7fdf4f7ff700 1 -- 172.21.15.40:0/3986435829 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf4815c720 msgr2=0x7fdf480b1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:01.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.339+0000 7fdf4f7ff700 1 --2- 172.21.15.40:0/3986435829 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf4815c720 0x7fdf480b1870 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdf44009870 tx=0x7fdf44009b80 comp rx=0 tx=0).stop 2023-06-22T10:54:01.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.339+0000 7fdf4f7ff700 1 -- 172.21.15.40:0/3986435829 shutdown_connections 2023-06-22T10:54:01.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.339+0000 7fdf4f7ff700 1 --2- 172.21.15.40:0/3986435829 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf4815c720 0x7fdf480b1870 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:01.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.339+0000 7fdf4f7ff700 1 -- 172.21.15.40:0/3986435829 >> 172.21.15.40:0/3986435829 conn(0x7fdf480cf720 msgr2=0x7fdf480cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:01.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.339+0000 7fdf4f7ff700 1 -- 172.21.15.40:0/3986435829 shutdown_connections 2023-06-22T10:54:01.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.339+0000 7fdf4f7ff700 1 -- 172.21.15.40:0/3986435829 wait complete. 2023-06-22T10:54:01.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.341+0000 7fdf4f7ff700 1 Processor -- start 2023-06-22T10:54:01.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.341+0000 7fdf4f7ff700 1 -- start start 2023-06-22T10:54:01.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.342+0000 7fdf4f7ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf480b4e30 0x7fdf480a9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:01.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.342+0000 7fdf4f7ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf480d2830 0x7fdf4815dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:01.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.342+0000 7fdf4f7ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fdf4815c720 0x7fdf4815e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:01.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.342+0000 7fdf4f7ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf480cb740 con 0x7fdf480b4e30 2023-06-22T10:54:01.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.342+0000 7fdf4f7ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf48150110 con 0x7fdf480d2830 2023-06-22T10:54:01.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.342+0000 7fdf4f7ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf480caac0 con 0x7fdf4815c720 2023-06-22T10:54:01.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.342+0000 7fdf4d59b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf480b4e30 0x7fdf480a9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:01.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.342+0000 7fdf4d59b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf480b4e30 0x7fdf480a9f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50546/0 (socket says 172.21.15.40:50546) 2023-06-22T10:54:01.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.342+0000 7fdf4d59b700 1 -- 172.21.15.40:0/3748888110 learned_addr learned my addr 172.21.15.40:0/3748888110 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:01.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.342+0000 7fdf4cd9a700 1 --2- 172.21.15.40:0/3748888110 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf480d2830 0x7fdf4815dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:01.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.342+0000 7fdf4dd9c700 1 --2- 172.21.15.40:0/3748888110 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fdf4815c720 0x7fdf4815e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:01.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.343+0000 7fdf4d59b700 1 -- 172.21.15.40:0/3748888110 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fdf4815c720 msgr2=0x7fdf4815e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:01.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.343+0000 7fdf4d59b700 1 --2- 172.21.15.40:0/3748888110 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fdf4815c720 0x7fdf4815e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:01.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.343+0000 7fdf4d59b700 1 -- 172.21.15.40:0/3748888110 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf480d2830 msgr2=0x7fdf4815dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:01.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.343+0000 7fdf4d59b700 1 --2- 172.21.15.40:0/3748888110 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf480d2830 0x7fdf4815dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:01.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.343+0000 7fdf4d59b700 1 -- 172.21.15.40:0/3748888110 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf440094a0 con 0x7fdf480b4e30 2023-06-22T10:54:01.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.343+0000 7fdf4d59b700 1 --2- 172.21.15.40:0/3748888110 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf480b4e30 0x7fdf480a9f80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fdf44014040 tx=0x7fdf44004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:01.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.343+0000 7fdf3dffb700 1 -- 172.21.15.40:0/3748888110 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4401a9f0 con 0x7fdf480b4e30 2023-06-22T10:54:01.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.343+0000 7fdf3dffb700 1 -- 172.21.15.40:0/3748888110 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf4401ab50 con 0x7fdf480b4e30 2023-06-22T10:54:01.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.343+0000 7fdf3dffb700 1 -- 172.21.15.40:0/3748888110 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf440223f0 con 0x7fdf480b4e30 2023-06-22T10:54:01.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.343+0000 7fdf4f7ff700 1 -- 172.21.15.40:0/3748888110 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf480cada0 con 0x7fdf480b4e30 2023-06-22T10:54:01.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.343+0000 7fdf4f7ff700 1 -- 172.21.15.40:0/3748888110 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf480cb360 con 0x7fdf480b4e30 2023-06-22T10:54:01.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.344+0000 7fdf4f7ff700 1 -- 172.21.15.40:0/3748888110 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf48067580 con 0x7fdf480b4e30 2023-06-22T10:54:01.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.345+0000 7fdf3dffb700 1 -- 172.21.15.40:0/3748888110 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdf440193b0 con 0x7fdf480b4e30 2023-06-22T10:54:01.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.346+0000 7fdf3dffb700 1 --2- 172.21.15.40:0/3748888110 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fdf2c06ace0 0x7fdf2c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:01.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.346+0000 7fdf3dffb700 1 -- 172.21.15.40:0/3748888110 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdf4408a370 con 0x7fdf480b4e30 2023-06-22T10:54:01.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.346+0000 7fdf4cd9a700 1 --2- 172.21.15.40:0/3748888110 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fdf2c06ace0 0x7fdf2c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:01.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.347+0000 7fdf4cd9a700 1 --2- 172.21.15.40:0/3748888110 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fdf2c06ace0 0x7fdf2c06d190 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdf481509b0 tx=0x7fdf38007e00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:01.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.350+0000 7fdf3dffb700 1 -- 172.21.15.40:0/3748888110 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdf440552f0 con 0x7fdf480b4e30 2023-06-22T10:54:01.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.551+0000 7fdf4f7ff700 1 -- 172.21.15.40:0/3748888110 --> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdf48160980 con 0x7fdf2c06ace0 2023-06-22T10:54:01.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.562+0000 7fdf3dffb700 1 -- 172.21.15.40:0/3748888110 <== mgr.4110 v2:172.21.15.40:6832/1803669772 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367364 (secure 0 0 0) 0x7fdf380058e0 con 0x7fdf2c06ace0 2023-06-22T10:54:01.568 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:54:01.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.567+0000 7fdf4f7ff700 1 -- 172.21.15.40:0/3748888110 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fdf2c06ace0 msgr2=0x7fdf2c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:01.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.567+0000 7fdf4f7ff700 1 --2- 172.21.15.40:0/3748888110 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fdf2c06ace0 0x7fdf2c06d190 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdf481509b0 tx=0x7fdf38007e00 comp rx=0 tx=0).stop 2023-06-22T10:54:01.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.567+0000 7fdf4f7ff700 1 -- 172.21.15.40:0/3748888110 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf480b4e30 msgr2=0x7fdf480a9f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:01.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.567+0000 7fdf4f7ff700 1 --2- 172.21.15.40:0/3748888110 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf480b4e30 0x7fdf480a9f80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fdf44014040 tx=0x7fdf44004750 comp rx=0 tx=0).stop 2023-06-22T10:54:01.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.567+0000 7fdf4f7ff700 1 -- 172.21.15.40:0/3748888110 shutdown_connections 2023-06-22T10:54:01.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.567+0000 7fdf4f7ff700 1 --2- 172.21.15.40:0/3748888110 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fdf2c06ace0 0x7fdf2c06d190 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:01.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.567+0000 7fdf4f7ff700 1 --2- 172.21.15.40:0/3748888110 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fdf4815c720 0x7fdf4815e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:01.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.567+0000 7fdf4f7ff700 1 --2- 172.21.15.40:0/3748888110 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf480b4e30 0x7fdf480a9f80 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:01.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.567+0000 7fdf4f7ff700 1 --2- 172.21.15.40:0/3748888110 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf480d2830 0x7fdf4815dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:01.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.567+0000 7fdf4f7ff700 1 -- 172.21.15.40:0/3748888110 >> 172.21.15.40:0/3748888110 conn(0x7fdf480cf720 msgr2=0x7fdf480c9250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:01.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.567+0000 7fdf4f7ff700 1 -- 172.21.15.40:0/3748888110 shutdown_connections 2023-06-22T10:54:01.579 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.567+0000 7fdf4f7ff700 1 -- 172.21.15.40:0/3748888110 wait complete. 2023-06-22T10:54:01.580 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-06-22T10:54:01.589 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2023-06-22T10:54:01.131720+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219176,"kb_used_data":3560,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755544,"statfs":{"total":773094113280,"available":772869677056,"internally_reserved":0,"allocated":3645440,"data_stored":2175296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003358"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.540129+0000","last_change":"2023-06-22T10:53:31.946165+0000","last_active":"2023-06-22T10:53:37.540129+0000","last_peered":"2023-06-22T10:53:37.540129+0000","last_clean":"2023-06-22T10:53:37.540129+0000","last_became_active":"2023-06-22T10:53:31.945515+0000","last_became_peered":"2023-06-22T10:53:31.945515+0000","last_unstale":"2023-06-22T10:53:37.540129+0000","last_undegraded":"2023-06-22T10:53:37.540129+0000","last_fullsized":"2023-06-22T10:53:37.540129+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T13:02:07.560484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958797+0000","last_change":"2023-06-22T10:53:31.943630+0000","last_active":"2023-06-22T10:53:36.958797+0000","last_peered":"2023-06-22T10:53:36.958797+0000","last_clean":"2023-06-22T10:53:36.958797+0000","last_became_active":"2023-06-22T10:53:31.943233+0000","last_became_peered":"2023-06-22T10:53:31.943233+0000","last_unstale":"2023-06-22T10:53:36.958797+0000","last_undegraded":"2023-06-22T10:53:36.958797+0000","last_fullsized":"2023-06-22T10:53:36.958797+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:15:20.227426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.959406+0000","last_change":"2023-06-22T10:53:31.951823+0000","last_active":"2023-06-22T10:53:36.959406+0000","last_peered":"2023-06-22T10:53:36.959406+0000","last_clean":"2023-06-22T10:53:36.959406+0000","last_became_active":"2023-06-22T10:53:31.951456+0000","last_became_peered":"2023-06-22T10:53:31.951456+0000","last_unstale":"2023-06-22T10:53:36.959406+0000","last_undegraded":"2023-06-22T10:53:36.959406+0000","last_fullsized":"2023-06-22T10:53:36.959406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T17:57:40.473883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.280096+0000","last_change":"2023-06-22T10:53:31.941895+0000","last_active":"2023-06-22T10:53:37.280096+0000","last_peered":"2023-06-22T10:53:37.280096+0000","last_clean":"2023-06-22T10:53:37.280096+0000","last_became_active":"2023-06-22T10:53:31.941630+0000","last_became_peered":"2023-06-22T10:53:31.941630+0000","last_unstale":"2023-06-22T10:53:37.280096+0000","last_undegraded":"2023-06-22T10:53:37.280096+0000","last_fullsized":"2023-06-22T10:53:37.280096+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T17:25:39.331517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.956556+0000","last_change":"2023-06-22T10:53:31.945358+0000","last_active":"2023-06-22T10:53:36.956556+0000","last_peered":"2023-06-22T10:53:36.956556+0000","last_clean":"2023-06-22T10:53:36.956556+0000","last_became_active":"2023-06-22T10:53:31.945078+0000","last_became_peered":"2023-06-22T10:53:31.945078+0000","last_unstale":"2023-06-22T10:53:36.956556+0000","last_undegraded":"2023-06-22T10:53:36.956556+0000","last_fullsized":"2023-06-22T10:53:36.956556+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T13:04:27.917981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958367+0000","last_change":"2023-06-22T10:53:31.950691+0000","last_active":"2023-06-22T10:53:36.958367+0000","last_peered":"2023-06-22T10:53:36.958367+0000","last_clean":"2023-06-22T10:53:36.958367+0000","last_became_active":"2023-06-22T10:53:31.950418+0000","last_became_peered":"2023-06-22T10:53:31.950418+0000","last_unstale":"2023-06-22T10:53:36.958367+0000","last_undegraded":"2023-06-22T10:53:36.958367+0000","last_fullsized":"2023-06-22T10:53:36.958367+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:27:48.848591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.732456+0000","last_change":"2023-06-22T10:53:31.947663+0000","last_active":"2023-06-22T10:53:37.732456+0000","last_peered":"2023-06-22T10:53:37.732456+0000","last_clean":"2023-06-22T10:53:37.732456+0000","last_became_active":"2023-06-22T10:53:31.945462+0000","last_became_peered":"2023-06-22T10:53:31.945462+0000","last_unstale":"2023-06-22T10:53:37.732456+0000","last_undegraded":"2023-06-22T10:53:37.732456+0000","last_fullsized":"2023-06-22T10:53:37.732456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:37:31.693376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957438+0000","last_change":"2023-06-22T10:53:31.953829+0000","last_active":"2023-06-22T10:53:36.957438+0000","last_peered":"2023-06-22T10:53:36.957438+0000","last_clean":"2023-06-22T10:53:36.957438+0000","last_became_active":"2023-06-22T10:53:31.953479+0000","last_became_peered":"2023-06-22T10:53:31.953479+0000","last_unstale":"2023-06-22T10:53:36.957438+0000","last_undegraded":"2023-06-22T10:53:36.957438+0000","last_fullsized":"2023-06-22T10:53:36.957438+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:56:30.123428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.956661+0000","last_change":"2023-06-22T10:53:31.944979+0000","last_active":"2023-06-22T10:53:36.956661+0000","last_peered":"2023-06-22T10:53:36.956661+0000","last_clean":"2023-06-22T10:53:36.956661+0000","last_became_active":"2023-06-22T10:53:31.944596+0000","last_became_peered":"2023-06-22T10:53:31.944596+0000","last_unstale":"2023-06-22T10:53:36.956661+0000","last_undegraded":"2023-06-22T10:53:36.956661+0000","last_fullsized":"2023-06-22T10:53:36.956661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T18:57:56.828299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.959118+0000","last_change":"2023-06-22T10:53:31.935384+0000","last_active":"2023-06-22T10:53:36.959118+0000","last_peered":"2023-06-22T10:53:36.959118+0000","last_clean":"2023-06-22T10:53:36.959118+0000","last_became_active":"2023-06-22T10:53:31.935038+0000","last_became_peered":"2023-06-22T10:53:31.935038+0000","last_unstale":"2023-06-22T10:53:36.959118+0000","last_undegraded":"2023-06-22T10:53:36.959118+0000","last_fullsized":"2023-06-22T10:53:36.959118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T17:38:24.000272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.959531+0000","last_change":"2023-06-22T10:53:31.952559+0000","last_active":"2023-06-22T10:53:36.959531+0000","last_peered":"2023-06-22T10:53:36.959531+0000","last_clean":"2023-06-22T10:53:36.959531+0000","last_became_active":"2023-06-22T10:53:31.952213+0000","last_became_peered":"2023-06-22T10:53:31.952213+0000","last_unstale":"2023-06-22T10:53:36.959531+0000","last_undegraded":"2023-06-22T10:53:36.959531+0000","last_fullsized":"2023-06-22T10:53:36.959531+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T18:02:23.289710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.539887+0000","last_change":"2023-06-22T10:53:31.957089+0000","last_active":"2023-06-22T10:53:37.539887+0000","last_peered":"2023-06-22T10:53:37.539887+0000","last_clean":"2023-06-22T10:53:37.539887+0000","last_became_active":"2023-06-22T10:53:31.956521+0000","last_became_peered":"2023-06-22T10:53:31.956521+0000","last_unstale":"2023-06-22T10:53:37.539887+0000","last_undegraded":"2023-06-22T10:53:37.539887+0000","last_fullsized":"2023-06-22T10:53:37.539887+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T11:34:19.856827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.540314+0000","last_change":"2023-06-22T10:53:31.945942+0000","last_active":"2023-06-22T10:53:37.540314+0000","last_peered":"2023-06-22T10:53:37.540314+0000","last_clean":"2023-06-22T10:53:37.540314+0000","last_became_active":"2023-06-22T10:53:31.945443+0000","last_became_peered":"2023-06-22T10:53:31.945443+0000","last_unstale":"2023-06-22T10:53:37.540314+0000","last_undegraded":"2023-06-22T10:53:37.540314+0000","last_fullsized":"2023-06-22T10:53:37.540314+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:53:17.921814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957777+0000","last_change":"2023-06-22T10:53:31.942412+0000","last_active":"2023-06-22T10:53:36.957777+0000","last_peered":"2023-06-22T10:53:36.957777+0000","last_clean":"2023-06-22T10:53:36.957777+0000","last_became_active":"2023-06-22T10:53:31.942136+0000","last_became_peered":"2023-06-22T10:53:31.942136+0000","last_unstale":"2023-06-22T10:53:36.957777+0000","last_undegraded":"2023-06-22T10:53:36.957777+0000","last_fullsized":"2023-06-22T10:53:36.957777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T18:31:17.457352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.732252+0000","last_change":"2023-06-22T10:53:31.947458+0000","last_active":"2023-06-22T10:53:37.732252+0000","last_peered":"2023-06-22T10:53:37.732252+0000","last_clean":"2023-06-22T10:53:37.732252+0000","last_became_active":"2023-06-22T10:53:31.947174+0000","last_became_peered":"2023-06-22T10:53:31.947174+0000","last_unstale":"2023-06-22T10:53:37.732252+0000","last_undegraded":"2023-06-22T10:53:37.732252+0000","last_fullsized":"2023-06-22T10:53:37.732252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:19:58.431004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957495+0000","last_change":"2023-06-22T10:53:31.952787+0000","last_active":"2023-06-22T10:53:36.957495+0000","last_peered":"2023-06-22T10:53:36.957495+0000","last_clean":"2023-06-22T10:53:36.957495+0000","last_became_active":"2023-06-22T10:53:31.951585+0000","last_became_peered":"2023-06-22T10:53:31.951585+0000","last_unstale":"2023-06-22T10:53:36.957495+0000","last_undegraded":"2023-06-22T10:53:36.957495+0000","last_fullsized":"2023-06-22T10:53:36.957495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T13:31:48.249498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.956661+0000","last_change":"2023-06-22T10:53:31.944865+0000","last_active":"2023-06-22T10:53:36.956661+0000","last_peered":"2023-06-22T10:53:36.956661+0000","last_clean":"2023-06-22T10:53:36.956661+0000","last_became_active":"2023-06-22T10:53:31.944263+0000","last_became_peered":"2023-06-22T10:53:31.944263+0000","last_unstale":"2023-06-22T10:53:36.956661+0000","last_undegraded":"2023-06-22T10:53:36.956661+0000","last_fullsized":"2023-06-22T10:53:36.956661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:47:02.983369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958024+0000","last_change":"2023-06-22T10:53:31.954328+0000","last_active":"2023-06-22T10:53:36.958024+0000","last_peered":"2023-06-22T10:53:36.958024+0000","last_clean":"2023-06-22T10:53:36.958024+0000","last_became_active":"2023-06-22T10:53:31.953823+0000","last_became_peered":"2023-06-22T10:53:31.953823+0000","last_unstale":"2023-06-22T10:53:36.958024+0000","last_undegraded":"2023-06-22T10:53:36.958024+0000","last_fullsized":"2023-06-22T10:53:36.958024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:58:30.886558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.539896+0000","last_change":"2023-06-22T10:53:31.943196+0000","last_active":"2023-06-22T10:53:37.539896+0000","last_peered":"2023-06-22T10:53:37.539896+0000","last_clean":"2023-06-22T10:53:37.539896+0000","last_became_active":"2023-06-22T10:53:31.942920+0000","last_became_peered":"2023-06-22T10:53:31.942920+0000","last_unstale":"2023-06-22T10:53:37.539896+0000","last_undegraded":"2023-06-22T10:53:37.539896+0000","last_fullsized":"2023-06-22T10:53:37.539896+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T20:10:55.019762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958201+0000","last_change":"2023-06-22T10:53:31.951020+0000","last_active":"2023-06-22T10:53:36.958201+0000","last_peered":"2023-06-22T10:53:36.958201+0000","last_clean":"2023-06-22T10:53:36.958201+0000","last_became_active":"2023-06-22T10:53:31.950755+0000","last_became_peered":"2023-06-22T10:53:31.950755+0000","last_unstale":"2023-06-22T10:53:36.958201+0000","last_undegraded":"2023-06-22T10:53:36.958201+0000","last_fullsized":"2023-06-22T10:53:36.958201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:15:38.583741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.732513+0000","last_change":"2023-06-22T10:53:31.942953+0000","last_active":"2023-06-22T10:53:37.732513+0000","last_peered":"2023-06-22T10:53:37.732513+0000","last_clean":"2023-06-22T10:53:37.732513+0000","last_became_active":"2023-06-22T10:53:31.942724+0000","last_became_peered":"2023-06-22T10:53:31.942724+0000","last_unstale":"2023-06-22T10:53:37.732513+0000","last_undegraded":"2023-06-22T10:53:37.732513+0000","last_fullsized":"2023-06-22T10:53:37.732513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T13:38:17.711538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.955830+0000","last_change":"2023-06-22T10:53:31.943005+0000","last_active":"2023-06-22T10:53:36.955830+0000","last_peered":"2023-06-22T10:53:36.955830+0000","last_clean":"2023-06-22T10:53:36.955830+0000","last_became_active":"2023-06-22T10:53:31.942716+0000","last_became_peered":"2023-06-22T10:53:31.942716+0000","last_unstale":"2023-06-22T10:53:36.955830+0000","last_undegraded":"2023-06-22T10:53:36.955830+0000","last_fullsized":"2023-06-22T10:53:36.955830+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:59:14.357071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.298489+0000","last_change":"2023-06-22T10:53:31.935496+0000","last_active":"2023-06-22T10:53:39.298489+0000","last_peered":"2023-06-22T10:53:39.298489+0000","last_clean":"2023-06-22T10:53:39.298489+0000","last_became_active":"2023-06-22T10:53:31.935201+0000","last_became_peered":"2023-06-22T10:53:31.935201+0000","last_unstale":"2023-06-22T10:53:39.298489+0000","last_undegraded":"2023-06-22T10:53:39.298489+0000","last_fullsized":"2023-06-22T10:53:39.298489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:37:31.693376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.732169+0000","last_change":"2023-06-22T10:53:31.947093+0000","last_active":"2023-06-22T10:53:37.732169+0000","last_peered":"2023-06-22T10:53:37.732169+0000","last_clean":"2023-06-22T10:53:37.732169+0000","last_became_active":"2023-06-22T10:53:31.946566+0000","last_became_peered":"2023-06-22T10:53:31.946566+0000","last_unstale":"2023-06-22T10:53:37.732169+0000","last_undegraded":"2023-06-22T10:53:37.732169+0000","last_fullsized":"2023-06-22T10:53:37.732169+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T17:02:38.568336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421688+0000","last_change":"2023-06-22T10:53:31.954476+0000","last_active":"2023-06-22T10:53:38.421688+0000","last_peered":"2023-06-22T10:53:38.421688+0000","last_clean":"2023-06-22T10:53:38.421688+0000","last_became_active":"2023-06-22T10:53:31.954161+0000","last_became_peered":"2023-06-22T10:53:31.954161+0000","last_unstale":"2023-06-22T10:53:38.421688+0000","last_undegraded":"2023-06-22T10:53:38.421688+0000","last_fullsized":"2023-06-22T10:53:38.421688+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:59:50.197538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421712+0000","last_change":"2023-06-22T10:53:31.933946+0000","last_active":"2023-06-22T10:53:38.421712+0000","last_peered":"2023-06-22T10:53:38.421712+0000","last_clean":"2023-06-22T10:53:38.421712+0000","last_became_active":"2023-06-22T10:53:31.933657+0000","last_became_peered":"2023-06-22T10:53:31.933657+0000","last_unstale":"2023-06-22T10:53:38.421712+0000","last_undegraded":"2023-06-22T10:53:38.421712+0000","last_fullsized":"2023-06-22T10:53:38.421712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T17:19:23.835283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958575+0000","last_change":"2023-06-22T10:53:31.949726+0000","last_active":"2023-06-22T10:53:36.958575+0000","last_peered":"2023-06-22T10:53:36.958575+0000","last_clean":"2023-06-22T10:53:36.958575+0000","last_became_active":"2023-06-22T10:53:31.949378+0000","last_became_peered":"2023-06-22T10:53:31.949378+0000","last_unstale":"2023-06-22T10:53:36.958575+0000","last_undegraded":"2023-06-22T10:53:36.958575+0000","last_fullsized":"2023-06-22T10:53:36.958575+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:01:37.811790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.959265+0000","last_change":"2023-06-22T10:53:35.993727+0000","last_active":"2023-06-22T10:53:36.959265+0000","last_peered":"2023-06-22T10:53:36.959265+0000","last_clean":"2023-06-22T10:53:36.959265+0000","last_became_active":"2023-06-22T10:53:35.993292+0000","last_became_peered":"2023-06-22T10:53:35.993292+0000","last_unstale":"2023-06-22T10:53:36.959265+0000","last_undegraded":"2023-06-22T10:53:36.959265+0000","last_fullsized":"2023-06-22T10:53:36.959265+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:53:08.402503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958353+0000","last_change":"2023-06-22T10:53:30.935533+0000","last_active":"2023-06-22T10:53:36.958353+0000","last_peered":"2023-06-22T10:53:36.958353+0000","last_clean":"2023-06-22T10:53:36.958353+0000","last_became_active":"2023-06-22T10:53:30.935260+0000","last_became_peered":"2023-06-22T10:53:30.935260+0000","last_unstale":"2023-06-22T10:53:36.958353+0000","last_undegraded":"2023-06-22T10:53:36.958353+0000","last_fullsized":"2023-06-22T10:53:36.958353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T11:57:57.902900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.299328+0000","last_change":"2023-06-22T10:53:31.940482+0000","last_active":"2023-06-22T10:53:39.299328+0000","last_peered":"2023-06-22T10:53:39.299328+0000","last_clean":"2023-06-22T10:53:39.299328+0000","last_became_active":"2023-06-22T10:53:31.940185+0000","last_became_peered":"2023-06-22T10:53:31.940185+0000","last_unstale":"2023-06-22T10:53:39.299328+0000","last_undegraded":"2023-06-22T10:53:39.299328+0000","last_fullsized":"2023-06-22T10:53:39.299328+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:16:58.055706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.280322+0000","last_change":"2023-06-22T10:53:35.980222+0000","last_active":"2023-06-22T10:53:37.280322+0000","last_peered":"2023-06-22T10:53:37.280322+0000","last_clean":"2023-06-22T10:53:37.280322+0000","last_became_active":"2023-06-22T10:53:35.979767+0000","last_became_peered":"2023-06-22T10:53:35.979767+0000","last_unstale":"2023-06-22T10:53:37.280322+0000","last_undegraded":"2023-06-22T10:53:37.280322+0000","last_fullsized":"2023-06-22T10:53:37.280322+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:52:53.767824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421003+0000","last_change":"2023-06-22T10:53:30.945420+0000","last_active":"2023-06-22T10:53:38.421003+0000","last_peered":"2023-06-22T10:53:38.421003+0000","last_clean":"2023-06-22T10:53:38.421003+0000","last_became_active":"2023-06-22T10:53:30.945124+0000","last_became_peered":"2023-06-22T10:53:30.945124+0000","last_unstale":"2023-06-22T10:53:38.421003+0000","last_undegraded":"2023-06-22T10:53:38.421003+0000","last_fullsized":"2023-06-22T10:53:38.421003+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T20:10:12.732255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.956493+0000","last_change":"2023-06-22T10:53:31.946696+0000","last_active":"2023-06-22T10:53:36.956493+0000","last_peered":"2023-06-22T10:53:36.956493+0000","last_clean":"2023-06-22T10:53:36.956493+0000","last_became_active":"2023-06-22T10:53:31.946424+0000","last_became_peered":"2023-06-22T10:53:31.946424+0000","last_unstale":"2023-06-22T10:53:36.956493+0000","last_undegraded":"2023-06-22T10:53:36.956493+0000","last_fullsized":"2023-06-22T10:53:36.956493+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:38:31.209670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.956801+0000","last_change":"2023-06-22T10:53:35.983086+0000","last_active":"2023-06-22T10:53:36.956801+0000","last_peered":"2023-06-22T10:53:36.956801+0000","last_clean":"2023-06-22T10:53:36.956801+0000","last_became_active":"2023-06-22T10:53:35.980183+0000","last_became_peered":"2023-06-22T10:53:35.980183+0000","last_unstale":"2023-06-22T10:53:36.956801+0000","last_undegraded":"2023-06-22T10:53:36.956801+0000","last_fullsized":"2023-06-22T10:53:36.956801+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:04:18.976819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.298108+0000","last_change":"2023-06-22T10:53:30.939562+0000","last_active":"2023-06-22T10:53:39.298108+0000","last_peered":"2023-06-22T10:53:39.298108+0000","last_clean":"2023-06-22T10:53:39.298108+0000","last_became_active":"2023-06-22T10:53:30.939268+0000","last_became_peered":"2023-06-22T10:53:30.939268+0000","last_unstale":"2023-06-22T10:53:39.298108+0000","last_undegraded":"2023-06-22T10:53:39.298108+0000","last_fullsized":"2023-06-22T10:53:39.298108+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:35:50.219987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.280368+0000","last_change":"2023-06-22T10:53:31.943624+0000","last_active":"2023-06-22T10:53:37.280368+0000","last_peered":"2023-06-22T10:53:37.280368+0000","last_clean":"2023-06-22T10:53:37.280368+0000","last_became_active":"2023-06-22T10:53:31.943277+0000","last_became_peered":"2023-06-22T10:53:31.943277+0000","last_unstale":"2023-06-22T10:53:37.280368+0000","last_undegraded":"2023-06-22T10:53:37.280368+0000","last_fullsized":"2023-06-22T10:53:37.280368+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:09:48.895446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.279534+0000","last_change":"2023-06-22T10:53:35.989354+0000","last_active":"2023-06-22T10:53:37.279534+0000","last_peered":"2023-06-22T10:53:37.279534+0000","last_clean":"2023-06-22T10:53:37.279534+0000","last_became_active":"2023-06-22T10:53:35.988867+0000","last_became_peered":"2023-06-22T10:53:35.988867+0000","last_unstale":"2023-06-22T10:53:37.279534+0000","last_undegraded":"2023-06-22T10:53:37.279534+0000","last_fullsized":"2023-06-22T10:53:37.279534+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:53:21.959666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.956819+0000","last_change":"2023-06-22T10:53:30.938551+0000","last_active":"2023-06-22T10:53:36.956819+0000","last_peered":"2023-06-22T10:53:36.956819+0000","last_clean":"2023-06-22T10:53:36.956819+0000","last_became_active":"2023-06-22T10:53:30.938065+0000","last_became_peered":"2023-06-22T10:53:30.938065+0000","last_unstale":"2023-06-22T10:53:36.956819+0000","last_undegraded":"2023-06-22T10:53:36.956819+0000","last_fullsized":"2023-06-22T10:53:36.956819+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:08:20.088422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.298566+0000","last_change":"2023-06-22T10:53:31.944695+0000","last_active":"2023-06-22T10:53:39.298566+0000","last_peered":"2023-06-22T10:53:39.298566+0000","last_clean":"2023-06-22T10:53:39.298566+0000","last_became_active":"2023-06-22T10:53:31.944401+0000","last_became_peered":"2023-06-22T10:53:31.944401+0000","last_unstale":"2023-06-22T10:53:39.298566+0000","last_undegraded":"2023-06-22T10:53:39.298566+0000","last_fullsized":"2023-06-22T10:53:39.298566+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:15:20.227426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.731901+0000","last_change":"2023-06-22T10:53:35.977551+0000","last_active":"2023-06-22T10:53:37.731901+0000","last_peered":"2023-06-22T10:53:37.731901+0000","last_clean":"2023-06-22T10:53:37.731901+0000","last_became_active":"2023-06-22T10:53:35.976931+0000","last_became_peered":"2023-06-22T10:53:35.976931+0000","last_unstale":"2023-06-22T10:53:37.731901+0000","last_undegraded":"2023-06-22T10:53:37.731901+0000","last_fullsized":"2023-06-22T10:53:37.731901+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:58:45.151109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958943+0000","last_change":"2023-06-22T10:53:30.926577+0000","last_active":"2023-06-22T10:53:36.958943+0000","last_peered":"2023-06-22T10:53:36.958943+0000","last_clean":"2023-06-22T10:53:36.958943+0000","last_became_active":"2023-06-22T10:53:30.926220+0000","last_became_peered":"2023-06-22T10:53:30.926220+0000","last_unstale":"2023-06-22T10:53:36.958943+0000","last_undegraded":"2023-06-22T10:53:36.958943+0000","last_fullsized":"2023-06-22T10:53:36.958943+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:16:41.854261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.298455+0000","last_change":"2023-06-22T10:53:31.943837+0000","last_active":"2023-06-22T10:53:39.298455+0000","last_peered":"2023-06-22T10:53:39.298455+0000","last_clean":"2023-06-22T10:53:39.298455+0000","last_became_active":"2023-06-22T10:53:31.943561+0000","last_became_peered":"2023-06-22T10:53:31.943561+0000","last_unstale":"2023-06-22T10:53:39.298455+0000","last_undegraded":"2023-06-22T10:53:39.298455+0000","last_fullsized":"2023-06-22T10:53:39.298455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T13:38:17.711538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.298880+0000","last_change":"2023-06-22T10:53:35.980240+0000","last_active":"2023-06-22T10:53:39.298880+0000","last_peered":"2023-06-22T10:53:39.298880+0000","last_clean":"2023-06-22T10:53:39.298880+0000","last_became_active":"2023-06-22T10:53:35.979760+0000","last_became_peered":"2023-06-22T10:53:35.979760+0000","last_unstale":"2023-06-22T10:53:39.298880+0000","last_undegraded":"2023-06-22T10:53:39.298880+0000","last_fullsized":"2023-06-22T10:53:39.298880+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T17:38:28.038125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.732712+0000","last_change":"2023-06-22T10:53:30.942222+0000","last_active":"2023-06-22T10:53:37.732712+0000","last_peered":"2023-06-22T10:53:37.732712+0000","last_clean":"2023-06-22T10:53:37.732712+0000","last_became_active":"2023-06-22T10:53:30.941843+0000","last_became_peered":"2023-06-22T10:53:30.941843+0000","last_unstale":"2023-06-22T10:53:37.732712+0000","last_undegraded":"2023-06-22T10:53:37.732712+0000","last_fullsized":"2023-06-22T10:53:37.732712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:54:13.524784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421339+0000","last_change":"2023-06-22T10:53:31.940635+0000","last_active":"2023-06-22T10:53:38.421339+0000","last_peered":"2023-06-22T10:53:38.421339+0000","last_clean":"2023-06-22T10:53:38.421339+0000","last_became_active":"2023-06-22T10:53:31.940144+0000","last_became_peered":"2023-06-22T10:53:31.940144+0000","last_unstale":"2023-06-22T10:53:38.421339+0000","last_undegraded":"2023-06-22T10:53:38.421339+0000","last_fullsized":"2023-06-22T10:53:38.421339+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T18:57:56.828299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421113+0000","last_change":"2023-06-22T10:53:35.981516+0000","last_active":"2023-06-22T10:53:38.421113+0000","last_peered":"2023-06-22T10:53:38.421113+0000","last_clean":"2023-06-22T10:53:38.421113+0000","last_became_active":"2023-06-22T10:53:35.981085+0000","last_became_peered":"2023-06-22T10:53:35.981085+0000","last_unstale":"2023-06-22T10:53:38.421113+0000","last_undegraded":"2023-06-22T10:53:38.421113+0000","last_fullsized":"2023-06-22T10:53:38.421113+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:49:24.206495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'10","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:50.736031+0000","last_change":"2023-06-22T10:53:30.929674+0000","last_active":"2023-06-22T10:53:50.736031+0000","last_peered":"2023-06-22T10:53:50.736031+0000","last_clean":"2023-06-22T10:53:50.736031+0000","last_became_active":"2023-06-22T10:53:30.929103+0000","last_became_peered":"2023-06-22T10:53:30.929103+0000","last_unstale":"2023-06-22T10:53:50.736031+0000","last_undegraded":"2023-06-22T10:53:50.736031+0000","last_fullsized":"2023-06-22T10:53:50.736031+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T11:24:25.762617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958280+0000","last_change":"2023-06-22T10:53:31.950427+0000","last_active":"2023-06-22T10:53:36.958280+0000","last_peered":"2023-06-22T10:53:36.958280+0000","last_clean":"2023-06-22T10:53:36.958280+0000","last_became_active":"2023-06-22T10:53:31.950139+0000","last_became_peered":"2023-06-22T10:53:31.950139+0000","last_unstale":"2023-06-22T10:53:36.958280+0000","last_undegraded":"2023-06-22T10:53:36.958280+0000","last_fullsized":"2023-06-22T10:53:36.958280+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:32:48.965556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958792+0000","last_change":"2023-06-22T10:53:35.974441+0000","last_active":"2023-06-22T10:53:36.958792+0000","last_peered":"2023-06-22T10:53:36.958792+0000","last_clean":"2023-06-22T10:53:36.958792+0000","last_became_active":"2023-06-22T10:53:35.973542+0000","last_became_peered":"2023-06-22T10:53:35.973542+0000","last_unstale":"2023-06-22T10:53:36.958792+0000","last_undegraded":"2023-06-22T10:53:36.958792+0000","last_fullsized":"2023-06-22T10:53:36.958792+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:37:35.731228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.732330+0000","last_change":"2023-06-22T10:53:30.940712+0000","last_active":"2023-06-22T10:53:37.732330+0000","last_peered":"2023-06-22T10:53:37.732330+0000","last_clean":"2023-06-22T10:53:37.732330+0000","last_became_active":"2023-06-22T10:53:30.940318+0000","last_became_peered":"2023-06-22T10:53:30.940318+0000","last_unstale":"2023-06-22T10:53:37.732330+0000","last_undegraded":"2023-06-22T10:53:37.732330+0000","last_fullsized":"2023-06-22T10:53:37.732330+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:15:19.221249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.299326+0000","last_change":"2023-06-22T10:53:31.942026+0000","last_active":"2023-06-22T10:53:39.299326+0000","last_peered":"2023-06-22T10:53:39.299326+0000","last_clean":"2023-06-22T10:53:39.299326+0000","last_became_active":"2023-06-22T10:53:31.941695+0000","last_became_peered":"2023-06-22T10:53:31.941695+0000","last_unstale":"2023-06-22T10:53:39.299326+0000","last_undegraded":"2023-06-22T10:53:39.299326+0000","last_fullsized":"2023-06-22T10:53:39.299326+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:49:21.017446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.299153+0000","last_change":"2023-06-22T10:53:35.984076+0000","last_active":"2023-06-22T10:53:39.299153+0000","last_peered":"2023-06-22T10:53:39.299153+0000","last_clean":"2023-06-22T10:53:39.299153+0000","last_became_active":"2023-06-22T10:53:35.983702+0000","last_became_peered":"2023-06-22T10:53:35.983702+0000","last_unstale":"2023-06-22T10:53:39.299153+0000","last_undegraded":"2023-06-22T10:53:39.299153+0000","last_fullsized":"2023-06-22T10:53:39.299153+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:39:18.877636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.955629+0000","last_change":"2023-06-22T10:53:30.937271+0000","last_active":"2023-06-22T10:53:36.955629+0000","last_peered":"2023-06-22T10:53:36.955629+0000","last_clean":"2023-06-22T10:53:36.955629+0000","last_became_active":"2023-06-22T10:53:30.936656+0000","last_became_peered":"2023-06-22T10:53:30.936656+0000","last_unstale":"2023-06-22T10:53:36.955629+0000","last_undegraded":"2023-06-22T10:53:36.955629+0000","last_fullsized":"2023-06-22T10:53:36.955629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T20:35:09.275456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958456+0000","last_change":"2023-06-22T10:53:31.937743+0000","last_active":"2023-06-22T10:53:36.958456+0000","last_peered":"2023-06-22T10:53:36.958456+0000","last_clean":"2023-06-22T10:53:36.958456+0000","last_became_active":"2023-06-22T10:53:31.937458+0000","last_became_peered":"2023-06-22T10:53:31.937458+0000","last_unstale":"2023-06-22T10:53:36.958456+0000","last_undegraded":"2023-06-22T10:53:36.958456+0000","last_fullsized":"2023-06-22T10:53:36.958456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:09:14.741666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.299475+0000","last_change":"2023-06-22T10:53:35.988689+0000","last_active":"2023-06-22T10:53:39.299475+0000","last_peered":"2023-06-22T10:53:39.299475+0000","last_clean":"2023-06-22T10:53:39.299475+0000","last_became_active":"2023-06-22T10:53:35.988266+0000","last_became_peered":"2023-06-22T10:53:35.988266+0000","last_unstale":"2023-06-22T10:53:39.299475+0000","last_undegraded":"2023-06-22T10:53:39.299475+0000","last_fullsized":"2023-06-22T10:53:39.299475+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:00:09.093418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.732168+0000","last_change":"2023-06-22T10:53:30.941102+0000","last_active":"2023-06-22T10:53:37.732168+0000","last_peered":"2023-06-22T10:53:37.732168+0000","last_clean":"2023-06-22T10:53:37.732168+0000","last_became_active":"2023-06-22T10:53:30.940822+0000","last_became_peered":"2023-06-22T10:53:30.940822+0000","last_unstale":"2023-06-22T10:53:37.732168+0000","last_undegraded":"2023-06-22T10:53:37.732168+0000","last_fullsized":"2023-06-22T10:53:37.732168+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:09:13.735489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.956701+0000","last_change":"2023-06-22T10:53:31.944224+0000","last_active":"2023-06-22T10:53:36.956701+0000","last_peered":"2023-06-22T10:53:36.956701+0000","last_clean":"2023-06-22T10:53:36.956701+0000","last_became_active":"2023-06-22T10:53:31.943836+0000","last_became_peered":"2023-06-22T10:53:31.943836+0000","last_unstale":"2023-06-22T10:53:36.956701+0000","last_undegraded":"2023-06-22T10:53:36.956701+0000","last_fullsized":"2023-06-22T10:53:36.956701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:06:51.541995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958768+0000","last_change":"2023-06-22T10:53:35.972031+0000","last_active":"2023-06-22T10:53:36.958768+0000","last_peered":"2023-06-22T10:53:36.958768+0000","last_clean":"2023-06-22T10:53:36.958768+0000","last_became_active":"2023-06-22T10:53:35.971550+0000","last_became_peered":"2023-06-22T10:53:35.971550+0000","last_unstale":"2023-06-22T10:53:36.958768+0000","last_undegraded":"2023-06-22T10:53:36.958768+0000","last_fullsized":"2023-06-22T10:53:36.958768+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T13:38:21.749390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.279619+0000","last_change":"2023-06-22T10:53:30.937109+0000","last_active":"2023-06-22T10:53:37.279619+0000","last_peered":"2023-06-22T10:53:37.279619+0000","last_clean":"2023-06-22T10:53:37.279619+0000","last_became_active":"2023-06-22T10:53:30.936757+0000","last_became_peered":"2023-06-22T10:53:30.936757+0000","last_unstale":"2023-06-22T10:53:37.279619+0000","last_undegraded":"2023-06-22T10:53:37.279619+0000","last_fullsized":"2023-06-22T10:53:37.279619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T13:33:41.336023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.299478+0000","last_change":"2023-06-22T10:53:31.948662+0000","last_active":"2023-06-22T10:53:39.299478+0000","last_peered":"2023-06-22T10:53:39.299478+0000","last_clean":"2023-06-22T10:53:39.299478+0000","last_became_active":"2023-06-22T10:53:31.948201+0000","last_became_peered":"2023-06-22T10:53:31.948201+0000","last_unstale":"2023-06-22T10:53:39.299478+0000","last_undegraded":"2023-06-22T10:53:39.299478+0000","last_fullsized":"2023-06-22T10:53:39.299478+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T15:52:35.480952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.732657+0000","last_change":"2023-06-22T10:53:35.977231+0000","last_active":"2023-06-22T10:53:37.732657+0000","last_peered":"2023-06-22T10:53:37.732657+0000","last_clean":"2023-06-22T10:53:37.732657+0000","last_became_active":"2023-06-22T10:53:35.976777+0000","last_became_peered":"2023-06-22T10:53:35.976777+0000","last_unstale":"2023-06-22T10:53:37.732657+0000","last_undegraded":"2023-06-22T10:53:37.732657+0000","last_fullsized":"2023-06-22T10:53:37.732657+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:16:46.898291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.733132+0000","last_change":"2023-06-22T10:53:30.941433+0000","last_active":"2023-06-22T10:53:37.733132+0000","last_peered":"2023-06-22T10:53:37.733132+0000","last_clean":"2023-06-22T10:53:37.733132+0000","last_became_active":"2023-06-22T10:53:30.941122+0000","last_became_peered":"2023-06-22T10:53:30.941122+0000","last_unstale":"2023-06-22T10:53:37.733132+0000","last_undegraded":"2023-06-22T10:53:37.733132+0000","last_fullsized":"2023-06-22T10:53:37.733132+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:49:20.011268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957286+0000","last_change":"2023-06-22T10:53:31.946014+0000","last_active":"2023-06-22T10:53:36.957286+0000","last_peered":"2023-06-22T10:53:36.957286+0000","last_clean":"2023-06-22T10:53:36.957286+0000","last_became_active":"2023-06-22T10:53:31.945733+0000","last_became_peered":"2023-06-22T10:53:31.945733+0000","last_unstale":"2023-06-22T10:53:36.957286+0000","last_undegraded":"2023-06-22T10:53:36.957286+0000","last_fullsized":"2023-06-22T10:53:36.957286+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:54:20.603411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.539641+0000","last_change":"2023-06-22T10:53:35.976548+0000","last_active":"2023-06-22T10:53:37.539641+0000","last_peered":"2023-06-22T10:53:37.539641+0000","last_clean":"2023-06-22T10:53:37.539641+0000","last_became_active":"2023-06-22T10:53:35.975282+0000","last_became_peered":"2023-06-22T10:53:35.975282+0000","last_unstale":"2023-06-22T10:53:37.539641+0000","last_undegraded":"2023-06-22T10:53:37.539641+0000","last_fullsized":"2023-06-22T10:53:37.539641+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:47:49.439479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.733034+0000","last_change":"2023-06-22T10:53:30.940936+0000","last_active":"2023-06-22T10:53:37.733034+0000","last_peered":"2023-06-22T10:53:37.733034+0000","last_clean":"2023-06-22T10:53:37.733034+0000","last_became_active":"2023-06-22T10:53:30.940494+0000","last_became_peered":"2023-06-22T10:53:30.940494+0000","last_unstale":"2023-06-22T10:53:37.733034+0000","last_undegraded":"2023-06-22T10:53:37.733034+0000","last_fullsized":"2023-06-22T10:53:37.733034+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:39:13.833606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957664+0000","last_change":"2023-06-22T10:53:31.953007+0000","last_active":"2023-06-22T10:53:36.957664+0000","last_peered":"2023-06-22T10:53:36.957664+0000","last_clean":"2023-06-22T10:53:36.957664+0000","last_became_active":"2023-06-22T10:53:31.952493+0000","last_became_peered":"2023-06-22T10:53:31.952493+0000","last_unstale":"2023-06-22T10:53:36.957664+0000","last_undegraded":"2023-06-22T10:53:36.957664+0000","last_fullsized":"2023-06-22T10:53:36.957664+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:46:07.563474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.539899+0000","last_change":"2023-06-22T10:53:35.975271+0000","last_active":"2023-06-22T10:53:37.539899+0000","last_peered":"2023-06-22T10:53:37.539899+0000","last_clean":"2023-06-22T10:53:37.539899+0000","last_became_active":"2023-06-22T10:53:35.974796+0000","last_became_peered":"2023-06-22T10:53:35.974796+0000","last_unstale":"2023-06-22T10:53:37.539899+0000","last_undegraded":"2023-06-22T10:53:37.539899+0000","last_fullsized":"2023-06-22T10:53:37.539899+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:55:38.296763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.732906+0000","last_change":"2023-06-22T10:53:30.935554+0000","last_active":"2023-06-22T10:53:37.732906+0000","last_peered":"2023-06-22T10:53:37.732906+0000","last_clean":"2023-06-22T10:53:37.732906+0000","last_became_active":"2023-06-22T10:53:30.935186+0000","last_became_peered":"2023-06-22T10:53:30.935186+0000","last_unstale":"2023-06-22T10:53:37.732906+0000","last_undegraded":"2023-06-22T10:53:37.732906+0000","last_fullsized":"2023-06-22T10:53:37.732906+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:12:31.122076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.279728+0000","last_change":"2023-06-22T10:53:31.939659+0000","last_active":"2023-06-22T10:53:37.279728+0000","last_peered":"2023-06-22T10:53:37.279728+0000","last_clean":"2023-06-22T10:53:37.279728+0000","last_became_active":"2023-06-22T10:53:31.939359+0000","last_became_peered":"2023-06-22T10:53:31.939359+0000","last_unstale":"2023-06-22T10:53:37.279728+0000","last_undegraded":"2023-06-22T10:53:37.279728+0000","last_fullsized":"2023-06-22T10:53:37.279728+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T20:49:06.159398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.539838+0000","last_change":"2023-06-22T10:53:35.986300+0000","last_active":"2023-06-22T10:53:37.539838+0000","last_peered":"2023-06-22T10:53:37.539838+0000","last_clean":"2023-06-22T10:53:37.539838+0000","last_became_active":"2023-06-22T10:53:35.985773+0000","last_became_peered":"2023-06-22T10:53:35.985773+0000","last_unstale":"2023-06-22T10:53:37.539838+0000","last_undegraded":"2023-06-22T10:53:37.539838+0000","last_fullsized":"2023-06-22T10:53:37.539838+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:02:57.117668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957836+0000","last_change":"2023-06-22T10:53:30.938410+0000","last_active":"2023-06-22T10:53:36.957836+0000","last_peered":"2023-06-22T10:53:36.957836+0000","last_clean":"2023-06-22T10:53:36.957836+0000","last_became_active":"2023-06-22T10:53:30.938082+0000","last_became_peered":"2023-06-22T10:53:30.938082+0000","last_unstale":"2023-06-22T10:53:36.957836+0000","last_undegraded":"2023-06-22T10:53:36.957836+0000","last_fullsized":"2023-06-22T10:53:36.957836+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:01:52.091411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.956128+0000","last_change":"2023-06-22T10:53:31.938625+0000","last_active":"2023-06-22T10:53:36.956128+0000","last_peered":"2023-06-22T10:53:36.956128+0000","last_clean":"2023-06-22T10:53:36.956128+0000","last_became_active":"2023-06-22T10:53:31.938266+0000","last_became_peered":"2023-06-22T10:53:31.938266+0000","last_unstale":"2023-06-22T10:53:36.956128+0000","last_undegraded":"2023-06-22T10:53:36.956128+0000","last_fullsized":"2023-06-22T10:53:36.956128+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:22:33.870719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.540124+0000","last_change":"2023-06-22T10:53:35.973789+0000","last_active":"2023-06-22T10:53:37.540124+0000","last_peered":"2023-06-22T10:53:37.540124+0000","last_clean":"2023-06-22T10:53:37.540124+0000","last_became_active":"2023-06-22T10:53:35.973221+0000","last_became_peered":"2023-06-22T10:53:35.973221+0000","last_unstale":"2023-06-22T10:53:37.540124+0000","last_undegraded":"2023-06-22T10:53:37.540124+0000","last_fullsized":"2023-06-22T10:53:37.540124+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:41:28.183007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.298246+0000","last_change":"2023-06-22T10:53:30.940317+0000","last_active":"2023-06-22T10:53:39.298246+0000","last_peered":"2023-06-22T10:53:39.298246+0000","last_clean":"2023-06-22T10:53:39.298246+0000","last_became_active":"2023-06-22T10:53:30.939695+0000","last_became_peered":"2023-06-22T10:53:30.939695+0000","last_unstale":"2023-06-22T10:53:39.298246+0000","last_undegraded":"2023-06-22T10:53:39.298246+0000","last_fullsized":"2023-06-22T10:53:39.298246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:19:57.424826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957974+0000","last_change":"2023-06-22T10:53:31.955337+0000","last_active":"2023-06-22T10:53:36.957974+0000","last_peered":"2023-06-22T10:53:36.957974+0000","last_clean":"2023-06-22T10:53:36.957974+0000","last_became_active":"2023-06-22T10:53:31.955009+0000","last_became_peered":"2023-06-22T10:53:31.955009+0000","last_unstale":"2023-06-22T10:53:36.957974+0000","last_undegraded":"2023-06-22T10:53:36.957974+0000","last_fullsized":"2023-06-22T10:53:36.957974+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:44:52.079657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421497+0000","last_change":"2023-06-22T10:53:35.992703+0000","last_active":"2023-06-22T10:53:38.421497+0000","last_peered":"2023-06-22T10:53:38.421497+0000","last_clean":"2023-06-22T10:53:38.421497+0000","last_became_active":"2023-06-22T10:53:35.991759+0000","last_became_peered":"2023-06-22T10:53:35.991759+0000","last_unstale":"2023-06-22T10:53:38.421497+0000","last_undegraded":"2023-06-22T10:53:38.421497+0000","last_fullsized":"2023-06-22T10:53:38.421497+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:06:55.579848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.279637+0000","last_change":"2023-06-22T10:53:30.942339+0000","last_active":"2023-06-22T10:53:37.279637+0000","last_peered":"2023-06-22T10:53:37.279637+0000","last_clean":"2023-06-22T10:53:37.279637+0000","last_became_active":"2023-06-22T10:53:30.942042+0000","last_became_peered":"2023-06-22T10:53:30.942042+0000","last_unstale":"2023-06-22T10:53:37.279637+0000","last_undegraded":"2023-06-22T10:53:37.279637+0000","last_fullsized":"2023-06-22T10:53:37.279637+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:03:54.160970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.959163+0000","last_change":"2023-06-22T10:53:31.946119+0000","last_active":"2023-06-22T10:53:36.959163+0000","last_peered":"2023-06-22T10:53:36.959163+0000","last_clean":"2023-06-22T10:53:36.959163+0000","last_became_active":"2023-06-22T10:53:31.945270+0000","last_became_peered":"2023-06-22T10:53:31.945270+0000","last_unstale":"2023-06-22T10:53:36.959163+0000","last_undegraded":"2023-06-22T10:53:36.959163+0000","last_fullsized":"2023-06-22T10:53:36.959163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:54:16.378747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958959+0000","last_change":"2023-06-22T10:53:35.981345+0000","last_active":"2023-06-22T10:53:36.958959+0000","last_peered":"2023-06-22T10:53:36.958959+0000","last_clean":"2023-06-22T10:53:36.958959+0000","last_became_active":"2023-06-22T10:53:35.980744+0000","last_became_peered":"2023-06-22T10:53:35.980744+0000","last_unstale":"2023-06-22T10:53:36.958959+0000","last_undegraded":"2023-06-22T10:53:36.958959+0000","last_fullsized":"2023-06-22T10:53:36.958959+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:54:18.568814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957001+0000","last_change":"2023-06-22T10:53:30.932306+0000","last_active":"2023-06-22T10:53:36.957001+0000","last_peered":"2023-06-22T10:53:36.957001+0000","last_clean":"2023-06-22T10:53:36.957001+0000","last_became_active":"2023-06-22T10:53:30.931997+0000","last_became_peered":"2023-06-22T10:53:30.931997+0000","last_unstale":"2023-06-22T10:53:36.957001+0000","last_undegraded":"2023-06-22T10:53:36.957001+0000","last_fullsized":"2023-06-22T10:53:36.957001+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:39:13.833606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958190+0000","last_change":"2023-06-22T10:53:31.954114+0000","last_active":"2023-06-22T10:53:36.958190+0000","last_peered":"2023-06-22T10:53:36.958190+0000","last_clean":"2023-06-22T10:53:36.958190+0000","last_became_active":"2023-06-22T10:53:31.953496+0000","last_became_peered":"2023-06-22T10:53:31.953496+0000","last_unstale":"2023-06-22T10:53:36.958190+0000","last_undegraded":"2023-06-22T10:53:36.958190+0000","last_fullsized":"2023-06-22T10:53:36.958190+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T15:22:38.636161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957711+0000","last_change":"2023-06-22T10:53:35.986282+0000","last_active":"2023-06-22T10:53:36.957711+0000","last_peered":"2023-06-22T10:53:36.957711+0000","last_clean":"2023-06-22T10:53:36.957711+0000","last_became_active":"2023-06-22T10:53:35.985805+0000","last_became_peered":"2023-06-22T10:53:35.985805+0000","last_unstale":"2023-06-22T10:53:36.957711+0000","last_undegraded":"2023-06-22T10:53:36.957711+0000","last_fullsized":"2023-06-22T10:53:36.957711+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:06:28.390109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.298108+0000","last_change":"2023-06-22T10:53:30.937943+0000","last_active":"2023-06-22T10:53:39.298108+0000","last_peered":"2023-06-22T10:53:39.298108+0000","last_clean":"2023-06-22T10:53:39.298108+0000","last_became_active":"2023-06-22T10:53:30.937648+0000","last_became_peered":"2023-06-22T10:53:30.937648+0000","last_unstale":"2023-06-22T10:53:39.298108+0000","last_undegraded":"2023-06-22T10:53:39.298108+0000","last_fullsized":"2023-06-22T10:53:39.298108+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T17:02:37.562158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421904+0000","last_change":"2023-06-22T10:53:31.930885+0000","last_active":"2023-06-22T10:53:38.421904+0000","last_peered":"2023-06-22T10:53:38.421904+0000","last_clean":"2023-06-22T10:53:38.421904+0000","last_became_active":"2023-06-22T10:53:31.930508+0000","last_became_peered":"2023-06-22T10:53:31.930508+0000","last_unstale":"2023-06-22T10:53:38.421904+0000","last_undegraded":"2023-06-22T10:53:38.421904+0000","last_fullsized":"2023-06-22T10:53:38.421904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:56:30.123428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.956198+0000","last_change":"2023-06-22T10:53:35.981990+0000","last_active":"2023-06-22T10:53:36.956198+0000","last_peered":"2023-06-22T10:53:36.956198+0000","last_clean":"2023-06-22T10:53:36.956198+0000","last_became_active":"2023-06-22T10:53:35.979743+0000","last_became_peered":"2023-06-22T10:53:35.979743+0000","last_unstale":"2023-06-22T10:53:36.956198+0000","last_undegraded":"2023-06-22T10:53:36.956198+0000","last_fullsized":"2023-06-22T10:53:36.956198+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:29:28.820265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421611+0000","last_change":"2023-06-22T10:53:25.624603+0000","last_active":"2023-06-22T10:53:38.421611+0000","last_peered":"2023-06-22T10:53:38.421611+0000","last_clean":"2023-06-22T10:53:38.421611+0000","last_became_active":"2023-06-22T10:53:25.624302+0000","last_became_peered":"2023-06-22T10:53:25.624302+0000","last_unstale":"2023-06-22T10:53:38.421611+0000","last_undegraded":"2023-06-22T10:53:38.421611+0000","last_fullsized":"2023-06-22T10:53:38.421611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_clean_scrub_stamp":"2023-06-22T10:53:24.612028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:46:56.694570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958314+0000","last_change":"2023-06-22T10:53:30.938529+0000","last_active":"2023-06-22T10:53:36.958314+0000","last_peered":"2023-06-22T10:53:36.958314+0000","last_clean":"2023-06-22T10:53:36.958314+0000","last_became_active":"2023-06-22T10:53:30.938128+0000","last_became_peered":"2023-06-22T10:53:30.938128+0000","last_unstale":"2023-06-22T10:53:36.958314+0000","last_undegraded":"2023-06-22T10:53:36.958314+0000","last_fullsized":"2023-06-22T10:53:36.958314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:19:57.424826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421209+0000","last_change":"2023-06-22T10:53:31.943591+0000","last_active":"2023-06-22T10:53:38.421209+0000","last_peered":"2023-06-22T10:53:38.421209+0000","last_clean":"2023-06-22T10:53:38.421209+0000","last_became_active":"2023-06-22T10:53:31.943246+0000","last_became_peered":"2023-06-22T10:53:31.943246+0000","last_unstale":"2023-06-22T10:53:38.421209+0000","last_undegraded":"2023-06-22T10:53:38.421209+0000","last_fullsized":"2023-06-22T10:53:38.421209+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:38:31.209670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.956370+0000","last_change":"2023-06-22T10:53:35.983928+0000","last_active":"2023-06-22T10:53:36.956370+0000","last_peered":"2023-06-22T10:53:36.956370+0000","last_clean":"2023-06-22T10:53:36.956370+0000","last_became_active":"2023-06-22T10:53:35.983547+0000","last_became_peered":"2023-06-22T10:53:35.983547+0000","last_unstale":"2023-06-22T10:53:36.956370+0000","last_undegraded":"2023-06-22T10:53:36.956370+0000","last_fullsized":"2023-06-22T10:53:36.956370+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T15:14:35.353462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957795+0000","last_change":"2023-06-22T10:53:25.624213+0000","last_active":"2023-06-22T10:53:36.957795+0000","last_peered":"2023-06-22T10:53:36.957795+0000","last_clean":"2023-06-22T10:53:36.957795+0000","last_became_active":"2023-06-22T10:53:25.623692+0000","last_became_peered":"2023-06-22T10:53:25.623692+0000","last_unstale":"2023-06-22T10:53:36.957795+0000","last_undegraded":"2023-06-22T10:53:36.957795+0000","last_fullsized":"2023-06-22T10:53:36.957795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_clean_scrub_stamp":"2023-06-22T10:53:24.612028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T11:10:32.309210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957903+0000","last_change":"2023-06-22T10:53:30.940331+0000","last_active":"2023-06-22T10:53:36.957903+0000","last_peered":"2023-06-22T10:53:36.957903+0000","last_clean":"2023-06-22T10:53:36.957903+0000","last_became_active":"2023-06-22T10:53:30.939881+0000","last_became_peered":"2023-06-22T10:53:30.939881+0000","last_unstale":"2023-06-22T10:53:36.957903+0000","last_undegraded":"2023-06-22T10:53:36.957903+0000","last_fullsized":"2023-06-22T10:53:36.957903+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:21:26.540035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421562+0000","last_change":"2023-06-22T10:53:31.934499+0000","last_active":"2023-06-22T10:53:38.421562+0000","last_peered":"2023-06-22T10:53:38.421562+0000","last_clean":"2023-06-22T10:53:38.421562+0000","last_became_active":"2023-06-22T10:53:31.934221+0000","last_became_peered":"2023-06-22T10:53:31.934221+0000","last_unstale":"2023-06-22T10:53:38.421562+0000","last_undegraded":"2023-06-22T10:53:38.421562+0000","last_fullsized":"2023-06-22T10:53:38.421562+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:08:21.094599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.540144+0000","last_change":"2023-06-22T10:53:35.973534+0000","last_active":"2023-06-22T10:53:37.540144+0000","last_peered":"2023-06-22T10:53:37.540144+0000","last_clean":"2023-06-22T10:53:37.540144+0000","last_became_active":"2023-06-22T10:53:35.973091+0000","last_became_peered":"2023-06-22T10:53:35.973091+0000","last_unstale":"2023-06-22T10:53:37.540144+0000","last_undegraded":"2023-06-22T10:53:37.540144+0000","last_fullsized":"2023-06-22T10:53:37.540144+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:21:55.271025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.539801+0000","last_change":"2023-06-22T10:53:25.679314+0000","last_active":"2023-06-22T10:53:37.539801+0000","last_peered":"2023-06-22T10:53:37.539801+0000","last_clean":"2023-06-22T10:53:37.539801+0000","last_became_active":"2023-06-22T10:53:25.678947+0000","last_became_peered":"2023-06-22T10:53:25.678947+0000","last_unstale":"2023-06-22T10:53:37.539801+0000","last_undegraded":"2023-06-22T10:53:37.539801+0000","last_fullsized":"2023-06-22T10:53:37.539801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_clean_scrub_stamp":"2023-06-22T10:53:24.612028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:08:41.570586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421091+0000","last_change":"2023-06-22T10:53:30.944583+0000","last_active":"2023-06-22T10:53:38.421091+0000","last_peered":"2023-06-22T10:53:38.421091+0000","last_clean":"2023-06-22T10:53:38.421091+0000","last_became_active":"2023-06-22T10:53:30.944251+0000","last_became_peered":"2023-06-22T10:53:30.944251+0000","last_unstale":"2023-06-22T10:53:38.421091+0000","last_undegraded":"2023-06-22T10:53:38.421091+0000","last_fullsized":"2023-06-22T10:53:38.421091+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:16:33.667495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421775+0000","last_change":"2023-06-22T10:53:31.939367+0000","last_active":"2023-06-22T10:53:38.421775+0000","last_peered":"2023-06-22T10:53:38.421775+0000","last_clean":"2023-06-22T10:53:38.421775+0000","last_became_active":"2023-06-22T10:53:31.939090+0000","last_became_peered":"2023-06-22T10:53:31.939090+0000","last_unstale":"2023-06-22T10:53:38.421775+0000","last_undegraded":"2023-06-22T10:53:38.421775+0000","last_fullsized":"2023-06-22T10:53:38.421775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:31:58.628207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.732375+0000","last_change":"2023-06-22T10:53:35.971334+0000","last_active":"2023-06-22T10:53:37.732375+0000","last_peered":"2023-06-22T10:53:37.732375+0000","last_clean":"2023-06-22T10:53:37.732375+0000","last_became_active":"2023-06-22T10:53:35.970663+0000","last_became_peered":"2023-06-22T10:53:35.970663+0000","last_unstale":"2023-06-22T10:53:37.732375+0000","last_undegraded":"2023-06-22T10:53:37.732375+0000","last_fullsized":"2023-06-22T10:53:37.732375+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T15:48:40.394252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958397+0000","last_change":"2023-06-22T10:53:25.624072+0000","last_active":"2023-06-22T10:53:36.958397+0000","last_peered":"2023-06-22T10:53:36.958397+0000","last_clean":"2023-06-22T10:53:36.958397+0000","last_became_active":"2023-06-22T10:53:25.623617+0000","last_became_peered":"2023-06-22T10:53:25.623617+0000","last_unstale":"2023-06-22T10:53:36.958397+0000","last_undegraded":"2023-06-22T10:53:36.958397+0000","last_fullsized":"2023-06-22T10:53:36.958397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_clean_scrub_stamp":"2023-06-22T10:53:24.612028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T15:48:30.067600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":183,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.732114+0000","last_change":"2023-06-22T10:53:19.693774+0000","last_active":"2023-06-22T10:53:37.732114+0000","last_peered":"2023-06-22T10:53:37.732114+0000","last_clean":"2023-06-22T10:53:37.732114+0000","last_became_active":"2023-06-22T10:53:19.692329+0000","last_became_peered":"2023-06-22T10:53:19.692329+0000","last_unstale":"2023-06-22T10:53:37.732114+0000","last_undegraded":"2023-06-22T10:53:37.732114+0000","last_fullsized":"2023-06-22T10:53:37.732114+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:17.830348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:17.830348+0000","last_clean_scrub_stamp":"2023-06-22T10:53:17.830348+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:35:38.155685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.298095+0000","last_change":"2023-06-22T10:53:30.939596+0000","last_active":"2023-06-22T10:53:39.298095+0000","last_peered":"2023-06-22T10:53:39.298095+0000","last_clean":"2023-06-22T10:53:39.298095+0000","last_became_active":"2023-06-22T10:53:30.939312+0000","last_became_peered":"2023-06-22T10:53:30.939312+0000","last_unstale":"2023-06-22T10:53:39.298095+0000","last_undegraded":"2023-06-22T10:53:39.298095+0000","last_fullsized":"2023-06-22T10:53:39.298095+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:58:40.107079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.279924+0000","last_change":"2023-06-22T10:53:31.953786+0000","last_active":"2023-06-22T10:53:37.279924+0000","last_peered":"2023-06-22T10:53:37.279924+0000","last_clean":"2023-06-22T10:53:37.279924+0000","last_became_active":"2023-06-22T10:53:31.953495+0000","last_became_peered":"2023-06-22T10:53:31.953495+0000","last_unstale":"2023-06-22T10:53:37.279924+0000","last_undegraded":"2023-06-22T10:53:37.279924+0000","last_fullsized":"2023-06-22T10:53:37.279924+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T18:35:18.801024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958642+0000","last_change":"2023-06-22T10:53:35.985942+0000","last_active":"2023-06-22T10:53:36.958642+0000","last_peered":"2023-06-22T10:53:36.958642+0000","last_clean":"2023-06-22T10:53:36.958642+0000","last_became_active":"2023-06-22T10:53:35.985552+0000","last_became_peered":"2023-06-22T10:53:35.985552+0000","last_unstale":"2023-06-22T10:53:36.958642+0000","last_undegraded":"2023-06-22T10:53:36.958642+0000","last_fullsized":"2023-06-22T10:53:36.958642+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:54:23.850496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.732378+0000","last_change":"2023-06-22T10:53:25.626890+0000","last_active":"2023-06-22T10:53:37.732378+0000","last_peered":"2023-06-22T10:53:37.732378+0000","last_clean":"2023-06-22T10:53:37.732378+0000","last_became_active":"2023-06-22T10:53:25.626558+0000","last_became_peered":"2023-06-22T10:53:25.626558+0000","last_unstale":"2023-06-22T10:53:37.732378+0000","last_undegraded":"2023-06-22T10:53:37.732378+0000","last_fullsized":"2023-06-22T10:53:37.732378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_clean_scrub_stamp":"2023-06-22T10:53:24.612028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:54:13.523844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.955533+0000","last_change":"2023-06-22T10:53:30.943578+0000","last_active":"2023-06-22T10:53:36.955533+0000","last_peered":"2023-06-22T10:53:36.955533+0000","last_clean":"2023-06-22T10:53:36.955533+0000","last_became_active":"2023-06-22T10:53:30.943117+0000","last_became_peered":"2023-06-22T10:53:30.943117+0000","last_unstale":"2023-06-22T10:53:36.955533+0000","last_undegraded":"2023-06-22T10:53:36.955533+0000","last_fullsized":"2023-06-22T10:53:36.955533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:00:06.067980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.956299+0000","last_change":"2023-06-22T10:53:31.943987+0000","last_active":"2023-06-22T10:53:36.956299+0000","last_peered":"2023-06-22T10:53:36.956299+0000","last_clean":"2023-06-22T10:53:36.956299+0000","last_became_active":"2023-06-22T10:53:31.943488+0000","last_became_peered":"2023-06-22T10:53:31.943488+0000","last_unstale":"2023-06-22T10:53:36.956299+0000","last_undegraded":"2023-06-22T10:53:36.956299+0000","last_fullsized":"2023-06-22T10:53:36.956299+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:31:56.049728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.280108+0000","last_change":"2023-06-22T10:53:35.989113+0000","last_active":"2023-06-22T10:53:37.280108+0000","last_peered":"2023-06-22T10:53:37.280108+0000","last_clean":"2023-06-22T10:53:37.280108+0000","last_became_active":"2023-06-22T10:53:35.988755+0000","last_became_peered":"2023-06-22T10:53:35.988755+0000","last_unstale":"2023-06-22T10:53:37.280108+0000","last_undegraded":"2023-06-22T10:53:37.280108+0000","last_fullsized":"2023-06-22T10:53:37.280108+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T18:28:31.706827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.732796+0000","last_change":"2023-06-22T10:53:25.626005+0000","last_active":"2023-06-22T10:53:37.732796+0000","last_peered":"2023-06-22T10:53:37.732796+0000","last_clean":"2023-06-22T10:53:37.732796+0000","last_became_active":"2023-06-22T10:53:25.625614+0000","last_became_peered":"2023-06-22T10:53:25.625614+0000","last_unstale":"2023-06-22T10:53:37.732796+0000","last_undegraded":"2023-06-22T10:53:37.732796+0000","last_fullsized":"2023-06-22T10:53:37.732796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_clean_scrub_stamp":"2023-06-22T10:53:24.612028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T17:38:17.711473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421888+0000","last_change":"2023-06-22T10:53:30.929933+0000","last_active":"2023-06-22T10:53:38.421888+0000","last_peered":"2023-06-22T10:53:38.421888+0000","last_clean":"2023-06-22T10:53:38.421888+0000","last_became_active":"2023-06-22T10:53:30.929555+0000","last_became_peered":"2023-06-22T10:53:30.929555+0000","last_unstale":"2023-06-22T10:53:38.421888+0000","last_undegraded":"2023-06-22T10:53:38.421888+0000","last_fullsized":"2023-06-22T10:53:38.421888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:54:19.597233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.956482+0000","last_change":"2023-06-22T10:53:31.947501+0000","last_active":"2023-06-22T10:53:36.956482+0000","last_peered":"2023-06-22T10:53:36.956482+0000","last_clean":"2023-06-22T10:53:36.956482+0000","last_became_active":"2023-06-22T10:53:31.947187+0000","last_became_peered":"2023-06-22T10:53:31.947187+0000","last_unstale":"2023-06-22T10:53:36.956482+0000","last_undegraded":"2023-06-22T10:53:36.956482+0000","last_fullsized":"2023-06-22T10:53:36.956482+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:16:34.673673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957362+0000","last_change":"2023-06-22T10:53:35.993805+0000","last_active":"2023-06-22T10:53:36.957362+0000","last_peered":"2023-06-22T10:53:36.957362+0000","last_clean":"2023-06-22T10:53:36.957362+0000","last_became_active":"2023-06-22T10:53:35.993328+0000","last_became_peered":"2023-06-22T10:53:35.993328+0000","last_unstale":"2023-06-22T10:53:36.957362+0000","last_undegraded":"2023-06-22T10:53:36.957362+0000","last_fullsized":"2023-06-22T10:53:36.957362+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:00:09.093418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.298382+0000","last_change":"2023-06-22T10:53:30.940900+0000","last_active":"2023-06-22T10:53:39.298382+0000","last_peered":"2023-06-22T10:53:39.298382+0000","last_clean":"2023-06-22T10:53:39.298382+0000","last_became_active":"2023-06-22T10:53:30.940629+0000","last_became_peered":"2023-06-22T10:53:30.940629+0000","last_unstale":"2023-06-22T10:53:39.298382+0000","last_undegraded":"2023-06-22T10:53:39.298382+0000","last_fullsized":"2023-06-22T10:53:39.298382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:09:13.735489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421554+0000","last_change":"2023-06-22T10:53:25.625427+0000","last_active":"2023-06-22T10:53:38.421554+0000","last_peered":"2023-06-22T10:53:38.421554+0000","last_clean":"2023-06-22T10:53:38.421554+0000","last_became_active":"2023-06-22T10:53:25.625237+0000","last_became_peered":"2023-06-22T10:53:25.625237+0000","last_unstale":"2023-06-22T10:53:38.421554+0000","last_undegraded":"2023-06-22T10:53:38.421554+0000","last_fullsized":"2023-06-22T10:53:38.421554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_clean_scrub_stamp":"2023-06-22T10:53:24.612028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:04:08.650168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.298446+0000","last_change":"2023-06-22T10:53:31.949224+0000","last_active":"2023-06-22T10:53:39.298446+0000","last_peered":"2023-06-22T10:53:39.298446+0000","last_clean":"2023-06-22T10:53:39.298446+0000","last_became_active":"2023-06-22T10:53:31.948912+0000","last_became_peered":"2023-06-22T10:53:31.948912+0000","last_unstale":"2023-06-22T10:53:39.298446+0000","last_undegraded":"2023-06-22T10:53:39.298446+0000","last_fullsized":"2023-06-22T10:53:39.298446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:54:19.812644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.298399+0000","last_change":"2023-06-22T10:53:35.983189+0000","last_active":"2023-06-22T10:53:39.298399+0000","last_peered":"2023-06-22T10:53:39.298399+0000","last_clean":"2023-06-22T10:53:39.298399+0000","last_became_active":"2023-06-22T10:53:35.982759+0000","last_became_peered":"2023-06-22T10:53:35.982759+0000","last_unstale":"2023-06-22T10:53:39.298399+0000","last_undegraded":"2023-06-22T10:53:39.298399+0000","last_fullsized":"2023-06-22T10:53:39.298399+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:01:41.849642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.280276+0000","last_change":"2023-06-22T10:53:25.625880+0000","last_active":"2023-06-22T10:53:37.280276+0000","last_peered":"2023-06-22T10:53:37.280276+0000","last_clean":"2023-06-22T10:53:37.280276+0000","last_became_active":"2023-06-22T10:53:25.625464+0000","last_became_peered":"2023-06-22T10:53:25.625464+0000","last_unstale":"2023-06-22T10:53:37.280276+0000","last_undegraded":"2023-06-22T10:53:37.280276+0000","last_fullsized":"2023-06-22T10:53:37.280276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_clean_scrub_stamp":"2023-06-22T10:53:24.612028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T18:21:03.851910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"26'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.956476+0000","last_change":"2023-06-22T10:53:30.938779+0000","last_active":"2023-06-22T10:53:36.956476+0000","last_peered":"2023-06-22T10:53:36.956476+0000","last_clean":"2023-06-22T10:53:36.956476+0000","last_became_active":"2023-06-22T10:53:30.938504+0000","last_became_peered":"2023-06-22T10:53:30.938504+0000","last_unstale":"2023-06-22T10:53:36.956476+0000","last_undegraded":"2023-06-22T10:53:36.956476+0000","last_fullsized":"2023-06-22T10:53:36.956476+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:49:19.162465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957157+0000","last_change":"2023-06-22T10:53:31.952763+0000","last_active":"2023-06-22T10:53:36.957157+0000","last_peered":"2023-06-22T10:53:36.957157+0000","last_clean":"2023-06-22T10:53:36.957157+0000","last_became_active":"2023-06-22T10:53:31.952142+0000","last_became_peered":"2023-06-22T10:53:31.952142+0000","last_unstale":"2023-06-22T10:53:36.957157+0000","last_undegraded":"2023-06-22T10:53:36.957157+0000","last_fullsized":"2023-06-22T10:53:36.957157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:16:58.055706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421993+0000","last_change":"2023-06-22T10:53:35.990183+0000","last_active":"2023-06-22T10:53:38.421993+0000","last_peered":"2023-06-22T10:53:38.421993+0000","last_clean":"2023-06-22T10:53:38.421993+0000","last_became_active":"2023-06-22T10:53:35.989752+0000","last_became_peered":"2023-06-22T10:53:35.989752+0000","last_unstale":"2023-06-22T10:53:38.421993+0000","last_undegraded":"2023-06-22T10:53:38.421993+0000","last_fullsized":"2023-06-22T10:53:38.421993+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T18:31:21.495204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.956332+0000","last_change":"2023-06-22T10:53:30.943481+0000","last_active":"2023-06-22T10:53:36.956332+0000","last_peered":"2023-06-22T10:53:36.956332+0000","last_clean":"2023-06-22T10:53:36.956332+0000","last_became_active":"2023-06-22T10:53:30.943176+0000","last_became_peered":"2023-06-22T10:53:30.943176+0000","last_unstale":"2023-06-22T10:53:36.956332+0000","last_undegraded":"2023-06-22T10:53:36.956332+0000","last_fullsized":"2023-06-22T10:53:36.956332+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T20:10:12.732255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.540111+0000","last_change":"2023-06-22T10:53:31.936896+0000","last_active":"2023-06-22T10:53:37.540111+0000","last_peered":"2023-06-22T10:53:37.540111+0000","last_clean":"2023-06-22T10:53:37.540111+0000","last_became_active":"2023-06-22T10:53:31.936564+0000","last_became_peered":"2023-06-22T10:53:31.936564+0000","last_unstale":"2023-06-22T10:53:37.540111+0000","last_undegraded":"2023-06-22T10:53:37.540111+0000","last_fullsized":"2023-06-22T10:53:37.540111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T13:21:48.372064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.732378+0000","last_change":"2023-06-22T10:53:35.978716+0000","last_active":"2023-06-22T10:53:37.732378+0000","last_peered":"2023-06-22T10:53:37.732378+0000","last_clean":"2023-06-22T10:53:37.732378+0000","last_became_active":"2023-06-22T10:53:35.978326+0000","last_became_peered":"2023-06-22T10:53:35.978326+0000","last_unstale":"2023-06-22T10:53:37.732378+0000","last_undegraded":"2023-06-22T10:53:37.732378+0000","last_fullsized":"2023-06-22T10:53:37.732378+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:01:41.849642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958008+0000","last_change":"2023-06-22T10:53:30.936749+0000","last_active":"2023-06-22T10:53:36.958008+0000","last_peered":"2023-06-22T10:53:36.958008+0000","last_clean":"2023-06-22T10:53:36.958008+0000","last_became_active":"2023-06-22T10:53:30.936447+0000","last_became_peered":"2023-06-22T10:53:30.936447+0000","last_unstale":"2023-06-22T10:53:36.958008+0000","last_undegraded":"2023-06-22T10:53:36.958008+0000","last_fullsized":"2023-06-22T10:53:36.958008+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:58:40.107079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957755+0000","last_change":"2023-06-22T10:53:31.955250+0000","last_active":"2023-06-22T10:53:36.957755+0000","last_peered":"2023-06-22T10:53:36.957755+0000","last_clean":"2023-06-22T10:53:36.957755+0000","last_became_active":"2023-06-22T10:53:31.954904+0000","last_became_peered":"2023-06-22T10:53:31.954904+0000","last_unstale":"2023-06-22T10:53:36.957755+0000","last_undegraded":"2023-06-22T10:53:36.957755+0000","last_fullsized":"2023-06-22T10:53:36.957755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:57:41.183955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958248+0000","last_change":"2023-06-22T10:53:35.977443+0000","last_active":"2023-06-22T10:53:36.958248+0000","last_peered":"2023-06-22T10:53:36.958248+0000","last_clean":"2023-06-22T10:53:36.958248+0000","last_became_active":"2023-06-22T10:53:35.977008+0000","last_became_peered":"2023-06-22T10:53:35.977008+0000","last_unstale":"2023-06-22T10:53:36.958248+0000","last_undegraded":"2023-06-22T10:53:36.958248+0000","last_fullsized":"2023-06-22T10:53:36.958248+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T17:02:42.606188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958133+0000","last_change":"2023-06-22T10:53:30.936289+0000","last_active":"2023-06-22T10:53:36.958133+0000","last_peered":"2023-06-22T10:53:36.958133+0000","last_clean":"2023-06-22T10:53:36.958133+0000","last_became_active":"2023-06-22T10:53:30.935990+0000","last_became_peered":"2023-06-22T10:53:30.935990+0000","last_unstale":"2023-06-22T10:53:36.958133+0000","last_undegraded":"2023-06-22T10:53:36.958133+0000","last_fullsized":"2023-06-22T10:53:36.958133+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:35:50.219987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957131+0000","last_change":"2023-06-22T10:53:31.941782+0000","last_active":"2023-06-22T10:53:36.957131+0000","last_peered":"2023-06-22T10:53:36.957131+0000","last_clean":"2023-06-22T10:53:36.957131+0000","last_became_active":"2023-06-22T10:53:31.940237+0000","last_became_peered":"2023-06-22T10:53:31.940237+0000","last_unstale":"2023-06-22T10:53:36.957131+0000","last_undegraded":"2023-06-22T10:53:36.957131+0000","last_fullsized":"2023-06-22T10:53:36.957131+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:49:21.017446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.956920+0000","last_change":"2023-06-22T10:53:35.989317+0000","last_active":"2023-06-22T10:53:36.956920+0000","last_peered":"2023-06-22T10:53:36.956920+0000","last_clean":"2023-06-22T10:53:36.956920+0000","last_became_active":"2023-06-22T10:53:35.988872+0000","last_became_peered":"2023-06-22T10:53:35.988872+0000","last_unstale":"2023-06-22T10:53:36.956920+0000","last_undegraded":"2023-06-22T10:53:36.956920+0000","last_fullsized":"2023-06-22T10:53:36.956920+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:12:36.166106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.298288+0000","last_change":"2023-06-22T10:53:30.936018+0000","last_active":"2023-06-22T10:53:39.298288+0000","last_peered":"2023-06-22T10:53:39.298288+0000","last_clean":"2023-06-22T10:53:39.298288+0000","last_became_active":"2023-06-22T10:53:30.935754+0000","last_became_peered":"2023-06-22T10:53:30.935754+0000","last_unstale":"2023-06-22T10:53:39.298288+0000","last_undegraded":"2023-06-22T10:53:39.298288+0000","last_fullsized":"2023-06-22T10:53:39.298288+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T15:48:35.350222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.298625+0000","last_change":"2023-06-22T10:53:31.927521+0000","last_active":"2023-06-22T10:53:39.298625+0000","last_peered":"2023-06-22T10:53:39.298625+0000","last_clean":"2023-06-22T10:53:39.298625+0000","last_became_active":"2023-06-22T10:53:31.927230+0000","last_became_peered":"2023-06-22T10:53:31.927230+0000","last_unstale":"2023-06-22T10:53:39.298625+0000","last_undegraded":"2023-06-22T10:53:39.298625+0000","last_fullsized":"2023-06-22T10:53:39.298625+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:16:42.860439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421325+0000","last_change":"2023-06-22T10:53:35.976634+0000","last_active":"2023-06-22T10:53:38.421325+0000","last_peered":"2023-06-22T10:53:38.421325+0000","last_clean":"2023-06-22T10:53:38.421325+0000","last_became_active":"2023-06-22T10:53:35.976193+0000","last_became_peered":"2023-06-22T10:53:35.976193+0000","last_unstale":"2023-06-22T10:53:38.421325+0000","last_undegraded":"2023-06-22T10:53:38.421325+0000","last_fullsized":"2023-06-22T10:53:38.421325+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T13:04:31.955833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957011+0000","last_change":"2023-06-22T10:53:30.938370+0000","last_active":"2023-06-22T10:53:36.957011+0000","last_peered":"2023-06-22T10:53:36.957011+0000","last_clean":"2023-06-22T10:53:36.957011+0000","last_became_active":"2023-06-22T10:53:30.937695+0000","last_became_peered":"2023-06-22T10:53:30.937695+0000","last_unstale":"2023-06-22T10:53:36.957011+0000","last_undegraded":"2023-06-22T10:53:36.957011+0000","last_fullsized":"2023-06-22T10:53:36.957011+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:59:49.191360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957346+0000","last_change":"2023-06-22T10:53:31.951892+0000","last_active":"2023-06-22T10:53:36.957346+0000","last_peered":"2023-06-22T10:53:36.957346+0000","last_clean":"2023-06-22T10:53:36.957346+0000","last_became_active":"2023-06-22T10:53:31.951200+0000","last_became_peered":"2023-06-22T10:53:31.951200+0000","last_unstale":"2023-06-22T10:53:36.957346+0000","last_undegraded":"2023-06-22T10:53:36.957346+0000","last_fullsized":"2023-06-22T10:53:36.957346+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T15:52:35.480952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.279886+0000","last_change":"2023-06-22T10:53:31.941076+0000","last_active":"2023-06-22T10:53:37.279886+0000","last_peered":"2023-06-22T10:53:37.279886+0000","last_clean":"2023-06-22T10:53:37.279886+0000","last_became_active":"2023-06-22T10:53:31.940796+0000","last_became_peered":"2023-06-22T10:53:31.940796+0000","last_unstale":"2023-06-22T10:53:37.279886+0000","last_undegraded":"2023-06-22T10:53:37.279886+0000","last_fullsized":"2023-06-22T10:53:37.279886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:04:33.641511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.298918+0000","last_change":"2023-06-22T10:53:31.940503+0000","last_active":"2023-06-22T10:53:39.298918+0000","last_peered":"2023-06-22T10:53:39.298918+0000","last_clean":"2023-06-22T10:53:39.298918+0000","last_became_active":"2023-06-22T10:53:31.939741+0000","last_became_peered":"2023-06-22T10:53:31.939741+0000","last_unstale":"2023-06-22T10:53:39.298918+0000","last_undegraded":"2023-06-22T10:53:39.298918+0000","last_fullsized":"2023-06-22T10:53:39.298918+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:12:32.128254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958527+0000","last_change":"2023-06-22T10:53:31.946176+0000","last_active":"2023-06-22T10:53:36.958527+0000","last_peered":"2023-06-22T10:53:36.958527+0000","last_clean":"2023-06-22T10:53:36.958527+0000","last_became_active":"2023-06-22T10:53:31.945842+0000","last_became_peered":"2023-06-22T10:53:31.945842+0000","last_unstale":"2023-06-22T10:53:36.958527+0000","last_undegraded":"2023-06-22T10:53:36.958527+0000","last_fullsized":"2023-06-22T10:53:36.958527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T18:41:56.633064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.298684+0000","last_change":"2023-06-22T10:53:31.949833+0000","last_active":"2023-06-22T10:53:39.298684+0000","last_peered":"2023-06-22T10:53:39.298684+0000","last_clean":"2023-06-22T10:53:39.298684+0000","last_became_active":"2023-06-22T10:53:31.949098+0000","last_became_peered":"2023-06-22T10:53:31.949098+0000","last_unstale":"2023-06-22T10:53:39.298684+0000","last_undegraded":"2023-06-22T10:53:39.298684+0000","last_fullsized":"2023-06-22T10:53:39.298684+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:54:14.530962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421731+0000","last_change":"2023-06-22T10:53:31.947493+0000","last_active":"2023-06-22T10:53:38.421731+0000","last_peered":"2023-06-22T10:53:38.421731+0000","last_clean":"2023-06-22T10:53:38.421731+0000","last_became_active":"2023-06-22T10:53:31.947154+0000","last_became_peered":"2023-06-22T10:53:31.947154+0000","last_unstale":"2023-06-22T10:53:38.421731+0000","last_undegraded":"2023-06-22T10:53:38.421731+0000","last_fullsized":"2023-06-22T10:53:38.421731+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T17:28:50.883566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":876,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":897024,"data_stored":714122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]}]},{"osd":7,"up_from":14,"seq":60129542156,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":900,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":921600,"data_stored":717550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":303104,"data_stored":123262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":123172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":319488,"data_stored":127022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":307200,"data_stored":123824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]}]},{"osd":2,"up_from":14,"seq":60129542154,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":123172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]}]},{"osd":6,"up_from":14,"seq":60129542155,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":123172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-22T10:54:01.599 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-06-22T10:54:01.600 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-06-22T10:54:01.600 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-06-22T10:54:01.601 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-06-22T10:54:01.601 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-06-22T10:54:01.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.830+0000 7ff1091ff700 1 Processor -- start 2023-06-22T10:54:01.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.830+0000 7ff1091ff700 1 -- start start 2023-06-22T10:54:01.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.831+0000 7ff1091ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff1040d2830 0x7ff1040b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:01.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.831+0000 7ff1091ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff1040b4c60 0x7ff1040d0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:01.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.831+0000 7ff1091ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1040b50a0 con 0x7ff10415c720 2023-06-22T10:54:01.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.831+0000 7ff1091ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff104160d60 con 0x7ff1040b4c60 2023-06-22T10:54:01.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.831+0000 7ff1091ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1040b2130 con 0x7ff1040d2830 2023-06-22T10:54:01.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.832+0000 7ff102d9d700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff10415c720 0x7ff1040b1870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.40:35678/0 (socket says 172.21.15.40:35678) 2023-06-22T10:54:01.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.832+0000 7ff102d9d700 1 -- 172.21.15.40:0/136450286 learned_addr learned my addr 172.21.15.40:0/136450286 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:01.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.832+0000 7ff10259c700 1 --2- 172.21.15.40:0/136450286 >> v2:172.21.15.45:3300/0 conn(0x7ff1040d2830 0x7ff1040b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:01.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.832+0000 7ff10359e700 1 --2- 172.21.15.40:0/136450286 >> v2:172.21.15.40:3300/0 conn(0x7ff1040b4c60 0x7ff1040d0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:01.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.832+0000 7ff101d9b700 1 -- 172.21.15.40:0/136450286 <== mon.1 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 913299848 0 0) 0x7ff1040b50a0 con 0x7ff10415c720 2023-06-22T10:54:01.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.832+0000 7ff101d9b700 1 -- 172.21.15.40:0/136450286 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0ec0035b0 con 0x7ff10415c720 2023-06-22T10:54:01.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.832+0000 7ff10359e700 1 -- 172.21.15.40:0/136450286 >> v2:172.21.15.45:3300/0 conn(0x7ff1040d2830 msgr2=0x7ff1040b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:01.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.832+0000 7ff10359e700 1 --2- 172.21.15.40:0/136450286 >> v2:172.21.15.45:3300/0 conn(0x7ff1040d2830 0x7ff1040b4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:01.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.832+0000 7ff10359e700 1 -- 172.21.15.40:0/136450286 >> v1:172.21.15.45:6789/0 conn(0x7ff10415c720 legacy=0x7ff1040b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:01.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.832+0000 7ff10359e700 1 -- 172.21.15.40:0/136450286 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff104161180 con 0x7ff1040b4c60 2023-06-22T10:54:01.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.832+0000 7ff10259c700 1 --2- 172.21.15.40:0/136450286 >> v2:172.21.15.45:3300/0 conn(0x7ff1040d2830 0x7ff1040b4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-22T10:54:01.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.832+0000 7ff10359e700 1 --2- 172.21.15.40:0/136450286 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff1040b4c60 0x7ff1040d0d00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc009d90 tx=0x7ff0fc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fef11b5f12b79fc0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:01.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.833+0000 7ff101d9b700 1 -- 172.21.15.40:0/136450286 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0fc00e070 con 0x7ff1040b4c60 2023-06-22T10:54:01.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.833+0000 7ff101d9b700 1 -- 172.21.15.40:0/136450286 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0fc00bae0 con 0x7ff1040b4c60 2023-06-22T10:54:01.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.833+0000 7ff101d9b700 1 -- 172.21.15.40:0/136450286 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0fc00be90 con 0x7ff1040b4c60 2023-06-22T10:54:01.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.833+0000 7ff1091ff700 1 -- 172.21.15.40:0/136450286 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff1040b4c60 msgr2=0x7ff1040d0d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:01.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.833+0000 7ff1091ff700 1 --2- 172.21.15.40:0/136450286 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff1040b4c60 0x7ff1040d0d00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc009d90 tx=0x7ff0fc00b330 comp rx=0 tx=0).stop 2023-06-22T10:54:01.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.833+0000 7ff1091ff700 1 -- 172.21.15.40:0/136450286 shutdown_connections 2023-06-22T10:54:01.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.833+0000 7ff1091ff700 1 --2- 172.21.15.40:0/136450286 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff1040b4c60 0x7ff1040d0d00 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:01.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.833+0000 7ff1091ff700 1 --2- 172.21.15.40:0/136450286 >> v2:172.21.15.45:3300/0 conn(0x7ff1040d2830 0x7ff1040b4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:01.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.833+0000 7ff1091ff700 1 -- 172.21.15.40:0/136450286 >> 172.21.15.40:0/136450286 conn(0x7ff1040cf720 msgr2=0x7ff1040cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:01.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.833+0000 7ff1091ff700 1 -- 172.21.15.40:0/136450286 shutdown_connections 2023-06-22T10:54:01.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.833+0000 7ff1091ff700 1 -- 172.21.15.40:0/136450286 wait complete. 2023-06-22T10:54:01.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.835+0000 7ff1091ff700 1 Processor -- start 2023-06-22T10:54:01.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.835+0000 7ff1091ff700 1 -- start start 2023-06-22T10:54:01.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.836+0000 7ff1091ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1040b4c60 0x7ff10414cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:01.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.836+0000 7ff1091ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff1040d2830 0x7ff10415d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:01.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.836+0000 7ff1091ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff10415c720 0x7ff10415eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:01.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.836+0000 7ff1091ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff10415e740 con 0x7ff1040d2830 2023-06-22T10:54:01.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.836+0000 7ff1091ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff10415dac0 con 0x7ff1040b4c60 2023-06-22T10:54:01.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.836+0000 7ff1091ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff10415dda0 con 0x7ff10415c720 2023-06-22T10:54:01.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.836+0000 7ff10259c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff1040d2830 0x7ff10415d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:01.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.837+0000 7ff102d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1040b4c60 0x7ff10414cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:01.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.837+0000 7ff10259c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff1040d2830 0x7ff10415d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50554/0 (socket says 172.21.15.40:50554) 2023-06-22T10:54:01.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.837+0000 7ff10259c700 1 -- 172.21.15.40:0/3255985787 learned_addr learned my addr 172.21.15.40:0/3255985787 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:01.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.837+0000 7ff10359e700 1 --2- 172.21.15.40:0/3255985787 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff10415c720 0x7ff10415eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:01.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.837+0000 7ff10259c700 1 -- 172.21.15.40:0/3255985787 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff10415c720 msgr2=0x7ff10415eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:01.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.837+0000 7ff10259c700 1 --2- 172.21.15.40:0/3255985787 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff10415c720 0x7ff10415eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:01.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.837+0000 7ff10259c700 1 -- 172.21.15.40:0/3255985787 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1040b4c60 msgr2=0x7ff10414cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:01.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.837+0000 7ff10259c700 1 --2- 172.21.15.40:0/3255985787 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1040b4c60 0x7ff10414cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:01.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.837+0000 7ff10259c700 1 -- 172.21.15.40:0/3255985787 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f80094a0 con 0x7ff1040d2830 2023-06-22T10:54:01.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.837+0000 7ff102d9d700 1 --2- 172.21.15.40:0/3255985787 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1040b4c60 0x7ff10414cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-22T10:54:01.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.837+0000 7ff10259c700 1 --2- 172.21.15.40:0/3255985787 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff1040d2830 0x7ff10415d000 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff0f800e9b0 tx=0x7ff0f800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:01.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.837+0000 7ff0eb7fe700 1 -- 172.21.15.40:0/3255985787 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f800ee50 con 0x7ff1040d2830 2023-06-22T10:54:01.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.838+0000 7ff0eb7fe700 1 -- 172.21.15.40:0/3255985787 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0f800c850 con 0x7ff1040d2830 2023-06-22T10:54:01.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.838+0000 7ff1091ff700 1 -- 172.21.15.40:0/3255985787 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0fc009a70 con 0x7ff1040d2830 2023-06-22T10:54:01.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.838+0000 7ff0eb7fe700 1 -- 172.21.15.40:0/3255985787 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f800cc00 con 0x7ff1040d2830 2023-06-22T10:54:01.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.838+0000 7ff1091ff700 1 -- 172.21.15.40:0/3255985787 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff10415e360 con 0x7ff1040d2830 2023-06-22T10:54:01.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.839+0000 7ff1091ff700 1 -- 172.21.15.40:0/3255985787 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff104067580 con 0x7ff1040d2830 2023-06-22T10:54:01.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.840+0000 7ff0eb7fe700 1 -- 172.21.15.40:0/3255985787 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff0f8013470 con 0x7ff1040d2830 2023-06-22T10:54:01.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.841+0000 7ff0eb7fe700 1 --2- 172.21.15.40:0/3255985787 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7ff0f006ace0 0x7ff0f006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:01.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.841+0000 7ff0eb7fe700 1 -- 172.21.15.40:0/3255985787 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff0f8089410 con 0x7ff1040d2830 2023-06-22T10:54:01.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.841+0000 7ff102d9d700 1 --2- 172.21.15.40:0/3255985787 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7ff0f006ace0 0x7ff0f006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:01.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.842+0000 7ff102d9d700 1 --2- 172.21.15.40:0/3255985787 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7ff0f006ace0 0x7ff0f006d190 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff0f4007fd0 tx=0x7ff0f4007dc0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:01.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:01.846+0000 7ff0eb7fe700 1 -- 172.21.15.40:0/3255985787 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff0f8057c50 con 0x7ff1040d2830 2023-06-22T10:54:02.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.107+0000 7ff1091ff700 1 -- 172.21.15.40:0/3255985787 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7ff1040b1b00 con 0x7ff1040d2830 2023-06-22T10:54:02.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.111+0000 7ff0eb7fe700 1 -- 172.21.15.40:0/3255985787 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+170841 (secure 0 0 0) 0x7ff0f80577e0 con 0x7ff1040d2830 2023-06-22T10:54:02.116 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:54:02.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.114+0000 7ff1091ff700 1 -- 172.21.15.40:0/3255985787 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7ff0f006ace0 msgr2=0x7ff0f006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:02.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.114+0000 7ff1091ff700 1 --2- 172.21.15.40:0/3255985787 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7ff0f006ace0 0x7ff0f006d190 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff0f4007fd0 tx=0x7ff0f4007dc0 comp rx=0 tx=0).stop 2023-06-22T10:54:02.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.114+0000 7ff1091ff700 1 -- 172.21.15.40:0/3255985787 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff1040d2830 msgr2=0x7ff10415d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:02.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.114+0000 7ff1091ff700 1 --2- 172.21.15.40:0/3255985787 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff1040d2830 0x7ff10415d000 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff0f800e9b0 tx=0x7ff0f800ecc0 comp rx=0 tx=0).stop 2023-06-22T10:54:02.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.114+0000 7ff1091ff700 1 -- 172.21.15.40:0/3255985787 shutdown_connections 2023-06-22T10:54:02.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.114+0000 7ff1091ff700 1 --2- 172.21.15.40:0/3255985787 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7ff0f006ace0 0x7ff0f006d190 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:02.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.114+0000 7ff1091ff700 1 --2- 172.21.15.40:0/3255985787 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff10415c720 0x7ff10415eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:02.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.114+0000 7ff1091ff700 1 --2- 172.21.15.40:0/3255985787 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1040b4c60 0x7ff10414cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:02.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.114+0000 7ff1091ff700 1 --2- 172.21.15.40:0/3255985787 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff1040d2830 0x7ff10415d000 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:02.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.114+0000 7ff1091ff700 1 -- 172.21.15.40:0/3255985787 >> 172.21.15.40:0/3255985787 conn(0x7ff1040cf720 msgr2=0x7ff1040b7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:02.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.114+0000 7ff1091ff700 1 -- 172.21.15.40:0/3255985787 shutdown_connections 2023-06-22T10:54:02.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.114+0000 7ff1091ff700 1 -- 172.21.15.40:0/3255985787 wait complete. 2023-06-22T10:54:02.136 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":5,"active_gid":4110,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1803669772},{"type":"v1","addr":"172.21.15.40:6833","nonce":1803669772}]},"active_addr":"172.21.15.40:6833/1803669772","active_change":"2023-06-22T10:53:11.109711+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4103,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.40:0","nonce":1995611854}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.40:0","nonce":653003028}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.40:0","nonce":2935404163}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.40:0","nonce":1367197013}]}]} 2023-06-22T10:54:02.140 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-06-22T10:54:02.141 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-06-22T10:54:02.141 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-22T10:54:02.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.338+0000 7f85bafff700 1 Processor -- start 2023-06-22T10:54:02.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.338+0000 7f85bafff700 1 -- start start 2023-06-22T10:54:02.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.339+0000 7f85bafff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f85b415c720 0x7f85b40b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:02.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.340+0000 7f85bafff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f85b40b4e30 0x7f85b40d0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:02.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.340+0000 7f85bafff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85b40b2130 con 0x7f85b40d2830 2023-06-22T10:54:02.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.340+0000 7f85bafff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85b4160d60 con 0x7f85b415c720 2023-06-22T10:54:02.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.340+0000 7f85bafff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85b4161180 con 0x7f85b40b4e30 2023-06-22T10:54:02.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.340+0000 7f85b8d9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f85b415c720 0x7f85b40b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:02.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.340+0000 7f85b8d9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f85b415c720 0x7f85b40b1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50556/0 (socket says 172.21.15.40:50556) 2023-06-22T10:54:02.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.340+0000 7f85b8d9b700 1 -- 172.21.15.40:0/4067552531 learned_addr learned my addr 172.21.15.40:0/4067552531 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:02.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.340+0000 7f85b959c700 1 --2- 172.21.15.40:0/4067552531 >> v2:172.21.15.45:3300/0 conn(0x7f85b40b4e30 0x7f85b40d0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:02.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.340+0000 7f85b8d9b700 1 -- 172.21.15.40:0/4067552531 >> v2:172.21.15.45:3300/0 conn(0x7f85b40b4e30 msgr2=0x7f85b40d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:02.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.340+0000 7f85b8d9b700 1 --2- 172.21.15.40:0/4067552531 >> v2:172.21.15.45:3300/0 conn(0x7f85b40b4e30 0x7f85b40d0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:02.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.340+0000 7f85b8d9b700 1 -- 172.21.15.40:0/4067552531 >> v1:172.21.15.45:6789/0 conn(0x7f85b40d2830 legacy=0x7f85b40b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:02.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.340+0000 7f85b8d9b700 1 -- 172.21.15.40:0/4067552531 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b41603c0 con 0x7f85b415c720 2023-06-22T10:54:02.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.341+0000 7f85b8d9b700 1 --2- 172.21.15.40:0/4067552531 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85b415c720 0x7f85b40b1870 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f85a80098f0 tx=0x7f85a8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c75252b53e21e443 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:02.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.341+0000 7f85b37fe700 1 -- 172.21.15.40:0/4067552531 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a8004230 con 0x7f85b415c720 2023-06-22T10:54:02.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.341+0000 7f85b37fe700 1 -- 172.21.15.40:0/4067552531 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85a8004390 con 0x7f85b415c720 2023-06-22T10:54:02.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.341+0000 7f85b37fe700 1 -- 172.21.15.40:0/4067552531 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a80036a0 con 0x7f85b415c720 2023-06-22T10:54:02.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.341+0000 7f85bafff700 1 -- 172.21.15.40:0/4067552531 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85b415c720 msgr2=0x7f85b40b1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:02.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.341+0000 7f85bafff700 1 --2- 172.21.15.40:0/4067552531 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85b415c720 0x7f85b40b1870 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f85a80098f0 tx=0x7f85a8009c00 comp rx=0 tx=0).stop 2023-06-22T10:54:02.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.341+0000 7f85bafff700 1 -- 172.21.15.40:0/4067552531 shutdown_connections 2023-06-22T10:54:02.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.341+0000 7f85bafff700 1 --2- 172.21.15.40:0/4067552531 >> v2:172.21.15.45:3300/0 conn(0x7f85b40b4e30 0x7f85b40d0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:02.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.341+0000 7f85bafff700 1 --2- 172.21.15.40:0/4067552531 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85b415c720 0x7f85b40b1870 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:02.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.341+0000 7f85bafff700 1 -- 172.21.15.40:0/4067552531 >> 172.21.15.40:0/4067552531 conn(0x7f85b40cf720 msgr2=0x7f85b40cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:02.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.341+0000 7f85bafff700 1 -- 172.21.15.40:0/4067552531 shutdown_connections 2023-06-22T10:54:02.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.342+0000 7f85bafff700 1 -- 172.21.15.40:0/4067552531 wait complete. 2023-06-22T10:54:02.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.343+0000 7f85bafff700 1 Processor -- start 2023-06-22T10:54:02.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.343+0000 7f85bafff700 1 -- start start 2023-06-22T10:54:02.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.344+0000 7f85bafff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85b40b4e30 0x7f85b41f3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:02.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.344+0000 7f85bafff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f85b40d2830 0x7f85b414e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:02.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.344+0000 7f85bafff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85b415c720 0x7f85b40ca730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:02.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.344+0000 7f85bafff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85b415cd30 con 0x7f85b40b4e30 2023-06-22T10:54:02.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.344+0000 7f85bafff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85b414e630 con 0x7f85b415c720 2023-06-22T10:54:02.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.344+0000 7f85bafff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85b40cb0b0 con 0x7f85b40d2830 2023-06-22T10:54:02.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.344+0000 7f85b8d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85b40b4e30 0x7f85b41f3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:02.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.345+0000 7f85b8d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85b40b4e30 0x7f85b41f3310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50564/0 (socket says 172.21.15.40:50564) 2023-06-22T10:54:02.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.345+0000 7f85b8d9b700 1 -- 172.21.15.40:0/1474538095 learned_addr learned my addr 172.21.15.40:0/1474538095 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:02.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.345+0000 7f85b3fff700 1 --2- 172.21.15.40:0/1474538095 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f85b40d2830 0x7f85b414e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:02.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.345+0000 7f85b959c700 1 --2- 172.21.15.40:0/1474538095 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85b415c720 0x7f85b40ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:02.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.345+0000 7f85b8d9b700 1 -- 172.21.15.40:0/1474538095 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f85b40d2830 msgr2=0x7f85b414e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:02.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.345+0000 7f85b8d9b700 1 --2- 172.21.15.40:0/1474538095 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f85b40d2830 0x7f85b414e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:02.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.345+0000 7f85b8d9b700 1 -- 172.21.15.40:0/1474538095 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85b415c720 msgr2=0x7f85b40ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:02.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.345+0000 7f85b8d9b700 1 --2- 172.21.15.40:0/1474538095 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85b415c720 0x7f85b40ca730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:02.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.345+0000 7f85b8d9b700 1 -- 172.21.15.40:0/1474538095 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a8009550 con 0x7f85b40b4e30 2023-06-22T10:54:02.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.345+0000 7f85b959c700 1 --2- 172.21.15.40:0/1474538095 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85b415c720 0x7f85b40ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:54:02.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.345+0000 7f85b8d9b700 1 --2- 172.21.15.40:0/1474538095 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85b40b4e30 0x7f85b41f3310 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f85a800b0e0 tx=0x7f85a8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:02.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.345+0000 7f85b17fa700 1 -- 172.21.15.40:0/1474538095 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a8003ea0 con 0x7f85b40b4e30 2023-06-22T10:54:02.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.345+0000 7f85b17fa700 1 -- 172.21.15.40:0/1474538095 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85a8011630 con 0x7f85b40b4e30 2023-06-22T10:54:02.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.346+0000 7f85bafff700 1 -- 172.21.15.40:0/1474538095 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85b415cf80 con 0x7f85b40b4e30 2023-06-22T10:54:02.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.346+0000 7f85b17fa700 1 -- 172.21.15.40:0/1474538095 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a80119e0 con 0x7f85b40b4e30 2023-06-22T10:54:02.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.346+0000 7f85bafff700 1 -- 172.21.15.40:0/1474538095 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85b415d540 con 0x7f85b40b4e30 2023-06-22T10:54:02.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.347+0000 7f85bafff700 1 -- 172.21.15.40:0/1474538095 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85b4067580 con 0x7f85b40b4e30 2023-06-22T10:54:02.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.348+0000 7f85b17fa700 1 -- 172.21.15.40:0/1474538095 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f85a8011b40 con 0x7f85b40b4e30 2023-06-22T10:54:02.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.349+0000 7f85b17fa700 1 --2- 172.21.15.40:0/1474538095 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f859806ace0 0x7f859806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:02.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.349+0000 7f85b17fa700 1 -- 172.21.15.40:0/1474538095 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f85a808af70 con 0x7f85b40b4e30 2023-06-22T10:54:02.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.349+0000 7f85b3fff700 1 --2- 172.21.15.40:0/1474538095 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f859806ace0 0x7f859806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:02.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.350+0000 7f85b3fff700 1 --2- 172.21.15.40:0/1474538095 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f859806ace0 0x7f859806d190 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f85a0007fd0 tx=0x7f85a0007ec0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:02.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.353+0000 7f85b17fa700 1 -- 172.21.15.40:0/1474538095 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f85a80bd310 con 0x7f85b40b4e30 2023-06-22T10:54:02.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.559+0000 7f85bafff700 1 -- 172.21.15.40:0/1474538095 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85b40b8990 con 0x7f85b40b4e30 2023-06-22T10:54:02.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.561+0000 7f85b17fa700 1 -- 172.21.15.40:0/1474538095 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20036 (secure 0 0 0) 0x7f85a8055dc0 con 0x7f85b40b4e30 2023-06-22T10:54:02.565 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:54:02.565 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":28,"fsid":"475560bc-1a7c-4a75-b3b6-6fc6b20bdc52","created":"2023-06-22T10:53:03.784568+0000","modified":"2023-06-22T10:53:36.483308+0000","last_up_change":"2023-06-22T10:53:17.830348+0000","last_in_change":"2023-06-22T10:53:07.329974+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-22T10:53:17.182228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-22T10:53:23.874432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-22T10:53:29.812963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-22T10:53:30.404021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-22T10:53:33.982289+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"918db6b4-053a-46ba-976d-6e1a0104017f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6809","nonce":2400162888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6811","nonce":2400162888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6815","nonce":2400162888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6813","nonce":2400162888}]},"public_addr":"172.21.15.40:6809/2400162888","cluster_addr":"172.21.15.40:6811/2400162888","heartbeat_back_addr":"172.21.15.40:6815/2400162888","heartbeat_front_addr":"172.21.15.40:6813/2400162888","state":["exists","up"]},{"osd":1,"uuid":"0c146e2b-1725-4dae-9b5c-38795943b9d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6801","nonce":230885800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6803","nonce":230885800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6807","nonce":230885800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6805","nonce":230885800}]},"public_addr":"172.21.15.40:6801/230885800","cluster_addr":"172.21.15.40:6803/230885800","heartbeat_back_addr":"172.21.15.40:6807/230885800","heartbeat_front_addr":"172.21.15.40:6805/230885800","state":["exists","up"]},{"osd":2,"uuid":"0b3727fd-f281-46d5-a675-86c8c5ab269e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6817","nonce":2681404929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6819","nonce":2681404929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6823","nonce":2681404929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6821","nonce":2681404929}]},"public_addr":"172.21.15.40:6817/2681404929","cluster_addr":"172.21.15.40:6819/2681404929","heartbeat_back_addr":"172.21.15.40:6823/2681404929","heartbeat_front_addr":"172.21.15.40:6821/2681404929","state":["exists","up"]},{"osd":3,"uuid":"2969c698-7039-4bbb-beda-f756f7a368a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6825","nonce":111110981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6827","nonce":111110981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6831","nonce":111110981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6829","nonce":111110981}]},"public_addr":"172.21.15.40:6825/111110981","cluster_addr":"172.21.15.40:6827/111110981","heartbeat_back_addr":"172.21.15.40:6831/111110981","heartbeat_front_addr":"172.21.15.40:6829/111110981","state":["exists","up"]},{"osd":4,"uuid":"3bb1d9c8-8e42-4a6b-998d-04834f34be5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6801","nonce":3625455711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6803","nonce":3625455711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6807","nonce":3625455711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6805","nonce":3625455711}]},"public_addr":"172.21.15.45:6801/3625455711","cluster_addr":"172.21.15.45:6803/3625455711","heartbeat_back_addr":"172.21.15.45:6807/3625455711","heartbeat_front_addr":"172.21.15.45:6805/3625455711","state":["exists","up"]},{"osd":5,"uuid":"f9854ee4-302c-41be-977b-bedda090a3d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6817","nonce":3354411217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6819","nonce":3354411217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6823","nonce":3354411217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6821","nonce":3354411217}]},"public_addr":"172.21.15.45:6817/3354411217","cluster_addr":"172.21.15.45:6819/3354411217","heartbeat_back_addr":"172.21.15.45:6823/3354411217","heartbeat_front_addr":"172.21.15.45:6821/3354411217","state":["exists","up"]},{"osd":6,"uuid":"bbdb1989-f6ac-4954-9b85-b8b540d683c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6809","nonce":320111074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6811","nonce":320111074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6815","nonce":320111074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6813","nonce":320111074}]},"public_addr":"172.21.15.45:6809/320111074","cluster_addr":"172.21.15.45:6811/320111074","heartbeat_back_addr":"172.21.15.45:6815/320111074","heartbeat_front_addr":"172.21.15.45:6813/320111074","state":["exists","up"]},{"osd":7,"uuid":"823d44e3-58f1-4d1d-8263-a4e4a69d4327","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6825","nonce":643617680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6827","nonce":643617680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6831","nonce":643617680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6829","nonce":643617680}]},"public_addr":"172.21.15.45:6825/643617680","cluster_addr":"172.21.15.45:6827/643617680","heartbeat_back_addr":"172.21.15.45:6831/643617680","heartbeat_front_addr":"172.21.15.45:6829/643617680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.731262+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.873226+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.898936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.666578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.645990+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.953699+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.642823+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.693395+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-22T10:54:02.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.563+0000 7f85bafff700 1 -- 172.21.15.40:0/1474538095 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f859806ace0 msgr2=0x7f859806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:02.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.563+0000 7f85bafff700 1 --2- 172.21.15.40:0/1474538095 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f859806ace0 0x7f859806d190 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f85a0007fd0 tx=0x7f85a0007ec0 comp rx=0 tx=0).stop 2023-06-22T10:54:02.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.563+0000 7f85bafff700 1 -- 172.21.15.40:0/1474538095 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85b40b4e30 msgr2=0x7f85b41f3310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:02.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.563+0000 7f85bafff700 1 --2- 172.21.15.40:0/1474538095 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85b40b4e30 0x7f85b41f3310 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f85a800b0e0 tx=0x7f85a8004750 comp rx=0 tx=0).stop 2023-06-22T10:54:02.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.563+0000 7f85bafff700 1 -- 172.21.15.40:0/1474538095 shutdown_connections 2023-06-22T10:54:02.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.563+0000 7f85bafff700 1 --2- 172.21.15.40:0/1474538095 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f859806ace0 0x7f859806d190 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:02.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.563+0000 7f85bafff700 1 --2- 172.21.15.40:0/1474538095 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85b415c720 0x7f85b40ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:02.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.563+0000 7f85bafff700 1 --2- 172.21.15.40:0/1474538095 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85b40b4e30 0x7f85b41f3310 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:02.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.563+0000 7f85bafff700 1 --2- 172.21.15.40:0/1474538095 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f85b40d2830 0x7f85b414e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:02.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.563+0000 7f85bafff700 1 -- 172.21.15.40:0/1474538095 >> 172.21.15.40:0/1474538095 conn(0x7f85b40cf720 msgr2=0x7f85b40b3c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:02.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.563+0000 7f85bafff700 1 -- 172.21.15.40:0/1474538095 shutdown_connections 2023-06-22T10:54:02.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.563+0000 7f85bafff700 1 -- 172.21.15.40:0/1474538095 wait complete. 2023-06-22T10:54:02.585 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-06-22T10:54:02.585 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-22T10:54:02.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.785+0000 7fe181bff700 1 Processor -- start 2023-06-22T10:54:02.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.785+0000 7fe181bff700 1 -- start start 2023-06-22T10:54:02.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.786+0000 7fe181bff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe17c15c720 0x7fe17c0b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:02.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.786+0000 7fe181bff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe17c0d2830 0x7fe17c0b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:02.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.786+0000 7fe181bff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe17c0b4c60 0x7fe17c06b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:02.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.786+0000 7fe181bff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe17c160d60 con 0x7fe17c15c720 2023-06-22T10:54:02.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.786+0000 7fe181bff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe17c0b50e0 con 0x7fe17c0b4c60 2023-06-22T10:54:02.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.786+0000 7fe181bff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c0b2130 con 0x7fe17c0d2830 2023-06-22T10:54:02.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.786+0000 7fe17b7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe17c15c720 0x7fe17c0b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:02.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.786+0000 7fe17b7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe17c15c720 0x7fe17c0b1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50576/0 (socket says 172.21.15.40:50576) 2023-06-22T10:54:02.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.786+0000 7fe17b7fe700 1 -- 172.21.15.40:0/4065786168 learned_addr learned my addr 172.21.15.40:0/4065786168 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:02.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.787+0000 7fe173fff700 1 --2- 172.21.15.40:0/4065786168 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe17c0d2830 0x7fe17c0b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:02.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.787+0000 7fe17bfff700 1 --2- 172.21.15.40:0/4065786168 >> v2:172.21.15.45:3300/0 conn(0x7fe17c0b4c60 0x7fe17c06b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:02.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.787+0000 7fe17b7fe700 1 -- 172.21.15.40:0/4065786168 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe17c0d2830 msgr2=0x7fe17c0b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:02.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.787+0000 7fe17b7fe700 1 --2- 172.21.15.40:0/4065786168 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe17c0d2830 0x7fe17c0b4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:02.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.787+0000 7fe17b7fe700 1 -- 172.21.15.40:0/4065786168 >> v2:172.21.15.45:3300/0 conn(0x7fe17c0b4c60 msgr2=0x7fe17c06b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:02.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.787+0000 7fe17b7fe700 1 --2- 172.21.15.40:0/4065786168 >> v2:172.21.15.45:3300/0 conn(0x7fe17c0b4c60 0x7fe17c06b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:02.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.787+0000 7fe17b7fe700 1 -- 172.21.15.40:0/4065786168 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe17c161180 con 0x7fe17c15c720 2023-06-22T10:54:02.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.787+0000 7fe17b7fe700 1 --2- 172.21.15.40:0/4065786168 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe17c15c720 0x7fe17c0b1870 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe17c0c9d00 tx=0x7fe16c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1372b55d5254f4 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:02.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.787+0000 7fe17affd700 1 -- 172.21.15.40:0/4065786168 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16c011830 con 0x7fe17c15c720 2023-06-22T10:54:02.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.787+0000 7fe17affd700 1 -- 172.21.15.40:0/4065786168 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe16c011990 con 0x7fe17c15c720 2023-06-22T10:54:02.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.787+0000 7fe17affd700 1 -- 172.21.15.40:0/4065786168 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16c011d20 con 0x7fe17c15c720 2023-06-22T10:54:02.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.788+0000 7fe181bff700 1 -- 172.21.15.40:0/4065786168 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe17c15c720 msgr2=0x7fe17c0b1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:02.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.788+0000 7fe181bff700 1 --2- 172.21.15.40:0/4065786168 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe17c15c720 0x7fe17c0b1870 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe17c0c9d00 tx=0x7fe16c009bd0 comp rx=0 tx=0).stop 2023-06-22T10:54:02.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.788+0000 7fe181bff700 1 -- 172.21.15.40:0/4065786168 shutdown_connections 2023-06-22T10:54:02.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.788+0000 7fe181bff700 1 --2- 172.21.15.40:0/4065786168 >> v2:172.21.15.45:3300/0 conn(0x7fe17c0b4c60 0x7fe17c06b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:02.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.788+0000 7fe181bff700 1 --2- 172.21.15.40:0/4065786168 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe17c15c720 0x7fe17c0b1870 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:02.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.788+0000 7fe181bff700 1 --2- 172.21.15.40:0/4065786168 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe17c0d2830 0x7fe17c0b4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:02.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.788+0000 7fe181bff700 1 -- 172.21.15.40:0/4065786168 >> 172.21.15.40:0/4065786168 conn(0x7fe17c0cf720 msgr2=0x7fe17c0cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:02.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.788+0000 7fe181bff700 1 -- 172.21.15.40:0/4065786168 shutdown_connections 2023-06-22T10:54:02.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.788+0000 7fe181bff700 1 -- 172.21.15.40:0/4065786168 wait complete. 2023-06-22T10:54:02.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.790+0000 7fe181bff700 1 Processor -- start 2023-06-22T10:54:02.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.790+0000 7fe181bff700 1 -- start start 2023-06-22T10:54:02.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.791+0000 7fe181bff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe17c0b4c60 0x7fe17c0c8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:02.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.791+0000 7fe181bff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe17c0d2830 0x7fe17c0b7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:02.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.791+0000 7fe181bff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe17c15c720 0x7fe17c0b7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:02.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.791+0000 7fe181bff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c0c9200 con 0x7fe17c0d2830 2023-06-22T10:54:02.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.791+0000 7fe181bff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c14a650 con 0x7fe17c15c720 2023-06-22T10:54:02.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.791+0000 7fe181bff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c14a930 con 0x7fe17c0b4c60 2023-06-22T10:54:02.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.791+0000 7fe173fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe17c0d2830 0x7fe17c0b7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:02.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.791+0000 7fe173fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe17c0d2830 0x7fe17c0b7530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50582/0 (socket says 172.21.15.40:50582) 2023-06-22T10:54:02.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.791+0000 7fe173fff700 1 -- 172.21.15.40:0/145035482 learned_addr learned my addr 172.21.15.40:0/145035482 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:02.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.791+0000 7fe17bfff700 1 --2- 172.21.15.40:0/145035482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe17c15c720 0x7fe17c0b7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:02.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.791+0000 7fe17b7fe700 1 --2- 172.21.15.40:0/145035482 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe17c0b4c60 0x7fe17c0c8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:02.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.792+0000 7fe173fff700 1 -- 172.21.15.40:0/145035482 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe17c0b4c60 msgr2=0x7fe17c0c8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:02.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.792+0000 7fe173fff700 1 --2- 172.21.15.40:0/145035482 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe17c0b4c60 0x7fe17c0c8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:02.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.792+0000 7fe173fff700 1 -- 172.21.15.40:0/145035482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe17c15c720 msgr2=0x7fe17c0b7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:02.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.792+0000 7fe173fff700 1 --2- 172.21.15.40:0/145035482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe17c15c720 0x7fe17c0b7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:02.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.792+0000 7fe173fff700 1 -- 172.21.15.40:0/145035482 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe16c009550 con 0x7fe17c0d2830 2023-06-22T10:54:02.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.792+0000 7fe173fff700 1 --2- 172.21.15.40:0/145035482 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe17c0d2830 0x7fe17c0b7530 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe16400e9b0 tx=0x7fe16400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:02.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.792+0000 7fe178ff9700 1 -- 172.21.15.40:0/145035482 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe164009710 con 0x7fe17c0d2830 2023-06-22T10:54:02.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.792+0000 7fe178ff9700 1 -- 172.21.15.40:0/145035482 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe16400ee50 con 0x7fe17c0d2830 2023-06-22T10:54:02.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.792+0000 7fe181bff700 1 -- 172.21.15.40:0/145035482 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe17c14ac10 con 0x7fe17c0d2830 2023-06-22T10:54:02.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.792+0000 7fe178ff9700 1 -- 172.21.15.40:0/145035482 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16400ca50 con 0x7fe17c0d2830 2023-06-22T10:54:02.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.792+0000 7fe181bff700 1 -- 172.21.15.40:0/145035482 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe17c14b1d0 con 0x7fe17c0d2830 2023-06-22T10:54:02.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.793+0000 7fe181bff700 1 -- 172.21.15.40:0/145035482 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe17c067580 con 0x7fe17c0d2830 2023-06-22T10:54:02.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.794+0000 7fe178ff9700 1 -- 172.21.15.40:0/145035482 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe16400cbb0 con 0x7fe17c0d2830 2023-06-22T10:54:02.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.795+0000 7fe178ff9700 1 --2- 172.21.15.40:0/145035482 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe15c06ace0 0x7fe15c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:02.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.795+0000 7fe178ff9700 1 -- 172.21.15.40:0/145035482 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe1640897f0 con 0x7fe17c0d2830 2023-06-22T10:54:02.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.795+0000 7fe17b7fe700 1 --2- 172.21.15.40:0/145035482 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe15c06ace0 0x7fe15c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:02.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.796+0000 7fe17b7fe700 1 --2- 172.21.15.40:0/145035482 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe15c06ace0 0x7fe15c06d190 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe16c009c10 tx=0x7fe16c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:02.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:02.799+0000 7fe178ff9700 1 -- 172.21.15.40:0/145035482 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe164057fa0 con 0x7fe17c0d2830 2023-06-22T10:54:03.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.007+0000 7fe181bff700 1 -- 172.21.15.40:0/145035482 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe17c0d0140 con 0x7fe17c0d2830 2023-06-22T10:54:03.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.009+0000 7fe178ff9700 1 -- 172.21.15.40:0/145035482 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20036 (secure 0 0 0) 0x7fe16400ce60 con 0x7fe17c0d2830 2023-06-22T10:54:03.012 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:54:03.013 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":28,"fsid":"475560bc-1a7c-4a75-b3b6-6fc6b20bdc52","created":"2023-06-22T10:53:03.784568+0000","modified":"2023-06-22T10:53:36.483308+0000","last_up_change":"2023-06-22T10:53:17.830348+0000","last_in_change":"2023-06-22T10:53:07.329974+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-22T10:53:17.182228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-22T10:53:23.874432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-22T10:53:29.812963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-22T10:53:30.404021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-22T10:53:33.982289+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"918db6b4-053a-46ba-976d-6e1a0104017f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6809","nonce":2400162888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6811","nonce":2400162888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6815","nonce":2400162888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6813","nonce":2400162888}]},"public_addr":"172.21.15.40:6809/2400162888","cluster_addr":"172.21.15.40:6811/2400162888","heartbeat_back_addr":"172.21.15.40:6815/2400162888","heartbeat_front_addr":"172.21.15.40:6813/2400162888","state":["exists","up"]},{"osd":1,"uuid":"0c146e2b-1725-4dae-9b5c-38795943b9d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6801","nonce":230885800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6803","nonce":230885800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6807","nonce":230885800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6805","nonce":230885800}]},"public_addr":"172.21.15.40:6801/230885800","cluster_addr":"172.21.15.40:6803/230885800","heartbeat_back_addr":"172.21.15.40:6807/230885800","heartbeat_front_addr":"172.21.15.40:6805/230885800","state":["exists","up"]},{"osd":2,"uuid":"0b3727fd-f281-46d5-a675-86c8c5ab269e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6817","nonce":2681404929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6819","nonce":2681404929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6823","nonce":2681404929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6821","nonce":2681404929}]},"public_addr":"172.21.15.40:6817/2681404929","cluster_addr":"172.21.15.40:6819/2681404929","heartbeat_back_addr":"172.21.15.40:6823/2681404929","heartbeat_front_addr":"172.21.15.40:6821/2681404929","state":["exists","up"]},{"osd":3,"uuid":"2969c698-7039-4bbb-beda-f756f7a368a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6825","nonce":111110981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6827","nonce":111110981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6831","nonce":111110981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6829","nonce":111110981}]},"public_addr":"172.21.15.40:6825/111110981","cluster_addr":"172.21.15.40:6827/111110981","heartbeat_back_addr":"172.21.15.40:6831/111110981","heartbeat_front_addr":"172.21.15.40:6829/111110981","state":["exists","up"]},{"osd":4,"uuid":"3bb1d9c8-8e42-4a6b-998d-04834f34be5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6801","nonce":3625455711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6803","nonce":3625455711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6807","nonce":3625455711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6805","nonce":3625455711}]},"public_addr":"172.21.15.45:6801/3625455711","cluster_addr":"172.21.15.45:6803/3625455711","heartbeat_back_addr":"172.21.15.45:6807/3625455711","heartbeat_front_addr":"172.21.15.45:6805/3625455711","state":["exists","up"]},{"osd":5,"uuid":"f9854ee4-302c-41be-977b-bedda090a3d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6817","nonce":3354411217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6819","nonce":3354411217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6823","nonce":3354411217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6821","nonce":3354411217}]},"public_addr":"172.21.15.45:6817/3354411217","cluster_addr":"172.21.15.45:6819/3354411217","heartbeat_back_addr":"172.21.15.45:6823/3354411217","heartbeat_front_addr":"172.21.15.45:6821/3354411217","state":["exists","up"]},{"osd":6,"uuid":"bbdb1989-f6ac-4954-9b85-b8b540d683c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6809","nonce":320111074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6811","nonce":320111074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6815","nonce":320111074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6813","nonce":320111074}]},"public_addr":"172.21.15.45:6809/320111074","cluster_addr":"172.21.15.45:6811/320111074","heartbeat_back_addr":"172.21.15.45:6815/320111074","heartbeat_front_addr":"172.21.15.45:6813/320111074","state":["exists","up"]},{"osd":7,"uuid":"823d44e3-58f1-4d1d-8263-a4e4a69d4327","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6825","nonce":643617680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6827","nonce":643617680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6831","nonce":643617680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6829","nonce":643617680}]},"public_addr":"172.21.15.45:6825/643617680","cluster_addr":"172.21.15.45:6827/643617680","heartbeat_back_addr":"172.21.15.45:6831/643617680","heartbeat_front_addr":"172.21.15.45:6829/643617680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.731262+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.873226+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.898936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.666578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.645990+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.953699+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.642823+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.693395+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-22T10:54:03.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.011+0000 7fe181bff700 1 -- 172.21.15.40:0/145035482 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe15c06ace0 msgr2=0x7fe15c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:03.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.011+0000 7fe181bff700 1 --2- 172.21.15.40:0/145035482 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe15c06ace0 0x7fe15c06d190 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe16c009c10 tx=0x7fe16c008030 comp rx=0 tx=0).stop 2023-06-22T10:54:03.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.011+0000 7fe181bff700 1 -- 172.21.15.40:0/145035482 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe17c0d2830 msgr2=0x7fe17c0b7530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:03.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.011+0000 7fe181bff700 1 --2- 172.21.15.40:0/145035482 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe17c0d2830 0x7fe17c0b7530 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe16400e9b0 tx=0x7fe16400ecc0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.011+0000 7fe181bff700 1 -- 172.21.15.40:0/145035482 shutdown_connections 2023-06-22T10:54:03.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.011+0000 7fe181bff700 1 --2- 172.21.15.40:0/145035482 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe15c06ace0 0x7fe15c06d190 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.011+0000 7fe181bff700 1 --2- 172.21.15.40:0/145035482 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe17c0b4c60 0x7fe17c0c8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.011+0000 7fe181bff700 1 --2- 172.21.15.40:0/145035482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe17c15c720 0x7fe17c0b7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.011+0000 7fe181bff700 1 --2- 172.21.15.40:0/145035482 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe17c0d2830 0x7fe17c0b7530 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.011+0000 7fe181bff700 1 -- 172.21.15.40:0/145035482 >> 172.21.15.40:0/145035482 conn(0x7fe17c0cf720 msgr2=0x7fe17c15b520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:03.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.011+0000 7fe181bff700 1 -- 172.21.15.40:0/145035482 shutdown_connections 2023-06-22T10:54:03.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.011+0000 7fe181bff700 1 -- 172.21.15.40:0/145035482 wait complete. 2023-06-22T10:54:03.033 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-06-22T10:54:03.034 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-06-22T10:54:03.034 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-06-22T10:54:03.034 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-06-22T10:54:03.035 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-06-22T10:54:03.035 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-06-22T10:54:03.036 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-06-22T10:54:03.036 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-06-22T10:54:03.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.401+0000 7f083ddff700 1 Processor -- start 2023-06-22T10:54:03.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.401+0000 7f083ddff700 1 -- start start 2023-06-22T10:54:03.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.403+0000 7f083ddff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f08381609a0 0x7f08380ce190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.403+0000 7f083ddff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08381643d0 con 0x7f0838069f30 2023-06-22T10:54:03.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.403+0000 7f083ddff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08381646b0 con 0x7f08380cf370 2023-06-22T10:54:03.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.403+0000 7f083ddff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0838165050 con 0x7f08381609a0 2023-06-22T10:54:03.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.404+0000 7f082effd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f08381609a0 0x7f08380ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:03.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.404+0000 7f082effd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f08381609a0 0x7f08380ce190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.40:46908/0 (socket says 172.21.15.40:46908) 2023-06-22T10:54:03.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.404+0000 7f082effd700 1 -- 172.21.15.40:0/3507147014 learned_addr learned my addr 172.21.15.40:0/3507147014 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:03.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.405+0000 7f082effd700 1 -- 172.21.15.40:0/3507147014 >> v1:172.21.15.45:6789/0 conn(0x7f08380cf370 legacy=0x7f083806c4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-06-22T10:54:03.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.405+0000 7f082effd700 1 -- 172.21.15.40:0/3507147014 >> v1:172.21.15.40:6789/0 conn(0x7f0838069f30 legacy=0x7f083806a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:03.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.405+0000 7f082effd700 1 -- 172.21.15.40:0/3507147014 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0838164990 con 0x7f08381609a0 2023-06-22T10:54:03.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.406+0000 7f082effd700 1 --2- 172.21.15.40:0/3507147014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08381609a0 0x7f08380ce190 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0820009e50 tx=0x7f082000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21b5128766d315e5 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:03.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.406+0000 7f0836ffd700 1 -- 172.21.15.40:0/3507147014 <== mon.1 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f082000e070 con 0x7f08381609a0 2023-06-22T10:54:03.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.406+0000 7f0836ffd700 1 -- 172.21.15.40:0/3507147014 <== mon.1 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0820003a20 con 0x7f08381609a0 2023-06-22T10:54:03.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.406+0000 7f0836ffd700 1 -- 172.21.15.40:0/3507147014 <== mon.1 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0820003dd0 con 0x7f08381609a0 2023-06-22T10:54:03.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.407+0000 7f083ddff700 1 -- 172.21.15.40:0/3507147014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08381609a0 msgr2=0x7f08380ce190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:03.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.407+0000 7f083ddff700 1 --2- 172.21.15.40:0/3507147014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08381609a0 0x7f08380ce190 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0820009e50 tx=0x7f082000b330 comp rx=0 tx=0).stop 2023-06-22T10:54:03.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.408+0000 7f083ddff700 1 -- 172.21.15.40:0/3507147014 shutdown_connections 2023-06-22T10:54:03.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.408+0000 7f083ddff700 1 --2- 172.21.15.40:0/3507147014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08381609a0 0x7f08380ce190 secure :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0820009e50 tx=0x7f082000b330 comp rx=0 tx=0).stop 2023-06-22T10:54:03.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.408+0000 7f083ddff700 1 -- 172.21.15.40:0/3507147014 >> 172.21.15.40:0/3507147014 conn(0x7f08380b0fe0 msgr2=0x7f08380ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:03.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.406+0000 7f2c9dfff700 1 Processor -- start 2023-06-22T10:54:03.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.406+0000 7f2c9dfff700 1 -- start start 2023-06-22T10:54:03.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.409+0000 7f083ddff700 1 -- 172.21.15.40:0/3507147014 shutdown_connections 2023-06-22T10:54:03.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.409+0000 7f083ddff700 1 -- 172.21.15.40:0/3507147014 wait complete. 2023-06-22T10:54:03.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.408+0000 7f2c9dfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2c98069f30 0x7f2c9806a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.408+0000 7f2c9dfff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f2c9806c940 0x7f2c98089000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.408+0000 7f2c9dfff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c98169510 con 0x7f2c9806c4a0 2023-06-22T10:54:03.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.408+0000 7f2c9dfff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c980885f0 con 0x7f2c98069f30 2023-06-22T10:54:03.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.408+0000 7f2c9dfff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9806a840 con 0x7f2c9806c940 2023-06-22T10:54:03.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.409+0000 7f2c977fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2c98069f30 0x7f2c9806a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:03.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.409+0000 7f2c97fff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f2c9806c940 0x7f2c98089000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:03.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.409+0000 7f2c977fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2c98069f30 0x7f2c9806a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50592/0 (socket says 172.21.15.40:50592) 2023-06-22T10:54:03.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.409+0000 7f2c97fff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f2c9806c940 0x7f2c98089000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3301/0 says I am v2:172.21.15.40:48692/0 (socket says 172.21.15.40:48692) 2023-06-22T10:54:03.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.409+0000 7f2c977fe700 1 -- 172.21.15.40:0/1541043093 learned_addr learned my addr 172.21.15.40:0/1541043093 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:03.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.410+0000 7f2c977fe700 1 -- 172.21.15.40:0/1541043093 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f2c9806c940 msgr2=0x7f2c98089000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:03.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.410+0000 7f2c977fe700 1 --2- 172.21.15.40:0/1541043093 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f2c9806c940 0x7f2c98089000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.410+0000 7f2c977fe700 1 -- 172.21.15.40:0/1541043093 >> v1:172.21.15.40:6789/0 conn(0x7f2c9806c4a0 legacy=0x7f2c9816cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:03.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.410+0000 7f2c977fe700 1 -- 172.21.15.40:0/1541043093 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c9816d630 con 0x7f2c98069f30 2023-06-22T10:54:03.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.412+0000 7f2c977fe700 1 --2- 172.21.15.40:0/1541043093 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c98069f30 0x7f2c9806a300 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2c90009920 tx=0x7f2c90009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9f5fbd8c0fdf5bb server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:03.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.413+0000 7f2c967fc700 1 -- 172.21.15.40:0/1541043093 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c90004230 con 0x7f2c98069f30 2023-06-22T10:54:03.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.413+0000 7f2c967fc700 1 -- 172.21.15.40:0/1541043093 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c90004390 con 0x7f2c98069f30 2023-06-22T10:54:03.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.413+0000 7f2c967fc700 1 -- 172.21.15.40:0/1541043093 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c90009e70 con 0x7f2c98069f30 2023-06-22T10:54:03.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.413+0000 7f083ddff700 1 Processor -- start 2023-06-22T10:54:03.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.414+0000 7f2c9dfff700 1 -- 172.21.15.40:0/1541043093 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c98069f30 msgr2=0x7f2c9806a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:03.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.414+0000 7f2c9dfff700 1 --2- 172.21.15.40:0/1541043093 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c98069f30 0x7f2c9806a300 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2c90009920 tx=0x7f2c90009c30 comp rx=0 tx=0).stop 2023-06-22T10:54:03.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.414+0000 7ff85b1ff700 1 Processor -- start 2023-06-22T10:54:03.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.414+0000 7fabee1ff700 1 Processor -- start 2023-06-22T10:54:03.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.415+0000 7fe259dff700 1 Processor -- start 2023-06-22T10:54:03.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.414+0000 7f083ddff700 1 -- start start 2023-06-22T10:54:03.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.417+0000 7fe259dff700 1 -- start start 2023-06-22T10:54:03.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.415+0000 7f083ddff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0838069f30 0x7f0838163310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.415+0000 7f083ddff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08380cf370 0x7f0838160d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.415+0000 7f083ddff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f08380c9e30 0x7f083815f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.415+0000 7f083ddff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08380c59a0 con 0x7f0838069f30 2023-06-22T10:54:03.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.415+0000 7f083ddff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0838163850 con 0x7f08380cf370 2023-06-22T10:54:03.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.415+0000 7f083ddff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08380ca3f0 con 0x7f08380c9e30 2023-06-22T10:54:03.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.418+0000 7f0837fff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f08380c9e30 0x7f083815f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:03.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.418+0000 7f0837fff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f08380c9e30 0x7f083815f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3301/0 says I am v2:172.21.15.40:48710/0 (socket says 172.21.15.40:48710) 2023-06-22T10:54:03.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.418+0000 7f0837fff700 1 -- 172.21.15.40:0/2597556397 learned_addr learned my addr 172.21.15.40:0/2597556397 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:03.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.418+0000 7f08377fe700 1 --2- 172.21.15.40:0/2597556397 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0838069f30 0x7f0838163310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:03.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.416+0000 7f2c9dfff700 1 -- 172.21.15.40:0/1541043093 shutdown_connections 2023-06-22T10:54:03.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.416+0000 7f2c9dfff700 1 --2- 172.21.15.40:0/1541043093 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f2c9806c940 0x7f2c98089000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.416+0000 7f2c9dfff700 1 --2- 172.21.15.40:0/1541043093 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c98069f30 0x7f2c9806a300 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.416+0000 7f2c9dfff700 1 -- 172.21.15.40:0/1541043093 >> 172.21.15.40:0/1541043093 conn(0x7f2c980b0fe0 msgr2=0x7f2c980ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:03.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.414+0000 7ff85b1ff700 1 -- start start 2023-06-22T10:54:03.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.416+0000 7ff85b1ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff85415bac0 0x7ff8540cc550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.416+0000 7ff85b1ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff85415ccd0 0x7ff8540ad730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.416+0000 7ff85b1ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff8540adc70 0x7ff854069f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.416+0000 7ff85b1ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8540ae0f0 con 0x7ff8540adc70 2023-06-22T10:54:03.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.416+0000 7ff85b1ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8540cd130 con 0x7ff85415ccd0 2023-06-22T10:54:03.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.416+0000 7ff85b1ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff85415be90 con 0x7ff85415bac0 2023-06-22T10:54:03.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.414+0000 7fabee1ff700 1 -- start start 2023-06-22T10:54:03.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.416+0000 7fabee1ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fabe815c4a0 0x7fabe80d1980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.416+0000 7fabee1ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fabe815c870 0x7fabe80cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.416+0000 7fabee1ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fabe80cd930 0x7fabe80b4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.416+0000 7fabee1ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabe80d08e0 con 0x7fabe80cd930 2023-06-22T10:54:03.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.416+0000 7fabee1ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabe80d0bc0 con 0x7fabe815c4a0 2023-06-22T10:54:03.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.416+0000 7fabee1ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabe80d0ea0 con 0x7fabe815c870 2023-06-22T10:54:03.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.416+0000 7fabe77fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fabe815c4a0 0x7fabe80d1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:03.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.416+0000 7fabe7fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fabe80cd930 0x7fabe80b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:03.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.416+0000 7fabe77fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fabe815c4a0 0x7fabe80d1980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.40:46920/0 (socket says 172.21.15.40:46920) 2023-06-22T10:54:03.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.416+0000 7fabe77fe700 1 -- 172.21.15.40:0/624958106 learned_addr learned my addr 172.21.15.40:0/624958106 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:03.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.417+0000 7fabe6ffd700 1 --2- 172.21.15.40:0/624958106 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fabe815c870 0x7fabe80cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:03.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.419+0000 7f08377fe700 1 -- 172.21.15.40:0/2597556397 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f08380c9e30 msgr2=0x7f083815f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:03.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.419+0000 7f08377fe700 1 --2- 172.21.15.40:0/2597556397 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f08380c9e30 0x7f083815f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.419+0000 7f08377fe700 1 -- 172.21.15.40:0/2597556397 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08380cf370 msgr2=0x7f0838160d70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-22T10:54:03.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.419+0000 7f08377fe700 1 --2- 172.21.15.40:0/2597556397 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08380cf370 0x7f0838160d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.419+0000 7f08377fe700 1 -- 172.21.15.40:0/2597556397 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0820009b30 con 0x7f0838069f30 2023-06-22T10:54:03.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.420+0000 7fe259dff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe2540cf0d0 0x7fe25406c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.420+0000 7fe259dff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2540cc400 con 0x7fe2540c1960 2023-06-22T10:54:03.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.420+0000 7fe259dff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe254070e50 con 0x7fe2541609a0 2023-06-22T10:54:03.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.420+0000 7fe259dff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe25406daf0 con 0x7fe2540cf0d0 2023-06-22T10:54:03.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.420+0000 7f08377fe700 1 --2- 172.21.15.40:0/2597556397 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0838069f30 0x7f0838163310 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f082800c3e0 tx=0x7f082800c6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:03.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.416+0000 7f2c9dfff700 1 -- 172.21.15.40:0/1541043093 shutdown_connections 2023-06-22T10:54:03.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.416+0000 7f2c9dfff700 1 -- 172.21.15.40:0/1541043093 wait complete. 2023-06-22T10:54:03.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.419+0000 7f2c9dfff700 1 Processor -- start 2023-06-22T10:54:03.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.419+0000 7f2c9dfff700 1 -- start start 2023-06-22T10:54:03.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.420+0000 7ff85979c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff8540adc70 0x7ff854069f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:03.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.420+0000 7ff85979c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff8540adc70 0x7ff854069f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50608/0 (socket says 172.21.15.40:50608) 2023-06-22T10:54:03.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.420+0000 7ff85979c700 1 -- 172.21.15.40:0/2555654190 learned_addr learned my addr 172.21.15.40:0/2555654190 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:03.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.420+0000 7ff85979c700 1 -- 172.21.15.40:0/2555654190 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff85415bac0 msgr2=0x7ff8540cc550 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-06-22T10:54:03.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.420+0000 7ff85979c700 1 --2- 172.21.15.40:0/2555654190 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff85415bac0 0x7ff8540cc550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.420+0000 7ff85979c700 1 -- 172.21.15.40:0/2555654190 >> v2:172.21.15.45:3300/0 conn(0x7ff85415ccd0 msgr2=0x7ff8540ad730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:03.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.420+0000 7ff853fff700 1 --2- 172.21.15.40:0/2555654190 >> v2:172.21.15.45:3300/0 conn(0x7ff85415ccd0 0x7ff8540ad730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:03.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.420+0000 7fe252ffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe2540cf0d0 0x7fe25406c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:03.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.420+0000 7fe252ffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe2540cf0d0 0x7fe25406c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.40:46950/0 (socket says 172.21.15.40:46950) 2023-06-22T10:54:03.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.420+0000 7fe252ffd700 1 -- 172.21.15.40:0/348488527 learned_addr learned my addr 172.21.15.40:0/348488527 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:03.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.421+0000 7f2c9dfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c98069f30 0x7f2c980c43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.421+0000 7f2c9dfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c9806c4a0 0x7f2c9816c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.421+0000 7f2c9dfff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f2c9806c940 0x7f2c98087b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.421+0000 7f2c9dfff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9816c600 con 0x7f2c9806c4a0 2023-06-22T10:54:03.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.421+0000 7f2c9dfff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c980b2960 con 0x7f2c98069f30 2023-06-22T10:54:03.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.421+0000 7f2c9dfff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c980b2c40 con 0x7f2c9806c940 2023-06-22T10:54:03.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.421+0000 7f0834ff9700 1 -- 172.21.15.40:0/2597556397 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f082800cea0 con 0x7f0838069f30 2023-06-22T10:54:03.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.421+0000 7f0834ff9700 1 -- 172.21.15.40:0/2597556397 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08280054e0 con 0x7f0838069f30 2023-06-22T10:54:03.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.421+0000 7f0834ff9700 1 -- 172.21.15.40:0/2597556397 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08280038c0 con 0x7f0838069f30 2023-06-22T10:54:03.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.421+0000 7ff85979c700 1 --2- 172.21.15.40:0/2555654190 >> v2:172.21.15.45:3300/0 conn(0x7ff85415ccd0 0x7ff8540ad730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.421+0000 7ff85979c700 1 -- 172.21.15.40:0/2555654190 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff854070440 con 0x7ff8540adc70 2023-06-22T10:54:03.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.421+0000 7ff853fff700 1 --2- 172.21.15.40:0/2555654190 >> v2:172.21.15.45:3300/0 conn(0x7ff85415ccd0 0x7ff8540ad730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-22T10:54:03.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.417+0000 7fabe7fff700 1 -- 172.21.15.40:0/624958106 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fabe815c870 msgr2=0x7fabe80cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:03.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.417+0000 7fabe7fff700 1 --2- 172.21.15.40:0/624958106 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fabe815c870 0x7fabe80cd3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.417+0000 7fabe7fff700 1 -- 172.21.15.40:0/624958106 >> v2:172.21.15.45:3300/0 conn(0x7fabe815c4a0 msgr2=0x7fabe80d1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:03.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.417+0000 7fabe7fff700 1 --2- 172.21.15.40:0/624958106 >> v2:172.21.15.45:3300/0 conn(0x7fabe815c4a0 0x7fabe80d1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.417+0000 7fabe7fff700 1 -- 172.21.15.40:0/624958106 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe80d1180 con 0x7fabe80cd930 2023-06-22T10:54:03.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.418+0000 7fabe7fff700 1 --2- 172.21.15.40:0/624958106 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fabe80cd930 0x7fabe80b4660 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fabe808acb0 tx=0x7fabe000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de9015351083f6c0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:03.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.421+0000 7fabe67fc700 1 -- 172.21.15.40:0/624958106 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe000e070 con 0x7fabe80cd930 2023-06-22T10:54:03.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.421+0000 7fabe67fc700 1 -- 172.21.15.40:0/624958106 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabe000bb20 con 0x7fabe80cd930 2023-06-22T10:54:03.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.421+0000 7fabe67fc700 1 -- 172.21.15.40:0/624958106 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe0012430 con 0x7fabe80cd930 2023-06-22T10:54:03.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.422+0000 7fe252ffd700 1 -- 172.21.15.40:0/348488527 >> v1:172.21.15.45:6789/0 conn(0x7fe2541609a0 legacy=0x7fe25406dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:03.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.421+0000 7f083ddff700 1 -- 172.21.15.40:0/2597556397 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08380c5c40 con 0x7f0838069f30 2023-06-22T10:54:03.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.421+0000 7f083ddff700 1 -- 172.21.15.40:0/2597556397 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08380ca6d0 con 0x7f0838069f30 2023-06-22T10:54:03.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.421+0000 7ff85979c700 1 --2- 172.21.15.40:0/2555654190 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8540adc70 0x7ff854069f30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff8540cf930 tx=0x7ff84c00d650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=452e8e97d26e0bda server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:03.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.422+0000 7fe252ffd700 1 -- 172.21.15.40:0/348488527 >> v1:172.21.15.40:6789/0 conn(0x7fe2540c1960 legacy=0x7fe254069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:03.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.422+0000 7fe252ffd700 1 -- 172.21.15.40:0/348488527 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe254071130 con 0x7fe2540cf0d0 2023-06-22T10:54:03.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.422+0000 7f2c977fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c98069f30 0x7f2c980c43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:03.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.422+0000 7f2c977fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c98069f30 0x7f2c980c43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.40:46964/0 (socket says 172.21.15.40:46964) 2023-06-22T10:54:03.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.422+0000 7f2c977fe700 1 -- 172.21.15.40:0/135382089 learned_addr learned my addr 172.21.15.40:0/135382089 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:03.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.422+0000 7f2c96ffd700 1 --2- 172.21.15.40:0/135382089 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c9806c4a0 0x7f2c9816c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:03.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.422+0000 7f2c97fff700 1 --2- 172.21.15.40:0/135382089 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f2c9806c940 0x7f2c98087b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:03.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.423+0000 7fe252ffd700 1 --2- 172.21.15.40:0/348488527 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2540cf0d0 0x7fe25406c4a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe24c009e50 tx=0x7fe24c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff51e56db61773d4 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:03.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.423+0000 7fe2527fc700 1 -- 172.21.15.40:0/348488527 <== mon.1 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24c00e070 con 0x7fe2540cf0d0 2023-06-22T10:54:03.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.423+0000 7fe2527fc700 1 -- 172.21.15.40:0/348488527 <== mon.1 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe24c003a20 con 0x7fe2540cf0d0 2023-06-22T10:54:03.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.423+0000 7fe2527fc700 1 -- 172.21.15.40:0/348488527 <== mon.1 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24c003dd0 con 0x7fe2540cf0d0 2023-06-22T10:54:03.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.424+0000 7fe259dff700 1 -- 172.21.15.40:0/348488527 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2540cf0d0 msgr2=0x7fe25406c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:03.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.424+0000 7fe259dff700 1 --2- 172.21.15.40:0/348488527 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2540cf0d0 0x7fe25406c4a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe24c009e50 tx=0x7fe24c00b330 comp rx=0 tx=0).stop 2023-06-22T10:54:03.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.424+0000 7fe259dff700 1 -- 172.21.15.40:0/348488527 shutdown_connections 2023-06-22T10:54:03.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.424+0000 7fe259dff700 1 --2- 172.21.15.40:0/348488527 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2540cf0d0 0x7fe25406c4a0 secure :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe24c009e50 tx=0x7fe24c00b330 comp rx=0 tx=0).stop 2023-06-22T10:54:03.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.424+0000 7fe259dff700 1 -- 172.21.15.40:0/348488527 >> 172.21.15.40:0/348488527 conn(0x7fe2540b0ff0 msgr2=0x7fe2540ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:03.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.425+0000 7fe259dff700 1 -- 172.21.15.40:0/348488527 shutdown_connections 2023-06-22T10:54:03.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.422+0000 7f083ddff700 1 -- 172.21.15.40:0/2597556397 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0838164c70 con 0x7f0838069f30 2023-06-22T10:54:03.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.423+0000 7ff8537fe700 1 -- 172.21.15.40:0/2555654190 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84c010070 con 0x7ff8540adc70 2023-06-22T10:54:03.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.423+0000 7ff8537fe700 1 -- 172.21.15.40:0/2555654190 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff84c00dce0 con 0x7ff8540adc70 2023-06-22T10:54:03.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.423+0000 7ff8537fe700 1 -- 172.21.15.40:0/2555654190 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84c007d70 con 0x7ff8540adc70 2023-06-22T10:54:03.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.424+0000 7ff85b1ff700 1 -- 172.21.15.40:0/2555654190 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8540adc70 msgr2=0x7ff854069f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:03.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.424+0000 7ff85b1ff700 1 --2- 172.21.15.40:0/2555654190 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8540adc70 0x7ff854069f30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff8540cf930 tx=0x7ff84c00d650 comp rx=0 tx=0).stop 2023-06-22T10:54:03.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.425+0000 7ff85b1ff700 1 -- 172.21.15.40:0/2555654190 shutdown_connections 2023-06-22T10:54:03.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.425+0000 7ff85b1ff700 1 --2- 172.21.15.40:0/2555654190 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff8540adc70 0x7ff854069f30 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.425+0000 7ff85b1ff700 1 --2- 172.21.15.40:0/2555654190 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff85415bac0 0x7ff8540cc550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.425+0000 7ff85b1ff700 1 --2- 172.21.15.40:0/2555654190 >> v2:172.21.15.45:3300/0 conn(0x7ff85415ccd0 0x7ff8540ad730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.425+0000 7ff85b1ff700 1 -- 172.21.15.40:0/2555654190 >> 172.21.15.40:0/2555654190 conn(0x7ff8540b0fe0 msgr2=0x7ff8540ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:03.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.425+0000 7ff85b1ff700 1 -- 172.21.15.40:0/2555654190 shutdown_connections 2023-06-22T10:54:03.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.423+0000 7fabee1ff700 1 -- 172.21.15.40:0/624958106 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fabe80cd930 msgr2=0x7fabe80b4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:03.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.423+0000 7fabee1ff700 1 --2- 172.21.15.40:0/624958106 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fabe80cd930 0x7fabe80b4660 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fabe808acb0 tx=0x7fabe000b330 comp rx=0 tx=0).stop 2023-06-22T10:54:03.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.423+0000 7fabee1ff700 1 -- 172.21.15.40:0/624958106 shutdown_connections 2023-06-22T10:54:03.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.423+0000 7fabee1ff700 1 --2- 172.21.15.40:0/624958106 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fabe80cd930 0x7fabe80b4660 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.423+0000 7fabee1ff700 1 --2- 172.21.15.40:0/624958106 >> v2:172.21.15.45:3300/0 conn(0x7fabe815c4a0 0x7fabe80d1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.423+0000 7fabee1ff700 1 --2- 172.21.15.40:0/624958106 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fabe815c870 0x7fabe80cd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.423+0000 7fabee1ff700 1 -- 172.21.15.40:0/624958106 >> 172.21.15.40:0/624958106 conn(0x7fabe80cf660 msgr2=0x7fabe80cfa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:03.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.423+0000 7fabee1ff700 1 -- 172.21.15.40:0/624958106 shutdown_connections 2023-06-22T10:54:03.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.424+0000 7fabee1ff700 1 -- 172.21.15.40:0/624958106 wait complete. 2023-06-22T10:54:03.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.426+0000 7ff85b1ff700 1 -- 172.21.15.40:0/2555654190 wait complete. 2023-06-22T10:54:03.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.426+0000 7fabee1ff700 1 Processor -- start 2023-06-22T10:54:03.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.427+0000 7fabee1ff700 1 -- start start 2023-06-22T10:54:03.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.426+0000 7f2c977fe700 1 -- 172.21.15.40:0/135382089 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f2c9806c940 msgr2=0x7f2c98087b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:03.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.426+0000 7f2c977fe700 1 --2- 172.21.15.40:0/135382089 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f2c9806c940 0x7f2c98087b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.426+0000 7f2c977fe700 1 -- 172.21.15.40:0/135382089 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c9806c4a0 msgr2=0x7f2c9816c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:03.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.426+0000 7f2c977fe700 1 --2- 172.21.15.40:0/135382089 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c9806c4a0 0x7f2c9816c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.426+0000 7f2c977fe700 1 -- 172.21.15.40:0/135382089 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c90009550 con 0x7f2c98069f30 2023-06-22T10:54:03.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.425+0000 7fe259dff700 1 -- 172.21.15.40:0/348488527 wait complete. 2023-06-22T10:54:03.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.427+0000 7fe259dff700 1 Processor -- start 2023-06-22T10:54:03.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.428+0000 7fe259dff700 1 -- start start 2023-06-22T10:54:03.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.428+0000 7f2c977fe700 1 --2- 172.21.15.40:0/135382089 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c98069f30 0x7f2c980c43e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2c98070130 tx=0x7f2c90004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:03.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.429+0000 7ff85b1ff700 1 Processor -- start 2023-06-22T10:54:03.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.428+0000 7fabee1ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fabe80cd930 0x7fabe8158290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.428+0000 7fabee1ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fabe815c4a0 0x7fabe813bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.428+0000 7fabee1ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fabe815c870 0x7fabe80cbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.428+0000 7fabee1ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe813c400 con 0x7fabe815c4a0 2023-06-22T10:54:03.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.428+0000 7fabee1ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe80cc430 con 0x7fabe815c870 2023-06-22T10:54:03.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.428+0000 7fabee1ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabe80cc710 con 0x7fabe80cd930 2023-06-22T10:54:03.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.429+0000 7fabe77fe700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fabe80cd930 0x7fabe8158290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:03.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.429+0000 7fabe77fe700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fabe80cd930 0x7fabe8158290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3301/0 says I am v2:172.21.15.40:48730/0 (socket says 172.21.15.40:48730) 2023-06-22T10:54:03.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.429+0000 7fabe77fe700 1 -- 172.21.15.40:0/3192179700 learned_addr learned my addr 172.21.15.40:0/3192179700 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:03.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.430+0000 7fe259dff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe2540c1960 0x7fe2540b17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.430+0000 7fe259dff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2541609a0 0x7fe2540c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.430+0000 7fe259dff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2540c4660 0x7fe25415ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.430+0000 7fe259dff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2540c41d0 con 0x7fe2541609a0 2023-06-22T10:54:03.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.430+0000 7fe259dff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2540b4470 con 0x7fe2540c4660 2023-06-22T10:54:03.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.430+0000 7fe259dff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2540c38a0 con 0x7fe2540c1960 2023-06-22T10:54:03.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.431+0000 7fe2537fe700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe2540c1960 0x7fe2540b17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:03.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.431+0000 7fe2537fe700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe2540c1960 0x7fe2540b17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3301/0 says I am v2:172.21.15.40:48734/0 (socket says 172.21.15.40:48734) 2023-06-22T10:54:03.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.431+0000 7fe2537fe700 1 -- 172.21.15.40:0/3131657310 learned_addr learned my addr 172.21.15.40:0/3131657310 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:03.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.431+0000 7fe253fff700 1 --2- 172.21.15.40:0/3131657310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2540c4660 0x7fe25415ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:03.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.430+0000 7f0834ff9700 1 -- 172.21.15.40:0/2597556397 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0828003a20 con 0x7f0838069f30 2023-06-22T10:54:03.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.429+0000 7f2c8ffff700 1 -- 172.21.15.40:0/135382089 <== mon.1 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9000bcf0 con 0x7f2c98069f30 2023-06-22T10:54:03.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.429+0000 7f2c8ffff700 1 -- 172.21.15.40:0/135382089 <== mon.1 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c9000be70 con 0x7f2c98069f30 2023-06-22T10:54:03.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.429+0000 7f2c8ffff700 1 -- 172.21.15.40:0/135382089 <== mon.1 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c900038e0 con 0x7f2c98069f30 2023-06-22T10:54:03.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.429+0000 7f2c9dfff700 1 -- 172.21.15.40:0/135382089 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c980b2f20 con 0x7f2c98069f30 2023-06-22T10:54:03.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.429+0000 7f2c9dfff700 1 -- 172.21.15.40:0/135382089 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c98169c90 con 0x7f2c98069f30 2023-06-22T10:54:03.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.429+0000 7ff85b1ff700 1 -- start start 2023-06-22T10:54:03.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.431+0000 7ff85b1ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8540adc70 0x7ff854150d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.431+0000 7ff85b1ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff85415bac0 0x7ff8540b2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.431+0000 7ff85b1ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff85415ccd0 0x7ff8540b25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.431+0000 7ff85b1ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8540b4410 con 0x7ff85415bac0 2023-06-22T10:54:03.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.431+0000 7ff85b1ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8540c2600 con 0x7ff8540adc70 2023-06-22T10:54:03.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.431+0000 7ff85b1ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8541512c0 con 0x7ff85415ccd0 2023-06-22T10:54:03.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.430+0000 7f9ddd9ff700 1 Processor -- start 2023-06-22T10:54:03.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.431+0000 7f9ddd9ff700 1 -- start start 2023-06-22T10:54:03.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.431+0000 7fabe77fe700 1 -- 172.21.15.40:0/3192179700 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fabe815c870 msgr2=0x7fabe80cbbc0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-22T10:54:03.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.431+0000 7fabe77fe700 1 --2- 172.21.15.40:0/3192179700 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fabe815c870 0x7fabe80cbbc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.431+0000 7fabe77fe700 1 -- 172.21.15.40:0/3192179700 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fabe815c4a0 msgr2=0x7fabe813bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:03.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.431+0000 7fabe77fe700 1 --2- 172.21.15.40:0/3192179700 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fabe815c4a0 0x7fabe813bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.431+0000 7fabe77fe700 1 -- 172.21.15.40:0/3192179700 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe0009a70 con 0x7fabe80cd930 2023-06-22T10:54:03.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.431+0000 7fabe77fe700 1 --2- 172.21.15.40:0/3192179700 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fabe80cd930 0x7fabe8158290 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fabd800e910 tx=0x7fabd800ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:03.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.432+0000 7fabcffff700 1 -- 172.21.15.40:0/3192179700 <== mon.2 v2:172.21.15.45:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd80096a0 con 0x7fabe80cd930 2023-06-22T10:54:03.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.432+0000 7fabcffff700 1 -- 172.21.15.40:0/3192179700 <== mon.2 v2:172.21.15.45:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd800c850 con 0x7fabe80cd930 2023-06-22T10:54:03.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.432+0000 7fabcffff700 1 -- 172.21.15.40:0/3192179700 <== mon.2 v2:172.21.15.45:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd800cc00 con 0x7fabe80cd930 2023-06-22T10:54:03.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.429+0000 7f3ac19ff700 1 Processor -- start 2023-06-22T10:54:03.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.429+0000 7f3ac19ff700 1 -- start start 2023-06-22T10:54:03.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.431+0000 7f3ac19ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f3abc0b1d90 0x7f3abc0d2160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.431+0000 7f3ac19ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3abc160f00 0x7f3abc161380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.431+0000 7f3ac19ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3abc15e9e0 con 0x7f3abc0b4660 2023-06-22T10:54:03.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.431+0000 7f3ac19ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3abc1654c0 con 0x7f3abc160f00 2023-06-22T10:54:03.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.431+0000 7f3ac19ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3abc06c230 con 0x7f3abc0b1d90 2023-06-22T10:54:03.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.432+0000 7f3abb7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3abc160f00 0x7f3abc161380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:03.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.432+0000 7f3abb7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3abc160f00 0x7f3abc161380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50660/0 (socket says 172.21.15.40:50660) 2023-06-22T10:54:03.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.432+0000 7f3abb7fe700 1 -- 172.21.15.40:0/1519599545 learned_addr learned my addr 172.21.15.40:0/1519599545 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:03.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.432+0000 7fe2537fe700 1 -- 172.21.15.40:0/3131657310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2540c4660 msgr2=0x7fe25415ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:03.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.432+0000 7fe2537fe700 1 --2- 172.21.15.40:0/3131657310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe2540c4660 0x7fe25415ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.432+0000 7fe2537fe700 1 -- 172.21.15.40:0/3131657310 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2541609a0 msgr2=0x7fe2540c80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:03.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.432+0000 7fe2537fe700 1 --2- 172.21.15.40:0/3131657310 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2541609a0 0x7fe2540c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.432+0000 7fe2537fe700 1 -- 172.21.15.40:0/3131657310 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe24c009b30 con 0x7fe2540c1960 2023-06-22T10:54:03.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.433+0000 7fe2537fe700 1 --2- 172.21.15.40:0/3131657310 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe2540c1960 0x7fe2540b17b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe24400b470 tx=0x7fe24400b830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:03.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.432+0000 7f0834ff9700 1 --2- 172.21.15.40:0/2597556397 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f081806adb0 0x7f081806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.432+0000 7f0834ff9700 1 -- 172.21.15.40:0/2597556397 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f08280895d0 con 0x7f0838069f30 2023-06-22T10:54:03.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.432+0000 7f0834ff9700 1 --2- 172.21.15.40:0/2597556397 >> [v2:172.21.15.40:6800/230885800,v1:172.21.15.40:6801/230885800] conn(0x7f0818074a80 0x7f0818076eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.432+0000 7f0834ff9700 1 -- 172.21.15.40:0/2597556397 --> [v2:172.21.15.40:6800/230885800,v1:172.21.15.40:6801/230885800] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0818077580 con 0x7f0818074a80 2023-06-22T10:54:03.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.432+0000 7f0834ff9700 1 -- 172.21.15.40:0/2597556397 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0828089980 con 0x7f0838069f30 2023-06-22T10:54:03.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.433+0000 7f2c9dfff700 1 -- 172.21.15.40:0/135382089 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2c7c000fc0 con 0x7f2c98069f30 2023-06-22T10:54:03.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.433+0000 7ff85979c700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff85415ccd0 0x7ff8540b25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:03.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.433+0000 7ff853fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff85415bac0 0x7ff8540b2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:03.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.433+0000 7ff853fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff85415bac0 0x7ff8540b2070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50642/0 (socket says 172.21.15.40:50642) 2023-06-22T10:54:03.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.433+0000 7ff853fff700 1 -- 172.21.15.40:0/735251415 learned_addr learned my addr 172.21.15.40:0/735251415 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:03.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.434+0000 7ff858f9b700 1 --2- 172.21.15.40:0/735251415 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8540adc70 0x7ff854150d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:03.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.433+0000 7fabee1ff700 1 -- 172.21.15.40:0/3192179700 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabe813b6c0 con 0x7fabe80cd930 2023-06-22T10:54:03.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.433+0000 7fabee1ff700 1 -- 172.21.15.40:0/3192179700 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabe80cc100 con 0x7fabe80cd930 2023-06-22T10:54:03.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.434+0000 7fabee1ff700 1 -- 172.21.15.40:0/3192179700 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fabe80d1ec0 con 0x7fabe80cd930 2023-06-22T10:54:03.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.432+0000 7f3ab27fc700 1 --2- 172.21.15.40:0/1519599545 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f3abc0b1d90 0x7f3abc0d2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:03.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.434+0000 7f3abb7fe700 1 -- 172.21.15.40:0/1519599545 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f3abc0b1d90 msgr2=0x7f3abc0d2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:03.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.434+0000 7f3abb7fe700 1 --2- 172.21.15.40:0/1519599545 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f3abc0b1d90 0x7f3abc0d2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.434+0000 7f3abb7fe700 1 -- 172.21.15.40:0/1519599545 >> v1:172.21.15.45:6789/0 conn(0x7f3abc0b4660 legacy=0x7f3abc0b4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:03.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.434+0000 7f3abb7fe700 1 -- 172.21.15.40:0/1519599545 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3abc0d29b0 con 0x7f3abc160f00 2023-06-22T10:54:03.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.434+0000 7f3abb7fe700 1 --2- 172.21.15.40:0/1519599545 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3abc160f00 0x7f3abc161380 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3ab4009e50 tx=0x7f3ab400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c25c3bbb6148957 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:03.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.434+0000 7fcfd6bff700 1 Processor -- start 2023-06-22T10:54:03.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.434+0000 7f9ddd9ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9dd815c870 0x7f9dd80cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.434+0000 7f9ddd9ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9dd80cd930 0x7f9dd80b4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.434+0000 7f9ddd9ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dd80d08e0 con 0x7f9dd815c4a0 2023-06-22T10:54:03.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.434+0000 7f9ddd9ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dd80d0bc0 con 0x7f9dd815c870 2023-06-22T10:54:03.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.434+0000 7f9ddd9ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd80d0ea0 con 0x7f9dd80cd930 2023-06-22T10:54:03.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.434+0000 7f9dd67fc700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9dd815c870 0x7f9dd80cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:03.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.434+0000 7f9dd77fe700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9dd80cd930 0x7f9dd80b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:03.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.434+0000 7f9dd77fe700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9dd80cd930 0x7f9dd80b4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3301/0 says I am v2:172.21.15.40:48772/0 (socket says 172.21.15.40:48772) 2023-06-22T10:54:03.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.434+0000 7f9dd77fe700 1 -- 172.21.15.40:0/4275602454 learned_addr learned my addr 172.21.15.40:0/4275602454 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:03.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.435+0000 7fe24bfff700 1 -- 172.21.15.40:0/3131657310 <== mon.2 v2:172.21.15.45:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe244011830 con 0x7fe2540c1960 2023-06-22T10:54:03.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.435+0000 7fe24bfff700 1 -- 172.21.15.40:0/3131657310 <== mon.2 v2:172.21.15.45:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2440119b0 con 0x7fe2540c1960 2023-06-22T10:54:03.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.435+0000 7fe24bfff700 1 -- 172.21.15.40:0/3131657310 <== mon.2 v2:172.21.15.45:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe244011d60 con 0x7fe2540c1960 2023-06-22T10:54:03.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.434+0000 7ff853fff700 1 -- 172.21.15.40:0/735251415 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff85415ccd0 msgr2=0x7ff8540b25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:03.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.435+0000 7ff853fff700 1 --2- 172.21.15.40:0/735251415 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff85415ccd0 0x7ff8540b25b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.435+0000 7ff853fff700 1 -- 172.21.15.40:0/735251415 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8540adc70 msgr2=0x7ff854150d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:03.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.435+0000 7ff853fff700 1 --2- 172.21.15.40:0/735251415 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8540adc70 0x7ff854150d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.435+0000 7ff853fff700 1 -- 172.21.15.40:0/735251415 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff84c00d050 con 0x7ff85415bac0 2023-06-22T10:54:03.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.435+0000 7ff853fff700 1 --2- 172.21.15.40:0/735251415 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff85415bac0 0x7ff8540b2070 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff84800c7f0 tx=0x7ff84800cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:03.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.435+0000 7f9dd77fe700 1 -- 172.21.15.40:0/4275602454 >> v2:172.21.15.45:3300/0 conn(0x7f9dd815c870 msgr2=0x7f9dd80cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:03.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.435+0000 7f9dd77fe700 1 --2- 172.21.15.40:0/4275602454 >> v2:172.21.15.45:3300/0 conn(0x7f9dd815c870 0x7f9dd80cd3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.435+0000 7f9dd77fe700 1 -- 172.21.15.40:0/4275602454 >> v1:172.21.15.45:6789/0 conn(0x7f9dd815c4a0 legacy=0x7f9dd80d1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:03.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.435+0000 7f9dd77fe700 1 -- 172.21.15.40:0/4275602454 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd80d1180 con 0x7f9dd80cd930 2023-06-22T10:54:03.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.435+0000 7fe259dff700 1 -- 172.21.15.40:0/3131657310 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2540c3b80 con 0x7fe2540c1960 2023-06-22T10:54:03.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.436+0000 7fe259dff700 1 -- 172.21.15.40:0/3131657310 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2540b1cf0 con 0x7fe2540c1960 2023-06-22T10:54:03.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.436+0000 7ff8517fa700 1 -- 172.21.15.40:0/735251415 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff848011800 con 0x7ff85415bac0 2023-06-22T10:54:03.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.436+0000 7ff8517fa700 1 -- 172.21.15.40:0/735251415 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff848011960 con 0x7ff85415bac0 2023-06-22T10:54:03.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.436+0000 7ff8517fa700 1 -- 172.21.15.40:0/735251415 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff848011cd0 con 0x7ff85415bac0 2023-06-22T10:54:03.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.435+0000 7f3aba7fc700 1 -- 172.21.15.40:0/1519599545 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab400e070 con 0x7f3abc160f00 2023-06-22T10:54:03.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.436+0000 7f3aba7fc700 1 -- 172.21.15.40:0/1519599545 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ab400b910 con 0x7f3abc160f00 2023-06-22T10:54:03.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.436+0000 7f3aba7fc700 1 -- 172.21.15.40:0/1519599545 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab400bcc0 con 0x7f3abc160f00 2023-06-22T10:54:03.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.437+0000 7f3ac19ff700 1 -- 172.21.15.40:0/1519599545 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3abc160f00 msgr2=0x7f3abc161380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:03.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.437+0000 7f3ac19ff700 1 --2- 172.21.15.40:0/1519599545 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3abc160f00 0x7f3abc161380 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3ab4009e50 tx=0x7f3ab400b330 comp rx=0 tx=0).stop 2023-06-22T10:54:03.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.434+0000 7fcfd6bff700 1 -- start start 2023-06-22T10:54:03.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.436+0000 7fcfd6bff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcfd00cf0d0 0x7fcfd006c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.436+0000 7fcfd6bff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fcfd00c1960 0x7fcfd00c1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.436+0000 7fcfd6bff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfd00cc400 con 0x7fcfd01609a0 2023-06-22T10:54:03.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.436+0000 7fcfd6bff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfd006daf0 con 0x7fcfd00cf0d0 2023-06-22T10:54:03.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.436+0000 7fcfd6bff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd0070e50 con 0x7fcfd00c1960 2023-06-22T10:54:03.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.436+0000 7fcfcffff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcfd00cf0d0 0x7fcfd006c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:03.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.437+0000 7fcfcffff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcfd00cf0d0 0x7fcfd006c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.40:46990/0 (socket says 172.21.15.40:46990) 2023-06-22T10:54:03.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.437+0000 7fcfcffff700 1 -- 172.21.15.40:0/3555026290 learned_addr learned my addr 172.21.15.40:0/3555026290 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:03.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.436+0000 7f9dd77fe700 1 --2- 172.21.15.40:0/4275602454 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9dd80cd930 0x7f9dd80b4660 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9dc80098f0 tx=0x7f9dc8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb9b8d103429ba6f server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:03.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.435+0000 7f2c8ffff700 1 -- 172.21.15.40:0/135382089 <== mon.1 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2c90021070 con 0x7f2c98069f30 2023-06-22T10:54:03.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.436+0000 7f2c8ffff700 1 --2- 172.21.15.40:0/135382089 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f2c7806adb0 0x7f2c7806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.437+0000 7f2c8ffff700 1 -- 172.21.15.40:0/135382089 <== mon.1 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2c9008ab50 con 0x7f2c98069f30 2023-06-22T10:54:03.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.437+0000 7fcfcffff700 1 -- 172.21.15.40:0/3555026290 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fcfd00c1960 msgr2=0x7fcfd00c1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:03.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.437+0000 7fcfcffff700 1 --2- 172.21.15.40:0/3555026290 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fcfd00c1960 0x7fcfd00c1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.437+0000 7fcfcffff700 1 -- 172.21.15.40:0/3555026290 >> v1:172.21.15.45:6789/0 conn(0x7fcfd01609a0 legacy=0x7fcfd006dc90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-06-22T10:54:03.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.437+0000 7f2c8ffff700 1 --2- 172.21.15.40:0/135382089 >> [v2:172.21.15.40:6816/2681404929,v1:172.21.15.40:6817/2681404929] conn(0x7f2c78074a80 0x7f2c78076eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.437+0000 7f2c8ffff700 1 -- 172.21.15.40:0/135382089 --> [v2:172.21.15.40:6816/2681404929,v1:172.21.15.40:6817/2681404929] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2c78077580 con 0x7f2c78074a80 2023-06-22T10:54:03.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.437+0000 7f2c8ffff700 1 -- 172.21.15.40:0/135382089 <== mon.1 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c9008f2a0 con 0x7f2c98069f30 2023-06-22T10:54:03.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.437+0000 7fcfcffff700 1 -- 172.21.15.40:0/3555026290 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd0071130 con 0x7fcfd00cf0d0 2023-06-22T10:54:03.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.435+0000 7f082effd700 1 --2- 172.21.15.40:0/2597556397 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f081806adb0 0x7f081806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:03.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.436+0000 7f0837fff700 1 --2- 172.21.15.40:0/2597556397 >> [v2:172.21.15.40:6800/230885800,v1:172.21.15.40:6801/230885800] conn(0x7f0818074a80 0x7f0818076eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:03.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.438+0000 7f0837fff700 1 --2- 172.21.15.40:0/2597556397 >> [v2:172.21.15.40:6800/230885800,v1:172.21.15.40:6801/230885800] conn(0x7f0818074a80 0x7f0818076eb0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:03.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.438+0000 7fcfcffff700 1 --2- 172.21.15.40:0/3555026290 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfd00cf0d0 0x7fcfd006c4a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcfc40098f0 tx=0x7fcfc4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e2a5c30e56d205a server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:03.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.438+0000 7f9dd5ffb700 1 -- 172.21.15.40:0/4275602454 <== mon.2 v2:172.21.15.45:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc8004230 con 0x7f9dd80cd930 2023-06-22T10:54:03.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.438+0000 7f9dd5ffb700 1 -- 172.21.15.40:0/4275602454 <== mon.2 v2:172.21.15.45:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dc8004390 con 0x7f9dd80cd930 2023-06-22T10:54:03.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.438+0000 7f9dd5ffb700 1 -- 172.21.15.40:0/4275602454 <== mon.2 v2:172.21.15.45:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc80036a0 con 0x7f9dd80cd930 2023-06-22T10:54:03.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.438+0000 7f3ac19ff700 1 -- 172.21.15.40:0/1519599545 shutdown_connections 2023-06-22T10:54:03.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.438+0000 7f3ac19ff700 1 --2- 172.21.15.40:0/1519599545 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3abc160f00 0x7f3abc161380 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.438+0000 7f3ac19ff700 1 --2- 172.21.15.40:0/1519599545 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f3abc0b1d90 0x7f3abc0d2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.438+0000 7f3ac19ff700 1 -- 172.21.15.40:0/1519599545 >> 172.21.15.40:0/1519599545 conn(0x7f3abc0cf660 msgr2=0x7f3abc0cfa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:03.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.438+0000 7ff85b1ff700 1 -- 172.21.15.40:0/735251415 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8540b2c80 con 0x7ff85415bac0 2023-06-22T10:54:03.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.438+0000 7ff85b1ff700 1 -- 172.21.15.40:0/735251415 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8540b3240 con 0x7ff85415bac0 2023-06-22T10:54:03.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.438+0000 7f2c96ffd700 1 --2- 172.21.15.40:0/135382089 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f2c7806adb0 0x7f2c7806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:03.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.439+0000 7ff85b1ff700 1 -- 172.21.15.40:0/735251415 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff854070690 con 0x7ff85415bac0 2023-06-22T10:54:03.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.439+0000 7f2c97fff700 1 --2- 172.21.15.40:0/135382089 >> [v2:172.21.15.40:6816/2681404929,v1:172.21.15.40:6817/2681404929] conn(0x7f2c78074a80 0x7f2c78076eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:03.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.439+0000 7f9ddd9ff700 1 -- 172.21.15.40:0/4275602454 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9dd80cd930 msgr2=0x7f9dd80b4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:03.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.439+0000 7f9ddd9ff700 1 --2- 172.21.15.40:0/4275602454 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9dd80cd930 0x7f9dd80b4660 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9dc80098f0 tx=0x7f9dc8009c00 comp rx=0 tx=0).stop 2023-06-22T10:54:03.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.438+0000 7f082effd700 1 --2- 172.21.15.40:0/2597556397 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f081806adb0 0x7f081806d260 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f08380703f0 tx=0x7f0820009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:03.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.439+0000 7f0834ff9700 1 -- 172.21.15.40:0/2597556397 <== osd.1 v2:172.21.15.40:6800/230885800 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f0818077580 con 0x7f0818074a80 2023-06-22T10:54:03.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.439+0000 7f9ddd9ff700 1 -- 172.21.15.40:0/4275602454 shutdown_connections 2023-06-22T10:54:03.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.439+0000 7f9ddd9ff700 1 --2- 172.21.15.40:0/4275602454 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9dd80cd930 0x7f9dd80b4660 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.439+0000 7f9ddd9ff700 1 --2- 172.21.15.40:0/4275602454 >> v2:172.21.15.45:3300/0 conn(0x7f9dd815c870 0x7f9dd80cd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.439+0000 7f9ddd9ff700 1 -- 172.21.15.40:0/4275602454 >> 172.21.15.40:0/4275602454 conn(0x7f9dd80cf660 msgr2=0x7f9dd80cfa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:03.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.438+0000 7fabcffff700 1 -- 172.21.15.40:0/3192179700 <== mon.2 v2:172.21.15.45:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fabd800cd60 con 0x7fabe80cd930 2023-06-22T10:54:03.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.440+0000 7fabcffff700 1 --2- 172.21.15.40:0/3192179700 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fabd406adb0 0x7fabd406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.440+0000 7fabcffff700 1 -- 172.21.15.40:0/3192179700 <== mon.2 v2:172.21.15.45:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fabd8089b20 con 0x7fabe80cd930 2023-06-22T10:54:03.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.440+0000 7fabe6ffd700 1 --2- 172.21.15.40:0/3192179700 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fabd406adb0 0x7fabd406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:03.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.440+0000 7fabcffff700 1 --2- 172.21.15.40:0/3192179700 >> [v2:172.21.15.45:6800/3625455711,v1:172.21.15.45:6801/3625455711] conn(0x7fabd4074a80 0x7fabd4076eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.441+0000 7fabcffff700 1 -- 172.21.15.40:0/3192179700 --> [v2:172.21.15.45:6800/3625455711,v1:172.21.15.45:6801/3625455711] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fabd4077580 con 0x7fabd4074a80 2023-06-22T10:54:03.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.441+0000 7fabcffff700 1 -- 172.21.15.40:0/3192179700 <== mon.2 v2:172.21.15.45:3301/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fabd8089ed0 con 0x7fabe80cd930 2023-06-22T10:54:03.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.440+0000 7fcfcf7fe700 1 -- 172.21.15.40:0/3555026290 <== mon.1 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc4004230 con 0x7fcfd00cf0d0 2023-06-22T10:54:03.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.440+0000 7fcfcf7fe700 1 -- 172.21.15.40:0/3555026290 <== mon.1 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfc4004390 con 0x7fcfd00cf0d0 2023-06-22T10:54:03.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.440+0000 7fcfcf7fe700 1 -- 172.21.15.40:0/3555026290 <== mon.1 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc40036a0 con 0x7fcfd00cf0d0 2023-06-22T10:54:03.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.441+0000 7fcfd6bff700 1 -- 172.21.15.40:0/3555026290 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfd00cf0d0 msgr2=0x7fcfd006c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:03.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.441+0000 7fcfd6bff700 1 --2- 172.21.15.40:0/3555026290 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfd00cf0d0 0x7fcfd006c4a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcfc40098f0 tx=0x7fcfc4009c00 comp rx=0 tx=0).stop 2023-06-22T10:54:03.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.441+0000 7f9ddd9ff700 1 -- 172.21.15.40:0/4275602454 shutdown_connections 2023-06-22T10:54:03.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.437+0000 7fe259dff700 1 -- 172.21.15.40:0/3131657310 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe2540cc650 con 0x7fe2540c1960 2023-06-22T10:54:03.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.440+0000 7f2c96ffd700 1 --2- 172.21.15.40:0/135382089 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f2c7806adb0 0x7f2c7806d260 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2c980c1e40 tx=0x7f2c880042c0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:03.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.441+0000 7f3ac19ff700 1 -- 172.21.15.40:0/1519599545 shutdown_connections 2023-06-22T10:54:03.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.441+0000 7fabe7fff700 1 --2- 172.21.15.40:0/3192179700 >> [v2:172.21.15.45:6800/3625455711,v1:172.21.15.45:6801/3625455711] conn(0x7fabd4074a80 0x7fabd4076eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:03.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.442+0000 7fe24bfff700 1 -- 172.21.15.40:0/3131657310 <== mon.2 v2:172.21.15.45:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe24401a400 con 0x7fe2540c1960 2023-06-22T10:54:03.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.442+0000 7f2c97fff700 1 --2- 172.21.15.40:0/135382089 >> [v2:172.21.15.40:6816/2681404929,v1:172.21.15.40:6817/2681404929] conn(0x7f2c78074a80 0x7f2c78076eb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:03.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.442+0000 7fabe7fff700 1 --2- 172.21.15.40:0/3192179700 >> [v2:172.21.15.45:6800/3625455711,v1:172.21.15.45:6801/3625455711] conn(0x7fabd4074a80 0x7fabd4076eb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:03.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.443+0000 7fe24bfff700 1 --2- 172.21.15.40:0/3131657310 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe23c06adb0 0x7fe23c06d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.443+0000 7fe24bfff700 1 -- 172.21.15.40:0/3131657310 <== mon.2 v2:172.21.15.45:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe244089f90 con 0x7fe2540c1960 2023-06-22T10:54:03.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.444+0000 7fe24bfff700 1 --2- 172.21.15.40:0/3131657310 >> [v2:172.21.15.40:6808/2400162888,v1:172.21.15.40:6809/2400162888] conn(0x7fe23c074a80 0x7fe23c076eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.444+0000 7fe24bfff700 1 -- 172.21.15.40:0/3131657310 --> [v2:172.21.15.40:6808/2400162888,v1:172.21.15.40:6809/2400162888] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe23c077580 con 0x7fe23c074a80 2023-06-22T10:54:03.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.444+0000 7fe24bfff700 1 -- 172.21.15.40:0/3131657310 <== mon.2 v2:172.21.15.45:3301/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe24408a340 con 0x7fe2540c1960 2023-06-22T10:54:03.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.444+0000 7fe252ffd700 1 --2- 172.21.15.40:0/3131657310 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe23c06adb0 0x7fe23c06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:03.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.443+0000 7f2c8ffff700 1 -- 172.21.15.40:0/135382089 <== osd.2 v2:172.21.15.40:6816/2681404929 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f2c78077580 con 0x7f2c78074a80 2023-06-22T10:54:03.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.442+0000 7ff8517fa700 1 -- 172.21.15.40:0/735251415 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff8480233e0 con 0x7ff85415bac0 2023-06-22T10:54:03.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.444+0000 7ff8517fa700 1 --2- 172.21.15.40:0/735251415 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7ff84006ad30 0x7ff84006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.444+0000 7ff8517fa700 1 -- 172.21.15.40:0/735251415 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff848089be0 con 0x7ff85415bac0 2023-06-22T10:54:03.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.444+0000 7ff8517fa700 1 --2- 172.21.15.40:0/735251415 >> [v2:172.21.15.40:6824/111110981,v1:172.21.15.40:6825/111110981] conn(0x7ff840074a00 0x7ff840076e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.445+0000 7ff8517fa700 1 -- 172.21.15.40:0/735251415 --> [v2:172.21.15.40:6824/111110981,v1:172.21.15.40:6825/111110981] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff840077500 con 0x7ff840074a00 2023-06-22T10:54:03.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.445+0000 7ff8517fa700 1 -- 172.21.15.40:0/735251415 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff848089f50 con 0x7ff85415bac0 2023-06-22T10:54:03.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.443+0000 7fabe6ffd700 1 --2- 172.21.15.40:0/3192179700 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fabd406adb0 0x7fabd406d260 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fabe814c800 tx=0x7fabdc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:03.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.441+0000 7f3ac19ff700 1 -- 172.21.15.40:0/1519599545 wait complete. 2023-06-22T10:54:03.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.444+0000 7f3ac19ff700 1 Processor -- start 2023-06-22T10:54:03.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.443+0000 7fcfd6bff700 1 -- 172.21.15.40:0/3555026290 shutdown_connections 2023-06-22T10:54:03.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.443+0000 7fcfd6bff700 1 --2- 172.21.15.40:0/3555026290 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fcfd00c1960 0x7fcfd00c1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.443+0000 7fcfd6bff700 1 --2- 172.21.15.40:0/3555026290 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfd00cf0d0 0x7fcfd006c4a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.443+0000 7fcfd6bff700 1 -- 172.21.15.40:0/3555026290 >> 172.21.15.40:0/3555026290 conn(0x7fcfd00b0ff0 msgr2=0x7fcfd00ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:03.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.443+0000 7fcfd6bff700 1 -- 172.21.15.40:0/3555026290 shutdown_connections 2023-06-22T10:54:03.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.441+0000 7f9ddd9ff700 1 -- 172.21.15.40:0/4275602454 wait complete. 2023-06-22T10:54:03.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.444+0000 7f9ddd9ff700 1 Processor -- start 2023-06-22T10:54:03.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.445+0000 7fabcffff700 1 -- 172.21.15.40:0/3192179700 <== osd.4 v2:172.21.15.45:6800/3625455711 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fabd4077580 con 0x7fabd4074a80 2023-06-22T10:54:03.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.445+0000 7fe252ffd700 1 --2- 172.21.15.40:0/3131657310 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe23c06adb0 0x7fe23c06d260 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe2540ce790 tx=0x7fe24c010000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:03.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.444+0000 7f3ac19ff700 1 -- start start 2023-06-22T10:54:03.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.446+0000 7f3ac19ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3abc0b1d90 0x7f3abc149dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.446+0000 7f3ac19ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f3abc0b4660 0x7f3abc150d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.446+0000 7f3ac19ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3abc160f00 0x7f3abc15d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.446+0000 7f3ac19ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3abc14a9a0 con 0x7f3abc160f00 2023-06-22T10:54:03.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.446+0000 7f3ac19ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3abc14a6c0 con 0x7f3abc0b1d90 2023-06-22T10:54:03.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.446+0000 7f3ac19ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3abc147860 con 0x7f3abc0b4660 2023-06-22T10:54:03.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.446+0000 7f3abb7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3abc160f00 0x7f3abc15d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:03.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.446+0000 7f3abb7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3abc160f00 0x7f3abc15d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50690/0 (socket says 172.21.15.40:50690) 2023-06-22T10:54:03.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.446+0000 7f3abb7fe700 1 -- 172.21.15.40:0/1160360421 learned_addr learned my addr 172.21.15.40:0/1160360421 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:03.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.447+0000 7f3abaffd700 1 --2- 172.21.15.40:0/1160360421 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3abc0b1d90 0x7f3abc149dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:03.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.447+0000 7f3ab27fc700 1 --2- 172.21.15.40:0/1160360421 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f3abc0b4660 0x7f3abc150d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:03.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.447+0000 7f3abb7fe700 1 -- 172.21.15.40:0/1160360421 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f3abc0b4660 msgr2=0x7f3abc150d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:03.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.447+0000 7f3abb7fe700 1 --2- 172.21.15.40:0/1160360421 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f3abc0b4660 0x7f3abc150d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.447+0000 7f3abb7fe700 1 -- 172.21.15.40:0/1160360421 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3abc0b1d90 msgr2=0x7f3abc149dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:03.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.447+0000 7f3abb7fe700 1 --2- 172.21.15.40:0/1160360421 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3abc0b1d90 0x7f3abc149dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.447+0000 7f3abb7fe700 1 -- 172.21.15.40:0/1160360421 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ab4009b30 con 0x7f3abc160f00 2023-06-22T10:54:03.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.448+0000 7f3abb7fe700 1 --2- 172.21.15.40:0/1160360421 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3abc160f00 0x7f3abc15d970 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3abc066950 tx=0x7f3ab4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:03.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.443+0000 7fcfd6bff700 1 -- 172.21.15.40:0/3555026290 wait complete. 2023-06-22T10:54:03.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.445+0000 7fcfd6bff700 1 Processor -- start 2023-06-22T10:54:03.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.446+0000 7fcfd6bff700 1 -- start start 2023-06-22T10:54:03.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.447+0000 7fcfd6bff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfd00c1960 0x7fcfd00c4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.447+0000 7fcfd6bff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfd00cf0d0 0x7fcfd00c4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.447+0000 7fcfd6bff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fcfd01609a0 0x7fcfd00aeee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.447+0000 7fcfd6bff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd01425a0 con 0x7fcfd00cf0d0 2023-06-22T10:54:03.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.447+0000 7fcfd6bff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd0156a80 con 0x7fcfd00c1960 2023-06-22T10:54:03.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.447+0000 7fcfd6bff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd01416b0 con 0x7fcfd01609a0 2023-06-22T10:54:03.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.448+0000 7fcfd519c700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fcfd01609a0 0x7fcfd00aeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:03.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.448+0000 7fcfd499b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfd00c1960 0x7fcfd00c4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:03.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.448+0000 7fcfd519c700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fcfd01609a0 0x7fcfd00aeee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3301/0 says I am v2:172.21.15.40:48822/0 (socket says 172.21.15.40:48822) 2023-06-22T10:54:03.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.448+0000 7fcfd519c700 1 -- 172.21.15.40:0/2576979875 learned_addr learned my addr 172.21.15.40:0/2576979875 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:03.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.444+0000 7f9ddd9ff700 1 -- start start 2023-06-22T10:54:03.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.445+0000 7f9ddd9ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9dd80cd930 0x7f9dd80b7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.445+0000 7f9ddd9ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9dd815c4a0 0x7f9dd80cbce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.446+0000 7f9ddd9ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9dd815c870 0x7f9dd80cc220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.446+0000 7f9ddd9ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd80cb850 con 0x7f9dd80cd930 2023-06-22T10:54:03.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.446+0000 7f9ddd9ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd80caf20 con 0x7f9dd815c870 2023-06-22T10:54:03.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.446+0000 7f9ddd9ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd80cb200 con 0x7f9dd815c4a0 2023-06-22T10:54:03.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.446+0000 7f9dd67fc700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9dd815c4a0 0x7f9dd80cbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:03.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.446+0000 7f9dd67fc700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9dd815c4a0 0x7f9dd80cbce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3301/0 says I am v2:172.21.15.40:48794/0 (socket says 172.21.15.40:48794) 2023-06-22T10:54:03.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.446+0000 7f9dd67fc700 1 -- 172.21.15.40:0/3742762444 learned_addr learned my addr 172.21.15.40:0/3742762444 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:03.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.447+0000 7f9dd6ffd700 1 --2- 172.21.15.40:0/3742762444 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9dd80cd930 0x7f9dd80b7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:03.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.447+0000 7f9dd67fc700 1 -- 172.21.15.40:0/3742762444 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9dd815c870 msgr2=0x7f9dd80cc220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:03.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.447+0000 7f9dd67fc700 1 --2- 172.21.15.40:0/3742762444 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9dd815c870 0x7f9dd80cc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.447+0000 7f9dd67fc700 1 -- 172.21.15.40:0/3742762444 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9dd80cd930 msgr2=0x7f9dd80b7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:03.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.447+0000 7f9dd67fc700 1 --2- 172.21.15.40:0/3742762444 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9dd80cd930 0x7f9dd80b7f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.447+0000 7f9dd67fc700 1 -- 172.21.15.40:0/3742762444 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc8009550 con 0x7f9dd815c4a0 2023-06-22T10:54:03.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.447+0000 7f9dd67fc700 1 --2- 172.21.15.40:0/3742762444 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9dd815c4a0 0x7f9dd80cbce0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc00e870 tx=0x7f9dcc00ec30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:03.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.448+0000 7fe253fff700 1 --2- 172.21.15.40:0/3131657310 >> [v2:172.21.15.40:6808/2400162888,v1:172.21.15.40:6809/2400162888] conn(0x7fe23c074a80 0x7fe23c076eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:03.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.448+0000 7fcfd519c700 1 -- 172.21.15.40:0/2576979875 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfd00c1960 msgr2=0x7fcfd00c4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:03.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.448+0000 7fcfd519c700 1 --2- 172.21.15.40:0/2576979875 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfd00c1960 0x7fcfd00c4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.448+0000 7fcfd519c700 1 -- 172.21.15.40:0/2576979875 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfd00cf0d0 msgr2=0x7fcfd00c4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:03.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.448+0000 7fcfd519c700 1 --2- 172.21.15.40:0/2576979875 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfd00cf0d0 0x7fcfd00c4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.448+0000 7fcfd519c700 1 -- 172.21.15.40:0/2576979875 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc4009550 con 0x7fcfd01609a0 2023-06-22T10:54:03.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.449+0000 7f3ab8ff9700 1 -- 172.21.15.40:0/1160360421 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab40099b0 con 0x7f3abc160f00 2023-06-22T10:54:03.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.449+0000 7f3ab8ff9700 1 -- 172.21.15.40:0/1160360421 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ab4004250 con 0x7f3abc160f00 2023-06-22T10:54:03.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.449+0000 7f3ab8ff9700 1 -- 172.21.15.40:0/1160360421 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab40045e0 con 0x7f3abc160f00 2023-06-22T10:54:03.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.449+0000 7fcfd519c700 1 --2- 172.21.15.40:0/2576979875 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fcfd01609a0 0x7fcfd00aeee0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fcfc800b970 tx=0x7fcfc800bd30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:03.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.449+0000 7f3ac19ff700 1 -- 172.21.15.40:0/1160360421 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3abc147b40 con 0x7f3abc160f00 2023-06-22T10:54:03.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.449+0000 7f3ac19ff700 1 -- 172.21.15.40:0/1160360421 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3abc14a300 con 0x7f3abc160f00 2023-06-22T10:54:03.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.450+0000 7f3ac19ff700 1 -- 172.21.15.40:0/1160360421 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3abc06b750 con 0x7f3abc160f00 2023-06-22T10:54:03.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.449+0000 7fcfcd7fa700 1 -- 172.21.15.40:0/2576979875 <== mon.2 v2:172.21.15.45:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc800c9b0 con 0x7fcfd01609a0 2023-06-22T10:54:03.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.449+0000 7fcfcd7fa700 1 -- 172.21.15.40:0/2576979875 <== mon.2 v2:172.21.15.45:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfc800cb30 con 0x7fcfd01609a0 2023-06-22T10:54:03.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.449+0000 7fcfcd7fa700 1 -- 172.21.15.40:0/2576979875 <== mon.2 v2:172.21.15.45:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc8014440 con 0x7fcfd01609a0 2023-06-22T10:54:03.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.450+0000 7fcfd6bff700 1 -- 172.21.15.40:0/2576979875 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfd0141990 con 0x7fcfd01609a0 2023-06-22T10:54:03.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.450+0000 7fcfd6bff700 1 -- 172.21.15.40:0/2576979875 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfd0141f50 con 0x7fcfd01609a0 2023-06-22T10:54:03.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.450+0000 7fcfd6bff700 1 -- 172.21.15.40:0/2576979875 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcfd00cc650 con 0x7fcfd01609a0 2023-06-22T10:54:03.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.451+0000 7fe253fff700 1 --2- 172.21.15.40:0/3131657310 >> [v2:172.21.15.40:6808/2400162888,v1:172.21.15.40:6809/2400162888] conn(0x7fe23c074a80 0x7fe23c076eb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:03.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.451+0000 7ff85979c700 1 --2- 172.21.15.40:0/735251415 >> [v2:172.21.15.40:6824/111110981,v1:172.21.15.40:6825/111110981] conn(0x7ff840074a00 0x7ff840076e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:03.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.452+0000 7ff85979c700 1 --2- 172.21.15.40:0/735251415 >> [v2:172.21.15.40:6824/111110981,v1:172.21.15.40:6825/111110981] conn(0x7ff840074a00 0x7ff840076e30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:03.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.452+0000 7ff858f9b700 1 --2- 172.21.15.40:0/735251415 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7ff84006ad30 0x7ff84006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:03.505 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.452+0000 7fe24bfff700 1 -- 172.21.15.40:0/3131657310 <== osd.0 v2:172.21.15.40:6808/2400162888 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fe23c077580 con 0x7fe23c074a80 2023-06-22T10:54:03.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.452+0000 7f9dbffff700 1 -- 172.21.15.40:0/3742762444 <== mon.2 v2:172.21.15.45:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dcc00ee70 con 0x7f9dd815c4a0 2023-06-22T10:54:03.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.452+0000 7f9dbffff700 1 -- 172.21.15.40:0/3742762444 <== mon.2 v2:172.21.15.45:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dcc00c850 con 0x7f9dd815c4a0 2023-06-22T10:54:03.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.452+0000 7f9dbffff700 1 -- 172.21.15.40:0/3742762444 <== mon.2 v2:172.21.15.45:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dcc00cbc0 con 0x7f9dd815c4a0 2023-06-22T10:54:03.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.454+0000 7f9ddd9ff700 1 -- 172.21.15.40:0/3742762444 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dd80cb4e0 con 0x7f9dd815c4a0 2023-06-22T10:54:03.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.454+0000 7f9ddd9ff700 1 -- 172.21.15.40:0/3742762444 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dd80b8770 con 0x7f9dd815c4a0 2023-06-22T10:54:03.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.453+0000 7f3ab8ff9700 1 -- 172.21.15.40:0/1160360421 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3ab4004740 con 0x7f3abc160f00 2023-06-22T10:54:03.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.454+0000 7f3ab8ff9700 1 --2- 172.21.15.40:0/1160360421 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f3aa806af10 0x7f3aa806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.454+0000 7f3ab8ff9700 1 -- 172.21.15.40:0/1160360421 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3ab408b1d0 con 0x7f3abc160f00 2023-06-22T10:54:03.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.455+0000 7f3ab8ff9700 1 --2- 172.21.15.40:0/1160360421 >> [v2:172.21.15.45:6816/3354411217,v1:172.21.15.45:6817/3354411217] conn(0x7f3aa8074be0 0x7f3aa8077010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.455+0000 7f3ab8ff9700 1 -- 172.21.15.40:0/1160360421 --> [v2:172.21.15.45:6816/3354411217,v1:172.21.15.45:6817/3354411217] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3aa80776e0 con 0x7f3aa8074be0 2023-06-22T10:54:03.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.455+0000 7f3ab8ff9700 1 -- 172.21.15.40:0/1160360421 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ab408b580 con 0x7f3abc160f00 2023-06-22T10:54:03.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.454+0000 7ff858f9b700 1 --2- 172.21.15.40:0/735251415 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7ff84006ad30 0x7ff84006d1e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff844006fd0 tx=0x7ff844009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:03.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.455+0000 7f3abaffd700 1 --2- 172.21.15.40:0/1160360421 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f3aa806af10 0x7f3aa806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:03.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.455+0000 7f3ab27fc700 1 --2- 172.21.15.40:0/1160360421 >> [v2:172.21.15.45:6816/3354411217,v1:172.21.15.45:6817/3354411217] conn(0x7f3aa8074be0 0x7f3aa8077010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:03.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.455+0000 7fcfcd7fa700 1 -- 172.21.15.40:0/2576979875 <== mon.2 v2:172.21.15.45:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcfc801d3b0 con 0x7fcfd01609a0 2023-06-22T10:54:03.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.455+0000 7ff8517fa700 1 -- 172.21.15.40:0/735251415 <== osd.3 v2:172.21.15.40:6824/111110981 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7ff840077500 con 0x7ff840074a00 2023-06-22T10:54:03.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.456+0000 7f9ddd9ff700 1 -- 172.21.15.40:0/3742762444 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9dd80d1460 con 0x7f9dd815c4a0 2023-06-22T10:54:03.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.457+0000 7f3abaffd700 1 --2- 172.21.15.40:0/1160360421 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f3aa806af10 0x7f3aa806d3c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3aac000f60 tx=0x7f3aac009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:03.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.457+0000 7fcfcd7fa700 1 --2- 172.21.15.40:0/2576979875 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fcfbc06ace0 0x7fcfbc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.457+0000 7fcfcd7fa700 1 -- 172.21.15.40:0/2576979875 <== mon.2 v2:172.21.15.45:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcfc8006e40 con 0x7fcfd01609a0 2023-06-22T10:54:03.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.458+0000 7f3ab27fc700 1 --2- 172.21.15.40:0/1160360421 >> [v2:172.21.15.45:6816/3354411217,v1:172.21.15.45:6817/3354411217] conn(0x7f3aa8074be0 0x7f3aa8077010 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:03.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.458+0000 7fcfcd7fa700 1 --2- 172.21.15.40:0/2576979875 >> [v2:172.21.15.45:6808/320111074,v1:172.21.15.45:6809/320111074] conn(0x7fcfbc0749b0 0x7fcfbc076de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.458+0000 7fcfcd7fa700 1 -- 172.21.15.40:0/2576979875 --> [v2:172.21.15.45:6808/320111074,v1:172.21.15.45:6809/320111074] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcfbc0774b0 con 0x7fcfbc0749b0 2023-06-22T10:54:03.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.458+0000 7fcfcd7fa700 1 -- 172.21.15.40:0/2576979875 <== mon.2 v2:172.21.15.45:3301/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcfc8089e90 con 0x7fcfd01609a0 2023-06-22T10:54:03.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.458+0000 7fcfd499b700 1 --2- 172.21.15.40:0/2576979875 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fcfbc06ace0 0x7fcfbc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:03.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.458+0000 7f9dbffff700 1 -- 172.21.15.40:0/3742762444 <== mon.2 v2:172.21.15.45:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9dcc00cd20 con 0x7f9dd815c4a0 2023-06-22T10:54:03.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.460+0000 7fcfd499b700 1 --2- 172.21.15.40:0/2576979875 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fcfbc06ace0 0x7fcfbc06d190 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcfc0009870 tx=0x7fcfc0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:03.513 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.460+0000 7f3ab8ff9700 1 -- 172.21.15.40:0/1160360421 <== osd.5 v2:172.21.15.45:6816/3354411217 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f3aa80776e0 con 0x7f3aa8074be0 2023-06-22T10:54:03.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.460+0000 7f9dbffff700 1 --2- 172.21.15.40:0/3742762444 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f9dc406ad30 0x7f9dc406d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.460+0000 7f9dbffff700 1 -- 172.21.15.40:0/3742762444 <== mon.2 v2:172.21.15.45:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9dcc089690 con 0x7f9dd815c4a0 2023-06-22T10:54:03.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.460+0000 7f9dbffff700 1 --2- 172.21.15.40:0/3742762444 >> [v2:172.21.15.45:6824/643617680,v1:172.21.15.45:6825/643617680] conn(0x7f9dc4074a00 0x7f9dc4076e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.461+0000 7f9dbffff700 1 -- 172.21.15.40:0/3742762444 --> [v2:172.21.15.45:6824/643617680,v1:172.21.15.45:6825/643617680] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9dc4077500 con 0x7f9dc4074a00 2023-06-22T10:54:03.514 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.461+0000 7f9dbffff700 1 -- 172.21.15.40:0/3742762444 <== mon.2 v2:172.21.15.45:3301/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9dcc08bc70 con 0x7f9dd815c4a0 2023-06-22T10:54:03.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.461+0000 7f9dd6ffd700 1 --2- 172.21.15.40:0/3742762444 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f9dc406ad30 0x7f9dc406d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:03.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.461+0000 7f9dd77fe700 1 --2- 172.21.15.40:0/3742762444 >> [v2:172.21.15.45:6824/643617680,v1:172.21.15.45:6825/643617680] conn(0x7f9dc4074a00 0x7f9dc4076e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:03.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.463+0000 7f9dd77fe700 1 --2- 172.21.15.40:0/3742762444 >> [v2:172.21.15.45:6824/643617680,v1:172.21.15.45:6825/643617680] conn(0x7f9dc4074a00 0x7f9dc4076e30 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:03.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.463+0000 7f9dd6ffd700 1 --2- 172.21.15.40:0/3742762444 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f9dc406ad30 0x7f9dc406d1e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9dd000e160 tx=0x7f9dd0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:03.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.464+0000 7f9dbffff700 1 -- 172.21.15.40:0/3742762444 <== osd.7 v2:172.21.15.45:6824/643617680 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f9dc4077500 con 0x7f9dc4074a00 2023-06-22T10:54:03.515 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.470+0000 7fcfcffff700 1 --2- 172.21.15.40:0/2576979875 >> [v2:172.21.15.45:6808/320111074,v1:172.21.15.45:6809/320111074] conn(0x7fcfbc0749b0 0x7fcfbc076de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:03.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.468+0000 7fabee1ff700 1 -- 172.21.15.40:0/3192179700 --> [v2:172.21.15.45:6800/3625455711,v1:172.21.15.45:6801/3625455711] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fabe80d1460 con 0x7fabd4074a80 2023-06-22T10:54:03.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.472+0000 7fabcffff700 1 -- 172.21.15.40:0/3192179700 <== osd.4 v2:172.21.15.45:6800/3625455711 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fabe0003a20 con 0x7fabd4074a80 2023-06-22T10:54:03.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.473+0000 7fcfcffff700 1 --2- 172.21.15.40:0/2576979875 >> [v2:172.21.15.45:6808/320111074,v1:172.21.15.45:6809/320111074] conn(0x7fcfbc0749b0 0x7fcfbc076de0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:03.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.473+0000 7f2c9dfff700 1 -- 172.21.15.40:0/135382089 --> [v2:172.21.15.40:6816/2681404929,v1:172.21.15.40:6817/2681404929] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2c7c002d40 con 0x7f2c78074a80 2023-06-22T10:54:03.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.473+0000 7fabee1ff700 1 -- 172.21.15.40:0/3192179700 >> [v2:172.21.15.45:6800/3625455711,v1:172.21.15.45:6801/3625455711] conn(0x7fabd4074a80 msgr2=0x7fabd4076eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:03.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.473+0000 7fabee1ff700 1 --2- 172.21.15.40:0/3192179700 >> [v2:172.21.15.45:6800/3625455711,v1:172.21.15.45:6801/3625455711] conn(0x7fabd4074a80 0x7fabd4076eb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.473+0000 7fabee1ff700 1 -- 172.21.15.40:0/3192179700 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fabd406adb0 msgr2=0x7fabd406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:03.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.473+0000 7fabee1ff700 1 --2- 172.21.15.40:0/3192179700 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fabd406adb0 0x7fabd406d260 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fabe814c800 tx=0x7fabdc008040 comp rx=0 tx=0).stop 2023-06-22T10:54:03.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.473+0000 7fabee1ff700 1 -- 172.21.15.40:0/3192179700 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fabe80cd930 msgr2=0x7fabe8158290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:03.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.473+0000 7fabee1ff700 1 --2- 172.21.15.40:0/3192179700 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fabe80cd930 0x7fabe8158290 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fabd800e910 tx=0x7fabd800ecd0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.473+0000 7fabe7fff700 1 -- 172.21.15.40:0/3192179700 reap_dead start 2023-06-22T10:54:03.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.473+0000 7fabee1ff700 1 -- 172.21.15.40:0/3192179700 shutdown_connections 2023-06-22T10:54:03.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.473+0000 7fabee1ff700 1 -- 172.21.15.40:0/3192179700 >> 172.21.15.40:0/3192179700 conn(0x7fabe80cf660 msgr2=0x7fabe815d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:03.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.474+0000 7f2c8ffff700 1 -- 172.21.15.40:0/135382089 <== osd.2 v2:172.21.15.40:6816/2681404929 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2c7c002d40 con 0x7f2c78074a80 2023-06-22T10:54:03.519 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.474+0000 7fabee1ff700 1 -- 172.21.15.40:0/3192179700 shutdown_connections 2023-06-22T10:54:03.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.474+0000 7fabee1ff700 1 -- 172.21.15.40:0/3192179700 wait complete. 2023-06-22T10:54:03.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.475+0000 7f2c9dfff700 1 -- 172.21.15.40:0/135382089 >> [v2:172.21.15.40:6816/2681404929,v1:172.21.15.40:6817/2681404929] conn(0x7f2c78074a80 msgr2=0x7f2c78076eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:03.520 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.476+0000 7f2c9dfff700 1 --2- 172.21.15.40:0/135382089 >> [v2:172.21.15.40:6816/2681404929,v1:172.21.15.40:6817/2681404929] conn(0x7f2c78074a80 0x7f2c78076eb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.475+0000 7fcfcd7fa700 1 -- 172.21.15.40:0/2576979875 <== osd.6 v2:172.21.15.45:6808/320111074 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fcfbc0774b0 con 0x7fcfbc0749b0 2023-06-22T10:54:03.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.476+0000 7f2c9dfff700 1 -- 172.21.15.40:0/135382089 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f2c7806adb0 msgr2=0x7f2c7806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:03.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.476+0000 7f2c9dfff700 1 --2- 172.21.15.40:0/135382089 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f2c7806adb0 0x7f2c7806d260 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2c980c1e40 tx=0x7f2c880042c0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.476+0000 7f2c9dfff700 1 -- 172.21.15.40:0/135382089 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c98069f30 msgr2=0x7f2c980c43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:03.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.476+0000 7f2c9dfff700 1 --2- 172.21.15.40:0/135382089 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c98069f30 0x7f2c980c43e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2c98070130 tx=0x7f2c90004750 comp rx=0 tx=0).stop 2023-06-22T10:54:03.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.476+0000 7f2c97fff700 1 -- 172.21.15.40:0/135382089 reap_dead start 2023-06-22T10:54:03.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.476+0000 7f2c9dfff700 1 -- 172.21.15.40:0/135382089 shutdown_connections 2023-06-22T10:54:03.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.476+0000 7f2c9dfff700 1 -- 172.21.15.40:0/135382089 >> 172.21.15.40:0/135382089 conn(0x7f2c980b0fe0 msgr2=0x7f2c980ce790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:03.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.478+0000 7f083ddff700 1 -- 172.21.15.40:0/2597556397 --> [v2:172.21.15.40:6800/230885800,v1:172.21.15.40:6801/230885800] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0838066ad0 con 0x7f0818074a80 2023-06-22T10:54:03.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.478+0000 7f2c9dfff700 1 -- 172.21.15.40:0/135382089 shutdown_connections 2023-06-22T10:54:03.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.478+0000 7f2c9dfff700 1 -- 172.21.15.40:0/135382089 wait complete. 2023-06-22T10:54:03.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.480+0000 7f0834ff9700 1 -- 172.21.15.40:0/2597556397 <== osd.1 v2:172.21.15.40:6800/230885800 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0838066ad0 con 0x7f0818074a80 2023-06-22T10:54:03.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.481+0000 7f083ddff700 1 -- 172.21.15.40:0/2597556397 >> [v2:172.21.15.40:6800/230885800,v1:172.21.15.40:6801/230885800] conn(0x7f0818074a80 msgr2=0x7f0818076eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:03.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.481+0000 7f083ddff700 1 --2- 172.21.15.40:0/2597556397 >> [v2:172.21.15.40:6800/230885800,v1:172.21.15.40:6801/230885800] conn(0x7f0818074a80 0x7f0818076eb0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.484+0000 7f083ddff700 1 -- 172.21.15.40:0/2597556397 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f081806adb0 msgr2=0x7f081806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:03.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.484+0000 7f083ddff700 1 --2- 172.21.15.40:0/2597556397 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f081806adb0 0x7f081806d260 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f08380703f0 tx=0x7f0820009000 comp rx=0 tx=0).stop 2023-06-22T10:54:03.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.484+0000 7f083ddff700 1 -- 172.21.15.40:0/2597556397 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0838069f30 msgr2=0x7f0838163310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:03.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.484+0000 7f083ddff700 1 --2- 172.21.15.40:0/2597556397 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0838069f30 0x7f0838163310 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f082800c3e0 tx=0x7f082800c6f0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.484+0000 7f0837fff700 1 -- 172.21.15.40:0/2597556397 reap_dead start 2023-06-22T10:54:03.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.484+0000 7f083ddff700 1 -- 172.21.15.40:0/2597556397 shutdown_connections 2023-06-22T10:54:03.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.484+0000 7f083ddff700 1 -- 172.21.15.40:0/2597556397 >> 172.21.15.40:0/2597556397 conn(0x7f08380b0fe0 msgr2=0x7f08380afaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:03.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.485+0000 7f083ddff700 1 -- 172.21.15.40:0/2597556397 shutdown_connections 2023-06-22T10:54:03.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.486+0000 7f083ddff700 1 -- 172.21.15.40:0/2597556397 wait complete. 2023-06-22T10:54:03.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.488+0000 7ff85b1ff700 1 -- 172.21.15.40:0/735251415 --> [v2:172.21.15.40:6824/111110981,v1:172.21.15.40:6825/111110981] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff8540cce50 con 0x7ff840074a00 2023-06-22T10:54:03.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.490+0000 7ff8517fa700 1 -- 172.21.15.40:0/735251415 <== osd.3 v2:172.21.15.40:6824/111110981 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff84c0071f0 con 0x7ff840074a00 2023-06-22T10:54:03.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.491+0000 7ff85b1ff700 1 -- 172.21.15.40:0/735251415 >> [v2:172.21.15.40:6824/111110981,v1:172.21.15.40:6825/111110981] conn(0x7ff840074a00 msgr2=0x7ff840076e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:03.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.491+0000 7ff85b1ff700 1 --2- 172.21.15.40:0/735251415 >> [v2:172.21.15.40:6824/111110981,v1:172.21.15.40:6825/111110981] conn(0x7ff840074a00 0x7ff840076e30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.492+0000 7ff85b1ff700 1 -- 172.21.15.40:0/735251415 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7ff84006ad30 msgr2=0x7ff84006d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:03.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.492+0000 7ff85b1ff700 1 --2- 172.21.15.40:0/735251415 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7ff84006ad30 0x7ff84006d1e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff844006fd0 tx=0x7ff844009190 comp rx=0 tx=0).stop 2023-06-22T10:54:03.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.492+0000 7ff85b1ff700 1 -- 172.21.15.40:0/735251415 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff85415bac0 msgr2=0x7ff8540b2070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:03.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.492+0000 7ff85b1ff700 1 --2- 172.21.15.40:0/735251415 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff85415bac0 0x7ff8540b2070 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff84800c7f0 tx=0x7ff84800cb00 comp rx=0 tx=0).stop 2023-06-22T10:54:03.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.492+0000 7ff85979c700 1 -- 172.21.15.40:0/735251415 reap_dead start 2023-06-22T10:54:03.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.492+0000 7ff85b1ff700 1 -- 172.21.15.40:0/735251415 shutdown_connections 2023-06-22T10:54:03.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.492+0000 7ff85b1ff700 1 -- 172.21.15.40:0/735251415 >> 172.21.15.40:0/735251415 conn(0x7ff8540b0fe0 msgr2=0x7ff8540ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:03.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.494+0000 7fe259dff700 1 -- 172.21.15.40:0/3131657310 --> [v2:172.21.15.40:6808/2400162888,v1:172.21.15.40:6809/2400162888] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe254071410 con 0x7fe23c074a80 2023-06-22T10:54:03.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.494+0000 7f3ac19ff700 1 -- 172.21.15.40:0/1160360421 --> [v2:172.21.15.45:6816/3354411217,v1:172.21.15.45:6817/3354411217] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3abc06b470 con 0x7f3aa8074be0 2023-06-22T10:54:03.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.494+0000 7ff85b1ff700 1 -- 172.21.15.40:0/735251415 shutdown_connections 2023-06-22T10:54:03.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.494+0000 7ff85b1ff700 1 -- 172.21.15.40:0/735251415 wait complete. 2023-06-22T10:54:03.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.495+0000 7fe24bfff700 1 -- 172.21.15.40:0/3131657310 <== osd.0 v2:172.21.15.40:6808/2400162888 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe2400012c0 con 0x7fe23c074a80 2023-06-22T10:54:03.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.496+0000 7fe259dff700 1 -- 172.21.15.40:0/3131657310 >> [v2:172.21.15.40:6808/2400162888,v1:172.21.15.40:6809/2400162888] conn(0x7fe23c074a80 msgr2=0x7fe23c076eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:03.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.496+0000 7fe259dff700 1 --2- 172.21.15.40:0/3131657310 >> [v2:172.21.15.40:6808/2400162888,v1:172.21.15.40:6809/2400162888] conn(0x7fe23c074a80 0x7fe23c076eb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.496+0000 7fe259dff700 1 -- 172.21.15.40:0/3131657310 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe23c06adb0 msgr2=0x7fe23c06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:03.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.496+0000 7fe259dff700 1 --2- 172.21.15.40:0/3131657310 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe23c06adb0 0x7fe23c06d260 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe2540ce790 tx=0x7fe24c010000 comp rx=0 tx=0).stop 2023-06-22T10:54:03.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.496+0000 7fe259dff700 1 -- 172.21.15.40:0/3131657310 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe2540c1960 msgr2=0x7fe2540b17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:03.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.496+0000 7fe259dff700 1 --2- 172.21.15.40:0/3131657310 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe2540c1960 0x7fe2540b17b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe24400b470 tx=0x7fe24400b830 comp rx=0 tx=0).stop 2023-06-22T10:54:03.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.497+0000 7fe253fff700 1 -- 172.21.15.40:0/3131657310 reap_dead start 2023-06-22T10:54:03.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.497+0000 7fe259dff700 1 -- 172.21.15.40:0/3131657310 shutdown_connections 2023-06-22T10:54:03.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.497+0000 7fe259dff700 1 -- 172.21.15.40:0/3131657310 >> 172.21.15.40:0/3131657310 conn(0x7fe2540b0ff0 msgr2=0x7fe2540c8e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:03.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.497+0000 7fe259dff700 1 -- 172.21.15.40:0/3131657310 shutdown_connections 2023-06-22T10:54:03.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.498+0000 7fe259dff700 1 -- 172.21.15.40:0/3131657310 wait complete. 2023-06-22T10:54:03.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.498+0000 7f3ab8ff9700 1 -- 172.21.15.40:0/1160360421 <== osd.5 v2:172.21.15.45:6816/3354411217 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3aa4009660 con 0x7f3aa8074be0 2023-06-22T10:54:03.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.500+0000 7f3ac19ff700 1 -- 172.21.15.40:0/1160360421 >> [v2:172.21.15.45:6816/3354411217,v1:172.21.15.45:6817/3354411217] conn(0x7f3aa8074be0 msgr2=0x7f3aa8077010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:03.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.500+0000 7f3ac19ff700 1 --2- 172.21.15.40:0/1160360421 >> [v2:172.21.15.45:6816/3354411217,v1:172.21.15.45:6817/3354411217] conn(0x7f3aa8074be0 0x7f3aa8077010 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.533 INFO:teuthology.orchestra.run.smithi040.stdout:55834574859 2023-06-22T10:54:03.534 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-06-22T10:54:03.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.501+0000 7f9ddd9ff700 1 -- 172.21.15.40:0/3742762444 --> [v2:172.21.15.45:6824/643617680,v1:172.21.15.45:6825/643617680] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9dd80cb9c0 con 0x7f9dc4074a00 2023-06-22T10:54:03.534 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.502+0000 7f9dbffff700 1 -- 172.21.15.40:0/3742762444 <== osd.7 v2:172.21.15.45:6824/643617680 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9dd80cb9c0 con 0x7f9dc4074a00 2023-06-22T10:54:03.535 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.503+0000 7f9ddd9ff700 1 -- 172.21.15.40:0/3742762444 >> [v2:172.21.15.45:6824/643617680,v1:172.21.15.45:6825/643617680] conn(0x7f9dc4074a00 msgr2=0x7f9dc4076e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:03.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.503+0000 7f9ddd9ff700 1 --2- 172.21.15.40:0/3742762444 >> [v2:172.21.15.45:6824/643617680,v1:172.21.15.45:6825/643617680] conn(0x7f9dc4074a00 0x7f9dc4076e30 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.503+0000 7f9ddd9ff700 1 -- 172.21.15.40:0/3742762444 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f9dc406ad30 msgr2=0x7f9dc406d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:03.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.503+0000 7f9ddd9ff700 1 --2- 172.21.15.40:0/3742762444 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f9dc406ad30 0x7f9dc406d1e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9dd000e160 tx=0x7f9dd0009040 comp rx=0 tx=0).stop 2023-06-22T10:54:03.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.503+0000 7f9ddd9ff700 1 -- 172.21.15.40:0/3742762444 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9dd815c4a0 msgr2=0x7f9dd80cbce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:03.536 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.503+0000 7f9ddd9ff700 1 --2- 172.21.15.40:0/3742762444 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9dd815c4a0 0x7f9dd80cbce0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc00e870 tx=0x7f9dcc00ec30 comp rx=0 tx=0).stop 2023-06-22T10:54:03.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.503+0000 7f9dd77fe700 1 -- 172.21.15.40:0/3742762444 reap_dead start 2023-06-22T10:54:03.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.504+0000 7f9ddd9ff700 1 -- 172.21.15.40:0/3742762444 shutdown_connections 2023-06-22T10:54:03.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.504+0000 7f9ddd9ff700 1 -- 172.21.15.40:0/3742762444 >> 172.21.15.40:0/3742762444 conn(0x7f9dd80cf660 msgr2=0x7f9dd8145b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:03.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.504+0000 7f9ddd9ff700 1 -- 172.21.15.40:0/3742762444 shutdown_connections 2023-06-22T10:54:03.537 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.504+0000 7f9ddd9ff700 1 -- 172.21.15.40:0/3742762444 wait complete. 2023-06-22T10:54:03.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.504+0000 7f3ac19ff700 1 -- 172.21.15.40:0/1160360421 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f3aa806af10 msgr2=0x7f3aa806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:03.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.504+0000 7f3ac19ff700 1 --2- 172.21.15.40:0/1160360421 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f3aa806af10 0x7f3aa806d3c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3aac000f60 tx=0x7f3aac009040 comp rx=0 tx=0).stop 2023-06-22T10:54:03.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.504+0000 7f3ac19ff700 1 -- 172.21.15.40:0/1160360421 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3abc160f00 msgr2=0x7f3abc15d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:03.538 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.504+0000 7f3ac19ff700 1 --2- 172.21.15.40:0/1160360421 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3abc160f00 0x7f3abc15d970 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3abc066950 tx=0x7f3ab4004ad0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.504+0000 7f3abb7fe700 1 -- 172.21.15.40:0/1160360421 reap_dead start 2023-06-22T10:54:03.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.505+0000 7f3ac19ff700 1 -- 172.21.15.40:0/1160360421 shutdown_connections 2023-06-22T10:54:03.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.505+0000 7f3ac19ff700 1 -- 172.21.15.40:0/1160360421 >> 172.21.15.40:0/1160360421 conn(0x7f3abc0cf660 msgr2=0x7f3abc1606d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:03.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.509+0000 7f3ac19ff700 1 -- 172.21.15.40:0/1160360421 shutdown_connections 2023-06-22T10:54:03.539 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.509+0000 7f3ac19ff700 1 -- 172.21.15.40:0/1160360421 wait complete. 2023-06-22T10:54:03.540 INFO:teuthology.orchestra.run.smithi040.stdout:60129542156 2023-06-22T10:54:03.540 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-06-22T10:54:03.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.513+0000 7fcfd6bff700 1 -- 172.21.15.40:0/2576979875 --> [v2:172.21.15.45:6808/320111074,v1:172.21.15.45:6809/320111074] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcfd0071410 con 0x7fcfbc0749b0 2023-06-22T10:54:03.541 INFO:teuthology.orchestra.run.smithi040.stdout:55834574860 2023-06-22T10:54:03.542 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-06-22T10:54:03.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.517+0000 7fcfcd7fa700 1 -- 172.21.15.40:0/2576979875 <== osd.6 v2:172.21.15.45:6808/320111074 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcfc4004030 con 0x7fcfbc0749b0 2023-06-22T10:54:03.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.517+0000 7fcfd6bff700 1 -- 172.21.15.40:0/2576979875 >> [v2:172.21.15.45:6808/320111074,v1:172.21.15.45:6809/320111074] conn(0x7fcfbc0749b0 msgr2=0x7fcfbc076de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:03.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.517+0000 7fcfd6bff700 1 --2- 172.21.15.40:0/2576979875 >> [v2:172.21.15.45:6808/320111074,v1:172.21.15.45:6809/320111074] conn(0x7fcfbc0749b0 0x7fcfbc076de0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.517+0000 7fcfd6bff700 1 -- 172.21.15.40:0/2576979875 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fcfbc06ace0 msgr2=0x7fcfbc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:03.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.517+0000 7fcfd6bff700 1 --2- 172.21.15.40:0/2576979875 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fcfbc06ace0 0x7fcfbc06d190 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcfc0009870 tx=0x7fcfc0008040 comp rx=0 tx=0).stop 2023-06-22T10:54:03.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.517+0000 7fcfd6bff700 1 -- 172.21.15.40:0/2576979875 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fcfd01609a0 msgr2=0x7fcfd00aeee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:03.544 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.517+0000 7fcfd6bff700 1 --2- 172.21.15.40:0/2576979875 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fcfd01609a0 0x7fcfd00aeee0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fcfc800b970 tx=0x7fcfc800bd30 comp rx=0 tx=0).stop 2023-06-22T10:54:03.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.518+0000 7fcfd519c700 1 -- 172.21.15.40:0/2576979875 reap_dead start 2023-06-22T10:54:03.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.518+0000 7fcfd6bff700 1 -- 172.21.15.40:0/2576979875 shutdown_connections 2023-06-22T10:54:03.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.518+0000 7fcfd6bff700 1 -- 172.21.15.40:0/2576979875 >> 172.21.15.40:0/2576979875 conn(0x7fcfd00b0ff0 msgr2=0x7fcfd00ae670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:03.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.518+0000 7fcfd6bff700 1 -- 172.21.15.40:0/2576979875 shutdown_connections 2023-06-22T10:54:03.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.518+0000 7fcfd6bff700 1 -- 172.21.15.40:0/2576979875 wait complete. 2023-06-22T10:54:03.547 INFO:teuthology.orchestra.run.smithi040.stdout:55834574859 2023-06-22T10:54:03.548 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-06-22T10:54:03.549 INFO:teuthology.orchestra.run.smithi040.stdout:60129542158 2023-06-22T10:54:03.550 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-06-22T10:54:03.551 INFO:teuthology.orchestra.run.smithi040.stdout:64424509452 2023-06-22T10:54:03.551 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-06-22T10:54:03.552 INFO:teuthology.orchestra.run.smithi040.stdout:55834574860 2023-06-22T10:54:03.553 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-06-22T10:54:03.554 INFO:teuthology.orchestra.run.smithi040.stdout:60129542157 2023-06-22T10:54:03.555 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-06-22T10:54:03.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.953+0000 7f65971ff700 1 Processor -- start 2023-06-22T10:54:03.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.953+0000 7f65971ff700 1 -- start start 2023-06-22T10:54:03.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.955+0000 7f65971ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f659015ccd0 0x7f65900ad730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.955+0000 7f65971ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f65900adc70 0x7f659006c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.955+0000 7f65971ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65900cd130 con 0x7f659015bac0 2023-06-22T10:54:03.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.955+0000 7f65971ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65900ccc60 con 0x7f659015ccd0 2023-06-22T10:54:03.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.955+0000 7f65971ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65900ae0f0 con 0x7f65900adc70 2023-06-22T10:54:03.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.956+0000 7f659579c700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f65900adc70 0x7f659006c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:03.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.956+0000 7f659579c700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f65900adc70 0x7f659006c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3301/0 says I am v2:172.21.15.40:48824/0 (socket says 172.21.15.40:48824) 2023-06-22T10:54:03.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.956+0000 7f659579c700 1 -- 172.21.15.40:0/3659780121 learned_addr learned my addr 172.21.15.40:0/3659780121 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:03.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.957+0000 7f658ffff700 1 --2- 172.21.15.40:0/3659780121 >> v2:172.21.15.40:3300/0 conn(0x7f659015ccd0 0x7f65900ad730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:03.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.958+0000 7f1f5cbff700 1 Processor -- start 2023-06-22T10:54:03.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.958+0000 7f1f5cbff700 1 -- start start 2023-06-22T10:54:03.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.959+0000 7f658ffff700 1 -- 172.21.15.40:0/3659780121 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f65900adc70 msgr2=0x7f659006c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:03.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.959+0000 7f658ffff700 1 --2- 172.21.15.40:0/3659780121 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f65900adc70 0x7f659006c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.959+0000 7f658ffff700 1 -- 172.21.15.40:0/3659780121 >> v1:172.21.15.40:6789/0 conn(0x7f659015bac0 legacy=0x7f65900cc550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:03.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.959+0000 7f658ffff700 1 -- 172.21.15.40:0/3659780121 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f659015be90 con 0x7f659015ccd0 2023-06-22T10:54:03.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.960+0000 7f658ffff700 1 --2- 172.21.15.40:0/3659780121 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f659015ccd0 0x7f65900ad730 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6580009870 tx=0x7f6580009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fc3ec2f90804f1e server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:03.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.960+0000 7f1f5cbff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1f581609a0 0x7f1f580ce190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.960+0000 7f1f5cbff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f581643d0 con 0x7f1f580cf370 2023-06-22T10:54:03.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.960+0000 7f1f5cbff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f581646b0 con 0x7f1f58069f30 2023-06-22T10:54:03.964 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.960+0000 7f1f5cbff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f58165050 con 0x7f1f581609a0 2023-06-22T10:54:03.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.961+0000 7f1f55d9b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1f581609a0 0x7f1f580ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:03.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.961+0000 7f1f55d9b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1f581609a0 0x7f1f580ce190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.40:47026/0 (socket says 172.21.15.40:47026) 2023-06-22T10:54:03.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.961+0000 7f1f55d9b700 1 -- 172.21.15.40:0/2359653199 learned_addr learned my addr 172.21.15.40:0/2359653199 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:03.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.961+0000 7f1f55d9b700 1 -- 172.21.15.40:0/2359653199 >> v1:172.21.15.45:6789/0 conn(0x7f1f58069f30 legacy=0x7f1f5806a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:03.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.962+0000 7f1f55d9b700 1 -- 172.21.15.40:0/2359653199 >> v1:172.21.15.40:6789/0 conn(0x7f1f580cf370 legacy=0x7f1f5806c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:03.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.962+0000 7f1f55d9b700 1 -- 172.21.15.40:0/2359653199 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f58164990 con 0x7f1f581609a0 2023-06-22T10:54:03.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.962+0000 7f1f55d9b700 1 --2- 172.21.15.40:0/2359653199 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f581609a0 0x7f1f580ce190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1f480098f0 tx=0x7f1f48009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc49578a95028f92 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:03.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.962+0000 7f2b577ff700 1 Processor -- start 2023-06-22T10:54:03.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.962+0000 7f658f7fe700 1 -- 172.21.15.40:0/3659780121 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6580011830 con 0x7f659015ccd0 2023-06-22T10:54:03.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.962+0000 7f658f7fe700 1 -- 172.21.15.40:0/3659780121 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6580011990 con 0x7f659015ccd0 2023-06-22T10:54:03.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.962+0000 7f658f7fe700 1 -- 172.21.15.40:0/3659780121 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6580011d20 con 0x7f659015ccd0 2023-06-22T10:54:03.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.963+0000 7f65971ff700 1 -- 172.21.15.40:0/3659780121 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f659015ccd0 msgr2=0x7f65900ad730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:03.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.963+0000 7f65971ff700 1 --2- 172.21.15.40:0/3659780121 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f659015ccd0 0x7f65900ad730 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6580009870 tx=0x7f6580009b80 comp rx=0 tx=0).stop 2023-06-22T10:54:03.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.964+0000 7f65971ff700 1 -- 172.21.15.40:0/3659780121 shutdown_connections 2023-06-22T10:54:03.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.964+0000 7f65971ff700 1 --2- 172.21.15.40:0/3659780121 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f65900adc70 0x7f659006c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.964+0000 7f65971ff700 1 --2- 172.21.15.40:0/3659780121 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f659015ccd0 0x7f65900ad730 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.964+0000 7f65971ff700 1 -- 172.21.15.40:0/3659780121 >> 172.21.15.40:0/3659780121 conn(0x7f65900b0fe0 msgr2=0x7f65900ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:03.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.962+0000 7f1f5559a700 1 -- 172.21.15.40:0/2359653199 <== mon.1 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f48004230 con 0x7f1f581609a0 2023-06-22T10:54:03.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.963+0000 7f1f5559a700 1 -- 172.21.15.40:0/2359653199 <== mon.1 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f48004390 con 0x7f1f581609a0 2023-06-22T10:54:03.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.963+0000 7f1f5559a700 1 -- 172.21.15.40:0/2359653199 <== mon.1 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f480036a0 con 0x7f1f581609a0 2023-06-22T10:54:03.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.964+0000 7f1f5cbff700 1 -- 172.21.15.40:0/2359653199 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f581609a0 msgr2=0x7f1f580ce190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:03.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.964+0000 7f1f5cbff700 1 --2- 172.21.15.40:0/2359653199 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f581609a0 0x7f1f580ce190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1f480098f0 tx=0x7f1f48009c00 comp rx=0 tx=0).stop 2023-06-22T10:54:03.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.962+0000 7f025d1ff700 1 Processor -- start 2023-06-22T10:54:03.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.964+0000 7f1f5cbff700 1 -- 172.21.15.40:0/2359653199 shutdown_connections 2023-06-22T10:54:03.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.964+0000 7f1f5cbff700 1 --2- 172.21.15.40:0/2359653199 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f581609a0 0x7f1f580ce190 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.964+0000 7f1f5cbff700 1 -- 172.21.15.40:0/2359653199 >> 172.21.15.40:0/2359653199 conn(0x7f1f580b0fe0 msgr2=0x7f1f580ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:03.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.962+0000 7f2b577ff700 1 -- start start 2023-06-22T10:54:03.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.964+0000 7f65971ff700 1 -- 172.21.15.40:0/3659780121 shutdown_connections 2023-06-22T10:54:03.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.965+0000 7f2b577ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2b501609a0 0x7f2b500cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.965+0000 7f2b577ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2b500c1960 0x7f2b500c1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.965+0000 7f2b577ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b500cc400 con 0x7f2b5006dc90 2023-06-22T10:54:03.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.965+0000 7f2b577ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b5006daf0 con 0x7f2b500c1960 2023-06-22T10:54:03.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.965+0000 7f2b577ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b5006cbb0 con 0x7f2b501609a0 2023-06-22T10:54:03.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.966+0000 7f2b54d9a700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f2b5006dc90 0x7f2b5006c4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.40:35752/0 (socket says 172.21.15.40:35752) 2023-06-22T10:54:03.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.966+0000 7f2b54d9a700 1 -- 172.21.15.40:0/11339048 learned_addr learned my addr 172.21.15.40:0/11339048 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:03.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.966+0000 7f2b5559b700 1 --2- 172.21.15.40:0/11339048 >> v2:172.21.15.45:3300/0 conn(0x7f2b501609a0 0x7f2b500cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:03.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.964+0000 7f025d1ff700 1 -- start start 2023-06-22T10:54:03.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.966+0000 7f025d1ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f025815ccd0 0x7f02580ad730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.966+0000 7f025d1ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f02580adc70 0x7f025806c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.966+0000 7f025d1ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02580cd130 con 0x7f025815bac0 2023-06-22T10:54:03.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.966+0000 7f025d1ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02580ccc60 con 0x7f02580adc70 2023-06-22T10:54:03.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.966+0000 7f025d1ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02580ae0f0 con 0x7f025815ccd0 2023-06-22T10:54:03.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.966+0000 7f2b55d9c700 1 --2- 172.21.15.40:0/11339048 >> v2:172.21.15.40:3300/0 conn(0x7f2b500c1960 0x7f2b500c1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:03.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.967+0000 7f2b47fff700 1 -- 172.21.15.40:0/11339048 <== mon.1 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1950406241 0 0) 0x7f2b500cc400 con 0x7f2b5006dc90 2023-06-22T10:54:03.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.967+0000 7f2b5559b700 1 -- 172.21.15.40:0/11339048 >> v2:172.21.15.40:3300/0 conn(0x7f2b500c1960 msgr2=0x7f2b500c1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:03.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.967+0000 7f2b5559b700 1 --2- 172.21.15.40:0/11339048 >> v2:172.21.15.40:3300/0 conn(0x7f2b500c1960 0x7f2b500c1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.967+0000 7f2b5559b700 1 -- 172.21.15.40:0/11339048 >> v1:172.21.15.45:6789/0 conn(0x7f2b5006dc90 legacy=0x7f2b5006c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:03.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.967+0000 7f2b5559b700 1 -- 172.21.15.40:0/11339048 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b50070e50 con 0x7f2b501609a0 2023-06-22T10:54:03.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.967+0000 7f025759e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f02580adc70 0x7f025806c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:03.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.967+0000 7f025759e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f02580adc70 0x7f025806c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.40:47048/0 (socket says 172.21.15.40:47048) 2023-06-22T10:54:03.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.967+0000 7f025759e700 1 -- 172.21.15.40:0/1749227648 learned_addr learned my addr 172.21.15.40:0/1749227648 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:03.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.967+0000 7f2b5559b700 1 --2- 172.21.15.40:0/11339048 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b501609a0 0x7f2b500cf0d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2b500ce760 tx=0x7f2b4c009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4756a6cc76682c63 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:03.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.965+0000 7f65971ff700 1 -- 172.21.15.40:0/3659780121 wait complete. 2023-06-22T10:54:03.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.967+0000 7f1f5cbff700 1 -- 172.21.15.40:0/2359653199 shutdown_connections 2023-06-22T10:54:03.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.968+0000 7f025759e700 1 -- 172.21.15.40:0/1749227648 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f025815ccd0 msgr2=0x7f02580ad730 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-22T10:54:03.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.968+0000 7f025759e700 1 --2- 172.21.15.40:0/1749227648 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f025815ccd0 0x7f02580ad730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.968+0000 7f025759e700 1 -- 172.21.15.40:0/1749227648 >> v1:172.21.15.40:6789/0 conn(0x7f025815bac0 legacy=0x7f02580cc550 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-22T10:54:03.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.968+0000 7f025759e700 1 -- 172.21.15.40:0/1749227648 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f025815be90 con 0x7f02580adc70 2023-06-22T10:54:03.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.968+0000 7f65971ff700 1 Processor -- start 2023-06-22T10:54:03.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.968+0000 7f025759e700 1 --2- 172.21.15.40:0/1749227648 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02580adc70 0x7f025806c970 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f025000d370 tx=0x7f025000d680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aadd6c25b25b2fcb server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:03.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.968+0000 7f1f5cbff700 1 -- 172.21.15.40:0/2359653199 wait complete. 2023-06-22T10:54:03.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.968+0000 7f0255d9b700 1 -- 172.21.15.40:0/1749227648 <== mon.1 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0250010070 con 0x7f02580adc70 2023-06-22T10:54:03.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.968+0000 7f0255d9b700 1 -- 172.21.15.40:0/1749227648 <== mon.1 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f025000dcd0 con 0x7f02580adc70 2023-06-22T10:54:03.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.968+0000 7f0255d9b700 1 -- 172.21.15.40:0/1749227648 <== mon.1 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0250007d70 con 0x7f02580adc70 2023-06-22T10:54:03.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.969+0000 7f2b47fff700 1 -- 172.21.15.40:0/11339048 <== mon.1 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4c011830 con 0x7f2b501609a0 2023-06-22T10:54:03.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.969+0000 7f2b47fff700 1 -- 172.21.15.40:0/11339048 <== mon.1 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b4c011990 con 0x7f2b501609a0 2023-06-22T10:54:03.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.969+0000 7f2b47fff700 1 -- 172.21.15.40:0/11339048 <== mon.1 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4c011d00 con 0x7f2b501609a0 2023-06-22T10:54:03.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.968+0000 7f65971ff700 1 -- start start 2023-06-22T10:54:03.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.969+0000 7f025d1ff700 1 -- 172.21.15.40:0/1749227648 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02580adc70 msgr2=0x7f025806c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:03.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.969+0000 7f025d1ff700 1 --2- 172.21.15.40:0/1749227648 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02580adc70 0x7f025806c970 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f025000d370 tx=0x7f025000d680 comp rx=0 tx=0).stop 2023-06-22T10:54:03.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.970+0000 7f65971ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65900adc70 0x7f659014a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.970+0000 7f65971ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f659015bac0 0x7f65900b1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.970+0000 7f65971ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f659015ccd0 0x7f65900c3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.970+0000 7f65971ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65900b31c0 con 0x7f659015bac0 2023-06-22T10:54:03.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.970+0000 7f65971ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65900b2120 con 0x7f65900adc70 2023-06-22T10:54:03.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.970+0000 7f65971ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65900b2400 con 0x7f659015ccd0 2023-06-22T10:54:03.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.970+0000 7f025d1ff700 1 -- 172.21.15.40:0/1749227648 shutdown_connections 2023-06-22T10:54:03.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.970+0000 7f025d1ff700 1 --2- 172.21.15.40:0/1749227648 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02580adc70 0x7f025806c970 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.970+0000 7f025d1ff700 1 --2- 172.21.15.40:0/1749227648 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f025815ccd0 0x7f02580ad730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.970+0000 7f025d1ff700 1 -- 172.21.15.40:0/1749227648 >> 172.21.15.40:0/1749227648 conn(0x7f02580b0fe0 msgr2=0x7f02580ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:03.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.970+0000 7f025d1ff700 1 -- 172.21.15.40:0/1749227648 shutdown_connections 2023-06-22T10:54:03.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.970+0000 7f2b577ff700 1 -- 172.21.15.40:0/11339048 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b501609a0 msgr2=0x7f2b500cf0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:03.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.970+0000 7f2b577ff700 1 --2- 172.21.15.40:0/11339048 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b501609a0 0x7f2b500cf0d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2b500ce760 tx=0x7f2b4c009b20 comp rx=0 tx=0).stop 2023-06-22T10:54:03.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.970+0000 7f2b577ff700 1 -- 172.21.15.40:0/11339048 shutdown_connections 2023-06-22T10:54:03.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.970+0000 7f2b577ff700 1 --2- 172.21.15.40:0/11339048 >> v2:172.21.15.40:3300/0 conn(0x7f2b500c1960 0x7f2b500c1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.970+0000 7f2b577ff700 1 --2- 172.21.15.40:0/11339048 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b501609a0 0x7f2b500cf0d0 secure :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2b500ce760 tx=0x7f2b4c009b20 comp rx=0 tx=0).stop 2023-06-22T10:54:03.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.970+0000 7f2b577ff700 1 -- 172.21.15.40:0/11339048 >> 172.21.15.40:0/11339048 conn(0x7f2b500b0ff0 msgr2=0x7f2b500ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:03.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.970+0000 7f2b577ff700 1 -- 172.21.15.40:0/11339048 shutdown_connections 2023-06-22T10:54:03.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.970+0000 7f2b577ff700 1 -- 172.21.15.40:0/11339048 wait complete. 2023-06-22T10:54:03.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.971+0000 7f658ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f659015bac0 0x7f65900b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:03.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.971+0000 7f658ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f659015bac0 0x7f65900b1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50744/0 (socket says 172.21.15.40:50744) 2023-06-22T10:54:03.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.971+0000 7f658ffff700 1 -- 172.21.15.40:0/385525172 learned_addr learned my addr 172.21.15.40:0/385525172 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:03.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.972+0000 7f658ffff700 1 -- 172.21.15.40:0/385525172 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f659015ccd0 msgr2=0x7f65900c3d50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-22T10:54:03.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.972+0000 7f658ffff700 1 --2- 172.21.15.40:0/385525172 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f659015ccd0 0x7f65900c3d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.972+0000 7f658ffff700 1 -- 172.21.15.40:0/385525172 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65900adc70 msgr2=0x7f659014a030 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-22T10:54:03.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.972+0000 7f658ffff700 1 --2- 172.21.15.40:0/385525172 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65900adc70 0x7f659014a030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.972+0000 7f658ffff700 1 -- 172.21.15.40:0/385525172 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65800094a0 con 0x7f659015bac0 2023-06-22T10:54:03.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.973+0000 7f658ffff700 1 --2- 172.21.15.40:0/385525172 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f659015bac0 0x7f65900b1660 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6580009840 tx=0x7f6580004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:03.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.971+0000 7f1f5cbff700 1 Processor -- start 2023-06-22T10:54:03.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.971+0000 7f1f5cbff700 1 -- start start 2023-06-22T10:54:03.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.973+0000 7f1f5cbff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f58069f30 0x7f1f581566d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.973+0000 7f1f5cbff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1f580cf370 0x7f1f58162350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.973+0000 7f1f5cbff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f581609a0 0x7f1f58162890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.973+0000 7f1f5cbff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f58157140 con 0x7f1f58069f30 2023-06-22T10:54:03.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.973+0000 7f1f5cbff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f58156c10 con 0x7f1f581609a0 2023-06-22T10:54:03.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.973+0000 7f1f5cbff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f58162dd0 con 0x7f1f580cf370 2023-06-22T10:54:03.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.974+0000 7f1f55d9b700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1f580cf370 0x7f1f58162350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:03.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.971+0000 7f025d1ff700 1 -- 172.21.15.40:0/1749227648 wait complete. 2023-06-22T10:54:03.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.973+0000 7f025d1ff700 1 Processor -- start 2023-06-22T10:54:03.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.972+0000 7f94ea9ff700 1 Processor -- start 2023-06-22T10:54:03.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.972+0000 7f94ea9ff700 1 -- start start 2023-06-22T10:54:03.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.974+0000 7f1f56d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f581609a0 0x7f1f58162890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:03.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.974+0000 7f1f56d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f581609a0 0x7f1f58162890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.40:47060/0 (socket says 172.21.15.40:47060) 2023-06-22T10:54:03.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.974+0000 7f1f56d9d700 1 -- 172.21.15.40:0/783522349 learned_addr learned my addr 172.21.15.40:0/783522349 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:03.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.974+0000 7f025d1ff700 1 -- start start 2023-06-22T10:54:03.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.975+0000 7f1f5659c700 1 --2- 172.21.15.40:0/783522349 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f58069f30 0x7f1f581566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:03.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.973+0000 7f2b577ff700 1 Processor -- start 2023-06-22T10:54:03.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.973+0000 7f2b577ff700 1 -- start start 2023-06-22T10:54:03.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.975+0000 7f2b577ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f2b5006dc90 0x7f2b50153af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.975+0000 7f2b577ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b500c1960 0x7f2b501f6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.975+0000 7f2b577ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b501f6ab0 0x7f2b50161dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.975+0000 7f2b577ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b500c3500 con 0x7f2b500c1960 2023-06-22T10:54:03.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.975+0000 7f2b577ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b500c4360 con 0x7f2b501f6ab0 2023-06-22T10:54:03.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.975+0000 7f2b577ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b500b45b0 con 0x7f2b5006dc90 2023-06-22T10:54:03.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.975+0000 7f1f56d9d700 1 -- 172.21.15.40:0/783522349 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1f580cf370 msgr2=0x7f1f58162350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:03.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.975+0000 7f1f56d9d700 1 --2- 172.21.15.40:0/783522349 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1f580cf370 0x7f1f58162350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.975+0000 7f1f56d9d700 1 -- 172.21.15.40:0/783522349 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f58069f30 msgr2=0x7f1f581566d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:03.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.975+0000 7f1f56d9d700 1 --2- 172.21.15.40:0/783522349 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f58069f30 0x7f1f581566d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.975+0000 7f1f56d9d700 1 -- 172.21.15.40:0/783522349 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f48009550 con 0x7f1f581609a0 2023-06-22T10:54:03.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.975+0000 7f1f5659c700 1 --2- 172.21.15.40:0/783522349 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f58069f30 0x7f1f581566d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:54:03.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.975+0000 7f2b54d9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b500c1960 0x7f2b501f6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:03.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.976+0000 7f2b54d9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b500c1960 0x7f2b501f6570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50760/0 (socket says 172.21.15.40:50760) 2023-06-22T10:54:03.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.976+0000 7f2b54d9a700 1 -- 172.21.15.40:0/562253369 learned_addr learned my addr 172.21.15.40:0/562253369 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:03.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.976+0000 7f025d1ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f02580adc70 0x7f02581fc860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.976+0000 7f025d1ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f025815bac0 0x7f02581ff2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.976+0000 7f025d1ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f025815ccd0 0x7f02581525b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.976+0000 7f025d1ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0258154460 con 0x7f025815ccd0 2023-06-22T10:54:03.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.976+0000 7f025d1ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02582001e0 con 0x7f025815bac0 2023-06-22T10:54:03.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.976+0000 7f025d1ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02581ffc20 con 0x7f02580adc70 2023-06-22T10:54:03.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.976+0000 7f2b5559b700 1 --2- 172.21.15.40:0/562253369 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f2b5006dc90 0x7f2b50153af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:03.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.976+0000 7f2b54d9a700 1 -- 172.21.15.40:0/562253369 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f2b5006dc90 msgr2=0x7f2b50153af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:03.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.976+0000 7f2b54d9a700 1 --2- 172.21.15.40:0/562253369 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f2b5006dc90 0x7f2b50153af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.976+0000 7f2b54d9a700 1 -- 172.21.15.40:0/562253369 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b501f6ab0 msgr2=0x7f2b50161dc0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-22T10:54:03.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.976+0000 7f2b54d9a700 1 --2- 172.21.15.40:0/562253369 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b501f6ab0 0x7f2b50161dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:03.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.976+0000 7f2b54d9a700 1 -- 172.21.15.40:0/562253369 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b4c0094a0 con 0x7f2b500c1960 2023-06-22T10:54:03.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.976+0000 7f025759e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f025815ccd0 0x7f02581525b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:03.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.976+0000 7f025759e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f025815ccd0 0x7f02581525b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50780/0 (socket says 172.21.15.40:50780) 2023-06-22T10:54:03.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.976+0000 7f025759e700 1 -- 172.21.15.40:0/4254220214 learned_addr learned my addr 172.21.15.40:0/4254220214 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:03.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.977+0000 7f0256d9d700 1 --2- 172.21.15.40:0/4254220214 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f02580adc70 0x7f02581fc860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:03.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.977+0000 7f025659c700 1 --2- 172.21.15.40:0/4254220214 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f025815bac0 0x7f02581ff2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:03.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.974+0000 7f94ea9ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f94e40cf370 0x7f94e40ce190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:03.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.975+0000 7f94ea9ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94e41643d0 con 0x7f94e4069f30 2023-06-22T10:54:03.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.975+0000 7f94ea9ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94e41646b0 con 0x7f94e41609a0 2023-06-22T10:54:03.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.975+0000 7f94ea9ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94e4165050 con 0x7f94e40cf370 2023-06-22T10:54:03.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.975+0000 7f94e37fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f94e41609a0 0x7f94e406c4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.40:35762/0 (socket says 172.21.15.40:35762) 2023-06-22T10:54:03.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.975+0000 7f94e37fe700 1 -- 172.21.15.40:0/1553461994 learned_addr learned my addr 172.21.15.40:0/1553461994 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:03.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.976+0000 7f94e8f9c700 1 --2- 172.21.15.40:0/1553461994 >> v2:172.21.15.40:3300/0 conn(0x7f94e40cf370 0x7f94e40ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:03.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.976+0000 7f94e2ffd700 1 -- 172.21.15.40:0/1553461994 <== mon.1 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2862700187 0 0) 0x7f94e41646b0 con 0x7f94e41609a0 2023-06-22T10:54:03.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.976+0000 7f94e2ffd700 1 -- 172.21.15.40:0/1553461994 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94cc0035b0 con 0x7f94e41609a0 2023-06-22T10:54:03.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.977+0000 7f94e8f9c700 1 -- 172.21.15.40:0/1553461994 >> v1:172.21.15.45:6789/0 conn(0x7f94e41609a0 legacy=0x7f94e406c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:04.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.977+0000 7f94e8f9c700 1 -- 172.21.15.40:0/1553461994 >> v1:172.21.15.40:6789/0 conn(0x7f94e4069f30 legacy=0x7f94e406a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:04.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.977+0000 7f94e8f9c700 1 -- 172.21.15.40:0/1553461994 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e4164990 con 0x7f94e40cf370 2023-06-22T10:54:04.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.977+0000 7f2b54d9a700 1 --2- 172.21.15.40:0/562253369 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b500c1960 0x7f2b501f6570 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2b4000c520 tx=0x7f2b4000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:04.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.978+0000 7f2b45ffb700 1 -- 172.21.15.40:0/562253369 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b40004c80 con 0x7f2b500c1960 2023-06-22T10:54:04.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.978+0000 7f2b45ffb700 1 -- 172.21.15.40:0/562253369 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b40004e00 con 0x7f2b500c1960 2023-06-22T10:54:04.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.978+0000 7f2b45ffb700 1 -- 172.21.15.40:0/562253369 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b40007310 con 0x7f2b500c1960 2023-06-22T10:54:04.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.977+0000 7f0256d9d700 1 -- 172.21.15.40:0/4254220214 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f025815bac0 msgr2=0x7f02581ff2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:04.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.977+0000 7f0256d9d700 1 --2- 172.21.15.40:0/4254220214 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f025815bac0 0x7f02581ff2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:04.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.977+0000 7f0256d9d700 1 -- 172.21.15.40:0/4254220214 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f025815ccd0 msgr2=0x7f02581525b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:04.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.977+0000 7f0256d9d700 1 --2- 172.21.15.40:0/4254220214 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f025815ccd0 0x7f02581525b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:04.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.977+0000 7f0256d9d700 1 -- 172.21.15.40:0/4254220214 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f025000d050 con 0x7f02580adc70 2023-06-22T10:54:04.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.977+0000 7f94e8f9c700 1 --2- 172.21.15.40:0/1553461994 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94e40cf370 0x7f94e40ce190 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f94dc009d90 tx=0x7f94dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0f2926c270e4980 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:04.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.978+0000 7f2b577ff700 1 -- 172.21.15.40:0/562253369 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b500c3750 con 0x7f2b500c1960 2023-06-22T10:54:04.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.978+0000 7f2b577ff700 1 -- 172.21.15.40:0/562253369 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b500c3d10 con 0x7f2b500c1960 2023-06-22T10:54:04.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.978+0000 7f94e2ffd700 1 -- 172.21.15.40:0/1553461994 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94dc00bb10 con 0x7f94e40cf370 2023-06-22T10:54:04.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.978+0000 7f94e2ffd700 1 -- 172.21.15.40:0/1553461994 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94dc01f070 con 0x7f94e40cf370 2023-06-22T10:54:04.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.978+0000 7f94e2ffd700 1 -- 172.21.15.40:0/1553461994 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94dc023440 con 0x7f94e40cf370 2023-06-22T10:54:04.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.979+0000 7f2b577ff700 1 -- 172.21.15.40:0/562253369 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b500c4510 con 0x7f2b500c1960 2023-06-22T10:54:04.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.979+0000 7f94ea9ff700 1 -- 172.21.15.40:0/1553461994 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94e40cf370 msgr2=0x7f94e40ce190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:04.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.979+0000 7f94ea9ff700 1 --2- 172.21.15.40:0/1553461994 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94e40cf370 0x7f94e40ce190 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f94dc009d90 tx=0x7f94dc00b330 comp rx=0 tx=0).stop 2023-06-22T10:54:04.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.979+0000 7f658d7fa700 1 -- 172.21.15.40:0/385525172 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65800036a0 con 0x7f659015bac0 2023-06-22T10:54:04.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.979+0000 7f658d7fa700 1 -- 172.21.15.40:0/385525172 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6580003800 con 0x7f659015bac0 2023-06-22T10:54:04.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.979+0000 7f658d7fa700 1 -- 172.21.15.40:0/385525172 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6580003b70 con 0x7f659015bac0 2023-06-22T10:54:04.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.980+0000 7f1f56d9d700 1 --2- 172.21.15.40:0/783522349 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f581609a0 0x7f1f58162890 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1f5000cbf0 tx=0x7f1f5000a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:04.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.980+0000 7f65971ff700 1 -- 172.21.15.40:0/385525172 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65900b26e0 con 0x7f659015bac0 2023-06-22T10:54:04.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.980+0000 7f65971ff700 1 -- 172.21.15.40:0/385525172 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65900b2ca0 con 0x7f659015bac0 2023-06-22T10:54:04.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.982+0000 7f65971ff700 1 -- 172.21.15.40:0/385525172 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65900b2ec0 con 0x7f659015bac0 2023-06-22T10:54:04.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.982+0000 7f2b45ffb700 1 -- 172.21.15.40:0/562253369 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2b40007470 con 0x7f2b500c1960 2023-06-22T10:54:04.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.982+0000 7f94ea9ff700 1 -- 172.21.15.40:0/1553461994 shutdown_connections 2023-06-22T10:54:04.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.982+0000 7f94ea9ff700 1 --2- 172.21.15.40:0/1553461994 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94e40cf370 0x7f94e40ce190 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:04.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.982+0000 7f94ea9ff700 1 -- 172.21.15.40:0/1553461994 >> 172.21.15.40:0/1553461994 conn(0x7f94e40b0fe0 msgr2=0x7f94e40ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:04.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.981+0000 7f1f46ffd700 1 -- 172.21.15.40:0/783522349 <== mon.1 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f50003c00 con 0x7f1f581609a0 2023-06-22T10:54:04.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.981+0000 7f1f46ffd700 1 -- 172.21.15.40:0/783522349 <== mon.1 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f50003d60 con 0x7f1f581609a0 2023-06-22T10:54:04.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.981+0000 7f1f46ffd700 1 -- 172.21.15.40:0/783522349 <== mon.1 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5000ac20 con 0x7f1f581609a0 2023-06-22T10:54:04.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.982+0000 7f1f5cbff700 1 -- 172.21.15.40:0/783522349 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f58163990 con 0x7f1f581609a0 2023-06-22T10:54:04.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.982+0000 7f1f5cbff700 1 -- 172.21.15.40:0/783522349 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f580c48b0 con 0x7f1f581609a0 2023-06-22T10:54:04.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.983+0000 7f0256d9d700 1 --2- 172.21.15.40:0/4254220214 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f02580adc70 0x7f02581fc860 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0248006fd0 tx=0x7f024800b730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:04.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.983+0000 7f2b45ffb700 1 --2- 172.21.15.40:0/562253369 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f2b3406adb0 0x7f2b3406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:04.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.984+0000 7f2b45ffb700 1 -- 172.21.15.40:0/562253369 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2b40089a30 con 0x7f2b500c1960 2023-06-22T10:54:04.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.984+0000 7f2b5559b700 1 --2- 172.21.15.40:0/562253369 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f2b3406adb0 0x7f2b3406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:04.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.985+0000 7f2b5559b700 1 --2- 172.21.15.40:0/562253369 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f2b3406adb0 0x7f2b3406d260 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2b5006ab80 tx=0x7f2b4c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:04.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.983+0000 7f94ea9ff700 1 -- 172.21.15.40:0/1553461994 shutdown_connections 2023-06-22T10:54:04.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.983+0000 7f94ea9ff700 1 -- 172.21.15.40:0/1553461994 wait complete. 2023-06-22T10:54:04.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.985+0000 7f1f5cbff700 1 -- 172.21.15.40:0/783522349 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f58066ab0 con 0x7f1f581609a0 2023-06-22T10:54:04.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.986+0000 7f94ea9ff700 1 Processor -- start 2023-06-22T10:54:04.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.986+0000 7f023f7fe700 1 -- 172.21.15.40:0/4254220214 <== mon.2 v2:172.21.15.45:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0248011830 con 0x7f02580adc70 2023-06-22T10:54:04.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.986+0000 7f023f7fe700 1 -- 172.21.15.40:0/4254220214 <== mon.2 v2:172.21.15.45:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0248011990 con 0x7f02580adc70 2023-06-22T10:54:04.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.986+0000 7f023f7fe700 1 -- 172.21.15.40:0/4254220214 <== mon.2 v2:172.21.15.45:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0248011d40 con 0x7f02580adc70 2023-06-22T10:54:04.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.986+0000 7f025d1ff700 1 -- 172.21.15.40:0/4254220214 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02581fff00 con 0x7f02580adc70 2023-06-22T10:54:04.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.987+0000 7f025d1ff700 1 -- 172.21.15.40:0/4254220214 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02581ff810 con 0x7f02580adc70 2023-06-22T10:54:04.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.988+0000 7f025d1ff700 1 -- 172.21.15.40:0/4254220214 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f025815b600 con 0x7f02580adc70 2023-06-22T10:54:04.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.986+0000 7f94ea9ff700 1 -- start start 2023-06-22T10:54:04.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.988+0000 7f94ea9ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94e4069f30 0x7f94e4161d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:04.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.988+0000 7f94ea9ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94e40cf370 0x7f94e414c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:04.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.988+0000 7f94ea9ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f94e41609a0 0x7f94e414d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:04.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.988+0000 7f94ea9ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e41622c0 con 0x7f94e40cf370 2023-06-22T10:54:04.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.988+0000 7f94ea9ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e4160d70 con 0x7f94e4069f30 2023-06-22T10:54:04.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.988+0000 7f94ea9ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94e4160fc0 con 0x7f94e41609a0 2023-06-22T10:54:04.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.988+0000 7f1f46ffd700 1 -- 172.21.15.40:0/783522349 <== mon.1 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1f500050d0 con 0x7f1f581609a0 2023-06-22T10:54:04.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.989+0000 7f94e3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94e4069f30 0x7f94e4161d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:04.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.989+0000 7f685bdff700 1 Processor -- start 2023-06-22T10:54:04.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.989+0000 7f94e3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94e4069f30 0x7f94e4161d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.40:47084/0 (socket says 172.21.15.40:47084) 2023-06-22T10:54:04.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.989+0000 7f94e3fff700 1 -- 172.21.15.40:0/391808891 learned_addr learned my addr 172.21.15.40:0/391808891 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:04.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.989+0000 7f94e37fe700 1 --2- 172.21.15.40:0/391808891 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94e40cf370 0x7f94e414c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:04.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.989+0000 7f2b45ffb700 1 -- 172.21.15.40:0/562253369 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2b40054740 con 0x7f2b500c1960 2023-06-22T10:54:04.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.989+0000 7f94e37fe700 1 -- 172.21.15.40:0/391808891 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f94e41609a0 msgr2=0x7f94e414d8a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-22T10:54:04.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.989+0000 7f94e37fe700 1 --2- 172.21.15.40:0/391808891 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f94e41609a0 0x7f94e414d8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:04.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.989+0000 7f94e37fe700 1 -- 172.21.15.40:0/391808891 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94e4069f30 msgr2=0x7f94e4161d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:04.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.989+0000 7f94e37fe700 1 --2- 172.21.15.40:0/391808891 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94e4069f30 0x7f94e4161d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:04.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.989+0000 7f94e37fe700 1 -- 172.21.15.40:0/391808891 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94dc009a70 con 0x7f94e40cf370 2023-06-22T10:54:04.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.989+0000 7f1f46ffd700 1 --2- 172.21.15.40:0/783522349 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f1f3806adb0 0x7f1f3806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:04.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.990+0000 7f1f46ffd700 1 -- 172.21.15.40:0/783522349 <== mon.1 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1f50089820 con 0x7f1f581609a0 2023-06-22T10:54:04.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.990+0000 7f94e37fe700 1 --2- 172.21.15.40:0/391808891 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94e40cf370 0x7f94e414c630 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f94d800c430 tx=0x7f94d800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:04.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.991+0000 7f1f5659c700 1 --2- 172.21.15.40:0/783522349 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f1f3806adb0 0x7f1f3806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:04.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.989+0000 7f685bdff700 1 -- start start 2023-06-22T10:54:04.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.991+0000 7f685bdff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f685415c720 0x7f68540b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:04.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.991+0000 7f685bdff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f68540d2830 0x7f68540b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:04.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.991+0000 7f685bdff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68540b50a0 con 0x7f68540b4c60 2023-06-22T10:54:04.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.991+0000 7f685bdff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6854160d60 con 0x7f68540d2830 2023-06-22T10:54:04.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.991+0000 7f685bdff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68540b2130 con 0x7f685415c720 2023-06-22T10:54:04.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.992+0000 7f1f5659c700 1 --2- 172.21.15.40:0/783522349 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f1f3806adb0 0x7f1f3806d260 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c0017d0 tx=0x7f1f4c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:04.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.992+0000 7f6859b9b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f685415c720 0x7f68540b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:04.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.992+0000 7f6859b9b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f685415c720 0x7f68540b1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.40:47090/0 (socket says 172.21.15.40:47090) 2023-06-22T10:54:04.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.992+0000 7f6859b9b700 1 -- 172.21.15.40:0/2288723951 learned_addr learned my addr 172.21.15.40:0/2288723951 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:04.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.992+0000 7f685939a700 1 --2- 172.21.15.40:0/2288723951 >> v2:172.21.15.40:3300/0 conn(0x7f68540d2830 0x7f68540b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:04.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.993+0000 7f6859b9b700 1 -- 172.21.15.40:0/2288723951 >> v2:172.21.15.40:3300/0 conn(0x7f68540d2830 msgr2=0x7f68540b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:04.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.993+0000 7f6859b9b700 1 --2- 172.21.15.40:0/2288723951 >> v2:172.21.15.40:3300/0 conn(0x7f68540d2830 0x7f68540b4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:04.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.993+0000 7f6859b9b700 1 -- 172.21.15.40:0/2288723951 >> v1:172.21.15.40:6789/0 conn(0x7f68540b4c60 legacy=0x7f685406b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:04.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.993+0000 7f6859b9b700 1 -- 172.21.15.40:0/2288723951 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6854161180 con 0x7f685415c720 2023-06-22T10:54:04.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.993+0000 7f6859b9b700 1 --2- 172.21.15.40:0/2288723951 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f685415c720 0x7f68540b1870 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f68500098f0 tx=0x7f6850009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e78304e6f7655f62 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:04.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.996+0000 7f1f46ffd700 1 -- 172.21.15.40:0/783522349 <== mon.1 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1f500545c0 con 0x7f1f581609a0 2023-06-22T10:54:04.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.996+0000 7f6858b99700 1 -- 172.21.15.40:0/2288723951 <== mon.1 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6850004230 con 0x7f685415c720 2023-06-22T10:54:04.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.996+0000 7f6858b99700 1 -- 172.21.15.40:0/2288723951 <== mon.1 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6850004390 con 0x7f685415c720 2023-06-22T10:54:04.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.996+0000 7f6858b99700 1 -- 172.21.15.40:0/2288723951 <== mon.1 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68500036a0 con 0x7f685415c720 2023-06-22T10:54:04.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.997+0000 7f685bdff700 1 -- 172.21.15.40:0/2288723951 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f685415c720 msgr2=0x7f68540b1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:04.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.997+0000 7f685bdff700 1 --2- 172.21.15.40:0/2288723951 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f685415c720 0x7f68540b1870 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f68500098f0 tx=0x7f6850009c00 comp rx=0 tx=0).stop 2023-06-22T10:54:04.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.997+0000 7f685bdff700 1 -- 172.21.15.40:0/2288723951 shutdown_connections 2023-06-22T10:54:04.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.997+0000 7f685bdff700 1 --2- 172.21.15.40:0/2288723951 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f685415c720 0x7f68540b1870 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:04.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.997+0000 7f685bdff700 1 --2- 172.21.15.40:0/2288723951 >> v2:172.21.15.40:3300/0 conn(0x7f68540d2830 0x7f68540b4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:04.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.997+0000 7f685bdff700 1 -- 172.21.15.40:0/2288723951 >> 172.21.15.40:0/2288723951 conn(0x7f68540cf720 msgr2=0x7f68540cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:04.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.996+0000 7f023f7fe700 1 -- 172.21.15.40:0/4254220214 <== mon.2 v2:172.21.15.45:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f024801a400 con 0x7f02580adc70 2023-06-22T10:54:04.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.997+0000 7f023f7fe700 1 --2- 172.21.15.40:0/4254220214 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f024406ad30 0x7f024406d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:04.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.998+0000 7f023f7fe700 1 -- 172.21.15.40:0/4254220214 <== mon.2 v2:172.21.15.45:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0248089b90 con 0x7f02580adc70 2023-06-22T10:54:04.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.994+0000 7f658d7fa700 1 -- 172.21.15.40:0/385525172 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6580003cd0 con 0x7f659015bac0 2023-06-22T10:54:04.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.995+0000 7f658d7fa700 1 --2- 172.21.15.40:0/385525172 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f657c06adb0 0x7f657c06d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:04.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.995+0000 7f658d7fa700 1 -- 172.21.15.40:0/385525172 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f658008ac50 con 0x7f659015bac0 2023-06-22T10:54:04.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.998+0000 7f025659c700 1 --2- 172.21.15.40:0/4254220214 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f024406ad30 0x7f024406d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:04.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.998+0000 7f685bdff700 1 -- 172.21.15.40:0/2288723951 shutdown_connections 2023-06-22T10:54:04.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:03.999+0000 7f685bdff700 1 -- 172.21.15.40:0/2288723951 wait complete. 2023-06-22T10:54:04.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.000+0000 7f025659c700 1 --2- 172.21.15.40:0/4254220214 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f024406ad30 0x7f024406d1e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f02580adc10 tx=0x7f024c0090e0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:04.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.000+0000 7f6594f9b700 1 --2- 172.21.15.40:0/385525172 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f657c06adb0 0x7f657c06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:04.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.000+0000 7f94e0ff9700 1 -- 172.21.15.40:0/391808891 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d8005e30 con 0x7f94e40cf370 2023-06-22T10:54:04.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.000+0000 7f94e0ff9700 1 -- 172.21.15.40:0/391808891 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d80070d0 con 0x7f94e40cf370 2023-06-22T10:54:04.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.000+0000 7f94e0ff9700 1 -- 172.21.15.40:0/391808891 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d8007440 con 0x7f94e40cf370 2023-06-22T10:54:04.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.001+0000 7f94ea9ff700 1 -- 172.21.15.40:0/391808891 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94e41612a0 con 0x7f94e40cf370 2023-06-22T10:54:04.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.001+0000 7f023f7fe700 1 -- 172.21.15.40:0/4254220214 <== mon.2 v2:172.21.15.45:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f02480549c0 con 0x7f02580adc70 2023-06-22T10:54:04.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.002+0000 7f685bdff700 1 Processor -- start 2023-06-22T10:54:04.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.002+0000 7f685bdff700 1 -- start start 2023-06-22T10:54:04.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.000+0000 7f8fde9ff700 1 Processor -- start 2023-06-22T10:54:04.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.000+0000 7f8fde9ff700 1 -- start start 2023-06-22T10:54:04.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.002+0000 7f8fde9ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8fd8069f30 0x7f8fd80ce190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:04.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.002+0000 7f8fde9ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8fd81609a0 0x7f8fd806a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:04.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.002+0000 7f8fde9ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8fd80cf370 0x7f8fd8070440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:04.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.002+0000 7f8fde9ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fd8165050 con 0x7f8fd81609a0 2023-06-22T10:54:04.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.002+0000 7f8fde9ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fd806e380 con 0x7f8fd80cf370 2023-06-22T10:54:04.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.002+0000 7f8fde9ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd806a840 con 0x7f8fd8069f30 2023-06-22T10:54:04.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.001+0000 7f94ea9ff700 1 -- 172.21.15.40:0/391808891 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94e4161860 con 0x7f94e40cf370 2023-06-22T10:54:04.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.003+0000 7f8fd7fff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8fd8069f30 0x7f8fd80ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:04.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.003+0000 7f8fd7fff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8fd8069f30 0x7f8fd80ce190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3301/0 says I am v2:172.21.15.40:48858/0 (socket says 172.21.15.40:48858) 2023-06-22T10:54:04.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.003+0000 7f8fd7fff700 1 -- 172.21.15.40:0/10778777 learned_addr learned my addr 172.21.15.40:0/10778777 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:04.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.003+0000 7f8fdcf9c700 1 --2- 172.21.15.40:0/10778777 >> v2:172.21.15.45:3300/0 conn(0x7f8fd80cf370 0x7f8fd8070440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:04.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.003+0000 7f94ea9ff700 1 -- 172.21.15.40:0/391808891 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94e4161a80 con 0x7f94e40cf370 2023-06-22T10:54:04.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.004+0000 7f8fd7fff700 1 -- 172.21.15.40:0/10778777 >> v2:172.21.15.45:3300/0 conn(0x7f8fd80cf370 msgr2=0x7f8fd8070440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:04.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.004+0000 7f8fd7fff700 1 --2- 172.21.15.40:0/10778777 >> v2:172.21.15.45:3300/0 conn(0x7f8fd80cf370 0x7f8fd8070440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:04.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.004+0000 7f8fd7fff700 1 -- 172.21.15.40:0/10778777 >> v2:172.21.15.40:3300/0 conn(0x7f8fd81609a0 msgr2=0x7f8fd806a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:04.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.004+0000 7f8fd7fff700 1 --2- 172.21.15.40:0/10778777 >> v2:172.21.15.40:3300/0 conn(0x7f8fd81609a0 0x7f8fd806a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:04.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.004+0000 7f8fd7fff700 1 -- 172.21.15.40:0/10778777 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd81643d0 con 0x7f8fd8069f30 2023-06-22T10:54:04.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.004+0000 7f685bdff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f68540b4c60 0x7f68541571f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:04.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.004+0000 7f685bdff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68540d2830 0x7f68540b7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:04.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.004+0000 7f685bdff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f685415c720 0x7f68540b7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:04.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.004+0000 7f685bdff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68540cd340 con 0x7f685415c720 2023-06-22T10:54:04.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.004+0000 7f685bdff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68541f6e10 con 0x7f68540d2830 2023-06-22T10:54:04.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.004+0000 7f685bdff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6854157730 con 0x7f68540b4c60 2023-06-22T10:54:04.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.004+0000 7f6594f9b700 1 --2- 172.21.15.40:0/385525172 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f657c06adb0 0x7f657c06d260 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6584000f60 tx=0x7f6584007a40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:04.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.004+0000 7f8fd7fff700 1 --2- 172.21.15.40:0/10778777 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8fd8069f30 0x7f8fd80ce190 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8fd80cd660 tx=0x7f8fc8009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc71c7d53229d94c server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:04.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.005+0000 7f6859b9b700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f68540b4c60 0x7f68541571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:04.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.005+0000 7f658d7fa700 1 -- 172.21.15.40:0/385525172 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f658008ae60 con 0x7f659015bac0 2023-06-22T10:54:04.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.005+0000 7f6859b9b700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f68540b4c60 0x7f68541571f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3301/0 says I am v2:172.21.15.40:48862/0 (socket says 172.21.15.40:48862) 2023-06-22T10:54:04.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.005+0000 7f6859b9b700 1 -- 172.21.15.40:0/737833674 learned_addr learned my addr 172.21.15.40:0/737833674 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:04.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.005+0000 7f685939a700 1 --2- 172.21.15.40:0/737833674 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68540d2830 0x7f68540b7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:04.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.005+0000 7f685a39c700 1 --2- 172.21.15.40:0/737833674 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f685415c720 0x7f68540b7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:04.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.006+0000 7f6859b9b700 1 -- 172.21.15.40:0/737833674 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68540d2830 msgr2=0x7f68540b7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:04.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.006+0000 7f6859b9b700 1 --2- 172.21.15.40:0/737833674 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68540d2830 0x7f68540b7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:04.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.006+0000 7f6859b9b700 1 -- 172.21.15.40:0/737833674 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f685415c720 msgr2=0x7f68540b7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:04.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.006+0000 7f6859b9b700 1 --2- 172.21.15.40:0/737833674 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f685415c720 0x7f68540b7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:04.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.006+0000 7f6859b9b700 1 -- 172.21.15.40:0/737833674 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6850009550 con 0x7f68540b4c60 2023-06-22T10:54:04.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.006+0000 7f6859b9b700 1 --2- 172.21.15.40:0/737833674 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f68540b4c60 0x7f68541571f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6850009c40 tx=0x7f6850004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:04.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.005+0000 7f8fd6ffd700 1 -- 172.21.15.40:0/10778777 <== mon.2 v2:172.21.15.45:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc8011830 con 0x7f8fd8069f30 2023-06-22T10:54:04.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.005+0000 7f8fd6ffd700 1 -- 172.21.15.40:0/10778777 <== mon.2 v2:172.21.15.45:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fc8011990 con 0x7f8fd8069f30 2023-06-22T10:54:04.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.005+0000 7f8fd6ffd700 1 -- 172.21.15.40:0/10778777 <== mon.2 v2:172.21.15.45:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc8011d20 con 0x7f8fd8069f30 2023-06-22T10:54:04.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.006+0000 7f8fde9ff700 1 -- 172.21.15.40:0/10778777 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8fd8069f30 msgr2=0x7f8fd80ce190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:04.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.006+0000 7f8fde9ff700 1 --2- 172.21.15.40:0/10778777 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8fd8069f30 0x7f8fd80ce190 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8fd80cd660 tx=0x7f8fc8009bd0 comp rx=0 tx=0).stop 2023-06-22T10:54:04.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.007+0000 7f8fde9ff700 1 -- 172.21.15.40:0/10778777 shutdown_connections 2023-06-22T10:54:04.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.007+0000 7f8fde9ff700 1 --2- 172.21.15.40:0/10778777 >> v2:172.21.15.45:3300/0 conn(0x7f8fd80cf370 0x7f8fd8070440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:04.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.007+0000 7f8fde9ff700 1 --2- 172.21.15.40:0/10778777 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8fd8069f30 0x7f8fd80ce190 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:04.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.007+0000 7f8fde9ff700 1 --2- 172.21.15.40:0/10778777 >> v2:172.21.15.40:3300/0 conn(0x7f8fd81609a0 0x7f8fd806a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:04.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.007+0000 7f8fde9ff700 1 -- 172.21.15.40:0/10778777 >> 172.21.15.40:0/10778777 conn(0x7f8fd80b0fe0 msgr2=0x7f8fd80ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:04.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.007+0000 7f684a7fc700 1 -- 172.21.15.40:0/737833674 <== mon.2 v2:172.21.15.45:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68500045b0 con 0x7f68540b4c60 2023-06-22T10:54:04.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.007+0000 7f684a7fc700 1 -- 172.21.15.40:0/737833674 <== mon.2 v2:172.21.15.45:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6850011630 con 0x7f68540b4c60 2023-06-22T10:54:04.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.007+0000 7f684a7fc700 1 -- 172.21.15.40:0/737833674 <== mon.2 v2:172.21.15.45:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68500119c0 con 0x7f68540b4c60 2023-06-22T10:54:04.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.007+0000 7f685bdff700 1 -- 172.21.15.40:0/737833674 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68541f72a0 con 0x7f68540b4c60 2023-06-22T10:54:04.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.007+0000 7f685bdff700 1 -- 172.21.15.40:0/737833674 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68541f67c0 con 0x7f68540b4c60 2023-06-22T10:54:04.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.008+0000 7f8fde9ff700 1 -- 172.21.15.40:0/10778777 shutdown_connections 2023-06-22T10:54:04.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.009+0000 7f8fde9ff700 1 -- 172.21.15.40:0/10778777 wait complete. 2023-06-22T10:54:04.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.012+0000 7f8fde9ff700 1 Processor -- start 2023-06-22T10:54:04.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.012+0000 7f8fde9ff700 1 -- start start 2023-06-22T10:54:04.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.012+0000 7f684a7fc700 1 -- 172.21.15.40:0/737833674 <== mon.2 v2:172.21.15.45:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6850022070 con 0x7f68540b4c60 2023-06-22T10:54:04.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.012+0000 7f685bdff700 1 -- 172.21.15.40:0/737833674 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68541f70f0 con 0x7f68540b4c60 2023-06-22T10:54:04.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.013+0000 7f684a7fc700 1 --2- 172.21.15.40:0/737833674 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f683806adb0 0x7f683806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:04.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.013+0000 7f684a7fc700 1 -- 172.21.15.40:0/737833674 <== mon.2 v2:172.21.15.45:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f685008b280 con 0x7f68540b4c60 2023-06-22T10:54:04.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.014+0000 7f8fde9ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fd8069f30 0x7f8fd815fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:04.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.014+0000 7f8fde9ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8fd80cf370 0x7f8fd80c75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:04.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.014+0000 7f8fde9ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fd81609a0 0x7f8fd80c7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:04.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.014+0000 7f8fde9ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd8203430 con 0x7f8fd81609a0 2023-06-22T10:54:04.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.014+0000 7f8fde9ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd81ff060 con 0x7f8fd8069f30 2023-06-22T10:54:04.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.014+0000 7f8fde9ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd81ff340 con 0x7f8fd80cf370 2023-06-22T10:54:04.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.012+0000 7f94e0ff9700 1 -- 172.21.15.40:0/391808891 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f94d80075a0 con 0x7f94e40cf370 2023-06-22T10:54:04.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.014+0000 7f94e0ff9700 1 --2- 172.21.15.40:0/391808891 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f94d006adb0 0x7f94d006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:04.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.014+0000 7f94e0ff9700 1 -- 172.21.15.40:0/391808891 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f94d8089310 con 0x7f94e40cf370 2023-06-22T10:54:04.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.015+0000 7f685939a700 1 --2- 172.21.15.40:0/737833674 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f683806adb0 0x7f683806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:04.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.016+0000 7f685939a700 1 --2- 172.21.15.40:0/737833674 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f683806adb0 0x7f683806d260 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f68540c8d90 tx=0x7f6844008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:04.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.016+0000 7f8fdcf9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fd81609a0 0x7f8fd80c7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:04.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.016+0000 7f8fdcf9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fd81609a0 0x7f8fd80c7ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50824/0 (socket says 172.21.15.40:50824) 2023-06-22T10:54:04.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.016+0000 7f8fdcf9c700 1 -- 172.21.15.40:0/1625092729 learned_addr learned my addr 172.21.15.40:0/1625092729 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:04.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.016+0000 7f94e3fff700 1 --2- 172.21.15.40:0/391808891 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f94d006adb0 0x7f94d006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:04.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.017+0000 7f8fdcf9c700 1 -- 172.21.15.40:0/1625092729 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8fd80cf370 msgr2=0x7f8fd80c75a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-06-22T10:54:04.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.017+0000 7f8fdcf9c700 1 --2- 172.21.15.40:0/1625092729 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8fd80cf370 0x7f8fd80c75a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:04.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.017+0000 7f8fdcf9c700 1 -- 172.21.15.40:0/1625092729 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fd8069f30 msgr2=0x7f8fd815fce0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-22T10:54:04.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.017+0000 7f8fdcf9c700 1 --2- 172.21.15.40:0/1625092729 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fd8069f30 0x7f8fd815fce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:04.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.017+0000 7f8fdcf9c700 1 -- 172.21.15.40:0/1625092729 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc8009550 con 0x7f8fd81609a0 2023-06-22T10:54:04.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.017+0000 7fceab5ff700 1 Processor -- start 2023-06-22T10:54:04.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.018+0000 7f684a7fc700 1 -- 172.21.15.40:0/737833674 <== mon.2 v2:172.21.15.45:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f68500560b0 con 0x7f68540b4c60 2023-06-22T10:54:04.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.018+0000 7f94e3fff700 1 --2- 172.21.15.40:0/391808891 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f94d006adb0 0x7f94d006d260 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f94e40b25d0 tx=0x7f94d4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:04.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.018+0000 7f8fdcf9c700 1 --2- 172.21.15.40:0/1625092729 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fd81609a0 0x7f8fd80c7ae0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8fd000efc0 tx=0x7f8fd000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:04.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.018+0000 7fceab5ff700 1 -- start start 2023-06-22T10:54:04.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.019+0000 7f94e0ff9700 1 -- 172.21.15.40:0/391808891 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f94d8054160 con 0x7f94e40cf370 2023-06-22T10:54:04.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.020+0000 7f8fd4ff9700 1 -- 172.21.15.40:0/1625092729 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd000cd40 con 0x7f8fd81609a0 2023-06-22T10:54:04.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.020+0000 7f8fd4ff9700 1 -- 172.21.15.40:0/1625092729 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd000f040 con 0x7f8fd81609a0 2023-06-22T10:54:04.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.020+0000 7f8fd4ff9700 1 -- 172.21.15.40:0/1625092729 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd000cea0 con 0x7f8fd81609a0 2023-06-22T10:54:04.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.020+0000 7f8fde9ff700 1 -- 172.21.15.40:0/1625092729 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fd81ff620 con 0x7f8fd81609a0 2023-06-22T10:54:04.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.020+0000 7f8fde9ff700 1 -- 172.21.15.40:0/1625092729 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fd8160220 con 0x7f8fd81609a0 2023-06-22T10:54:04.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.020+0000 7fceab5ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcea415bac0 0x7fcea40cc550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:04.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.020+0000 7fceab5ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcea40cd130 con 0x7fcea40ade40 2023-06-22T10:54:04.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.020+0000 7fceab5ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcea415be90 con 0x7fcea415ccd0 2023-06-22T10:54:04.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.020+0000 7fceab5ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcea4070440 con 0x7fcea415bac0 2023-06-22T10:54:04.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.021+0000 7fcea9b9c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fcea40ade40 0x7fcea406c970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:58544/0 (socket says 172.21.15.40:58544) 2023-06-22T10:54:04.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.021+0000 7fcea9b9c700 1 -- 172.21.15.40:0/1463195387 learned_addr learned my addr 172.21.15.40:0/1463195387 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:04.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.023+0000 7fcea939b700 1 --2- 172.21.15.40:0/1463195387 >> v2:172.21.15.40:3300/0 conn(0x7fcea415bac0 0x7fcea40cc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:04.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.023+0000 7f8fde9ff700 1 -- 172.21.15.40:0/1625092729 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fb80052f0 con 0x7f8fd81609a0 2023-06-22T10:54:04.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.023+0000 7fcea939b700 1 -- 172.21.15.40:0/1463195387 >> v1:172.21.15.45:6789/0 conn(0x7fcea415ccd0 legacy=0x7fcea40ad730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:04.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.023+0000 7fcea939b700 1 -- 172.21.15.40:0/1463195387 >> v1:172.21.15.40:6789/0 conn(0x7fcea40ade40 legacy=0x7fcea406c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:04.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.024+0000 7fcea939b700 1 -- 172.21.15.40:0/1463195387 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea40cce50 con 0x7fcea415bac0 2023-06-22T10:54:04.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.025+0000 7fcea939b700 1 --2- 172.21.15.40:0/1463195387 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcea415bac0 0x7fcea40cc550 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fce94009190 tx=0x7fce940094a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eae82d36364376b3 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:04.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.034+0000 7fce9bfff700 1 -- 172.21.15.40:0/1463195387 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce94004230 con 0x7fcea415bac0 2023-06-22T10:54:04.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.034+0000 7fce9bfff700 1 -- 172.21.15.40:0/1463195387 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce94004390 con 0x7fcea415bac0 2023-06-22T10:54:04.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.034+0000 7fce9bfff700 1 -- 172.21.15.40:0/1463195387 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9400f740 con 0x7fcea415bac0 2023-06-22T10:54:04.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.035+0000 7fceab5ff700 1 -- 172.21.15.40:0/1463195387 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcea415bac0 msgr2=0x7fcea40cc550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:04.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.035+0000 7fceab5ff700 1 --2- 172.21.15.40:0/1463195387 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcea415bac0 0x7fcea40cc550 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fce94009190 tx=0x7fce940094a0 comp rx=0 tx=0).stop 2023-06-22T10:54:04.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.036+0000 7fceab5ff700 1 -- 172.21.15.40:0/1463195387 shutdown_connections 2023-06-22T10:54:04.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.036+0000 7fceab5ff700 1 --2- 172.21.15.40:0/1463195387 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcea415bac0 0x7fcea40cc550 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:04.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.036+0000 7fceab5ff700 1 -- 172.21.15.40:0/1463195387 >> 172.21.15.40:0/1463195387 conn(0x7fcea40b0fe0 msgr2=0x7fcea40ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:04.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.036+0000 7fceab5ff700 1 -- 172.21.15.40:0/1463195387 shutdown_connections 2023-06-22T10:54:04.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.037+0000 7fceab5ff700 1 -- 172.21.15.40:0/1463195387 wait complete. 2023-06-22T10:54:04.052 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.039+0000 7f8fd4ff9700 1 -- 172.21.15.40:0/1625092729 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8fd00146c0 con 0x7f8fd81609a0 2023-06-22T10:54:04.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.039+0000 7fceab5ff700 1 Processor -- start 2023-06-22T10:54:04.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.040+0000 7fceab5ff700 1 -- start start 2023-06-22T10:54:04.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.042+0000 7fceab5ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fcea40ade40 0x7fcea40b2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:04.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.042+0000 7fceab5ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcea415bac0 0x7fcea414fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:04.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.042+0000 7fceab5ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcea415ccd0 0x7fcea41f69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:04.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.042+0000 7fceab5ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea4158170 con 0x7fcea415bac0 2023-06-22T10:54:04.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.042+0000 7fceab5ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea4150220 con 0x7fcea415ccd0 2023-06-22T10:54:04.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.042+0000 7fceab5ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcea41f7360 con 0x7fcea40ade40 2023-06-22T10:54:04.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.043+0000 7fcea8b9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcea415bac0 0x7fcea414fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:04.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.043+0000 7fcea8b9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcea415bac0 0x7fcea414fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50844/0 (socket says 172.21.15.40:50844) 2023-06-22T10:54:04.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.043+0000 7fcea8b9a700 1 -- 172.21.15.40:0/2828688428 learned_addr learned my addr 172.21.15.40:0/2828688428 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:04.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.044+0000 7fcea8b9a700 1 -- 172.21.15.40:0/2828688428 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fcea40ade40 msgr2=0x7fcea40b2b80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-22T10:54:04.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.044+0000 7fcea8b9a700 1 --2- 172.21.15.40:0/2828688428 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fcea40ade40 0x7fcea40b2b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:04.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.044+0000 7fcea8b9a700 1 -- 172.21.15.40:0/2828688428 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcea415ccd0 msgr2=0x7fcea41f69b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-22T10:54:04.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.044+0000 7fcea8b9a700 1 --2- 172.21.15.40:0/2828688428 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcea415ccd0 0x7fcea41f69b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:04.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.044+0000 7fcea8b9a700 1 -- 172.21.15.40:0/2828688428 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce94009d30 con 0x7fcea415bac0 2023-06-22T10:54:04.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.044+0000 7fcea8b9a700 1 --2- 172.21.15.40:0/2828688428 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcea415bac0 0x7fcea414fce0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcea000c4a0 tx=0x7fcea000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:04.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.045+0000 7fce99ffb700 1 -- 172.21.15.40:0/2828688428 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea0011790 con 0x7fcea415bac0 2023-06-22T10:54:04.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.045+0000 7fce99ffb700 1 -- 172.21.15.40:0/2828688428 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea00118f0 con 0x7fcea415bac0 2023-06-22T10:54:04.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.045+0000 7fce99ffb700 1 -- 172.21.15.40:0/2828688428 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea0011ca0 con 0x7fcea415bac0 2023-06-22T10:54:04.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.045+0000 7fceab5ff700 1 -- 172.21.15.40:0/2828688428 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcea41f7640 con 0x7fcea415bac0 2023-06-22T10:54:04.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.046+0000 7fceab5ff700 1 -- 172.21.15.40:0/2828688428 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcea41f7920 con 0x7fcea415bac0 2023-06-22T10:54:04.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.040+0000 7f8fd4ff9700 1 --2- 172.21.15.40:0/1625092729 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f8fc406adb0 0x7f8fc406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:04.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.040+0000 7f8fd4ff9700 1 -- 172.21.15.40:0/1625092729 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8fd008aaa0 con 0x7f8fd81609a0 2023-06-22T10:54:04.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.041+0000 7f8fd4ff9700 1 -- 172.21.15.40:0/1625092729 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8fd00b63b0 con 0x7f8fd81609a0 2023-06-22T10:54:04.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.043+0000 7f8fd7fff700 1 --2- 172.21.15.40:0/1625092729 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f8fc406adb0 0x7f8fc406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:04.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.044+0000 7f8fd7fff700 1 --2- 172.21.15.40:0/1625092729 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f8fc406adb0 0x7f8fc406d260 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8fd82024a0 tx=0x7f8fc8008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:04.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.050+0000 7fce99ffb700 1 -- 172.21.15.40:0/2828688428 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcea001c460 con 0x7fcea415bac0 2023-06-22T10:54:04.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.051+0000 7fce99ffb700 1 --2- 172.21.15.40:0/2828688428 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fce8806adb0 0x7fce8806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:04.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.051+0000 7fce99ffb700 1 -- 172.21.15.40:0/2828688428 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcea00895a0 con 0x7fcea415bac0 2023-06-22T10:54:04.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.052+0000 7fcea939b700 1 --2- 172.21.15.40:0/2828688428 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fce8806adb0 0x7fce8806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:04.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.054+0000 7fcea939b700 1 --2- 172.21.15.40:0/2828688428 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fce8806adb0 0x7fce8806d260 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fce94009160 tx=0x7fce94008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:04.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.054+0000 7fceab5ff700 1 -- 172.21.15.40:0/2828688428 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcea4067580 con 0x7fcea415bac0 2023-06-22T10:54:04.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.064+0000 7fce99ffb700 1 -- 172.21.15.40:0/2828688428 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcea00543d0 con 0x7fcea415bac0 2023-06-22T10:54:04.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.457+0000 7f025d1ff700 1 -- 172.21.15.40:0/4254220214 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f0258066a90 con 0x7f02580adc70 2023-06-22T10:54:04.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.458+0000 7f023f7fe700 1 -- 172.21.15.40:0/4254220214 <== mon.2 v2:172.21.15.45:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0248015020 con 0x7f02580adc70 2023-06-22T10:54:04.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.460+0000 7f1f5cbff700 1 -- 172.21.15.40:0/783522349 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1f580afd20 con 0x7f1f581609a0 2023-06-22T10:54:04.463 INFO:teuthology.orchestra.run.smithi040.stdout:55834574858 2023-06-22T10:54:04.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.460+0000 7f2b577ff700 1 -- 172.21.15.40:0/562253369 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2b500c44d0 con 0x7f2b500c1960 2023-06-22T10:54:04.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.460+0000 7f2b45ffb700 1 -- 172.21.15.40:0/562253369 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2b40057d60 con 0x7f2b500c1960 2023-06-22T10:54:04.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.460+0000 7f1f46ffd700 1 -- 172.21.15.40:0/783522349 <== mon.1 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1f50057be0 con 0x7f1f581609a0 2023-06-22T10:54:04.464 INFO:teuthology.orchestra.run.smithi040.stdout:55834574858 2023-06-22T10:54:04.466 INFO:teuthology.orchestra.run.smithi040.stdout:55834574859 2023-06-22T10:54:04.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.462+0000 7f025d1ff700 1 -- 172.21.15.40:0/4254220214 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f024406ad30 msgr2=0x7f024406d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:04.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.462+0000 7f025d1ff700 1 --2- 172.21.15.40:0/4254220214 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f024406ad30 0x7f024406d1e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f02580adc10 tx=0x7f024c0090e0 comp rx=0 tx=0).stop 2023-06-22T10:54:04.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.462+0000 7f025d1ff700 1 -- 172.21.15.40:0/4254220214 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f02580adc70 msgr2=0x7f02581fc860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:04.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.462+0000 7f025d1ff700 1 --2- 172.21.15.40:0/4254220214 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f02580adc70 0x7f02581fc860 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0248006fd0 tx=0x7f024800b730 comp rx=0 tx=0).stop 2023-06-22T10:54:04.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.463+0000 7f025d1ff700 1 -- 172.21.15.40:0/4254220214 shutdown_connections 2023-06-22T10:54:04.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.463+0000 7f025d1ff700 1 --2- 172.21.15.40:0/4254220214 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f024406ad30 0x7f024406d1e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:04.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.463+0000 7f025d1ff700 1 --2- 172.21.15.40:0/4254220214 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f02580adc70 0x7f02581fc860 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:04.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.463+0000 7f025d1ff700 1 --2- 172.21.15.40:0/4254220214 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f025815ccd0 0x7f02581525b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:04.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.463+0000 7f025d1ff700 1 --2- 172.21.15.40:0/4254220214 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f025815bac0 0x7f02581ff2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:04.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.463+0000 7f025d1ff700 1 -- 172.21.15.40:0/4254220214 >> 172.21.15.40:0/4254220214 conn(0x7f02580b0fe0 msgr2=0x7f0258151ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:04.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.464+0000 7f025d1ff700 1 -- 172.21.15.40:0/4254220214 shutdown_connections 2023-06-22T10:54:04.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.464+0000 7f025d1ff700 1 -- 172.21.15.40:0/4254220214 wait complete. 2023-06-22T10:54:04.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.466+0000 7f1f5cbff700 1 -- 172.21.15.40:0/783522349 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f1f3806adb0 msgr2=0x7f1f3806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:04.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.466+0000 7f1f5cbff700 1 --2- 172.21.15.40:0/783522349 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f1f3806adb0 0x7f1f3806d260 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c0017d0 tx=0x7f1f4c009040 comp rx=0 tx=0).stop 2023-06-22T10:54:04.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.466+0000 7f1f5cbff700 1 -- 172.21.15.40:0/783522349 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f581609a0 msgr2=0x7f1f58162890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:04.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.466+0000 7f1f5cbff700 1 --2- 172.21.15.40:0/783522349 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f581609a0 0x7f1f58162890 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1f5000cbf0 tx=0x7f1f5000a060 comp rx=0 tx=0).stop 2023-06-22T10:54:04.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.466+0000 7f1f5cbff700 1 -- 172.21.15.40:0/783522349 shutdown_connections 2023-06-22T10:54:04.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.466+0000 7f1f5cbff700 1 --2- 172.21.15.40:0/783522349 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f1f3806adb0 0x7f1f3806d260 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:04.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.466+0000 7f1f5cbff700 1 --2- 172.21.15.40:0/783522349 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f581609a0 0x7f1f58162890 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:04.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.466+0000 7f1f5cbff700 1 --2- 172.21.15.40:0/783522349 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f58069f30 0x7f1f581566d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:04.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.466+0000 7f1f5cbff700 1 --2- 172.21.15.40:0/783522349 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1f580cf370 0x7f1f58162350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:04.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.466+0000 7f1f5cbff700 1 -- 172.21.15.40:0/783522349 >> 172.21.15.40:0/783522349 conn(0x7f1f580b0fe0 msgr2=0x7f1f5806c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:04.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.466+0000 7f2b577ff700 1 -- 172.21.15.40:0/562253369 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f2b3406adb0 msgr2=0x7f2b3406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:04.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.466+0000 7f2b577ff700 1 --2- 172.21.15.40:0/562253369 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f2b3406adb0 0x7f2b3406d260 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2b5006ab80 tx=0x7f2b4c008030 comp rx=0 tx=0).stop 2023-06-22T10:54:04.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.466+0000 7f2b577ff700 1 -- 172.21.15.40:0/562253369 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b500c1960 msgr2=0x7f2b501f6570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:04.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.466+0000 7f2b577ff700 1 --2- 172.21.15.40:0/562253369 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b500c1960 0x7f2b501f6570 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2b4000c520 tx=0x7f2b4000c8e0 comp rx=0 tx=0).stop 2023-06-22T10:54:04.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.466+0000 7f685bdff700 1 -- 172.21.15.40:0/737833674 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6854067580 con 0x7f68540b4c60 2023-06-22T10:54:04.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.467+0000 7f2b577ff700 1 -- 172.21.15.40:0/562253369 shutdown_connections 2023-06-22T10:54:04.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.467+0000 7f2b577ff700 1 --2- 172.21.15.40:0/562253369 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f2b3406adb0 0x7f2b3406d260 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:04.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.467+0000 7f2b577ff700 1 --2- 172.21.15.40:0/562253369 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f2b5006dc90 0x7f2b50153af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:04.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.467+0000 7f2b577ff700 1 --2- 172.21.15.40:0/562253369 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b501f6ab0 0x7f2b50161dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:04.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.467+0000 7f2b577ff700 1 --2- 172.21.15.40:0/562253369 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2b500c1960 0x7f2b501f6570 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:04.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.467+0000 7f2b577ff700 1 -- 172.21.15.40:0/562253369 >> 172.21.15.40:0/562253369 conn(0x7f2b500b0ff0 msgr2=0x7f2b500ae2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:04.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.467+0000 7f1f5cbff700 1 -- 172.21.15.40:0/783522349 shutdown_connections 2023-06-22T10:54:04.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.467+0000 7f1f5cbff700 1 -- 172.21.15.40:0/783522349 wait complete. 2023-06-22T10:54:04.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.467+0000 7f2b577ff700 1 -- 172.21.15.40:0/562253369 shutdown_connections 2023-06-22T10:54:04.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.467+0000 7f2b577ff700 1 -- 172.21.15.40:0/562253369 wait complete. 2023-06-22T10:54:04.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.467+0000 7f684a7fc700 1 -- 172.21.15.40:0/737833674 <== mon.2 v2:172.21.15.45:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f68500596d0 con 0x7f68540b4c60 2023-06-22T10:54:04.477 INFO:teuthology.orchestra.run.smithi040.stdout:64424509450 2023-06-22T10:54:04.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.474+0000 7f65971ff700 1 -- 172.21.15.40:0/385525172 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f659015be90 con 0x7f659015bac0 2023-06-22T10:54:04.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.475+0000 7f658d7fa700 1 -- 172.21.15.40:0/385525172 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f659015be90 con 0x7f659015bac0 2023-06-22T10:54:04.479 INFO:teuthology.orchestra.run.smithi040.stdout:60129542155 2023-06-22T10:54:04.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.475+0000 7f685bdff700 1 -- 172.21.15.40:0/737833674 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f683806adb0 msgr2=0x7f683806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:04.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.475+0000 7f685bdff700 1 --2- 172.21.15.40:0/737833674 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f683806adb0 0x7f683806d260 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f68540c8d90 tx=0x7f6844008040 comp rx=0 tx=0).stop 2023-06-22T10:54:04.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.475+0000 7f685bdff700 1 -- 172.21.15.40:0/737833674 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f68540b4c60 msgr2=0x7f68541571f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:04.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.475+0000 7f685bdff700 1 --2- 172.21.15.40:0/737833674 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f68540b4c60 0x7f68541571f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6850009c40 tx=0x7f6850004750 comp rx=0 tx=0).stop 2023-06-22T10:54:04.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.476+0000 7f685bdff700 1 -- 172.21.15.40:0/737833674 shutdown_connections 2023-06-22T10:54:04.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.476+0000 7f685bdff700 1 --2- 172.21.15.40:0/737833674 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f683806adb0 0x7f683806d260 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:04.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.476+0000 7f685bdff700 1 --2- 172.21.15.40:0/737833674 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f68540b4c60 0x7f68541571f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:04.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.476+0000 7f685bdff700 1 --2- 172.21.15.40:0/737833674 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f685415c720 0x7f68540b7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:04.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.476+0000 7f685bdff700 1 --2- 172.21.15.40:0/737833674 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68540d2830 0x7f68540b7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:04.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.476+0000 7f685bdff700 1 -- 172.21.15.40:0/737833674 >> 172.21.15.40:0/737833674 conn(0x7f68540cf720 msgr2=0x7f68540d0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:04.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.477+0000 7f685bdff700 1 -- 172.21.15.40:0/737833674 shutdown_connections 2023-06-22T10:54:04.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.477+0000 7f685bdff700 1 -- 172.21.15.40:0/737833674 wait complete. 2023-06-22T10:54:04.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.479+0000 7f94ea9ff700 1 -- 172.21.15.40:0/391808891 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f94e4067580 con 0x7f94e40cf370 2023-06-22T10:54:04.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.480+0000 7f65971ff700 1 -- 172.21.15.40:0/385525172 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f657c06adb0 msgr2=0x7f657c06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:04.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.480+0000 7f65971ff700 1 --2- 172.21.15.40:0/385525172 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f657c06adb0 0x7f657c06d260 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6584000f60 tx=0x7f6584007a40 comp rx=0 tx=0).stop 2023-06-22T10:54:04.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.480+0000 7f65971ff700 1 -- 172.21.15.40:0/385525172 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f659015bac0 msgr2=0x7f65900b1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:04.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.480+0000 7f65971ff700 1 --2- 172.21.15.40:0/385525172 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f659015bac0 0x7f65900b1660 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6580009840 tx=0x7f6580004750 comp rx=0 tx=0).stop 2023-06-22T10:54:04.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.481+0000 7f65971ff700 1 -- 172.21.15.40:0/385525172 shutdown_connections 2023-06-22T10:54:04.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.481+0000 7f65971ff700 1 --2- 172.21.15.40:0/385525172 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f657c06adb0 0x7f657c06d260 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:04.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.481+0000 7f65971ff700 1 --2- 172.21.15.40:0/385525172 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f659015ccd0 0x7f65900c3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:04.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.481+0000 7f65971ff700 1 --2- 172.21.15.40:0/385525172 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65900adc70 0x7f659014a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:04.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.481+0000 7f65971ff700 1 --2- 172.21.15.40:0/385525172 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f659015bac0 0x7f65900b1660 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:04.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.481+0000 7f65971ff700 1 -- 172.21.15.40:0/385525172 >> 172.21.15.40:0/385525172 conn(0x7f65900b0fe0 msgr2=0x7f659006cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:04.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.481+0000 7f65971ff700 1 -- 172.21.15.40:0/385525172 shutdown_connections 2023-06-22T10:54:04.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.481+0000 7f65971ff700 1 -- 172.21.15.40:0/385525172 wait complete. 2023-06-22T10:54:04.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.482+0000 7f94e0ff9700 1 -- 172.21.15.40:0/391808891 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f94d8057780 con 0x7f94e40cf370 2023-06-22T10:54:04.487 INFO:teuthology.orchestra.run.smithi040.stdout:60129542157 2023-06-22T10:54:04.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.487+0000 7f94ea9ff700 1 -- 172.21.15.40:0/391808891 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f94d006adb0 msgr2=0x7f94d006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:04.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.487+0000 7f94ea9ff700 1 --2- 172.21.15.40:0/391808891 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f94d006adb0 0x7f94d006d260 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f94e40b25d0 tx=0x7f94d4009040 comp rx=0 tx=0).stop 2023-06-22T10:54:04.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.487+0000 7f94ea9ff700 1 -- 172.21.15.40:0/391808891 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94e40cf370 msgr2=0x7f94e414c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:04.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.487+0000 7f94ea9ff700 1 --2- 172.21.15.40:0/391808891 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94e40cf370 0x7f94e414c630 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f94d800c430 tx=0x7f94d800c7f0 comp rx=0 tx=0).stop 2023-06-22T10:54:04.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.487+0000 7f94ea9ff700 1 -- 172.21.15.40:0/391808891 shutdown_connections 2023-06-22T10:54:04.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.487+0000 7f94ea9ff700 1 --2- 172.21.15.40:0/391808891 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f94d006adb0 0x7f94d006d260 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:04.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.487+0000 7f94ea9ff700 1 --2- 172.21.15.40:0/391808891 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f94e41609a0 0x7f94e414d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:04.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.487+0000 7f94ea9ff700 1 --2- 172.21.15.40:0/391808891 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94e4069f30 0x7f94e4161d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:04.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.487+0000 7f94ea9ff700 1 --2- 172.21.15.40:0/391808891 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94e40cf370 0x7f94e414c630 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:04.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.487+0000 7f94ea9ff700 1 -- 172.21.15.40:0/391808891 >> 172.21.15.40:0/391808891 conn(0x7f94e40b0fe0 msgr2=0x7f94e40adec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:04.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.488+0000 7f94ea9ff700 1 -- 172.21.15.40:0/391808891 shutdown_connections 2023-06-22T10:54:04.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.488+0000 7f94ea9ff700 1 -- 172.21.15.40:0/391808891 wait complete. 2023-06-22T10:54:04.503 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.1 2023-06-22T10:54:04.504 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.4 2023-06-22T10:54:04.505 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.3 2023-06-22T10:54:04.511 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.508+0000 7f8fde9ff700 1 -- 172.21.15.40:0/1625092729 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f8fb8005870 con 0x7f8fd81609a0 2023-06-22T10:54:04.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.508+0000 7f8fd4ff9700 1 -- 172.21.15.40:0/1625092729 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8fd0055840 con 0x7f8fd81609a0 2023-06-22T10:54:04.512 INFO:teuthology.orchestra.run.smithi040.stdout:55834574859 2023-06-22T10:54:04.515 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542155 for osd.2 2023-06-22T10:54:04.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.511+0000 7f8fde9ff700 1 -- 172.21.15.40:0/1625092729 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f8fc406adb0 msgr2=0x7f8fc406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:04.516 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.511+0000 7f8fde9ff700 1 --2- 172.21.15.40:0/1625092729 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f8fc406adb0 0x7f8fc406d260 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8fd82024a0 tx=0x7f8fc8008030 comp rx=0 tx=0).stop 2023-06-22T10:54:04.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.511+0000 7f8fde9ff700 1 -- 172.21.15.40:0/1625092729 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fd81609a0 msgr2=0x7f8fd80c7ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:04.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.511+0000 7f8fde9ff700 1 --2- 172.21.15.40:0/1625092729 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fd81609a0 0x7f8fd80c7ae0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8fd000efc0 tx=0x7f8fd000c3a0 comp rx=0 tx=0).stop 2023-06-22T10:54:04.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.511+0000 7f8fde9ff700 1 -- 172.21.15.40:0/1625092729 shutdown_connections 2023-06-22T10:54:04.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.511+0000 7f8fde9ff700 1 --2- 172.21.15.40:0/1625092729 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f8fc406adb0 0x7f8fc406d260 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:04.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.511+0000 7f8fde9ff700 1 --2- 172.21.15.40:0/1625092729 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fd81609a0 0x7f8fd80c7ae0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:04.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.511+0000 7f8fde9ff700 1 --2- 172.21.15.40:0/1625092729 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fd8069f30 0x7f8fd815fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:04.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.511+0000 7f8fde9ff700 1 --2- 172.21.15.40:0/1625092729 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8fd80cf370 0x7f8fd80c75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:04.517 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.511+0000 7f8fde9ff700 1 -- 172.21.15.40:0/1625092729 >> 172.21.15.40:0/1625092729 conn(0x7f8fd80b0fe0 msgr2=0x7f8fd80cb2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:04.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.512+0000 7f8fde9ff700 1 -- 172.21.15.40:0/1625092729 shutdown_connections 2023-06-22T10:54:04.518 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.512+0000 7f8fde9ff700 1 -- 172.21.15.40:0/1625092729 wait complete. 2023-06-22T10:54:04.518 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509450 for osd.0 2023-06-22T10:54:04.521 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542158 got 60129542157 for osd.7 2023-06-22T10:54:04.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.520+0000 7fceab5ff700 1 -- 172.21.15.40:0/2828688428 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fcea40c2070 con 0x7fcea415bac0 2023-06-22T10:54:04.523 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.520+0000 7fce99ffb700 1 -- 172.21.15.40:0/2828688428 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcea00579f0 con 0x7fcea415bac0 2023-06-22T10:54:04.523 INFO:teuthology.orchestra.run.smithi040.stdout:60129542156 2023-06-22T10:54:04.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.524+0000 7fceab5ff700 1 -- 172.21.15.40:0/2828688428 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fce8806adb0 msgr2=0x7fce8806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:04.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.524+0000 7fceab5ff700 1 --2- 172.21.15.40:0/2828688428 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fce8806adb0 0x7fce8806d260 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fce94009160 tx=0x7fce94008030 comp rx=0 tx=0).stop 2023-06-22T10:54:04.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.524+0000 7fceab5ff700 1 -- 172.21.15.40:0/2828688428 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcea415bac0 msgr2=0x7fcea414fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:04.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.524+0000 7fceab5ff700 1 --2- 172.21.15.40:0/2828688428 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcea415bac0 0x7fcea414fce0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcea000c4a0 tx=0x7fcea000c860 comp rx=0 tx=0).stop 2023-06-22T10:54:04.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.524+0000 7fceab5ff700 1 -- 172.21.15.40:0/2828688428 shutdown_connections 2023-06-22T10:54:04.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.524+0000 7fceab5ff700 1 --2- 172.21.15.40:0/2828688428 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fce8806adb0 0x7fce8806d260 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:04.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.524+0000 7fceab5ff700 1 --2- 172.21.15.40:0/2828688428 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fcea40ade40 0x7fcea40b2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:04.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.524+0000 7fceab5ff700 1 --2- 172.21.15.40:0/2828688428 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcea415ccd0 0x7fcea41f69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:04.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.524+0000 7fceab5ff700 1 --2- 172.21.15.40:0/2828688428 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcea415bac0 0x7fcea414fce0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:04.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.524+0000 7fceab5ff700 1 -- 172.21.15.40:0/2828688428 >> 172.21.15.40:0/2828688428 conn(0x7fcea40b0fe0 msgr2=0x7fcea4151af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:04.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.524+0000 7fceab5ff700 1 -- 172.21.15.40:0/2828688428 shutdown_connections 2023-06-22T10:54:04.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:04.524+0000 7fceab5ff700 1 -- 172.21.15.40:0/2828688428 wait complete. 2023-06-22T10:54:04.543 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.5 2023-06-22T10:54:04.550 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542157 got 60129542156 for osd.6 2023-06-22T10:54:05.504 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-06-22T10:54:05.505 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-06-22T10:54:05.506 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-06-22T10:54:05.516 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-06-22T10:54:05.520 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-06-22T10:54:05.522 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-06-22T10:54:05.544 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-06-22T10:54:05.551 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-06-22T10:54:05.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.866+0000 7f34579ff700 1 Processor -- start 2023-06-22T10:54:05.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.867+0000 7f34579ff700 1 -- start start 2023-06-22T10:54:05.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.869+0000 7f34579ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f34500c1960 0x7f34500c1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:05.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.869+0000 7f34579ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34500cc400 con 0x7f34500cf0d0 2023-06-22T10:54:05.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.869+0000 7f34579ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f345006cbb0 con 0x7f34501609a0 2023-06-22T10:54:05.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.869+0000 7f34579ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f345006daf0 con 0x7f34500c1960 2023-06-22T10:54:05.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.870+0000 7f3454f9a700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f34500cf0d0 0x7f345006c4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:58554/0 (socket says 172.21.15.40:58554) 2023-06-22T10:54:05.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.870+0000 7f3454f9a700 1 -- 172.21.15.40:0/1754655700 learned_addr learned my addr 172.21.15.40:0/1754655700 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:05.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.871+0000 7f3455f9c700 1 --2- 172.21.15.40:0/1754655700 >> v2:172.21.15.40:3300/0 conn(0x7f34500c1960 0x7f34500c1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:05.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.871+0000 7f3455f9c700 1 -- 172.21.15.40:0/1754655700 >> v1:172.21.15.45:6789/0 conn(0x7f34501609a0 legacy=0x7f345006dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:05.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.871+0000 7f3455f9c700 1 -- 172.21.15.40:0/1754655700 >> v1:172.21.15.40:6789/0 conn(0x7f34500cf0d0 legacy=0x7f345006c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:05.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.871+0000 7f3455f9c700 1 -- 172.21.15.40:0/1754655700 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3450070e50 con 0x7f34500c1960 2023-06-22T10:54:05.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.872+0000 7f3455f9c700 1 --2- 172.21.15.40:0/1754655700 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34500c1960 0x7f34500c1dc0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3440009840 tx=0x7f3440009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61dd4338835d0476 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:05.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.873+0000 7f3447fff700 1 -- 172.21.15.40:0/1754655700 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3440004230 con 0x7f34500c1960 2023-06-22T10:54:05.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.873+0000 7f3447fff700 1 -- 172.21.15.40:0/1754655700 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3440004390 con 0x7f34500c1960 2023-06-22T10:54:05.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.873+0000 7f3447fff700 1 -- 172.21.15.40:0/1754655700 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34400036a0 con 0x7f34500c1960 2023-06-22T10:54:05.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.874+0000 7f34579ff700 1 -- 172.21.15.40:0/1754655700 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34500c1960 msgr2=0x7f34500c1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:05.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.874+0000 7f34579ff700 1 --2- 172.21.15.40:0/1754655700 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34500c1960 0x7f34500c1dc0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3440009840 tx=0x7f3440009b50 comp rx=0 tx=0).stop 2023-06-22T10:54:05.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.874+0000 7f34579ff700 1 -- 172.21.15.40:0/1754655700 shutdown_connections 2023-06-22T10:54:05.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.874+0000 7f34579ff700 1 --2- 172.21.15.40:0/1754655700 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34500c1960 0x7f34500c1dc0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:05.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.874+0000 7f34579ff700 1 -- 172.21.15.40:0/1754655700 >> 172.21.15.40:0/1754655700 conn(0x7f34500b0ff0 msgr2=0x7f34500ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:05.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.874+0000 7f34579ff700 1 -- 172.21.15.40:0/1754655700 shutdown_connections 2023-06-22T10:54:05.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.874+0000 7f34579ff700 1 -- 172.21.15.40:0/1754655700 wait complete. 2023-06-22T10:54:05.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.875+0000 7f77147ff700 1 Processor -- start 2023-06-22T10:54:05.883 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.878+0000 7f2723bff700 1 Processor -- start 2023-06-22T10:54:05.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.877+0000 7f34579ff700 1 Processor -- start 2023-06-22T10:54:05.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.876+0000 7f77147ff700 1 -- start start 2023-06-22T10:54:05.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.878+0000 7f77147ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f770c1609a0 0x7f770c0cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:05.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.878+0000 7f77147ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f770c0cc400 con 0x7f770c06dc90 2023-06-22T10:54:05.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.878+0000 7f77147ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f770c06cbb0 con 0x7f770c0c1960 2023-06-22T10:54:05.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.878+0000 7f77147ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f770c06daf0 con 0x7f770c1609a0 2023-06-22T10:54:05.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.879+0000 7f7712d9c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f770c0c1960 0x7f770c069f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.40:35796/0 (socket says 172.21.15.40:35796) 2023-06-22T10:54:05.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.879+0000 7f7712d9c700 1 -- 172.21.15.40:0/1591330110 learned_addr learned my addr 172.21.15.40:0/1591330110 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:05.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.878+0000 7f2723bff700 1 -- start start 2023-06-22T10:54:05.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.880+0000 7f2723bff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f271c15c4a0 0x7f271c0d1980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:05.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.880+0000 7f2723bff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f271c15c870 0x7f271c0cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:05.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.880+0000 7f2723bff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f271c0d08e0 con 0x7f271c0cd930 2023-06-22T10:54:05.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.880+0000 7f2723bff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f271c0d0bc0 con 0x7f271c15c4a0 2023-06-22T10:54:05.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.880+0000 7f2723bff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f271c0d0ea0 con 0x7f271c15c870 2023-06-22T10:54:05.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.881+0000 7f272219c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f271c0cd930 0x7f271c0b4660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.40:35806/0 (socket says 172.21.15.40:35806) 2023-06-22T10:54:05.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.881+0000 7f272219c700 1 -- 172.21.15.40:0/3123115061 learned_addr learned my addr 172.21.15.40:0/3123115061 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:05.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.881+0000 7f272199b700 1 --2- 172.21.15.40:0/3123115061 >> v2:172.21.15.45:3300/0 conn(0x7f271c15c4a0 0x7f271c0d1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:05.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.881+0000 7f272199b700 1 -- 172.21.15.40:0/3123115061 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f271c15c870 msgr2=0x7f271c0cd3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-06-22T10:54:05.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.881+0000 7f272199b700 1 --2- 172.21.15.40:0/3123115061 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f271c15c870 0x7f271c0cd3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:05.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.881+0000 7f272199b700 1 -- 172.21.15.40:0/3123115061 >> v1:172.21.15.45:6789/0 conn(0x7f271c0cd930 legacy=0x7f271c0b4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:05.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.881+0000 7f272199b700 1 -- 172.21.15.40:0/3123115061 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f271c0d1180 con 0x7f271c15c4a0 2023-06-22T10:54:05.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.882+0000 7f272199b700 1 --2- 172.21.15.40:0/3123115061 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f271c15c4a0 0x7f271c0d1980 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2718009840 tx=0x7f2718009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b2df5631fdb9944 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:05.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.877+0000 7f34579ff700 1 -- start start 2023-06-22T10:54:05.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.879+0000 7f34579ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f34500c1960 0x7f3450162ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:05.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.879+0000 7f34579ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34500cf0d0 0x7f34502029a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:05.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.879+0000 7f34579ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34501609a0 0x7f3450202ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:05.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.879+0000 7f34579ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34500c4630 con 0x7f34500cf0d0 2023-06-22T10:54:05.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.879+0000 7f34579ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34500c4910 con 0x7f34501609a0 2023-06-22T10:54:05.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.879+0000 7f34579ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34500c4bf0 con 0x7f34500c1960 2023-06-22T10:54:05.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.880+0000 7f345579b700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f34500c1960 0x7f3450162ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:05.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.880+0000 7f345579b700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f34500c1960 0x7f3450162ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3301/0 says I am v2:172.21.15.40:48890/0 (socket says 172.21.15.40:48890) 2023-06-22T10:54:05.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.880+0000 7f345579b700 1 -- 172.21.15.40:0/490040788 learned_addr learned my addr 172.21.15.40:0/490040788 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:05.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.880+0000 7f771259b700 1 --2- 172.21.15.40:0/1591330110 >> v2:172.21.15.40:3300/0 conn(0x7f770c1609a0 0x7f770c0cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:05.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.881+0000 7f771259b700 1 -- 172.21.15.40:0/1591330110 >> v1:172.21.15.45:6789/0 conn(0x7f770c0c1960 legacy=0x7f770c069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:05.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.881+0000 7f771259b700 1 -- 172.21.15.40:0/1591330110 >> v1:172.21.15.40:6789/0 conn(0x7f770c06dc90 legacy=0x7f770c06c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:05.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.881+0000 7f771259b700 1 -- 172.21.15.40:0/1591330110 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f770c070e50 con 0x7f770c1609a0 2023-06-22T10:54:05.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.881+0000 7f771259b700 1 --2- 172.21.15.40:0/1591330110 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f770c1609a0 0x7f770c0cf0d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7708009840 tx=0x7f7708009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=469a5d146641b472 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:05.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.882+0000 7f7711599700 1 -- 172.21.15.40:0/1591330110 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7708004230 con 0x7f770c1609a0 2023-06-22T10:54:05.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.882+0000 7f7711599700 1 -- 172.21.15.40:0/1591330110 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7708004390 con 0x7f770c1609a0 2023-06-22T10:54:05.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.882+0000 7f7711599700 1 -- 172.21.15.40:0/1591330110 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77080036a0 con 0x7f770c1609a0 2023-06-22T10:54:05.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.882+0000 7f3454f9a700 1 --2- 172.21.15.40:0/490040788 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34500cf0d0 0x7f34502029a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:05.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.882+0000 7f3455f9c700 1 --2- 172.21.15.40:0/490040788 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34501609a0 0x7f3450202ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:05.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.883+0000 7f345579b700 1 -- 172.21.15.40:0/490040788 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34501609a0 msgr2=0x7f3450202ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:05.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.883+0000 7f345579b700 1 --2- 172.21.15.40:0/490040788 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34501609a0 0x7f3450202ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:05.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.883+0000 7f345579b700 1 -- 172.21.15.40:0/490040788 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34500cf0d0 msgr2=0x7f34502029a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:05.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.883+0000 7f345579b700 1 --2- 172.21.15.40:0/490040788 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34500cf0d0 0x7f34502029a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:05.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.883+0000 7f345579b700 1 -- 172.21.15.40:0/490040788 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34400094a0 con 0x7f34500c1960 2023-06-22T10:54:05.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.883+0000 7f77147ff700 1 -- 172.21.15.40:0/1591330110 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f770c1609a0 msgr2=0x7f770c0cf0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:05.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.883+0000 7f77147ff700 1 --2- 172.21.15.40:0/1591330110 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f770c1609a0 0x7f770c0cf0d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7708009840 tx=0x7f7708009b50 comp rx=0 tx=0).stop 2023-06-22T10:54:05.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.883+0000 7f77147ff700 1 -- 172.21.15.40:0/1591330110 shutdown_connections 2023-06-22T10:54:05.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.883+0000 7f77147ff700 1 --2- 172.21.15.40:0/1591330110 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f770c1609a0 0x7f770c0cf0d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:05.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.883+0000 7f77147ff700 1 -- 172.21.15.40:0/1591330110 >> 172.21.15.40:0/1591330110 conn(0x7f770c0b0ff0 msgr2=0x7f770c0ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:05.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.883+0000 7f345579b700 1 --2- 172.21.15.40:0/490040788 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f34500c1960 0x7f3450162ff0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f344800ba50 tx=0x7f344800bd60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:05.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.883+0000 7f77147ff700 1 -- 172.21.15.40:0/1591330110 shutdown_connections 2023-06-22T10:54:05.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.883+0000 7f2720999700 1 -- 172.21.15.40:0/3123115061 <== mon.1 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2718011830 con 0x7f271c15c4a0 2023-06-22T10:54:05.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.883+0000 7f2720999700 1 -- 172.21.15.40:0/3123115061 <== mon.1 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2718011990 con 0x7f271c15c4a0 2023-06-22T10:54:05.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.883+0000 7f2720999700 1 -- 172.21.15.40:0/3123115061 <== mon.1 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2718011d20 con 0x7f271c15c4a0 2023-06-22T10:54:05.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.884+0000 7f5aa2bff700 1 Processor -- start 2023-06-22T10:54:05.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.884+0000 7f2723bff700 1 -- 172.21.15.40:0/3123115061 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f271c15c4a0 msgr2=0x7f271c0d1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:05.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.884+0000 7f2723bff700 1 --2- 172.21.15.40:0/3123115061 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f271c15c4a0 0x7f271c0d1980 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2718009840 tx=0x7f2718009b50 comp rx=0 tx=0).stop 2023-06-22T10:54:05.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.884+0000 7f5aa2bff700 1 -- start start 2023-06-22T10:54:05.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.886+0000 7f3445ffb700 1 -- 172.21.15.40:0/490040788 <== mon.2 v2:172.21.15.45:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344800c930 con 0x7f34500c1960 2023-06-22T10:54:05.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.886+0000 7f99163ff700 1 Processor -- start 2023-06-22T10:54:05.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.886+0000 7f3445ffb700 1 -- 172.21.15.40:0/490040788 <== mon.2 v2:172.21.15.45:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f344800cad0 con 0x7f34500c1960 2023-06-22T10:54:05.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.886+0000 7f3445ffb700 1 -- 172.21.15.40:0/490040788 <== mon.2 v2:172.21.15.45:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344800ce80 con 0x7f34500c1960 2023-06-22T10:54:05.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.887+0000 7f99163ff700 1 -- start start 2023-06-22T10:54:05.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.887+0000 7f34579ff700 1 -- 172.21.15.40:0/490040788 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34500c4ed0 con 0x7f34500c1960 2023-06-22T10:54:05.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.887+0000 7f34579ff700 1 -- 172.21.15.40:0/490040788 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3450163710 con 0x7f34500c1960 2023-06-22T10:54:05.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.886+0000 7f5aa2bff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5a9c0cef40 0x7f5a9c15bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:05.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.886+0000 7f5aa2bff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5a9c15ccd0 0x7f5a9c0cc550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:05.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.886+0000 7f5aa2bff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f5a9c0ad730 0x7f5a9c0adbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:05.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.887+0000 7f5aa2bff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a9c0ae0f0 con 0x7f5a9c0cef40 2023-06-22T10:54:05.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.887+0000 7f5aa2bff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a9c0cd130 con 0x7f5a9c15ccd0 2023-06-22T10:54:05.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.887+0000 7f5aa2bff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9c070440 con 0x7f5a9c0ad730 2023-06-22T10:54:05.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.887+0000 7f2723bff700 1 -- 172.21.15.40:0/3123115061 shutdown_connections 2023-06-22T10:54:05.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.887+0000 7f2723bff700 1 --2- 172.21.15.40:0/3123115061 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f271c15c4a0 0x7f271c0d1980 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:05.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.887+0000 7f2723bff700 1 --2- 172.21.15.40:0/3123115061 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f271c15c870 0x7f271c0cd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:05.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.887+0000 7f2723bff700 1 -- 172.21.15.40:0/3123115061 >> 172.21.15.40:0/3123115061 conn(0x7f271c0cf660 msgr2=0x7f271c0cfa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:05.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.888+0000 7f2723bff700 1 -- 172.21.15.40:0/3123115061 shutdown_connections 2023-06-22T10:54:05.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.888+0000 7f2723bff700 1 -- 172.21.15.40:0/3123115061 wait complete. 2023-06-22T10:54:05.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.889+0000 7f5aa099b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5a9c0cef40 0x7f5a9c15bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:05.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.889+0000 7f5aa099b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5a9c0cef40 0x7f5a9c15bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50886/0 (socket says 172.21.15.40:50886) 2023-06-22T10:54:05.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.889+0000 7f5aa099b700 1 -- 172.21.15.40:0/209235071 learned_addr learned my addr 172.21.15.40:0/209235071 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:05.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.889+0000 7f5aa099b700 1 -- 172.21.15.40:0/209235071 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f5a9c0ad730 msgr2=0x7f5a9c0adbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:05.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.889+0000 7f5aa099b700 1 --2- 172.21.15.40:0/209235071 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f5a9c0ad730 0x7f5a9c0adbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:05.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.889+0000 7f5aa099b700 1 -- 172.21.15.40:0/209235071 >> v2:172.21.15.45:3300/0 conn(0x7f5a9c15ccd0 msgr2=0x7f5a9c0cc550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:05.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.889+0000 7f5aa099b700 1 --2- 172.21.15.40:0/209235071 >> v2:172.21.15.45:3300/0 conn(0x7f5a9c15ccd0 0x7f5a9c0cc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:05.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.890+0000 7f5aa099b700 1 -- 172.21.15.40:0/209235071 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a9c0cce50 con 0x7f5a9c0cef40 2023-06-22T10:54:05.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.890+0000 7f5aa099b700 1 --2- 172.21.15.40:0/209235071 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a9c0cef40 0x7f5a9c15bac0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c15c000 tx=0x7f5a98009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6833e206abaa5c82 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:05.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.890+0000 7f34579ff700 1 -- 172.21.15.40:0/490040788 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34300052f0 con 0x7f34500c1960 2023-06-22T10:54:05.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.891+0000 7f5a937fe700 1 -- 172.21.15.40:0/209235071 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a9800b870 con 0x7f5a9c0cef40 2023-06-22T10:54:05.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.891+0000 7f5a937fe700 1 -- 172.21.15.40:0/209235071 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a9800b9d0 con 0x7f5a9c0cef40 2023-06-22T10:54:05.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.891+0000 7f5a937fe700 1 -- 172.21.15.40:0/209235071 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a9800bd60 con 0x7f5a9c0cef40 2023-06-22T10:54:05.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.891+0000 7f99163ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f99100ae640 0x7f9910070c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:05.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.891+0000 7f99163ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f99100cea30 0x7f991015ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:05.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.891+0000 7f99163ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99100ccc90 con 0x7f99100711d0 2023-06-22T10:54:05.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.891+0000 7f99163ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9910071670 con 0x7f99100ae640 2023-06-22T10:54:05.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.891+0000 7f99163ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f991015b7e0 con 0x7f99100cea30 2023-06-22T10:54:05.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.892+0000 7f5aa2bff700 1 -- 172.21.15.40:0/209235071 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a9c0cef40 msgr2=0x7f5a9c15bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:05.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.892+0000 7f5aa2bff700 1 --2- 172.21.15.40:0/209235071 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a9c0cef40 0x7f5a9c15bac0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c15c000 tx=0x7f5a98009bd0 comp rx=0 tx=0).stop 2023-06-22T10:54:05.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.891+0000 7f3445ffb700 1 -- 172.21.15.40:0/490040788 <== mon.2 v2:172.21.15.45:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f344801d3b0 con 0x7f34500c1960 2023-06-22T10:54:05.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.892+0000 7f2723bff700 1 Processor -- start 2023-06-22T10:54:05.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.884+0000 7f77147ff700 1 -- 172.21.15.40:0/1591330110 wait complete. 2023-06-22T10:54:05.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.888+0000 7f77147ff700 1 Processor -- start 2023-06-22T10:54:05.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.888+0000 7f77147ff700 1 -- start start 2023-06-22T10:54:05.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.890+0000 7f77147ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f770c06dc90 0x7f770c204a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:05.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.890+0000 7f77147ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f770c0c1960 0x7f770c0c3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:05.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.890+0000 7f77147ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f770c1609a0 0x7f770c162f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:05.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.890+0000 7f77147ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f770c0c81c0 con 0x7f770c0c1960 2023-06-22T10:54:05.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.890+0000 7f77147ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f770c208610 con 0x7f770c1609a0 2023-06-22T10:54:05.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.890+0000 7f77147ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f770c207720 con 0x7f770c06dc90 2023-06-22T10:54:05.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.891+0000 7f771259b700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f770c06dc90 0x7f770c204a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:05.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.891+0000 7f7712d9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f770c1609a0 0x7f770c162f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:05.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.891+0000 7f771259b700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f770c06dc90 0x7f770c204a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3301/0 says I am v2:172.21.15.40:48914/0 (socket says 172.21.15.40:48914) 2023-06-22T10:54:05.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.891+0000 7f771259b700 1 -- 172.21.15.40:0/1518659760 learned_addr learned my addr 172.21.15.40:0/1518659760 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:05.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.892+0000 7f771259b700 1 -- 172.21.15.40:0/1518659760 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f770c1609a0 msgr2=0x7f770c162f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:05.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.892+0000 7f771259b700 1 --2- 172.21.15.40:0/1518659760 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f770c1609a0 0x7f770c162f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:05.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.892+0000 7f771259b700 1 -- 172.21.15.40:0/1518659760 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f770c0c1960 msgr2=0x7f770c0c3560 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-06-22T10:54:05.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.892+0000 7f771259b700 1 --2- 172.21.15.40:0/1518659760 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f770c0c1960 0x7f770c0c3560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:05.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.892+0000 7f771259b700 1 -- 172.21.15.40:0/1518659760 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77080094a0 con 0x7f770c06dc90 2023-06-22T10:54:05.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.892+0000 7f771259b700 1 --2- 172.21.15.40:0/1518659760 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f770c06dc90 0x7f770c204a30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7708000c00 tx=0x7f77080047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:05.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.892+0000 7f5aa2bff700 1 -- 172.21.15.40:0/209235071 shutdown_connections 2023-06-22T10:54:05.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.892+0000 7f5aa2bff700 1 --2- 172.21.15.40:0/209235071 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f5a9c0ad730 0x7f5a9c0adbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:05.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.892+0000 7f5aa2bff700 1 --2- 172.21.15.40:0/209235071 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a9c0cef40 0x7f5a9c15bac0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:05.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.892+0000 7f5aa2bff700 1 --2- 172.21.15.40:0/209235071 >> v2:172.21.15.45:3300/0 conn(0x7f5a9c15ccd0 0x7f5a9c0cc550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:05.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.892+0000 7f5aa2bff700 1 -- 172.21.15.40:0/209235071 >> 172.21.15.40:0/209235071 conn(0x7f5a9c0b0fe0 msgr2=0x7f5a9c0ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:05.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.892+0000 7f990f7fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f99100711d0 0x7f99100ce320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:58574/0 (socket says 172.21.15.40:58574) 2023-06-22T10:54:05.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.892+0000 7f990f7fe700 1 -- 172.21.15.40:0/2845899140 learned_addr learned my addr 172.21.15.40:0/2845899140 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:05.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.893+0000 7f5aa2bff700 1 -- 172.21.15.40:0/209235071 shutdown_connections 2023-06-22T10:54:05.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.893+0000 7f5aa2bff700 1 -- 172.21.15.40:0/209235071 wait complete. 2023-06-22T10:54:05.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.894+0000 7f991499c700 1 --2- 172.21.15.40:0/2845899140 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f99100cea30 0x7f991015ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:05.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.894+0000 7f3445ffb700 1 --2- 172.21.15.40:0/490040788 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f343406adb0 0x7f343406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:05.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.894+0000 7f3445ffb700 1 -- 172.21.15.40:0/490040788 <== mon.2 v2:172.21.15.45:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3448089130 con 0x7f34500c1960 2023-06-22T10:54:05.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.894+0000 7f990effd700 1 -- 172.21.15.40:0/2845899140 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1405172011 0 0) 0x7f99100ccc90 con 0x7f99100711d0 2023-06-22T10:54:05.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.894+0000 7f990ffff700 1 --2- 172.21.15.40:0/2845899140 >> v2:172.21.15.45:3300/0 conn(0x7f99100ae640 0x7f9910070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:05.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.894+0000 7f990effd700 1 -- 172.21.15.40:0/2845899140 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98f80035b0 con 0x7f99100711d0 2023-06-22T10:54:05.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.893+0000 7f2723bff700 1 -- start start 2023-06-22T10:54:05.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.894+0000 7f2723bff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f271c0cd930 0x7f271c0c90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:05.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.894+0000 7f2723bff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f271c15c4a0 0x7f271c1f5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:05.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.894+0000 7f2723bff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f271c15c870 0x7f271c0cc060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:05.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.894+0000 7f2723bff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f271c14a8c0 con 0x7f271c15c870 2023-06-22T10:54:05.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.894+0000 7f2723bff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f271c0c87f0 con 0x7f271c15c4a0 2023-06-22T10:54:05.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.894+0000 7f2723bff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f271c0c7be0 con 0x7f271c0cd930 2023-06-22T10:54:05.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.895+0000 7f272119a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f271c15c4a0 0x7f271c1f5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:05.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.895+0000 7f272119a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f271c15c4a0 0x7f271c1f5a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.40:47174/0 (socket says 172.21.15.40:47174) 2023-06-22T10:54:05.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.895+0000 7f272119a700 1 -- 172.21.15.40:0/4024863834 learned_addr learned my addr 172.21.15.40:0/4024863834 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:05.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.895+0000 7f272199b700 1 --2- 172.21.15.40:0/4024863834 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f271c0cd930 0x7f271c0c90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:05.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.895+0000 7f990effd700 1 -- 172.21.15.40:0/2845899140 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 268492794 0 0) 0x7f98f80035b0 con 0x7f99100711d0 2023-06-22T10:54:05.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.895+0000 7f990effd700 1 -- 172.21.15.40:0/2845899140 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f99100cea30 msgr2=0x7f991015ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:05.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.895+0000 7f990effd700 1 --2- 172.21.15.40:0/2845899140 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f99100cea30 0x7f991015ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:05.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.895+0000 7f990effd700 1 -- 172.21.15.40:0/2845899140 >> v2:172.21.15.45:3300/0 conn(0x7f99100ae640 msgr2=0x7f9910070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:05.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.895+0000 7f990effd700 1 --2- 172.21.15.40:0/2845899140 >> v2:172.21.15.45:3300/0 conn(0x7f99100ae640 0x7f9910070c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:05.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.895+0000 7f990effd700 1 -- 172.21.15.40:0/2845899140 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99100cd810 con 0x7f99100711d0 2023-06-22T10:54:05.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.895+0000 7f990effd700 1 -- 172.21.15.40:0/2845899140 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1490606486 0 0) 0x7f9904001670 con 0x7f99100711d0 2023-06-22T10:54:05.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.895+0000 7f990effd700 1 -- 172.21.15.40:0/2845899140 >> v1:172.21.15.40:6789/0 conn(0x7f99100711d0 legacy=0x7f99100ce320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:05.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.895+0000 7f990effd700 1 --2- 172.21.15.40:0/2845899140 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98f8003a00 0x7f98f8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:05.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.895+0000 7f990effd700 1 --2- 172.21.15.40:0/2845899140 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98f8004430 0x7f98f80048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:05.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.895+0000 7f990effd700 1 --2- 172.21.15.40:0/2845899140 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f98f8004f60 0x7f98f800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:05.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.895+0000 7f990effd700 1 -- 172.21.15.40:0/2845899140 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f991015b7e0 con 0x7f98f8004430 2023-06-22T10:54:05.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.896+0000 7f272119a700 1 -- 172.21.15.40:0/4024863834 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f271c0cd930 msgr2=0x7f271c0c90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:05.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.896+0000 7f272119a700 1 --2- 172.21.15.40:0/4024863834 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f271c0cd930 0x7f271c0c90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:05.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.896+0000 7f272119a700 1 -- 172.21.15.40:0/4024863834 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f271c15c870 msgr2=0x7f271c0cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:05.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.896+0000 7f272119a700 1 --2- 172.21.15.40:0/4024863834 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f271c15c870 0x7f271c0cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:05.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.896+0000 7f272119a700 1 -- 172.21.15.40:0/4024863834 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27180094a0 con 0x7f271c15c4a0 2023-06-22T10:54:05.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.895+0000 7f990effd700 1 -- 172.21.15.40:0/2845899140 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f8005720 con 0x7f98f8003a00 2023-06-22T10:54:05.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.895+0000 7f990effd700 1 -- 172.21.15.40:0/2845899140 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98f800bfd0 con 0x7f98f8004f60 2023-06-22T10:54:05.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.895+0000 7f990f7fe700 1 --2- 172.21.15.40:0/2845899140 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98f8004430 0x7f98f80048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:05.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.896+0000 7f5aa2bff700 1 Processor -- start 2023-06-22T10:54:05.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.896+0000 7f3454f9a700 1 --2- 172.21.15.40:0/490040788 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f343406adb0 0x7f343406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:05.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.896+0000 7f990f7fe700 1 -- 172.21.15.40:0/2845899140 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f98f8004f60 msgr2=0x7f98f800ba10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-06-22T10:54:05.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.896+0000 7f990f7fe700 1 --2- 172.21.15.40:0/2845899140 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f98f8004f60 0x7f98f800ba10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:05.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.896+0000 7f990f7fe700 1 -- 172.21.15.40:0/2845899140 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98f8003a00 msgr2=0x7f98f8003e10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-22T10:54:05.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.896+0000 7f990f7fe700 1 --2- 172.21.15.40:0/2845899140 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98f8003a00 0x7f98f8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:05.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.896+0000 7f990f7fe700 1 -- 172.21.15.40:0/2845899140 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99100cd810 con 0x7f98f8004430 2023-06-22T10:54:05.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.897+0000 7f272119a700 1 --2- 172.21.15.40:0/4024863834 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f271c15c4a0 0x7f271c1f5a20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f271400b840 tx=0x7f271400bc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:05.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.897+0000 7f27127fc700 1 -- 172.21.15.40:0/4024863834 <== mon.1 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271400d890 con 0x7f271c15c4a0 2023-06-22T10:54:05.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.897+0000 7f27127fc700 1 -- 172.21.15.40:0/4024863834 <== mon.1 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f271400d9f0 con 0x7f271c15c4a0 2023-06-22T10:54:05.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.897+0000 7f27127fc700 1 -- 172.21.15.40:0/4024863834 <== mon.1 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271400dda0 con 0x7f271c15c4a0 2023-06-22T10:54:05.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.897+0000 7f990f7fe700 1 --2- 172.21.15.40:0/2845899140 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98f8004430 0x7f98f80048f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f990400c2f0 tx=0x7f98f8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da4c423c1ff38b66 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:05.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.897+0000 7f2723bff700 1 -- 172.21.15.40:0/4024863834 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f271c0c7ec0 con 0x7f271c15c4a0 2023-06-22T10:54:05.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.898+0000 7f2723bff700 1 -- 172.21.15.40:0/4024863834 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f271c0c8480 con 0x7f271c15c4a0 2023-06-22T10:54:05.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.900+0000 7f3454f9a700 1 --2- 172.21.15.40:0/490040788 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f343406adb0 0x7f343406d260 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f344c0013c0 tx=0x7f344c001350 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:05.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.898+0000 7f7702ffd700 1 -- 172.21.15.40:0/1518659760 <== mon.2 v2:172.21.15.45:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7708011630 con 0x7f770c06dc90 2023-06-22T10:54:05.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.898+0000 7f7702ffd700 1 -- 172.21.15.40:0/1518659760 <== mon.2 v2:172.21.15.45:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7708011790 con 0x7f770c06dc90 2023-06-22T10:54:05.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.898+0000 7f7702ffd700 1 -- 172.21.15.40:0/1518659760 <== mon.2 v2:172.21.15.45:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7708011b20 con 0x7f770c06dc90 2023-06-22T10:54:05.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.899+0000 7f77147ff700 1 -- 172.21.15.40:0/1518659760 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f770c207a00 con 0x7f770c06dc90 2023-06-22T10:54:05.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.899+0000 7f77147ff700 1 -- 172.21.15.40:0/1518659760 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f770c207fc0 con 0x7f770c06dc90 2023-06-22T10:54:05.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.896+0000 7f5aa2bff700 1 -- start start 2023-06-22T10:54:05.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.898+0000 7f5aa2bff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a9c0ad730 0x7f5a9c144900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:05.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.898+0000 7f5aa2bff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f5a9c0cef40 0x7f5a9c0c4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:05.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.898+0000 7f5aa2bff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a9c15ccd0 0x7f5a9c0c60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:05.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.898+0000 7f5aa2bff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9c144e40 con 0x7f5a9c0ad730 2023-06-22T10:54:05.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.898+0000 7f5aa2bff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9c0c23c0 con 0x7f5a9c15ccd0 2023-06-22T10:54:05.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.898+0000 7f5aa2bff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9c0c26a0 con 0x7f5a9c0cef40 2023-06-22T10:54:05.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.898+0000 7f5a93fff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f5a9c0cef40 0x7f5a9c0c4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:05.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.898+0000 7f5a93fff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f5a9c0cef40 0x7f5a9c0c4bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3301/0 says I am v2:172.21.15.40:48954/0 (socket says 172.21.15.40:48954) 2023-06-22T10:54:05.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.898+0000 7f5a93fff700 1 -- 172.21.15.40:0/1511449943 learned_addr learned my addr 172.21.15.40:0/1511449943 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:05.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.899+0000 7f5aa119c700 1 --2- 172.21.15.40:0/1511449943 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a9c15ccd0 0x7f5a9c0c60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:05.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.898+0000 7f990effd700 1 -- 172.21.15.40:0/2845899140 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990400ce30 con 0x7f98f8004430 2023-06-22T10:54:05.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.898+0000 7f990effd700 1 -- 172.21.15.40:0/2845899140 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9904005960 con 0x7f98f8004430 2023-06-22T10:54:05.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.898+0000 7f990effd700 1 -- 172.21.15.40:0/2845899140 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9904005d10 con 0x7f98f8004430 2023-06-22T10:54:05.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.899+0000 7f99163ff700 1 -- 172.21.15.40:0/2845899140 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98f8004430 msgr2=0x7f98f80048f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:05.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.899+0000 7f99163ff700 1 --2- 172.21.15.40:0/2845899140 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98f8004430 0x7f98f80048f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f990400c2f0 tx=0x7f98f8005880 comp rx=0 tx=0).stop 2023-06-22T10:54:05.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.899+0000 7f991499c700 1 -- 172.21.15.40:0/2845899140 reap_dead start 2023-06-22T10:54:05.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.899+0000 7f99163ff700 1 -- 172.21.15.40:0/2845899140 shutdown_connections 2023-06-22T10:54:05.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.899+0000 7f99163ff700 1 -- 172.21.15.40:0/2845899140 >> 172.21.15.40:0/2845899140 conn(0x7f99100cf0c0 msgr2=0x7f99100cf490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:05.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.900+0000 7f99163ff700 1 -- 172.21.15.40:0/2845899140 shutdown_connections 2023-06-22T10:54:05.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.901+0000 7f3445ffb700 1 -- 172.21.15.40:0/490040788 <== mon.2 v2:172.21.15.45:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3448053f80 con 0x7f34500c1960 2023-06-22T10:54:05.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.900+0000 7f5a93fff700 1 -- 172.21.15.40:0/1511449943 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a9c15ccd0 msgr2=0x7f5a9c0c60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:05.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.900+0000 7f5a93fff700 1 --2- 172.21.15.40:0/1511449943 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a9c15ccd0 0x7f5a9c0c60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:05.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.900+0000 7f5a93fff700 1 -- 172.21.15.40:0/1511449943 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a9c0ad730 msgr2=0x7f5a9c144900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:05.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.900+0000 7f5a93fff700 1 --2- 172.21.15.40:0/1511449943 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a9c0ad730 0x7f5a9c144900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:05.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.900+0000 7f5a93fff700 1 -- 172.21.15.40:0/1511449943 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a98009550 con 0x7f5a9c0cef40 2023-06-22T10:54:05.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.901+0000 7f5a93fff700 1 --2- 172.21.15.40:0/1511449943 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f5a9c0cef40 0x7f5a9c0c4bb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c00b450 tx=0x7f5a8c00b760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:05.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.901+0000 7f77147ff700 1 -- 172.21.15.40:0/1518659760 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f770c0ccea0 con 0x7f770c06dc90 2023-06-22T10:54:05.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.901+0000 7f99163ff700 1 -- 172.21.15.40:0/2845899140 wait complete. 2023-06-22T10:54:05.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.902+0000 7f2723bff700 1 -- 172.21.15.40:0/4024863834 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27040052f0 con 0x7f271c15c4a0 2023-06-22T10:54:05.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.904+0000 7f5a917fa700 1 -- 172.21.15.40:0/1511449943 <== mon.2 v2:172.21.15.45:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8c011830 con 0x7f5a9c0cef40 2023-06-22T10:54:05.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.904+0000 7f5a917fa700 1 -- 172.21.15.40:0/1511449943 <== mon.2 v2:172.21.15.45:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a8c011990 con 0x7f5a9c0cef40 2023-06-22T10:54:05.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.904+0000 7f5a917fa700 1 -- 172.21.15.40:0/1511449943 <== mon.2 v2:172.21.15.45:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8c011d20 con 0x7f5a9c0cef40 2023-06-22T10:54:05.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.905+0000 7f5aa2bff700 1 -- 172.21.15.40:0/1511449943 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a9c0c2980 con 0x7f5a9c0cef40 2023-06-22T10:54:05.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.905+0000 7f5aa2bff700 1 -- 172.21.15.40:0/1511449943 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a9c1450e0 con 0x7f5a9c0cef40 2023-06-22T10:54:05.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.904+0000 7f99163ff700 1 Processor -- start 2023-06-22T10:54:05.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.904+0000 7f99163ff700 1 -- start start 2023-06-22T10:54:05.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.906+0000 7f99163ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f991014d5b0 0x7f99100b4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:05.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.906+0000 7f99163ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f99100c8430 0x7f99100c6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:05.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.906+0000 7f99163ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f991014d980 0x7f99100c66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:05.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.906+0000 7f99163ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99100b29a0 con 0x7f991014d5b0 2023-06-22T10:54:05.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.906+0000 7f99163ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99100b2c40 con 0x7f991014d980 2023-06-22T10:54:05.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.906+0000 7f99163ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99100b2f20 con 0x7f99100c8430 2023-06-22T10:54:05.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.904+0000 7f27127fc700 1 -- 172.21.15.40:0/4024863834 <== mon.1 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f27140203f0 con 0x7f271c15c4a0 2023-06-22T10:54:05.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.905+0000 7f27127fc700 1 --2- 172.21.15.40:0/4024863834 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f270006adb0 0x7f270006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:05.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.906+0000 7f27127fc700 1 -- 172.21.15.40:0/4024863834 <== mon.1 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2714089840 con 0x7f271c15c4a0 2023-06-22T10:54:05.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.907+0000 7f272199b700 1 --2- 172.21.15.40:0/4024863834 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f270006adb0 0x7f270006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:05.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.906+0000 7f990f7fe700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f99100c8430 0x7f99100c6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:05.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.907+0000 7f990ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f991014d5b0 0x7f99100b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:05.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.907+0000 7f990ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f991014d5b0 0x7f99100b4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50930/0 (socket says 172.21.15.40:50930) 2023-06-22T10:54:05.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.907+0000 7f990ffff700 1 -- 172.21.15.40:0/2272498885 learned_addr learned my addr 172.21.15.40:0/2272498885 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:05.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.908+0000 7f272199b700 1 --2- 172.21.15.40:0/4024863834 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f270006adb0 0x7f270006d260 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f27180090b0 tx=0x7f2718008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:05.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.908+0000 7f5aa2bff700 1 -- 172.21.15.40:0/1511449943 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a9c067580 con 0x7f5a9c0cef40 2023-06-22T10:54:05.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.908+0000 7f991499c700 1 --2- 172.21.15.40:0/2272498885 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f991014d980 0x7f99100c66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:05.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.909+0000 7f83c55ff700 1 Processor -- start 2023-06-22T10:54:05.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.909+0000 7f990ffff700 1 -- 172.21.15.40:0/2272498885 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f99100c8430 msgr2=0x7f99100c6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:05.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.909+0000 7f990ffff700 1 --2- 172.21.15.40:0/2272498885 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f99100c8430 0x7f99100c6190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:05.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.909+0000 7f990ffff700 1 -- 172.21.15.40:0/2272498885 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f991014d980 msgr2=0x7f99100c66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:05.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.909+0000 7f990ffff700 1 --2- 172.21.15.40:0/2272498885 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f991014d980 0x7f99100c66d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:05.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.909+0000 7f990ffff700 1 -- 172.21.15.40:0/2272498885 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99100b3200 con 0x7f991014d5b0 2023-06-22T10:54:05.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.909+0000 7f991499c700 1 --2- 172.21.15.40:0/2272498885 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f991014d980 0x7f99100c66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-22T10:54:05.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.909+0000 7f990ffff700 1 --2- 172.21.15.40:0/2272498885 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f991014d5b0 0x7f99100b4420 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f990000e860 tx=0x7f990000ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:05.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.911+0000 7f27127fc700 1 -- 172.21.15.40:0/4024863834 <== mon.1 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f27140545e0 con 0x7f271c15c4a0 2023-06-22T10:54:05.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.910+0000 7f990cff9700 1 -- 172.21.15.40:0/2272498885 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990000ee60 con 0x7f991014d5b0 2023-06-22T10:54:05.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.910+0000 7f990cff9700 1 -- 172.21.15.40:0/2272498885 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f990000c850 con 0x7f991014d5b0 2023-06-22T10:54:05.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.910+0000 7f990cff9700 1 -- 172.21.15.40:0/2272498885 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990000cc00 con 0x7f991014d5b0 2023-06-22T10:54:05.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.910+0000 7f99163ff700 1 -- 172.21.15.40:0/2272498885 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99100b34e0 con 0x7f991014d5b0 2023-06-22T10:54:05.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.910+0000 7f99163ff700 1 -- 172.21.15.40:0/2272498885 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99100c73b0 con 0x7f991014d5b0 2023-06-22T10:54:05.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.909+0000 7f83c55ff700 1 -- start start 2023-06-22T10:54:05.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.911+0000 7f83c55ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f83c015c4a0 0x7f83c00d1980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:05.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.911+0000 7f83c55ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f83c00b4660 0x7f83c00b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:05.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.911+0000 7f83c55ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83c00d08e0 con 0x7f83c015c870 2023-06-22T10:54:05.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.911+0000 7f83c55ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83c00b5040 con 0x7f83c00b4660 2023-06-22T10:54:05.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.911+0000 7f83c55ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83c00d0bc0 con 0x7f83c015c4a0 2023-06-22T10:54:05.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.912+0000 7f5a917fa700 1 -- 172.21.15.40:0/1511449943 <== mon.2 v2:172.21.15.45:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5a8c01a400 con 0x7f5a9c0cef40 2023-06-22T10:54:05.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.913+0000 7f83beffd700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f83c015c4a0 0x7f83c00d1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:05.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.913+0000 7f83be7fc700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f83c015c870 0x7f83c00cd3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:58588/0 (socket says 172.21.15.40:58588) 2023-06-22T10:54:05.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.913+0000 7f83be7fc700 1 -- 172.21.15.40:0/2321850202 learned_addr learned my addr 172.21.15.40:0/2321850202 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:05.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.913+0000 7f83bf7fe700 1 --2- 172.21.15.40:0/2321850202 >> v2:172.21.15.40:3300/0 conn(0x7f83c00b4660 0x7f83c00b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:05.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.914+0000 7f83beffd700 1 -- 172.21.15.40:0/2321850202 >> v2:172.21.15.40:3300/0 conn(0x7f83c00b4660 msgr2=0x7f83c00b4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:05.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.914+0000 7f83beffd700 1 --2- 172.21.15.40:0/2321850202 >> v2:172.21.15.40:3300/0 conn(0x7f83c00b4660 0x7f83c00b4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:05.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.914+0000 7f83beffd700 1 -- 172.21.15.40:0/2321850202 >> v1:172.21.15.40:6789/0 conn(0x7f83c015c870 legacy=0x7f83c00cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:05.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.914+0000 7f83beffd700 1 -- 172.21.15.40:0/2321850202 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c00d0ea0 con 0x7f83c015c4a0 2023-06-22T10:54:05.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.914+0000 7f83beffd700 1 --2- 172.21.15.40:0/2321850202 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f83c015c4a0 0x7f83c00d1980 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f83b4009840 tx=0x7f83b4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16fdcd92058f7b70 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:05.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.914+0000 7f5a917fa700 1 --2- 172.21.15.40:0/1511449943 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f5a8806adb0 0x7f5a8806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:05.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.914+0000 7f5a917fa700 1 -- 172.21.15.40:0/1511449943 <== mon.2 v2:172.21.15.45:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5a8c0896a0 con 0x7f5a9c0cef40 2023-06-22T10:54:05.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.915+0000 7f5aa099b700 1 --2- 172.21.15.40:0/1511449943 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f5a8806adb0 0x7f5a8806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:05.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.908+0000 7f7702ffd700 1 -- 172.21.15.40:0/1518659760 <== mon.2 v2:172.21.15.45:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7708011c80 con 0x7f770c06dc90 2023-06-22T10:54:05.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.910+0000 7f7702ffd700 1 --2- 172.21.15.40:0/1518659760 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f76f006adb0 0x7f76f006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:05.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.910+0000 7f7702ffd700 1 -- 172.21.15.40:0/1518659760 <== mon.2 v2:172.21.15.45:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f770808b670 con 0x7f770c06dc90 2023-06-22T10:54:05.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.911+0000 7f7702ffd700 1 -- 172.21.15.40:0/1518659760 <== mon.2 v2:172.21.15.45:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f770808baf0 con 0x7f770c06dc90 2023-06-22T10:54:05.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.911+0000 7f7711d9a700 1 --2- 172.21.15.40:0/1518659760 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f76f006adb0 0x7f76f006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:05.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.913+0000 7f7711d9a700 1 --2- 172.21.15.40:0/1518659760 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f76f006adb0 0x7f76f006d260 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f770c0cce70 tx=0x7f76fc007a20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:05.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.916+0000 7f83bdffb700 1 -- 172.21.15.40:0/2321850202 <== mon.2 v2:172.21.15.45:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b4004230 con 0x7f83c015c4a0 2023-06-22T10:54:05.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.916+0000 7f83bdffb700 1 -- 172.21.15.40:0/2321850202 <== mon.2 v2:172.21.15.45:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b4004390 con 0x7f83c015c4a0 2023-06-22T10:54:05.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.916+0000 7f83bdffb700 1 -- 172.21.15.40:0/2321850202 <== mon.2 v2:172.21.15.45:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b40036a0 con 0x7f83c015c4a0 2023-06-22T10:54:05.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.917+0000 7f83c55ff700 1 -- 172.21.15.40:0/2321850202 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f83c015c4a0 msgr2=0x7f83c00d1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:05.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.917+0000 7f83c55ff700 1 --2- 172.21.15.40:0/2321850202 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f83c015c4a0 0x7f83c00d1980 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f83b4009840 tx=0x7f83b4009b50 comp rx=0 tx=0).stop 2023-06-22T10:54:05.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.917+0000 7f5aa099b700 1 --2- 172.21.15.40:0/1511449943 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f5a8806adb0 0x7f5a8806d260 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5a98009c10 tx=0x7f5a98010000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:05.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.916+0000 7f99163ff700 1 -- 172.21.15.40:0/2272498885 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98f00052f0 con 0x7f991014d5b0 2023-06-22T10:54:05.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.917+0000 7f990cff9700 1 -- 172.21.15.40:0/2272498885 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f990000cd60 con 0x7f991014d5b0 2023-06-22T10:54:05.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.919+0000 7f990cff9700 1 --2- 172.21.15.40:0/2272498885 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f98fc06adb0 0x7f98fc06d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:05.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.919+0000 7f990cff9700 1 -- 172.21.15.40:0/2272498885 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9900089b30 con 0x7f991014d5b0 2023-06-22T10:54:05.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.920+0000 7f990f7fe700 1 --2- 172.21.15.40:0/2272498885 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f98fc06adb0 0x7f98fc06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:05.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.921+0000 7f83c55ff700 1 -- 172.21.15.40:0/2321850202 shutdown_connections 2023-06-22T10:54:05.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.921+0000 7f83c55ff700 1 --2- 172.21.15.40:0/2321850202 >> v2:172.21.15.40:3300/0 conn(0x7f83c00b4660 0x7f83c00b4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:05.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.921+0000 7f83c55ff700 1 --2- 172.21.15.40:0/2321850202 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f83c015c4a0 0x7f83c00d1980 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:05.953 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.921+0000 7f83c55ff700 1 -- 172.21.15.40:0/2321850202 >> 172.21.15.40:0/2321850202 conn(0x7f83c00cf660 msgr2=0x7f83c00cfa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:05.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.921+0000 7f83c55ff700 1 -- 172.21.15.40:0/2321850202 shutdown_connections 2023-06-22T10:54:05.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.921+0000 7f83c55ff700 1 -- 172.21.15.40:0/2321850202 wait complete. 2023-06-22T10:54:05.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.924+0000 7f83c55ff700 1 Processor -- start 2023-06-22T10:54:05.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.925+0000 7f83c55ff700 1 -- start start 2023-06-22T10:54:05.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.926+0000 7f83c55ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83c00b4660 0x7f83c014ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:05.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.926+0000 7f83c55ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83c015c4a0 0x7f83c01e4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:05.954 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.926+0000 7f83c55ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f83c015c870 0x7f83c01e5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:05.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.926+0000 7f83c55ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c01e7000 con 0x7f83c015c4a0 2023-06-22T10:54:05.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.927+0000 7f83c55ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c014d3c0 con 0x7f83c00b4660 2023-06-22T10:54:05.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.927+0000 7f83c55ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83c01e7880 con 0x7f83c015c870 2023-06-22T10:54:05.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.921+0000 7f5a917fa700 1 -- 172.21.15.40:0/1511449943 <== mon.2 v2:172.21.15.45:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5a8c0544d0 con 0x7f5a9c0cef40 2023-06-22T10:54:05.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.928+0000 7f990cff9700 1 -- 172.21.15.40:0/2272498885 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f99000548d0 con 0x7f991014d5b0 2023-06-22T10:54:05.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.928+0000 7f83be7fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83c015c4a0 0x7f83c01e4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:05.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.928+0000 7f83be7fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83c015c4a0 0x7f83c01e4de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50944/0 (socket says 172.21.15.40:50944) 2023-06-22T10:54:05.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.928+0000 7f83be7fc700 1 -- 172.21.15.40:0/4174681271 learned_addr learned my addr 172.21.15.40:0/4174681271 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:05.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.929+0000 7f83be7fc700 1 -- 172.21.15.40:0/4174681271 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f83c015c870 msgr2=0x7f83c01e5320 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-22T10:54:05.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.929+0000 7f83be7fc700 1 --2- 172.21.15.40:0/4174681271 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f83c015c870 0x7f83c01e5320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:05.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.929+0000 7f83be7fc700 1 -- 172.21.15.40:0/4174681271 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83c00b4660 msgr2=0x7f83c014ce80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-22T10:54:05.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.929+0000 7f83be7fc700 1 --2- 172.21.15.40:0/4174681271 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83c00b4660 0x7f83c014ce80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:05.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.929+0000 7f83be7fc700 1 -- 172.21.15.40:0/4174681271 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b40094a0 con 0x7f83c015c4a0 2023-06-22T10:54:05.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.930+0000 7f83be7fc700 1 --2- 172.21.15.40:0/4174681271 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83c015c4a0 0x7f83c01e4de0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f83b000b550 tx=0x7f83b000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:05.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.930+0000 7f990f7fe700 1 --2- 172.21.15.40:0/2272498885 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f98fc06adb0 0x7f98fc06d260 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9910063c00 tx=0x7f9904007000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:05.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.931+0000 7f83a77fe700 1 -- 172.21.15.40:0/4174681271 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b0011830 con 0x7f83c015c4a0 2023-06-22T10:54:05.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.931+0000 7f83a77fe700 1 -- 172.21.15.40:0/4174681271 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b00119b0 con 0x7f83c015c4a0 2023-06-22T10:54:05.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.931+0000 7f83a77fe700 1 -- 172.21.15.40:0/4174681271 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b0011d60 con 0x7f83c015c4a0 2023-06-22T10:54:05.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.931+0000 7f83c55ff700 1 -- 172.21.15.40:0/4174681271 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83c00b8830 con 0x7f83c015c4a0 2023-06-22T10:54:05.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.931+0000 7f83c55ff700 1 -- 172.21.15.40:0/4174681271 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83c01e7230 con 0x7f83c015c4a0 2023-06-22T10:54:05.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.933+0000 7f83c55ff700 1 -- 172.21.15.40:0/4174681271 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83c0067580 con 0x7f83c015c4a0 2023-06-22T10:54:05.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.949+0000 7f83a77fe700 1 -- 172.21.15.40:0/4174681271 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f83b001a400 con 0x7f83c015c4a0 2023-06-22T10:54:05.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.951+0000 7f83a77fe700 1 --2- 172.21.15.40:0/4174681271 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f83ac06adb0 0x7f83ac06d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:05.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.951+0000 7f83a77fe700 1 -- 172.21.15.40:0/4174681271 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f83b0089e50 con 0x7f83c015c4a0 2023-06-22T10:54:05.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.951+0000 7f83a77fe700 1 -- 172.21.15.40:0/4174681271 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f83b008a2d0 con 0x7f83c015c4a0 2023-06-22T10:54:05.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.953+0000 7f83beffd700 1 --2- 172.21.15.40:0/4174681271 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f83ac06adb0 0x7f83ac06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:05.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.954+0000 7f83beffd700 1 --2- 172.21.15.40:0/4174681271 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f83ac06adb0 0x7f83ac06d260 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f83b4009b90 tx=0x7f83b4008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:05.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.979+0000 7f250e9ff700 1 Processor -- start 2023-06-22T10:54:05.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.979+0000 7f250e9ff700 1 -- start start 2023-06-22T10:54:05.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.981+0000 7f250e9ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f2508158480 0x7f250806d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:05.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.981+0000 7f250e9ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2508158850 0x7f250815c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:05.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.981+0000 7f250e9ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f250806d560 0x7f250815c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:05.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.981+0000 7f250e9ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25080cae80 con 0x7f250806d560 2023-06-22T10:54:05.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.981+0000 7f250e9ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f250815ccb0 con 0x7f2508158850 2023-06-22T10:54:05.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.981+0000 7f250e9ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f250806c540 con 0x7f2508158480 2023-06-22T10:54:05.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.982+0000 7f2507fff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f2508158480 0x7f250806d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:05.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.982+0000 7f2507fff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f2508158480 0x7f250806d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3301/0 says I am v2:172.21.15.40:48996/0 (socket says 172.21.15.40:48996) 2023-06-22T10:54:05.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.982+0000 7f2507fff700 1 -- 172.21.15.40:0/4034446082 learned_addr learned my addr 172.21.15.40:0/4034446082 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:05.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.982+0000 7f25077fe700 1 --2- 172.21.15.40:0/4034446082 >> v2:172.21.15.45:3300/0 conn(0x7f2508158850 0x7f250815c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:05.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.983+0000 7f25077fe700 1 -- 172.21.15.40:0/4034446082 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f2508158480 msgr2=0x7f250806d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:05.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.983+0000 7f25077fe700 1 --2- 172.21.15.40:0/4034446082 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f2508158480 0x7f250806d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:05.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.983+0000 7f25077fe700 1 -- 172.21.15.40:0/4034446082 >> v2:172.21.15.40:3300/0 conn(0x7f250806d560 msgr2=0x7f250815c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:05.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.983+0000 7f25077fe700 1 --2- 172.21.15.40:0/4034446082 >> v2:172.21.15.40:3300/0 conn(0x7f250806d560 0x7f250815c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:05.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.983+0000 7f25077fe700 1 -- 172.21.15.40:0/4034446082 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f250806c820 con 0x7f2508158850 2023-06-22T10:54:05.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.983+0000 7f25077fe700 1 --2- 172.21.15.40:0/4034446082 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2508158850 0x7f250815c140 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2508066ac0 tx=0x7f250000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed53057615d10a9 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:05.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.984+0000 7f2506ffd700 1 -- 172.21.15.40:0/4034446082 <== mon.1 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f250000bd20 con 0x7f2508158850 2023-06-22T10:54:05.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.984+0000 7f2506ffd700 1 -- 172.21.15.40:0/4034446082 <== mon.1 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f250000be80 con 0x7f2508158850 2023-06-22T10:54:05.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.984+0000 7f2506ffd700 1 -- 172.21.15.40:0/4034446082 <== mon.1 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25000106f0 con 0x7f2508158850 2023-06-22T10:54:05.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.986+0000 7f250e9ff700 1 -- 172.21.15.40:0/4034446082 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2508158850 msgr2=0x7f250815c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:05.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.986+0000 7f250e9ff700 1 --2- 172.21.15.40:0/4034446082 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2508158850 0x7f250815c140 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2508066ac0 tx=0x7f250000b330 comp rx=0 tx=0).stop 2023-06-22T10:54:05.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.986+0000 7f250e9ff700 1 -- 172.21.15.40:0/4034446082 shutdown_connections 2023-06-22T10:54:05.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.986+0000 7f250e9ff700 1 --2- 172.21.15.40:0/4034446082 >> v2:172.21.15.40:3300/0 conn(0x7f250806d560 0x7f250815c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:05.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.986+0000 7f250e9ff700 1 --2- 172.21.15.40:0/4034446082 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f2508158480 0x7f250806d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:05.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.986+0000 7f250e9ff700 1 --2- 172.21.15.40:0/4034446082 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2508158850 0x7f250815c140 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:05.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.986+0000 7f250e9ff700 1 -- 172.21.15.40:0/4034446082 >> 172.21.15.40:0/4034446082 conn(0x7f25080b0ff0 msgr2=0x7f25080ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:05.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.987+0000 7f250e9ff700 1 -- 172.21.15.40:0/4034446082 shutdown_connections 2023-06-22T10:54:05.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.987+0000 7f250e9ff700 1 -- 172.21.15.40:0/4034446082 wait complete. 2023-06-22T10:54:05.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.990+0000 7f250e9ff700 1 Processor -- start 2023-06-22T10:54:05.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.991+0000 7f250e9ff700 1 -- start start 2023-06-22T10:54:05.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.992+0000 7f250e9ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f250806d560 0x7f25080b2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:05.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.992+0000 7f250e9ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2508158480 0x7f25081f91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:05.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.992+0000 7f250e9ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2508158850 0x7f250815a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:05.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.992+0000 7f250e9ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25080b2680 con 0x7f2508158480 2023-06-22T10:54:05.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.992+0000 7f250e9ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25080b3650 con 0x7f2508158850 2023-06-22T10:54:05.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.992+0000 7f250e9ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25080c88d0 con 0x7f250806d560 2023-06-22T10:54:05.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.993+0000 7f250cf9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2508158850 0x7f250815a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:05.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.993+0000 7f250cf9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2508158850 0x7f250815a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.40:47246/0 (socket says 172.21.15.40:47246) 2023-06-22T10:54:05.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.993+0000 7f250cf9c700 1 -- 172.21.15.40:0/861749719 learned_addr learned my addr 172.21.15.40:0/861749719 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:05.999 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.994+0000 7f2507fff700 1 --2- 172.21.15.40:0/861749719 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f250806d560 0x7f25080b2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:06.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.996+0000 7f2507fff700 1 -- 172.21.15.40:0/861749719 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2508158850 msgr2=0x7f250815a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:06.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.996+0000 7f2507fff700 1 --2- 172.21.15.40:0/861749719 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2508158850 0x7f250815a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:06.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.996+0000 7f2507fff700 1 -- 172.21.15.40:0/861749719 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2508158480 msgr2=0x7f25081f91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:06.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.996+0000 7f2507fff700 1 --2- 172.21.15.40:0/861749719 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2508158480 0x7f25081f91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:06.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.996+0000 7f2507fff700 1 -- 172.21.15.40:0/861749719 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2500009a70 con 0x7f250806d560 2023-06-22T10:54:06.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.997+0000 7f2507fff700 1 --2- 172.21.15.40:0/861749719 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f250806d560 0x7f25080b2140 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f24fc00b670 tx=0x7f24fc00ba30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:06.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.998+0000 7f2504ff9700 1 -- 172.21.15.40:0/861749719 <== mon.2 v2:172.21.15.45:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24fc010040 con 0x7f250806d560 2023-06-22T10:54:06.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.998+0000 7f2504ff9700 1 -- 172.21.15.40:0/861749719 <== mon.2 v2:172.21.15.45:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24fc00e9c0 con 0x7f250806d560 2023-06-22T10:54:06.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.998+0000 7f2504ff9700 1 -- 172.21.15.40:0/861749719 <== mon.2 v2:172.21.15.45:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24fc00ed70 con 0x7f250806d560 2023-06-22T10:54:06.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.999+0000 7f250e9ff700 1 -- 172.21.15.40:0/861749719 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25081fff90 con 0x7f250806d560 2023-06-22T10:54:06.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:05.999+0000 7f250e9ff700 1 -- 172.21.15.40:0/861749719 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25080b1660 con 0x7f250806d560 2023-06-22T10:54:06.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.003+0000 7f2504ff9700 1 -- 172.21.15.40:0/861749719 <== mon.2 v2:172.21.15.45:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f24fc01f410 con 0x7f250806d560 2023-06-22T10:54:06.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.004+0000 7f2504ff9700 1 --2- 172.21.15.40:0/861749719 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f24f406adb0 0x7f24f406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:06.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.004+0000 7f2504ff9700 1 -- 172.21.15.40:0/861749719 <== mon.2 v2:172.21.15.45:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f24fc089640 con 0x7f250806d560 2023-06-22T10:54:06.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.005+0000 7f25077fe700 1 --2- 172.21.15.40:0/861749719 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f24f406adb0 0x7f24f406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:06.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.006+0000 7f250e9ff700 1 -- 172.21.15.40:0/861749719 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2508067580 con 0x7f250806d560 2023-06-22T10:54:06.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.007+0000 7f25077fe700 1 --2- 172.21.15.40:0/861749719 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f24f406adb0 0x7f24f406d260 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2508203a60 tx=0x7f2500012000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:06.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.011+0000 7f9f585ff700 1 Processor -- start 2023-06-22T10:54:06.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.011+0000 7f9f585ff700 1 -- start start 2023-06-22T10:54:06.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.012+0000 7f2504ff9700 1 -- 172.21.15.40:0/861749719 <== mon.2 v2:172.21.15.45:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f24fc054470 con 0x7f250806d560 2023-06-22T10:54:06.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.013+0000 7f9f585ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9f500d2830 0x7f9f500b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:06.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.013+0000 7f9f585ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9f500b4c60 0x7f9f500d0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:06.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.014+0000 7f9f585ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f500b2130 con 0x7f9f5015c720 2023-06-22T10:54:06.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.014+0000 7f9f585ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f50160d60 con 0x7f9f500d2830 2023-06-22T10:54:06.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.014+0000 7f9f585ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f500b50e0 con 0x7f9f500b4c60 2023-06-22T10:54:06.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.015+0000 7f9f55b9a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9f500d2830 0x7f9f500b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:06.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.015+0000 7f9f5639b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f9f5015c720 0x7f9f500b1870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:58592/0 (socket says 172.21.15.40:58592) 2023-06-22T10:54:06.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.015+0000 7f9f5639b700 1 -- 172.21.15.40:0/502430392 learned_addr learned my addr 172.21.15.40:0/502430392 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:06.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.015+0000 7f9f55b9a700 1 -- 172.21.15.40:0/502430392 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9f500b4c60 msgr2=0x7f9f500d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:06.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.015+0000 7f9f56b9c700 1 --2- 172.21.15.40:0/502430392 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9f500b4c60 0x7f9f500d0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:06.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.016+0000 7f9f55399700 1 -- 172.21.15.40:0/502430392 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2373743637 0 0) 0x7f9f500b2130 con 0x7f9f5015c720 2023-06-22T10:54:06.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.016+0000 7f9f55b9a700 1 --2- 172.21.15.40:0/502430392 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9f500b4c60 0x7f9f500d0d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:06.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.016+0000 7f9f55b9a700 1 -- 172.21.15.40:0/502430392 >> v1:172.21.15.40:6789/0 conn(0x7f9f5015c720 legacy=0x7f9f500b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:06.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.016+0000 7f9f55b9a700 1 -- 172.21.15.40:0/502430392 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f50161180 con 0x7f9f500d2830 2023-06-22T10:54:06.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.017+0000 7f9f55b9a700 1 --2- 172.21.15.40:0/502430392 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f500d2830 0x7f9f500b4720 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9f40009870 tx=0x7f9f40009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e16d2f860909309 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:06.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.017+0000 7f9f55399700 1 -- 172.21.15.40:0/502430392 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f40011830 con 0x7f9f500d2830 2023-06-22T10:54:06.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.017+0000 7f9f55399700 1 -- 172.21.15.40:0/502430392 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f40011990 con 0x7f9f500d2830 2023-06-22T10:54:06.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.017+0000 7f9f55399700 1 -- 172.21.15.40:0/502430392 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f40011d20 con 0x7f9f500d2830 2023-06-22T10:54:06.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.020+0000 7f9f585ff700 1 -- 172.21.15.40:0/502430392 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f500d2830 msgr2=0x7f9f500b4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:06.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.021+0000 7f9f585ff700 1 --2- 172.21.15.40:0/502430392 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f500d2830 0x7f9f500b4720 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9f40009870 tx=0x7f9f40009b80 comp rx=0 tx=0).stop 2023-06-22T10:54:06.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.022+0000 7f9f585ff700 1 -- 172.21.15.40:0/502430392 shutdown_connections 2023-06-22T10:54:06.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.022+0000 7f9f585ff700 1 --2- 172.21.15.40:0/502430392 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9f500b4c60 0x7f9f500d0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:06.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.022+0000 7f9f585ff700 1 --2- 172.21.15.40:0/502430392 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f500d2830 0x7f9f500b4720 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:06.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.022+0000 7f9f585ff700 1 -- 172.21.15.40:0/502430392 >> 172.21.15.40:0/502430392 conn(0x7f9f500cf720 msgr2=0x7f9f500cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:06.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.022+0000 7f9f585ff700 1 -- 172.21.15.40:0/502430392 shutdown_connections 2023-06-22T10:54:06.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.022+0000 7f9f585ff700 1 -- 172.21.15.40:0/502430392 wait complete. 2023-06-22T10:54:06.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.025+0000 7f9f585ff700 1 Processor -- start 2023-06-22T10:54:06.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.026+0000 7f9f585ff700 1 -- start start 2023-06-22T10:54:06.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.027+0000 7f9f585ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f500b4c60 0x7f9f500c7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:06.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.027+0000 7f9f585ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f500d2830 0x7f9f500b6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:06.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.027+0000 7f9f585ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9f5015c720 0x7f9f500b7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:06.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.027+0000 7f9f585ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5015d910 con 0x7f9f500b4c60 2023-06-22T10:54:06.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.027+0000 7f9f585ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f500b6f80 con 0x7f9f500d2830 2023-06-22T10:54:06.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.027+0000 7f9f585ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f500b7260 con 0x7f9f5015c720 2023-06-22T10:54:06.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.030+0000 7f9f5639b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f500b4c60 0x7f9f500c7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:06.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.031+0000 7f9f5639b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f500b4c60 0x7f9f500c7b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50986/0 (socket says 172.21.15.40:50986) 2023-06-22T10:54:06.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.031+0000 7f9f5639b700 1 -- 172.21.15.40:0/3113229034 learned_addr learned my addr 172.21.15.40:0/3113229034 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:06.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.031+0000 7f9f5639b700 1 -- 172.21.15.40:0/3113229034 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9f5015c720 msgr2=0x7f9f500b7ee0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-22T10:54:06.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.031+0000 7f9f5639b700 1 --2- 172.21.15.40:0/3113229034 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9f5015c720 0x7f9f500b7ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:06.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.031+0000 7f9f5639b700 1 -- 172.21.15.40:0/3113229034 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f500d2830 msgr2=0x7f9f500b6490 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-22T10:54:06.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.031+0000 7f9f5639b700 1 --2- 172.21.15.40:0/3113229034 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f500d2830 0x7f9f500b6490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:06.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.032+0000 7f9f5639b700 1 -- 172.21.15.40:0/3113229034 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f400094a0 con 0x7f9f500b4c60 2023-06-22T10:54:06.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.032+0000 7f9f5639b700 1 --2- 172.21.15.40:0/3113229034 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f500b4c60 0x7f9f500c7b40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c00cbe0 tx=0x7f9f4c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:06.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.033+0000 7f9f46ffd700 1 -- 172.21.15.40:0/3113229034 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c00abc0 con 0x7f9f500b4c60 2023-06-22T10:54:06.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.033+0000 7f9f46ffd700 1 -- 172.21.15.40:0/3113229034 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f4c00ad20 con 0x7f9f500b4c60 2023-06-22T10:54:06.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.033+0000 7f9f46ffd700 1 -- 172.21.15.40:0/3113229034 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c007310 con 0x7f9f500b4c60 2023-06-22T10:54:06.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.033+0000 7f9f585ff700 1 -- 172.21.15.40:0/3113229034 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f500b7540 con 0x7f9f500b4c60 2023-06-22T10:54:06.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.033+0000 7f9f585ff700 1 -- 172.21.15.40:0/3113229034 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f500c8b30 con 0x7f9f500b4c60 2023-06-22T10:54:06.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.037+0000 7f9f46ffd700 1 -- 172.21.15.40:0/3113229034 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9f4c007470 con 0x7f9f500b4c60 2023-06-22T10:54:06.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.039+0000 7f9f46ffd700 1 --2- 172.21.15.40:0/3113229034 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f9f3406adb0 0x7f9f3406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:06.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.039+0000 7f9f46ffd700 1 -- 172.21.15.40:0/3113229034 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9f4c089780 con 0x7f9f500b4c60 2023-06-22T10:54:06.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.041+0000 7f9f55b9a700 1 --2- 172.21.15.40:0/3113229034 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f9f3406adb0 0x7f9f3406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:06.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.042+0000 7f9f55b9a700 1 --2- 172.21.15.40:0/3113229034 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f9f3406adb0 0x7f9f3406d260 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9f500d2c70 tx=0x7f9f40008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:06.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.043+0000 7f9f585ff700 1 -- 172.21.15.40:0/3113229034 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f380052f0 con 0x7f9f500b4c60 2023-06-22T10:54:06.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.053+0000 7f9f46ffd700 1 -- 172.21.15.40:0/3113229034 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9f4c054520 con 0x7f9f500b4c60 2023-06-22T10:54:06.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.340+0000 7f34579ff700 1 -- 172.21.15.40:0/490040788 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f34300055a0 con 0x7f34500c1960 2023-06-22T10:54:06.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.341+0000 7f3445ffb700 1 -- 172.21.15.40:0/490040788 <== mon.2 v2:172.21.15.45:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f34480575a0 con 0x7f34500c1960 2023-06-22T10:54:06.347 INFO:teuthology.orchestra.run.smithi040.stdout:55834574859 2023-06-22T10:54:06.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.345+0000 7f34579ff700 1 -- 172.21.15.40:0/490040788 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f343406adb0 msgr2=0x7f343406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:06.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.345+0000 7f34579ff700 1 --2- 172.21.15.40:0/490040788 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f343406adb0 0x7f343406d260 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f344c0013c0 tx=0x7f344c001350 comp rx=0 tx=0).stop 2023-06-22T10:54:06.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.345+0000 7f34579ff700 1 -- 172.21.15.40:0/490040788 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f34500c1960 msgr2=0x7f3450162ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:06.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.345+0000 7f34579ff700 1 --2- 172.21.15.40:0/490040788 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f34500c1960 0x7f3450162ff0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f344800ba50 tx=0x7f344800bd60 comp rx=0 tx=0).stop 2023-06-22T10:54:06.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.345+0000 7f34579ff700 1 -- 172.21.15.40:0/490040788 shutdown_connections 2023-06-22T10:54:06.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.345+0000 7f34579ff700 1 --2- 172.21.15.40:0/490040788 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f343406adb0 0x7f343406d260 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:06.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.345+0000 7f34579ff700 1 --2- 172.21.15.40:0/490040788 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f34500c1960 0x7f3450162ff0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:06.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.345+0000 7f34579ff700 1 --2- 172.21.15.40:0/490040788 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34501609a0 0x7f3450202ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:06.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.346+0000 7f34579ff700 1 --2- 172.21.15.40:0/490040788 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34500cf0d0 0x7f34502029a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:06.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.346+0000 7f34579ff700 1 -- 172.21.15.40:0/490040788 >> 172.21.15.40:0/490040788 conn(0x7f34500b0ff0 msgr2=0x7f345006c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:06.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.346+0000 7f34579ff700 1 -- 172.21.15.40:0/490040788 shutdown_connections 2023-06-22T10:54:06.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.346+0000 7f34579ff700 1 -- 172.21.15.40:0/490040788 wait complete. 2023-06-22T10:54:06.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.377+0000 7f77147ff700 1 -- 172.21.15.40:0/1518659760 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f770c067580 con 0x7f770c06dc90 2023-06-22T10:54:06.381 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.4 2023-06-22T10:54:06.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.378+0000 7f2723bff700 1 -- 172.21.15.40:0/4024863834 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f27040055a0 con 0x7f271c15c4a0 2023-06-22T10:54:06.382 DEBUG:teuthology.parallel:result is None 2023-06-22T10:54:06.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.378+0000 7f7702ffd700 1 -- 172.21.15.40:0/1518659760 <== mon.2 v2:172.21.15.45:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f77080564a0 con 0x7f770c06dc90 2023-06-22T10:54:06.383 INFO:teuthology.orchestra.run.smithi040.stdout:55834574859 2023-06-22T10:54:06.383 INFO:teuthology.orchestra.run.smithi040.stdout:55834574860 2023-06-22T10:54:06.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.378+0000 7f27127fc700 1 -- 172.21.15.40:0/4024863834 <== mon.1 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2714057c00 con 0x7f271c15c4a0 2023-06-22T10:54:06.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.381+0000 7f77147ff700 1 -- 172.21.15.40:0/1518659760 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f76f006adb0 msgr2=0x7f76f006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:06.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.381+0000 7f77147ff700 1 --2- 172.21.15.40:0/1518659760 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f76f006adb0 0x7f76f006d260 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f770c0cce70 tx=0x7f76fc007a20 comp rx=0 tx=0).stop 2023-06-22T10:54:06.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.381+0000 7f77147ff700 1 -- 172.21.15.40:0/1518659760 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f770c06dc90 msgr2=0x7f770c204a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:06.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.381+0000 7f77147ff700 1 --2- 172.21.15.40:0/1518659760 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f770c06dc90 0x7f770c204a30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7708000c00 tx=0x7f77080047c0 comp rx=0 tx=0).stop 2023-06-22T10:54:06.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.382+0000 7f2723bff700 1 -- 172.21.15.40:0/4024863834 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f270006adb0 msgr2=0x7f270006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:06.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.382+0000 7f2723bff700 1 --2- 172.21.15.40:0/4024863834 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f270006adb0 0x7f270006d260 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f27180090b0 tx=0x7f2718008030 comp rx=0 tx=0).stop 2023-06-22T10:54:06.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.382+0000 7f2723bff700 1 -- 172.21.15.40:0/4024863834 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f271c15c4a0 msgr2=0x7f271c1f5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:06.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.382+0000 7f2723bff700 1 --2- 172.21.15.40:0/4024863834 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f271c15c4a0 0x7f271c1f5a20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f271400b840 tx=0x7f271400bc00 comp rx=0 tx=0).stop 2023-06-22T10:54:06.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.382+0000 7f2723bff700 1 -- 172.21.15.40:0/4024863834 shutdown_connections 2023-06-22T10:54:06.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.382+0000 7f2723bff700 1 --2- 172.21.15.40:0/4024863834 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f270006adb0 0x7f270006d260 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:06.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.382+0000 7f2723bff700 1 --2- 172.21.15.40:0/4024863834 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f271c0cd930 0x7f271c0c90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:06.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.382+0000 7f2723bff700 1 --2- 172.21.15.40:0/4024863834 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f271c15c870 0x7f271c0cc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:06.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.382+0000 7f2723bff700 1 --2- 172.21.15.40:0/4024863834 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f271c15c4a0 0x7f271c1f5a20 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:06.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.382+0000 7f2723bff700 1 -- 172.21.15.40:0/4024863834 >> 172.21.15.40:0/4024863834 conn(0x7f271c0cf660 msgr2=0x7f271c06bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:06.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.383+0000 7f2723bff700 1 -- 172.21.15.40:0/4024863834 shutdown_connections 2023-06-22T10:54:06.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.383+0000 7f2723bff700 1 -- 172.21.15.40:0/4024863834 wait complete. 2023-06-22T10:54:06.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.383+0000 7f77147ff700 1 -- 172.21.15.40:0/1518659760 shutdown_connections 2023-06-22T10:54:06.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.383+0000 7f77147ff700 1 --2- 172.21.15.40:0/1518659760 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f76f006adb0 0x7f76f006d260 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:06.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.383+0000 7f77147ff700 1 --2- 172.21.15.40:0/1518659760 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f770c06dc90 0x7f770c204a30 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:06.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.383+0000 7f77147ff700 1 --2- 172.21.15.40:0/1518659760 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f770c1609a0 0x7f770c162f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:06.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.383+0000 7f77147ff700 1 --2- 172.21.15.40:0/1518659760 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f770c0c1960 0x7f770c0c3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:06.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.383+0000 7f77147ff700 1 -- 172.21.15.40:0/1518659760 >> 172.21.15.40:0/1518659760 conn(0x7f770c0b0ff0 msgr2=0x7f770c0aedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:06.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.383+0000 7f77147ff700 1 -- 172.21.15.40:0/1518659760 shutdown_connections 2023-06-22T10:54:06.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.383+0000 7f77147ff700 1 -- 172.21.15.40:0/1518659760 wait complete. 2023-06-22T10:54:06.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.393+0000 7f5aa2bff700 1 -- 172.21.15.40:0/1511449943 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5a9c0c27e0 con 0x7f5a9c0cef40 2023-06-22T10:54:06.398 INFO:teuthology.orchestra.run.smithi040.stdout:60129542156 2023-06-22T10:54:06.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.394+0000 7f5a917fa700 1 -- 172.21.15.40:0/1511449943 <== mon.2 v2:172.21.15.45:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5a9c0c27e0 con 0x7f5a9c0cef40 2023-06-22T10:54:06.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.398+0000 7f5aa2bff700 1 -- 172.21.15.40:0/1511449943 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f5a8806adb0 msgr2=0x7f5a8806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:06.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.398+0000 7f5aa2bff700 1 --2- 172.21.15.40:0/1511449943 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f5a8806adb0 0x7f5a8806d260 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5a98009c10 tx=0x7f5a98010000 comp rx=0 tx=0).stop 2023-06-22T10:54:06.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.398+0000 7f5aa2bff700 1 -- 172.21.15.40:0/1511449943 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f5a9c0cef40 msgr2=0x7f5a9c0c4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:06.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.398+0000 7f5aa2bff700 1 --2- 172.21.15.40:0/1511449943 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f5a9c0cef40 0x7f5a9c0c4bb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c00b450 tx=0x7f5a8c00b760 comp rx=0 tx=0).stop 2023-06-22T10:54:06.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.399+0000 7f5aa2bff700 1 -- 172.21.15.40:0/1511449943 shutdown_connections 2023-06-22T10:54:06.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.399+0000 7f5aa2bff700 1 --2- 172.21.15.40:0/1511449943 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f5a8806adb0 0x7f5a8806d260 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:06.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.399+0000 7f5aa2bff700 1 --2- 172.21.15.40:0/1511449943 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a9c15ccd0 0x7f5a9c0c60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:06.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.399+0000 7f5aa2bff700 1 --2- 172.21.15.40:0/1511449943 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5a9c0ad730 0x7f5a9c144900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:06.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.399+0000 7f5aa2bff700 1 --2- 172.21.15.40:0/1511449943 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f5a9c0cef40 0x7f5a9c0c4bb0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:06.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.399+0000 7f5aa2bff700 1 -- 172.21.15.40:0/1511449943 >> 172.21.15.40:0/1511449943 conn(0x7f5a9c0b0fe0 msgr2=0x7f5a9c0ae2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:06.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.399+0000 7f5aa2bff700 1 -- 172.21.15.40:0/1511449943 shutdown_connections 2023-06-22T10:54:06.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.399+0000 7f5aa2bff700 1 -- 172.21.15.40:0/1511449943 wait complete. 2023-06-22T10:54:06.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.402+0000 7f99163ff700 1 -- 172.21.15.40:0/2272498885 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f98f00055a0 con 0x7f991014d5b0 2023-06-22T10:54:06.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.403+0000 7f990cff9700 1 -- 172.21.15.40:0/2272498885 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9900057ef0 con 0x7f991014d5b0 2023-06-22T10:54:06.406 INFO:teuthology.orchestra.run.smithi040.stdout:64424509452 2023-06-22T10:54:06.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.406+0000 7f99163ff700 1 -- 172.21.15.40:0/2272498885 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f98fc06adb0 msgr2=0x7f98fc06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:06.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.406+0000 7f99163ff700 1 --2- 172.21.15.40:0/2272498885 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f98fc06adb0 0x7f98fc06d260 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9910063c00 tx=0x7f9904007000 comp rx=0 tx=0).stop 2023-06-22T10:54:06.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.406+0000 7f99163ff700 1 -- 172.21.15.40:0/2272498885 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f991014d5b0 msgr2=0x7f99100b4420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:06.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.406+0000 7f99163ff700 1 --2- 172.21.15.40:0/2272498885 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f991014d5b0 0x7f99100b4420 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f990000e860 tx=0x7f990000ec20 comp rx=0 tx=0).stop 2023-06-22T10:54:06.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.408+0000 7f99163ff700 1 -- 172.21.15.40:0/2272498885 shutdown_connections 2023-06-22T10:54:06.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.408+0000 7f99163ff700 1 --2- 172.21.15.40:0/2272498885 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f98fc06adb0 0x7f98fc06d260 secure :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9910063c00 tx=0x7f9904007000 comp rx=0 tx=0).stop 2023-06-22T10:54:06.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.408+0000 7f99163ff700 1 --2- 172.21.15.40:0/2272498885 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f991014d980 0x7f99100c66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:06.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.408+0000 7f99163ff700 1 --2- 172.21.15.40:0/2272498885 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f991014d5b0 0x7f99100b4420 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:06.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.408+0000 7f99163ff700 1 --2- 172.21.15.40:0/2272498885 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f99100c8430 0x7f99100c6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:06.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.408+0000 7f99163ff700 1 -- 172.21.15.40:0/2272498885 >> 172.21.15.40:0/2272498885 conn(0x7f99100cf0c0 msgr2=0x7f991015d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:06.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.409+0000 7f99163ff700 1 -- 172.21.15.40:0/2272498885 shutdown_connections 2023-06-22T10:54:06.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.409+0000 7f99163ff700 1 -- 172.21.15.40:0/2272498885 wait complete. 2023-06-22T10:54:06.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.409+0000 7f83c55ff700 1 -- 172.21.15.40:0/4174681271 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f83c0152670 con 0x7f83c015c4a0 2023-06-22T10:54:06.416 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.3 2023-06-22T10:54:06.416 DEBUG:teuthology.parallel:result is None 2023-06-22T10:54:06.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.414+0000 7f83a77fe700 1 -- 172.21.15.40:0/4174681271 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f83b0015020 con 0x7f83c015c4a0 2023-06-22T10:54:06.418 INFO:teuthology.orchestra.run.smithi040.stdout:60129542158 2023-06-22T10:54:06.419 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.1 2023-06-22T10:54:06.419 DEBUG:teuthology.parallel:result is None 2023-06-22T10:54:06.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.418+0000 7f83c55ff700 1 -- 172.21.15.40:0/4174681271 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f83ac06adb0 msgr2=0x7f83ac06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:06.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.418+0000 7f83c55ff700 1 --2- 172.21.15.40:0/4174681271 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f83ac06adb0 0x7f83ac06d260 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f83b4009b90 tx=0x7f83b4008030 comp rx=0 tx=0).stop 2023-06-22T10:54:06.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.418+0000 7f83c55ff700 1 -- 172.21.15.40:0/4174681271 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83c015c4a0 msgr2=0x7f83c01e4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:06.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.418+0000 7f83c55ff700 1 --2- 172.21.15.40:0/4174681271 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83c015c4a0 0x7f83c01e4de0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f83b000b550 tx=0x7f83b000b910 comp rx=0 tx=0).stop 2023-06-22T10:54:06.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.418+0000 7f83c55ff700 1 -- 172.21.15.40:0/4174681271 shutdown_connections 2023-06-22T10:54:06.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.418+0000 7f83c55ff700 1 --2- 172.21.15.40:0/4174681271 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f83ac06adb0 0x7f83ac06d260 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:06.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.418+0000 7f83c55ff700 1 --2- 172.21.15.40:0/4174681271 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f83c015c870 0x7f83c01e5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:06.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.418+0000 7f83c55ff700 1 --2- 172.21.15.40:0/4174681271 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83c00b4660 0x7f83c014ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:06.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.418+0000 7f83c55ff700 1 --2- 172.21.15.40:0/4174681271 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83c015c4a0 0x7f83c01e4de0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:06.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.418+0000 7f83c55ff700 1 -- 172.21.15.40:0/4174681271 >> 172.21.15.40:0/4174681271 conn(0x7f83c00cf660 msgr2=0x7f83c015f1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:06.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.419+0000 7f83c55ff700 1 -- 172.21.15.40:0/4174681271 shutdown_connections 2023-06-22T10:54:06.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.419+0000 7f83c55ff700 1 -- 172.21.15.40:0/4174681271 wait complete. 2023-06-22T10:54:06.431 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542156 for osd.2 2023-06-22T10:54:06.431 DEBUG:teuthology.parallel:result is None 2023-06-22T10:54:06.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.433+0000 7f250e9ff700 1 -- 172.21.15.40:0/861749719 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f25080cf390 con 0x7f250806d560 2023-06-22T10:54:06.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.433+0000 7f2504ff9700 1 -- 172.21.15.40:0/861749719 <== mon.2 v2:172.21.15.45:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f24fc057a90 con 0x7f250806d560 2023-06-22T10:54:06.437 INFO:teuthology.orchestra.run.smithi040.stdout:55834574860 2023-06-22T10:54:06.438 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509452 for osd.0 2023-06-22T10:54:06.438 DEBUG:teuthology.parallel:result is None 2023-06-22T10:54:06.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.436+0000 7f250e9ff700 1 -- 172.21.15.40:0/861749719 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f24f406adb0 msgr2=0x7f24f406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:06.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.436+0000 7f250e9ff700 1 --2- 172.21.15.40:0/861749719 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f24f406adb0 0x7f24f406d260 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2508203a60 tx=0x7f2500012000 comp rx=0 tx=0).stop 2023-06-22T10:54:06.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.436+0000 7f250e9ff700 1 -- 172.21.15.40:0/861749719 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f250806d560 msgr2=0x7f25080b2140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:06.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.436+0000 7f250e9ff700 1 --2- 172.21.15.40:0/861749719 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f250806d560 0x7f25080b2140 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f24fc00b670 tx=0x7f24fc00ba30 comp rx=0 tx=0).stop 2023-06-22T10:54:06.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.437+0000 7f250e9ff700 1 -- 172.21.15.40:0/861749719 shutdown_connections 2023-06-22T10:54:06.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.437+0000 7f250e9ff700 1 --2- 172.21.15.40:0/861749719 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f24f406adb0 0x7f24f406d260 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:06.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.437+0000 7f250e9ff700 1 --2- 172.21.15.40:0/861749719 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f250806d560 0x7f25080b2140 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:06.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.437+0000 7f250e9ff700 1 --2- 172.21.15.40:0/861749719 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2508158850 0x7f250815a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:06.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.437+0000 7f250e9ff700 1 --2- 172.21.15.40:0/861749719 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2508158480 0x7f25081f91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:06.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.437+0000 7f250e9ff700 1 -- 172.21.15.40:0/861749719 >> 172.21.15.40:0/861749719 conn(0x7f25080b0ff0 msgr2=0x7f2508156700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:06.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.437+0000 7f250e9ff700 1 -- 172.21.15.40:0/861749719 shutdown_connections 2023-06-22T10:54:06.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.437+0000 7f250e9ff700 1 -- 172.21.15.40:0/861749719 wait complete. 2023-06-22T10:54:06.448 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542158 got 60129542158 for osd.7 2023-06-22T10:54:06.448 DEBUG:teuthology.parallel:result is None 2023-06-22T10:54:06.458 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.5 2023-06-22T10:54:06.459 DEBUG:teuthology.parallel:result is None 2023-06-22T10:54:06.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.468+0000 7f9f585ff700 1 -- 172.21.15.40:0/3113229034 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f9f380055a0 con 0x7f9f500b4c60 2023-06-22T10:54:06.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.468+0000 7f9f46ffd700 1 -- 172.21.15.40:0/3113229034 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9f4c018030 con 0x7f9f500b4c60 2023-06-22T10:54:06.473 INFO:teuthology.orchestra.run.smithi040.stdout:60129542157 2023-06-22T10:54:06.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.471+0000 7f9f585ff700 1 -- 172.21.15.40:0/3113229034 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f9f3406adb0 msgr2=0x7f9f3406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:06.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.471+0000 7f9f585ff700 1 --2- 172.21.15.40:0/3113229034 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f9f3406adb0 0x7f9f3406d260 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9f500d2c70 tx=0x7f9f40008030 comp rx=0 tx=0).stop 2023-06-22T10:54:06.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.471+0000 7f9f585ff700 1 -- 172.21.15.40:0/3113229034 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f500b4c60 msgr2=0x7f9f500c7b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:06.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.471+0000 7f9f585ff700 1 --2- 172.21.15.40:0/3113229034 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f500b4c60 0x7f9f500c7b40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c00cbe0 tx=0x7f9f4c00a060 comp rx=0 tx=0).stop 2023-06-22T10:54:06.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.471+0000 7f9f585ff700 1 -- 172.21.15.40:0/3113229034 shutdown_connections 2023-06-22T10:54:06.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.471+0000 7f9f585ff700 1 --2- 172.21.15.40:0/3113229034 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f9f3406adb0 0x7f9f3406d260 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:06.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.471+0000 7f9f585ff700 1 --2- 172.21.15.40:0/3113229034 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9f5015c720 0x7f9f500b7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:06.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.471+0000 7f9f585ff700 1 --2- 172.21.15.40:0/3113229034 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9f500b4c60 0x7f9f500c7b40 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:06.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.471+0000 7f9f585ff700 1 --2- 172.21.15.40:0/3113229034 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9f500d2830 0x7f9f500b6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:06.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.471+0000 7f9f585ff700 1 -- 172.21.15.40:0/3113229034 >> 172.21.15.40:0/3113229034 conn(0x7f9f500cf720 msgr2=0x7f9f500d0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:06.477 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.471+0000 7f9f585ff700 1 -- 172.21.15.40:0/3113229034 shutdown_connections 2023-06-22T10:54:06.478 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.471+0000 7f9f585ff700 1 -- 172.21.15.40:0/3113229034 wait complete. 2023-06-22T10:54:06.491 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542157 got 60129542157 for osd.6 2023-06-22T10:54:06.492 DEBUG:teuthology.parallel:result is None 2023-06-22T10:54:06.492 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-06-22T10:54:06.493 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-22T10:54:06.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.730+0000 7f813e3ff700 1 Processor -- start 2023-06-22T10:54:06.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.731+0000 7f813e3ff700 1 -- start start 2023-06-22T10:54:06.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.732+0000 7f813e3ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f81380d2830 0x7f81380b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:06.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.732+0000 7f813e3ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f81380b4c60 0x7f81380d0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:06.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.732+0000 7f813e3ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81380b50a0 con 0x7f813815c720 2023-06-22T10:54:06.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.732+0000 7f813e3ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8138160d60 con 0x7f81380d2830 2023-06-22T10:54:06.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.732+0000 7f813e3ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81380b2130 con 0x7f81380b4c60 2023-06-22T10:54:06.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.732+0000 7f8137fff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f813815c720 0x7f81380b1870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:58608/0 (socket says 172.21.15.40:58608) 2023-06-22T10:54:06.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.732+0000 7f8137fff700 1 -- 172.21.15.40:0/3091207109 learned_addr learned my addr 172.21.15.40:0/3091207109 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:06.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.732+0000 7f81377fe700 1 --2- 172.21.15.40:0/3091207109 >> v2:172.21.15.40:3300/0 conn(0x7f81380d2830 0x7f81380b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:06.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.732+0000 7f813c99c700 1 --2- 172.21.15.40:0/3091207109 >> v2:172.21.15.45:3300/0 conn(0x7f81380b4c60 0x7f81380d0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:06.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.732+0000 7f8136ffd700 1 -- 172.21.15.40:0/3091207109 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1772227907 0 0) 0x7f81380b50a0 con 0x7f813815c720 2023-06-22T10:54:06.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.733+0000 7f8136ffd700 1 -- 172.21.15.40:0/3091207109 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81200035b0 con 0x7f813815c720 2023-06-22T10:54:06.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.733+0000 7f81377fe700 1 -- 172.21.15.40:0/3091207109 >> v2:172.21.15.45:3300/0 conn(0x7f81380b4c60 msgr2=0x7f81380d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:06.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.733+0000 7f81377fe700 1 --2- 172.21.15.40:0/3091207109 >> v2:172.21.15.45:3300/0 conn(0x7f81380b4c60 0x7f81380d0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:06.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.733+0000 7f81377fe700 1 -- 172.21.15.40:0/3091207109 >> v1:172.21.15.40:6789/0 conn(0x7f813815c720 legacy=0x7f81380b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:06.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.733+0000 7f81377fe700 1 -- 172.21.15.40:0/3091207109 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8138161180 con 0x7f81380d2830 2023-06-22T10:54:06.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.733+0000 7f81377fe700 1 --2- 172.21.15.40:0/3091207109 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81380d2830 0x7f81380b4720 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f812c009840 tx=0x7f812c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74e7d12ceb0e3e2b server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:06.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.733+0000 7f8136ffd700 1 -- 172.21.15.40:0/3091207109 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812c011830 con 0x7f81380d2830 2023-06-22T10:54:06.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.733+0000 7f8136ffd700 1 -- 172.21.15.40:0/3091207109 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f812c011990 con 0x7f81380d2830 2023-06-22T10:54:06.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.733+0000 7f8136ffd700 1 -- 172.21.15.40:0/3091207109 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812c011d20 con 0x7f81380d2830 2023-06-22T10:54:06.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.734+0000 7f813e3ff700 1 -- 172.21.15.40:0/3091207109 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81380d2830 msgr2=0x7f81380b4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:06.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.734+0000 7f813e3ff700 1 --2- 172.21.15.40:0/3091207109 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81380d2830 0x7f81380b4720 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f812c009840 tx=0x7f812c009b50 comp rx=0 tx=0).stop 2023-06-22T10:54:06.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.734+0000 7f813e3ff700 1 -- 172.21.15.40:0/3091207109 shutdown_connections 2023-06-22T10:54:06.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.734+0000 7f813e3ff700 1 --2- 172.21.15.40:0/3091207109 >> v2:172.21.15.45:3300/0 conn(0x7f81380b4c60 0x7f81380d0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:06.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.734+0000 7f813e3ff700 1 --2- 172.21.15.40:0/3091207109 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81380d2830 0x7f81380b4720 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:06.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.734+0000 7f813e3ff700 1 -- 172.21.15.40:0/3091207109 >> 172.21.15.40:0/3091207109 conn(0x7f81380cf720 msgr2=0x7f81380cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:06.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.734+0000 7f813e3ff700 1 -- 172.21.15.40:0/3091207109 shutdown_connections 2023-06-22T10:54:06.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.734+0000 7f813e3ff700 1 -- 172.21.15.40:0/3091207109 wait complete. 2023-06-22T10:54:06.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.735+0000 7f813e3ff700 1 Processor -- start 2023-06-22T10:54:06.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.736+0000 7f813e3ff700 1 -- start start 2023-06-22T10:54:06.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.736+0000 7f813e3ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f81380b4c60 0x7f81381f5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:06.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.736+0000 7f813e3ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81380d2830 0x7f81380cc050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:06.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.737+0000 7f813e3ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f813815c720 0x7f813815e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:06.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.737+0000 7f813e3ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f813815dbe0 con 0x7f81380d2830 2023-06-22T10:54:06.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.737+0000 7f813e3ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81381f5b80 con 0x7f813815c720 2023-06-22T10:54:06.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.737+0000 7f813e3ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81381f5e60 con 0x7f81380b4c60 2023-06-22T10:54:06.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.737+0000 7f81377fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81380d2830 0x7f81380cc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:06.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.737+0000 7f81377fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81380d2830 0x7f81380cc050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50994/0 (socket says 172.21.15.40:50994) 2023-06-22T10:54:06.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.737+0000 7f81377fe700 1 -- 172.21.15.40:0/2793245361 learned_addr learned my addr 172.21.15.40:0/2793245361 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:06.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.737+0000 7f8137fff700 1 --2- 172.21.15.40:0/2793245361 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f81380b4c60 0x7f81381f5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:06.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.737+0000 7f813c99c700 1 --2- 172.21.15.40:0/2793245361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f813815c720 0x7f813815e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:06.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.737+0000 7f81377fe700 1 -- 172.21.15.40:0/2793245361 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f81380b4c60 msgr2=0x7f81381f5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:06.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.737+0000 7f81377fe700 1 --2- 172.21.15.40:0/2793245361 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f81380b4c60 0x7f81381f5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:06.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.737+0000 7f81377fe700 1 -- 172.21.15.40:0/2793245361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f813815c720 msgr2=0x7f813815e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:06.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.737+0000 7f81377fe700 1 --2- 172.21.15.40:0/2793245361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f813815c720 0x7f813815e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:06.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.737+0000 7f81377fe700 1 -- 172.21.15.40:0/2793245361 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f812c0094a0 con 0x7f81380d2830 2023-06-22T10:54:06.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.737+0000 7f81377fe700 1 --2- 172.21.15.40:0/2793245361 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81380d2830 0x7f81380cc050 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f812c009b90 tx=0x7f812c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:06.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.738+0000 7f8134ff9700 1 -- 172.21.15.40:0/2793245361 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812c004510 con 0x7f81380d2830 2023-06-22T10:54:06.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.738+0000 7f8134ff9700 1 -- 172.21.15.40:0/2793245361 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f812c01e070 con 0x7f81380d2830 2023-06-22T10:54:06.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.738+0000 7f813e3ff700 1 -- 172.21.15.40:0/2793245361 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81381f5890 con 0x7f81380d2830 2023-06-22T10:54:06.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.738+0000 7f8134ff9700 1 -- 172.21.15.40:0/2793245361 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812c0038e0 con 0x7f81380d2830 2023-06-22T10:54:06.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.738+0000 7f813e3ff700 1 -- 172.21.15.40:0/2793245361 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81380cc590 con 0x7f81380d2830 2023-06-22T10:54:06.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.739+0000 7f813e3ff700 1 -- 172.21.15.40:0/2793245361 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81380cc780 con 0x7f81380d2830 2023-06-22T10:54:06.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.740+0000 7f8134ff9700 1 -- 172.21.15.40:0/2793245361 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f812c003a40 con 0x7f81380d2830 2023-06-22T10:54:06.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.741+0000 7f8134ff9700 1 --2- 172.21.15.40:0/2793245361 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f812406ace0 0x7f812406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:06.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.741+0000 7f8134ff9700 1 -- 172.21.15.40:0/2793245361 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f812c020070 con 0x7f81380d2830 2023-06-22T10:54:06.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.741+0000 7f8137fff700 1 --2- 172.21.15.40:0/2793245361 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f812406ace0 0x7f812406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:06.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.741+0000 7f8137fff700 1 --2- 172.21.15.40:0/2793245361 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f812406ace0 0x7f812406d190 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8128007fd0 tx=0x7f8128007dc0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:06.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.745+0000 7f8134ff9700 1 -- 172.21.15.40:0/2793245361 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f812c0556b0 con 0x7f81380d2830 2023-06-22T10:54:06.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.949+0000 7f813e3ff700 1 -- 172.21.15.40:0/2793245361 --> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f81381606a0 con 0x7f812406ace0 2023-06-22T10:54:06.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.960+0000 7f8134ff9700 1 -- 172.21.15.40:0/2793245361 <== mgr.4110 v2:172.21.15.40:6832/1803669772 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367343 (secure 0 0 0) 0x7f81280058e0 con 0x7f812406ace0 2023-06-22T10:54:06.964 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:54:06.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.964+0000 7f813e3ff700 1 -- 172.21.15.40:0/2793245361 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f812406ace0 msgr2=0x7f812406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:06.970 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.964+0000 7f813e3ff700 1 --2- 172.21.15.40:0/2793245361 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f812406ace0 0x7f812406d190 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8128007fd0 tx=0x7f8128007dc0 comp rx=0 tx=0).stop 2023-06-22T10:54:06.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.964+0000 7f813e3ff700 1 -- 172.21.15.40:0/2793245361 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81380d2830 msgr2=0x7f81380cc050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:06.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.964+0000 7f813e3ff700 1 --2- 172.21.15.40:0/2793245361 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81380d2830 0x7f81380cc050 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f812c009b90 tx=0x7f812c004750 comp rx=0 tx=0).stop 2023-06-22T10:54:06.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.964+0000 7f813e3ff700 1 -- 172.21.15.40:0/2793245361 shutdown_connections 2023-06-22T10:54:06.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.964+0000 7f813e3ff700 1 --2- 172.21.15.40:0/2793245361 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f812406ace0 0x7f812406d190 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:06.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.964+0000 7f813e3ff700 1 --2- 172.21.15.40:0/2793245361 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f81380b4c60 0x7f81381f5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:06.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.964+0000 7f813e3ff700 1 --2- 172.21.15.40:0/2793245361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f813815c720 0x7f813815e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:06.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.964+0000 7f813e3ff700 1 --2- 172.21.15.40:0/2793245361 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81380d2830 0x7f81380cc050 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:06.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.964+0000 7f813e3ff700 1 -- 172.21.15.40:0/2793245361 >> 172.21.15.40:0/2793245361 conn(0x7f81380cf720 msgr2=0x7f81380b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:06.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.965+0000 7f813e3ff700 1 -- 172.21.15.40:0/2793245361 shutdown_connections 2023-06-22T10:54:06.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:06.965+0000 7f813e3ff700 1 -- 172.21.15.40:0/2793245361 wait complete. 2023-06-22T10:54:06.972 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-06-22T10:54:06.986 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":46,"stamp":"2023-06-22T10:54:05.134413+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219176,"kb_used_data":3560,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755544,"statfs":{"total":773094113280,"available":772869677056,"internally_reserved":0,"allocated":3645440,"data_stored":2175296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005020"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.540129+0000","last_change":"2023-06-22T10:53:31.946165+0000","last_active":"2023-06-22T10:53:37.540129+0000","last_peered":"2023-06-22T10:53:37.540129+0000","last_clean":"2023-06-22T10:53:37.540129+0000","last_became_active":"2023-06-22T10:53:31.945515+0000","last_became_peered":"2023-06-22T10:53:31.945515+0000","last_unstale":"2023-06-22T10:53:37.540129+0000","last_undegraded":"2023-06-22T10:53:37.540129+0000","last_fullsized":"2023-06-22T10:53:37.540129+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T13:02:07.560484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958797+0000","last_change":"2023-06-22T10:53:31.943630+0000","last_active":"2023-06-22T10:53:36.958797+0000","last_peered":"2023-06-22T10:53:36.958797+0000","last_clean":"2023-06-22T10:53:36.958797+0000","last_became_active":"2023-06-22T10:53:31.943233+0000","last_became_peered":"2023-06-22T10:53:31.943233+0000","last_unstale":"2023-06-22T10:53:36.958797+0000","last_undegraded":"2023-06-22T10:53:36.958797+0000","last_fullsized":"2023-06-22T10:53:36.958797+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:15:20.227426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.959406+0000","last_change":"2023-06-22T10:53:31.951823+0000","last_active":"2023-06-22T10:53:36.959406+0000","last_peered":"2023-06-22T10:53:36.959406+0000","last_clean":"2023-06-22T10:53:36.959406+0000","last_became_active":"2023-06-22T10:53:31.951456+0000","last_became_peered":"2023-06-22T10:53:31.951456+0000","last_unstale":"2023-06-22T10:53:36.959406+0000","last_undegraded":"2023-06-22T10:53:36.959406+0000","last_fullsized":"2023-06-22T10:53:36.959406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T17:57:40.473883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.280096+0000","last_change":"2023-06-22T10:53:31.941895+0000","last_active":"2023-06-22T10:53:37.280096+0000","last_peered":"2023-06-22T10:53:37.280096+0000","last_clean":"2023-06-22T10:53:37.280096+0000","last_became_active":"2023-06-22T10:53:31.941630+0000","last_became_peered":"2023-06-22T10:53:31.941630+0000","last_unstale":"2023-06-22T10:53:37.280096+0000","last_undegraded":"2023-06-22T10:53:37.280096+0000","last_fullsized":"2023-06-22T10:53:37.280096+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T17:25:39.331517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.956556+0000","last_change":"2023-06-22T10:53:31.945358+0000","last_active":"2023-06-22T10:53:36.956556+0000","last_peered":"2023-06-22T10:53:36.956556+0000","last_clean":"2023-06-22T10:53:36.956556+0000","last_became_active":"2023-06-22T10:53:31.945078+0000","last_became_peered":"2023-06-22T10:53:31.945078+0000","last_unstale":"2023-06-22T10:53:36.956556+0000","last_undegraded":"2023-06-22T10:53:36.956556+0000","last_fullsized":"2023-06-22T10:53:36.956556+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T13:04:27.917981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958367+0000","last_change":"2023-06-22T10:53:31.950691+0000","last_active":"2023-06-22T10:53:36.958367+0000","last_peered":"2023-06-22T10:53:36.958367+0000","last_clean":"2023-06-22T10:53:36.958367+0000","last_became_active":"2023-06-22T10:53:31.950418+0000","last_became_peered":"2023-06-22T10:53:31.950418+0000","last_unstale":"2023-06-22T10:53:36.958367+0000","last_undegraded":"2023-06-22T10:53:36.958367+0000","last_fullsized":"2023-06-22T10:53:36.958367+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:27:48.848591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.732456+0000","last_change":"2023-06-22T10:53:31.947663+0000","last_active":"2023-06-22T10:53:37.732456+0000","last_peered":"2023-06-22T10:53:37.732456+0000","last_clean":"2023-06-22T10:53:37.732456+0000","last_became_active":"2023-06-22T10:53:31.945462+0000","last_became_peered":"2023-06-22T10:53:31.945462+0000","last_unstale":"2023-06-22T10:53:37.732456+0000","last_undegraded":"2023-06-22T10:53:37.732456+0000","last_fullsized":"2023-06-22T10:53:37.732456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:37:31.693376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957438+0000","last_change":"2023-06-22T10:53:31.953829+0000","last_active":"2023-06-22T10:53:36.957438+0000","last_peered":"2023-06-22T10:53:36.957438+0000","last_clean":"2023-06-22T10:53:36.957438+0000","last_became_active":"2023-06-22T10:53:31.953479+0000","last_became_peered":"2023-06-22T10:53:31.953479+0000","last_unstale":"2023-06-22T10:53:36.957438+0000","last_undegraded":"2023-06-22T10:53:36.957438+0000","last_fullsized":"2023-06-22T10:53:36.957438+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:56:30.123428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.956661+0000","last_change":"2023-06-22T10:53:31.944979+0000","last_active":"2023-06-22T10:53:36.956661+0000","last_peered":"2023-06-22T10:53:36.956661+0000","last_clean":"2023-06-22T10:53:36.956661+0000","last_became_active":"2023-06-22T10:53:31.944596+0000","last_became_peered":"2023-06-22T10:53:31.944596+0000","last_unstale":"2023-06-22T10:53:36.956661+0000","last_undegraded":"2023-06-22T10:53:36.956661+0000","last_fullsized":"2023-06-22T10:53:36.956661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T18:57:56.828299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.959118+0000","last_change":"2023-06-22T10:53:31.935384+0000","last_active":"2023-06-22T10:53:36.959118+0000","last_peered":"2023-06-22T10:53:36.959118+0000","last_clean":"2023-06-22T10:53:36.959118+0000","last_became_active":"2023-06-22T10:53:31.935038+0000","last_became_peered":"2023-06-22T10:53:31.935038+0000","last_unstale":"2023-06-22T10:53:36.959118+0000","last_undegraded":"2023-06-22T10:53:36.959118+0000","last_fullsized":"2023-06-22T10:53:36.959118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T17:38:24.000272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.959531+0000","last_change":"2023-06-22T10:53:31.952559+0000","last_active":"2023-06-22T10:53:36.959531+0000","last_peered":"2023-06-22T10:53:36.959531+0000","last_clean":"2023-06-22T10:53:36.959531+0000","last_became_active":"2023-06-22T10:53:31.952213+0000","last_became_peered":"2023-06-22T10:53:31.952213+0000","last_unstale":"2023-06-22T10:53:36.959531+0000","last_undegraded":"2023-06-22T10:53:36.959531+0000","last_fullsized":"2023-06-22T10:53:36.959531+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T18:02:23.289710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.539887+0000","last_change":"2023-06-22T10:53:31.957089+0000","last_active":"2023-06-22T10:53:37.539887+0000","last_peered":"2023-06-22T10:53:37.539887+0000","last_clean":"2023-06-22T10:53:37.539887+0000","last_became_active":"2023-06-22T10:53:31.956521+0000","last_became_peered":"2023-06-22T10:53:31.956521+0000","last_unstale":"2023-06-22T10:53:37.539887+0000","last_undegraded":"2023-06-22T10:53:37.539887+0000","last_fullsized":"2023-06-22T10:53:37.539887+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T11:34:19.856827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.540314+0000","last_change":"2023-06-22T10:53:31.945942+0000","last_active":"2023-06-22T10:53:37.540314+0000","last_peered":"2023-06-22T10:53:37.540314+0000","last_clean":"2023-06-22T10:53:37.540314+0000","last_became_active":"2023-06-22T10:53:31.945443+0000","last_became_peered":"2023-06-22T10:53:31.945443+0000","last_unstale":"2023-06-22T10:53:37.540314+0000","last_undegraded":"2023-06-22T10:53:37.540314+0000","last_fullsized":"2023-06-22T10:53:37.540314+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:53:17.921814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957777+0000","last_change":"2023-06-22T10:53:31.942412+0000","last_active":"2023-06-22T10:53:36.957777+0000","last_peered":"2023-06-22T10:53:36.957777+0000","last_clean":"2023-06-22T10:53:36.957777+0000","last_became_active":"2023-06-22T10:53:31.942136+0000","last_became_peered":"2023-06-22T10:53:31.942136+0000","last_unstale":"2023-06-22T10:53:36.957777+0000","last_undegraded":"2023-06-22T10:53:36.957777+0000","last_fullsized":"2023-06-22T10:53:36.957777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T18:31:17.457352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.732252+0000","last_change":"2023-06-22T10:53:31.947458+0000","last_active":"2023-06-22T10:53:37.732252+0000","last_peered":"2023-06-22T10:53:37.732252+0000","last_clean":"2023-06-22T10:53:37.732252+0000","last_became_active":"2023-06-22T10:53:31.947174+0000","last_became_peered":"2023-06-22T10:53:31.947174+0000","last_unstale":"2023-06-22T10:53:37.732252+0000","last_undegraded":"2023-06-22T10:53:37.732252+0000","last_fullsized":"2023-06-22T10:53:37.732252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:19:58.431004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957495+0000","last_change":"2023-06-22T10:53:31.952787+0000","last_active":"2023-06-22T10:53:36.957495+0000","last_peered":"2023-06-22T10:53:36.957495+0000","last_clean":"2023-06-22T10:53:36.957495+0000","last_became_active":"2023-06-22T10:53:31.951585+0000","last_became_peered":"2023-06-22T10:53:31.951585+0000","last_unstale":"2023-06-22T10:53:36.957495+0000","last_undegraded":"2023-06-22T10:53:36.957495+0000","last_fullsized":"2023-06-22T10:53:36.957495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T13:31:48.249498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.956661+0000","last_change":"2023-06-22T10:53:31.944865+0000","last_active":"2023-06-22T10:53:36.956661+0000","last_peered":"2023-06-22T10:53:36.956661+0000","last_clean":"2023-06-22T10:53:36.956661+0000","last_became_active":"2023-06-22T10:53:31.944263+0000","last_became_peered":"2023-06-22T10:53:31.944263+0000","last_unstale":"2023-06-22T10:53:36.956661+0000","last_undegraded":"2023-06-22T10:53:36.956661+0000","last_fullsized":"2023-06-22T10:53:36.956661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:47:02.983369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958024+0000","last_change":"2023-06-22T10:53:31.954328+0000","last_active":"2023-06-22T10:53:36.958024+0000","last_peered":"2023-06-22T10:53:36.958024+0000","last_clean":"2023-06-22T10:53:36.958024+0000","last_became_active":"2023-06-22T10:53:31.953823+0000","last_became_peered":"2023-06-22T10:53:31.953823+0000","last_unstale":"2023-06-22T10:53:36.958024+0000","last_undegraded":"2023-06-22T10:53:36.958024+0000","last_fullsized":"2023-06-22T10:53:36.958024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:58:30.886558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.539896+0000","last_change":"2023-06-22T10:53:31.943196+0000","last_active":"2023-06-22T10:53:37.539896+0000","last_peered":"2023-06-22T10:53:37.539896+0000","last_clean":"2023-06-22T10:53:37.539896+0000","last_became_active":"2023-06-22T10:53:31.942920+0000","last_became_peered":"2023-06-22T10:53:31.942920+0000","last_unstale":"2023-06-22T10:53:37.539896+0000","last_undegraded":"2023-06-22T10:53:37.539896+0000","last_fullsized":"2023-06-22T10:53:37.539896+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T20:10:55.019762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958201+0000","last_change":"2023-06-22T10:53:31.951020+0000","last_active":"2023-06-22T10:53:36.958201+0000","last_peered":"2023-06-22T10:53:36.958201+0000","last_clean":"2023-06-22T10:53:36.958201+0000","last_became_active":"2023-06-22T10:53:31.950755+0000","last_became_peered":"2023-06-22T10:53:31.950755+0000","last_unstale":"2023-06-22T10:53:36.958201+0000","last_undegraded":"2023-06-22T10:53:36.958201+0000","last_fullsized":"2023-06-22T10:53:36.958201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:15:38.583741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.732513+0000","last_change":"2023-06-22T10:53:31.942953+0000","last_active":"2023-06-22T10:53:37.732513+0000","last_peered":"2023-06-22T10:53:37.732513+0000","last_clean":"2023-06-22T10:53:37.732513+0000","last_became_active":"2023-06-22T10:53:31.942724+0000","last_became_peered":"2023-06-22T10:53:31.942724+0000","last_unstale":"2023-06-22T10:53:37.732513+0000","last_undegraded":"2023-06-22T10:53:37.732513+0000","last_fullsized":"2023-06-22T10:53:37.732513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T13:38:17.711538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.955830+0000","last_change":"2023-06-22T10:53:31.943005+0000","last_active":"2023-06-22T10:53:36.955830+0000","last_peered":"2023-06-22T10:53:36.955830+0000","last_clean":"2023-06-22T10:53:36.955830+0000","last_became_active":"2023-06-22T10:53:31.942716+0000","last_became_peered":"2023-06-22T10:53:31.942716+0000","last_unstale":"2023-06-22T10:53:36.955830+0000","last_undegraded":"2023-06-22T10:53:36.955830+0000","last_fullsized":"2023-06-22T10:53:36.955830+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:59:14.357071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.298489+0000","last_change":"2023-06-22T10:53:31.935496+0000","last_active":"2023-06-22T10:53:39.298489+0000","last_peered":"2023-06-22T10:53:39.298489+0000","last_clean":"2023-06-22T10:53:39.298489+0000","last_became_active":"2023-06-22T10:53:31.935201+0000","last_became_peered":"2023-06-22T10:53:31.935201+0000","last_unstale":"2023-06-22T10:53:39.298489+0000","last_undegraded":"2023-06-22T10:53:39.298489+0000","last_fullsized":"2023-06-22T10:53:39.298489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:37:31.693376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.732169+0000","last_change":"2023-06-22T10:53:31.947093+0000","last_active":"2023-06-22T10:53:37.732169+0000","last_peered":"2023-06-22T10:53:37.732169+0000","last_clean":"2023-06-22T10:53:37.732169+0000","last_became_active":"2023-06-22T10:53:31.946566+0000","last_became_peered":"2023-06-22T10:53:31.946566+0000","last_unstale":"2023-06-22T10:53:37.732169+0000","last_undegraded":"2023-06-22T10:53:37.732169+0000","last_fullsized":"2023-06-22T10:53:37.732169+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T17:02:38.568336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421688+0000","last_change":"2023-06-22T10:53:31.954476+0000","last_active":"2023-06-22T10:53:38.421688+0000","last_peered":"2023-06-22T10:53:38.421688+0000","last_clean":"2023-06-22T10:53:38.421688+0000","last_became_active":"2023-06-22T10:53:31.954161+0000","last_became_peered":"2023-06-22T10:53:31.954161+0000","last_unstale":"2023-06-22T10:53:38.421688+0000","last_undegraded":"2023-06-22T10:53:38.421688+0000","last_fullsized":"2023-06-22T10:53:38.421688+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:59:50.197538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421712+0000","last_change":"2023-06-22T10:53:31.933946+0000","last_active":"2023-06-22T10:53:38.421712+0000","last_peered":"2023-06-22T10:53:38.421712+0000","last_clean":"2023-06-22T10:53:38.421712+0000","last_became_active":"2023-06-22T10:53:31.933657+0000","last_became_peered":"2023-06-22T10:53:31.933657+0000","last_unstale":"2023-06-22T10:53:38.421712+0000","last_undegraded":"2023-06-22T10:53:38.421712+0000","last_fullsized":"2023-06-22T10:53:38.421712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T17:19:23.835283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958575+0000","last_change":"2023-06-22T10:53:31.949726+0000","last_active":"2023-06-22T10:53:36.958575+0000","last_peered":"2023-06-22T10:53:36.958575+0000","last_clean":"2023-06-22T10:53:36.958575+0000","last_became_active":"2023-06-22T10:53:31.949378+0000","last_became_peered":"2023-06-22T10:53:31.949378+0000","last_unstale":"2023-06-22T10:53:36.958575+0000","last_undegraded":"2023-06-22T10:53:36.958575+0000","last_fullsized":"2023-06-22T10:53:36.958575+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:01:37.811790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.959265+0000","last_change":"2023-06-22T10:53:35.993727+0000","last_active":"2023-06-22T10:53:36.959265+0000","last_peered":"2023-06-22T10:53:36.959265+0000","last_clean":"2023-06-22T10:53:36.959265+0000","last_became_active":"2023-06-22T10:53:35.993292+0000","last_became_peered":"2023-06-22T10:53:35.993292+0000","last_unstale":"2023-06-22T10:53:36.959265+0000","last_undegraded":"2023-06-22T10:53:36.959265+0000","last_fullsized":"2023-06-22T10:53:36.959265+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:53:08.402503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958353+0000","last_change":"2023-06-22T10:53:30.935533+0000","last_active":"2023-06-22T10:53:36.958353+0000","last_peered":"2023-06-22T10:53:36.958353+0000","last_clean":"2023-06-22T10:53:36.958353+0000","last_became_active":"2023-06-22T10:53:30.935260+0000","last_became_peered":"2023-06-22T10:53:30.935260+0000","last_unstale":"2023-06-22T10:53:36.958353+0000","last_undegraded":"2023-06-22T10:53:36.958353+0000","last_fullsized":"2023-06-22T10:53:36.958353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T11:57:57.902900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.299328+0000","last_change":"2023-06-22T10:53:31.940482+0000","last_active":"2023-06-22T10:53:39.299328+0000","last_peered":"2023-06-22T10:53:39.299328+0000","last_clean":"2023-06-22T10:53:39.299328+0000","last_became_active":"2023-06-22T10:53:31.940185+0000","last_became_peered":"2023-06-22T10:53:31.940185+0000","last_unstale":"2023-06-22T10:53:39.299328+0000","last_undegraded":"2023-06-22T10:53:39.299328+0000","last_fullsized":"2023-06-22T10:53:39.299328+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:16:58.055706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.280322+0000","last_change":"2023-06-22T10:53:35.980222+0000","last_active":"2023-06-22T10:53:37.280322+0000","last_peered":"2023-06-22T10:53:37.280322+0000","last_clean":"2023-06-22T10:53:37.280322+0000","last_became_active":"2023-06-22T10:53:35.979767+0000","last_became_peered":"2023-06-22T10:53:35.979767+0000","last_unstale":"2023-06-22T10:53:37.280322+0000","last_undegraded":"2023-06-22T10:53:37.280322+0000","last_fullsized":"2023-06-22T10:53:37.280322+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:52:53.767824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421003+0000","last_change":"2023-06-22T10:53:30.945420+0000","last_active":"2023-06-22T10:53:38.421003+0000","last_peered":"2023-06-22T10:53:38.421003+0000","last_clean":"2023-06-22T10:53:38.421003+0000","last_became_active":"2023-06-22T10:53:30.945124+0000","last_became_peered":"2023-06-22T10:53:30.945124+0000","last_unstale":"2023-06-22T10:53:38.421003+0000","last_undegraded":"2023-06-22T10:53:38.421003+0000","last_fullsized":"2023-06-22T10:53:38.421003+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T20:10:12.732255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.956493+0000","last_change":"2023-06-22T10:53:31.946696+0000","last_active":"2023-06-22T10:53:36.956493+0000","last_peered":"2023-06-22T10:53:36.956493+0000","last_clean":"2023-06-22T10:53:36.956493+0000","last_became_active":"2023-06-22T10:53:31.946424+0000","last_became_peered":"2023-06-22T10:53:31.946424+0000","last_unstale":"2023-06-22T10:53:36.956493+0000","last_undegraded":"2023-06-22T10:53:36.956493+0000","last_fullsized":"2023-06-22T10:53:36.956493+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:38:31.209670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.956801+0000","last_change":"2023-06-22T10:53:35.983086+0000","last_active":"2023-06-22T10:53:36.956801+0000","last_peered":"2023-06-22T10:53:36.956801+0000","last_clean":"2023-06-22T10:53:36.956801+0000","last_became_active":"2023-06-22T10:53:35.980183+0000","last_became_peered":"2023-06-22T10:53:35.980183+0000","last_unstale":"2023-06-22T10:53:36.956801+0000","last_undegraded":"2023-06-22T10:53:36.956801+0000","last_fullsized":"2023-06-22T10:53:36.956801+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:04:18.976819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.298108+0000","last_change":"2023-06-22T10:53:30.939562+0000","last_active":"2023-06-22T10:53:39.298108+0000","last_peered":"2023-06-22T10:53:39.298108+0000","last_clean":"2023-06-22T10:53:39.298108+0000","last_became_active":"2023-06-22T10:53:30.939268+0000","last_became_peered":"2023-06-22T10:53:30.939268+0000","last_unstale":"2023-06-22T10:53:39.298108+0000","last_undegraded":"2023-06-22T10:53:39.298108+0000","last_fullsized":"2023-06-22T10:53:39.298108+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:35:50.219987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.280368+0000","last_change":"2023-06-22T10:53:31.943624+0000","last_active":"2023-06-22T10:53:37.280368+0000","last_peered":"2023-06-22T10:53:37.280368+0000","last_clean":"2023-06-22T10:53:37.280368+0000","last_became_active":"2023-06-22T10:53:31.943277+0000","last_became_peered":"2023-06-22T10:53:31.943277+0000","last_unstale":"2023-06-22T10:53:37.280368+0000","last_undegraded":"2023-06-22T10:53:37.280368+0000","last_fullsized":"2023-06-22T10:53:37.280368+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:09:48.895446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.279534+0000","last_change":"2023-06-22T10:53:35.989354+0000","last_active":"2023-06-22T10:53:37.279534+0000","last_peered":"2023-06-22T10:53:37.279534+0000","last_clean":"2023-06-22T10:53:37.279534+0000","last_became_active":"2023-06-22T10:53:35.988867+0000","last_became_peered":"2023-06-22T10:53:35.988867+0000","last_unstale":"2023-06-22T10:53:37.279534+0000","last_undegraded":"2023-06-22T10:53:37.279534+0000","last_fullsized":"2023-06-22T10:53:37.279534+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:53:21.959666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.956819+0000","last_change":"2023-06-22T10:53:30.938551+0000","last_active":"2023-06-22T10:53:36.956819+0000","last_peered":"2023-06-22T10:53:36.956819+0000","last_clean":"2023-06-22T10:53:36.956819+0000","last_became_active":"2023-06-22T10:53:30.938065+0000","last_became_peered":"2023-06-22T10:53:30.938065+0000","last_unstale":"2023-06-22T10:53:36.956819+0000","last_undegraded":"2023-06-22T10:53:36.956819+0000","last_fullsized":"2023-06-22T10:53:36.956819+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:08:20.088422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.298566+0000","last_change":"2023-06-22T10:53:31.944695+0000","last_active":"2023-06-22T10:53:39.298566+0000","last_peered":"2023-06-22T10:53:39.298566+0000","last_clean":"2023-06-22T10:53:39.298566+0000","last_became_active":"2023-06-22T10:53:31.944401+0000","last_became_peered":"2023-06-22T10:53:31.944401+0000","last_unstale":"2023-06-22T10:53:39.298566+0000","last_undegraded":"2023-06-22T10:53:39.298566+0000","last_fullsized":"2023-06-22T10:53:39.298566+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:15:20.227426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.731901+0000","last_change":"2023-06-22T10:53:35.977551+0000","last_active":"2023-06-22T10:53:37.731901+0000","last_peered":"2023-06-22T10:53:37.731901+0000","last_clean":"2023-06-22T10:53:37.731901+0000","last_became_active":"2023-06-22T10:53:35.976931+0000","last_became_peered":"2023-06-22T10:53:35.976931+0000","last_unstale":"2023-06-22T10:53:37.731901+0000","last_undegraded":"2023-06-22T10:53:37.731901+0000","last_fullsized":"2023-06-22T10:53:37.731901+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:58:45.151109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958943+0000","last_change":"2023-06-22T10:53:30.926577+0000","last_active":"2023-06-22T10:53:36.958943+0000","last_peered":"2023-06-22T10:53:36.958943+0000","last_clean":"2023-06-22T10:53:36.958943+0000","last_became_active":"2023-06-22T10:53:30.926220+0000","last_became_peered":"2023-06-22T10:53:30.926220+0000","last_unstale":"2023-06-22T10:53:36.958943+0000","last_undegraded":"2023-06-22T10:53:36.958943+0000","last_fullsized":"2023-06-22T10:53:36.958943+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:16:41.854261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.298455+0000","last_change":"2023-06-22T10:53:31.943837+0000","last_active":"2023-06-22T10:53:39.298455+0000","last_peered":"2023-06-22T10:53:39.298455+0000","last_clean":"2023-06-22T10:53:39.298455+0000","last_became_active":"2023-06-22T10:53:31.943561+0000","last_became_peered":"2023-06-22T10:53:31.943561+0000","last_unstale":"2023-06-22T10:53:39.298455+0000","last_undegraded":"2023-06-22T10:53:39.298455+0000","last_fullsized":"2023-06-22T10:53:39.298455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T13:38:17.711538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.298880+0000","last_change":"2023-06-22T10:53:35.980240+0000","last_active":"2023-06-22T10:53:39.298880+0000","last_peered":"2023-06-22T10:53:39.298880+0000","last_clean":"2023-06-22T10:53:39.298880+0000","last_became_active":"2023-06-22T10:53:35.979760+0000","last_became_peered":"2023-06-22T10:53:35.979760+0000","last_unstale":"2023-06-22T10:53:39.298880+0000","last_undegraded":"2023-06-22T10:53:39.298880+0000","last_fullsized":"2023-06-22T10:53:39.298880+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T17:38:28.038125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.732712+0000","last_change":"2023-06-22T10:53:30.942222+0000","last_active":"2023-06-22T10:53:37.732712+0000","last_peered":"2023-06-22T10:53:37.732712+0000","last_clean":"2023-06-22T10:53:37.732712+0000","last_became_active":"2023-06-22T10:53:30.941843+0000","last_became_peered":"2023-06-22T10:53:30.941843+0000","last_unstale":"2023-06-22T10:53:37.732712+0000","last_undegraded":"2023-06-22T10:53:37.732712+0000","last_fullsized":"2023-06-22T10:53:37.732712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:54:13.524784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421339+0000","last_change":"2023-06-22T10:53:31.940635+0000","last_active":"2023-06-22T10:53:38.421339+0000","last_peered":"2023-06-22T10:53:38.421339+0000","last_clean":"2023-06-22T10:53:38.421339+0000","last_became_active":"2023-06-22T10:53:31.940144+0000","last_became_peered":"2023-06-22T10:53:31.940144+0000","last_unstale":"2023-06-22T10:53:38.421339+0000","last_undegraded":"2023-06-22T10:53:38.421339+0000","last_fullsized":"2023-06-22T10:53:38.421339+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T18:57:56.828299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421113+0000","last_change":"2023-06-22T10:53:35.981516+0000","last_active":"2023-06-22T10:53:38.421113+0000","last_peered":"2023-06-22T10:53:38.421113+0000","last_clean":"2023-06-22T10:53:38.421113+0000","last_became_active":"2023-06-22T10:53:35.981085+0000","last_became_peered":"2023-06-22T10:53:35.981085+0000","last_unstale":"2023-06-22T10:53:38.421113+0000","last_undegraded":"2023-06-22T10:53:38.421113+0000","last_fullsized":"2023-06-22T10:53:38.421113+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:49:24.206495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'10","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:50.736031+0000","last_change":"2023-06-22T10:53:30.929674+0000","last_active":"2023-06-22T10:53:50.736031+0000","last_peered":"2023-06-22T10:53:50.736031+0000","last_clean":"2023-06-22T10:53:50.736031+0000","last_became_active":"2023-06-22T10:53:30.929103+0000","last_became_peered":"2023-06-22T10:53:30.929103+0000","last_unstale":"2023-06-22T10:53:50.736031+0000","last_undegraded":"2023-06-22T10:53:50.736031+0000","last_fullsized":"2023-06-22T10:53:50.736031+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T11:24:25.762617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958280+0000","last_change":"2023-06-22T10:53:31.950427+0000","last_active":"2023-06-22T10:53:36.958280+0000","last_peered":"2023-06-22T10:53:36.958280+0000","last_clean":"2023-06-22T10:53:36.958280+0000","last_became_active":"2023-06-22T10:53:31.950139+0000","last_became_peered":"2023-06-22T10:53:31.950139+0000","last_unstale":"2023-06-22T10:53:36.958280+0000","last_undegraded":"2023-06-22T10:53:36.958280+0000","last_fullsized":"2023-06-22T10:53:36.958280+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:32:48.965556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958792+0000","last_change":"2023-06-22T10:53:35.974441+0000","last_active":"2023-06-22T10:53:36.958792+0000","last_peered":"2023-06-22T10:53:36.958792+0000","last_clean":"2023-06-22T10:53:36.958792+0000","last_became_active":"2023-06-22T10:53:35.973542+0000","last_became_peered":"2023-06-22T10:53:35.973542+0000","last_unstale":"2023-06-22T10:53:36.958792+0000","last_undegraded":"2023-06-22T10:53:36.958792+0000","last_fullsized":"2023-06-22T10:53:36.958792+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:37:35.731228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.732330+0000","last_change":"2023-06-22T10:53:30.940712+0000","last_active":"2023-06-22T10:53:37.732330+0000","last_peered":"2023-06-22T10:53:37.732330+0000","last_clean":"2023-06-22T10:53:37.732330+0000","last_became_active":"2023-06-22T10:53:30.940318+0000","last_became_peered":"2023-06-22T10:53:30.940318+0000","last_unstale":"2023-06-22T10:53:37.732330+0000","last_undegraded":"2023-06-22T10:53:37.732330+0000","last_fullsized":"2023-06-22T10:53:37.732330+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:15:19.221249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.299326+0000","last_change":"2023-06-22T10:53:31.942026+0000","last_active":"2023-06-22T10:53:39.299326+0000","last_peered":"2023-06-22T10:53:39.299326+0000","last_clean":"2023-06-22T10:53:39.299326+0000","last_became_active":"2023-06-22T10:53:31.941695+0000","last_became_peered":"2023-06-22T10:53:31.941695+0000","last_unstale":"2023-06-22T10:53:39.299326+0000","last_undegraded":"2023-06-22T10:53:39.299326+0000","last_fullsized":"2023-06-22T10:53:39.299326+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:49:21.017446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.299153+0000","last_change":"2023-06-22T10:53:35.984076+0000","last_active":"2023-06-22T10:53:39.299153+0000","last_peered":"2023-06-22T10:53:39.299153+0000","last_clean":"2023-06-22T10:53:39.299153+0000","last_became_active":"2023-06-22T10:53:35.983702+0000","last_became_peered":"2023-06-22T10:53:35.983702+0000","last_unstale":"2023-06-22T10:53:39.299153+0000","last_undegraded":"2023-06-22T10:53:39.299153+0000","last_fullsized":"2023-06-22T10:53:39.299153+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:39:18.877636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.955629+0000","last_change":"2023-06-22T10:53:30.937271+0000","last_active":"2023-06-22T10:53:36.955629+0000","last_peered":"2023-06-22T10:53:36.955629+0000","last_clean":"2023-06-22T10:53:36.955629+0000","last_became_active":"2023-06-22T10:53:30.936656+0000","last_became_peered":"2023-06-22T10:53:30.936656+0000","last_unstale":"2023-06-22T10:53:36.955629+0000","last_undegraded":"2023-06-22T10:53:36.955629+0000","last_fullsized":"2023-06-22T10:53:36.955629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T20:35:09.275456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958456+0000","last_change":"2023-06-22T10:53:31.937743+0000","last_active":"2023-06-22T10:53:36.958456+0000","last_peered":"2023-06-22T10:53:36.958456+0000","last_clean":"2023-06-22T10:53:36.958456+0000","last_became_active":"2023-06-22T10:53:31.937458+0000","last_became_peered":"2023-06-22T10:53:31.937458+0000","last_unstale":"2023-06-22T10:53:36.958456+0000","last_undegraded":"2023-06-22T10:53:36.958456+0000","last_fullsized":"2023-06-22T10:53:36.958456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:09:14.741666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.299475+0000","last_change":"2023-06-22T10:53:35.988689+0000","last_active":"2023-06-22T10:53:39.299475+0000","last_peered":"2023-06-22T10:53:39.299475+0000","last_clean":"2023-06-22T10:53:39.299475+0000","last_became_active":"2023-06-22T10:53:35.988266+0000","last_became_peered":"2023-06-22T10:53:35.988266+0000","last_unstale":"2023-06-22T10:53:39.299475+0000","last_undegraded":"2023-06-22T10:53:39.299475+0000","last_fullsized":"2023-06-22T10:53:39.299475+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:00:09.093418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.732168+0000","last_change":"2023-06-22T10:53:30.941102+0000","last_active":"2023-06-22T10:53:37.732168+0000","last_peered":"2023-06-22T10:53:37.732168+0000","last_clean":"2023-06-22T10:53:37.732168+0000","last_became_active":"2023-06-22T10:53:30.940822+0000","last_became_peered":"2023-06-22T10:53:30.940822+0000","last_unstale":"2023-06-22T10:53:37.732168+0000","last_undegraded":"2023-06-22T10:53:37.732168+0000","last_fullsized":"2023-06-22T10:53:37.732168+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:09:13.735489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.956701+0000","last_change":"2023-06-22T10:53:31.944224+0000","last_active":"2023-06-22T10:53:36.956701+0000","last_peered":"2023-06-22T10:53:36.956701+0000","last_clean":"2023-06-22T10:53:36.956701+0000","last_became_active":"2023-06-22T10:53:31.943836+0000","last_became_peered":"2023-06-22T10:53:31.943836+0000","last_unstale":"2023-06-22T10:53:36.956701+0000","last_undegraded":"2023-06-22T10:53:36.956701+0000","last_fullsized":"2023-06-22T10:53:36.956701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:06:51.541995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958768+0000","last_change":"2023-06-22T10:53:35.972031+0000","last_active":"2023-06-22T10:53:36.958768+0000","last_peered":"2023-06-22T10:53:36.958768+0000","last_clean":"2023-06-22T10:53:36.958768+0000","last_became_active":"2023-06-22T10:53:35.971550+0000","last_became_peered":"2023-06-22T10:53:35.971550+0000","last_unstale":"2023-06-22T10:53:36.958768+0000","last_undegraded":"2023-06-22T10:53:36.958768+0000","last_fullsized":"2023-06-22T10:53:36.958768+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T13:38:21.749390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.279619+0000","last_change":"2023-06-22T10:53:30.937109+0000","last_active":"2023-06-22T10:53:37.279619+0000","last_peered":"2023-06-22T10:53:37.279619+0000","last_clean":"2023-06-22T10:53:37.279619+0000","last_became_active":"2023-06-22T10:53:30.936757+0000","last_became_peered":"2023-06-22T10:53:30.936757+0000","last_unstale":"2023-06-22T10:53:37.279619+0000","last_undegraded":"2023-06-22T10:53:37.279619+0000","last_fullsized":"2023-06-22T10:53:37.279619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T13:33:41.336023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.299478+0000","last_change":"2023-06-22T10:53:31.948662+0000","last_active":"2023-06-22T10:53:39.299478+0000","last_peered":"2023-06-22T10:53:39.299478+0000","last_clean":"2023-06-22T10:53:39.299478+0000","last_became_active":"2023-06-22T10:53:31.948201+0000","last_became_peered":"2023-06-22T10:53:31.948201+0000","last_unstale":"2023-06-22T10:53:39.299478+0000","last_undegraded":"2023-06-22T10:53:39.299478+0000","last_fullsized":"2023-06-22T10:53:39.299478+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T15:52:35.480952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.732657+0000","last_change":"2023-06-22T10:53:35.977231+0000","last_active":"2023-06-22T10:53:37.732657+0000","last_peered":"2023-06-22T10:53:37.732657+0000","last_clean":"2023-06-22T10:53:37.732657+0000","last_became_active":"2023-06-22T10:53:35.976777+0000","last_became_peered":"2023-06-22T10:53:35.976777+0000","last_unstale":"2023-06-22T10:53:37.732657+0000","last_undegraded":"2023-06-22T10:53:37.732657+0000","last_fullsized":"2023-06-22T10:53:37.732657+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:16:46.898291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.733132+0000","last_change":"2023-06-22T10:53:30.941433+0000","last_active":"2023-06-22T10:53:37.733132+0000","last_peered":"2023-06-22T10:53:37.733132+0000","last_clean":"2023-06-22T10:53:37.733132+0000","last_became_active":"2023-06-22T10:53:30.941122+0000","last_became_peered":"2023-06-22T10:53:30.941122+0000","last_unstale":"2023-06-22T10:53:37.733132+0000","last_undegraded":"2023-06-22T10:53:37.733132+0000","last_fullsized":"2023-06-22T10:53:37.733132+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:49:20.011268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957286+0000","last_change":"2023-06-22T10:53:31.946014+0000","last_active":"2023-06-22T10:53:36.957286+0000","last_peered":"2023-06-22T10:53:36.957286+0000","last_clean":"2023-06-22T10:53:36.957286+0000","last_became_active":"2023-06-22T10:53:31.945733+0000","last_became_peered":"2023-06-22T10:53:31.945733+0000","last_unstale":"2023-06-22T10:53:36.957286+0000","last_undegraded":"2023-06-22T10:53:36.957286+0000","last_fullsized":"2023-06-22T10:53:36.957286+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:54:20.603411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.539641+0000","last_change":"2023-06-22T10:53:35.976548+0000","last_active":"2023-06-22T10:53:37.539641+0000","last_peered":"2023-06-22T10:53:37.539641+0000","last_clean":"2023-06-22T10:53:37.539641+0000","last_became_active":"2023-06-22T10:53:35.975282+0000","last_became_peered":"2023-06-22T10:53:35.975282+0000","last_unstale":"2023-06-22T10:53:37.539641+0000","last_undegraded":"2023-06-22T10:53:37.539641+0000","last_fullsized":"2023-06-22T10:53:37.539641+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:47:49.439479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.733034+0000","last_change":"2023-06-22T10:53:30.940936+0000","last_active":"2023-06-22T10:53:37.733034+0000","last_peered":"2023-06-22T10:53:37.733034+0000","last_clean":"2023-06-22T10:53:37.733034+0000","last_became_active":"2023-06-22T10:53:30.940494+0000","last_became_peered":"2023-06-22T10:53:30.940494+0000","last_unstale":"2023-06-22T10:53:37.733034+0000","last_undegraded":"2023-06-22T10:53:37.733034+0000","last_fullsized":"2023-06-22T10:53:37.733034+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:39:13.833606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957664+0000","last_change":"2023-06-22T10:53:31.953007+0000","last_active":"2023-06-22T10:53:36.957664+0000","last_peered":"2023-06-22T10:53:36.957664+0000","last_clean":"2023-06-22T10:53:36.957664+0000","last_became_active":"2023-06-22T10:53:31.952493+0000","last_became_peered":"2023-06-22T10:53:31.952493+0000","last_unstale":"2023-06-22T10:53:36.957664+0000","last_undegraded":"2023-06-22T10:53:36.957664+0000","last_fullsized":"2023-06-22T10:53:36.957664+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:46:07.563474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.539899+0000","last_change":"2023-06-22T10:53:35.975271+0000","last_active":"2023-06-22T10:53:37.539899+0000","last_peered":"2023-06-22T10:53:37.539899+0000","last_clean":"2023-06-22T10:53:37.539899+0000","last_became_active":"2023-06-22T10:53:35.974796+0000","last_became_peered":"2023-06-22T10:53:35.974796+0000","last_unstale":"2023-06-22T10:53:37.539899+0000","last_undegraded":"2023-06-22T10:53:37.539899+0000","last_fullsized":"2023-06-22T10:53:37.539899+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:55:38.296763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.732906+0000","last_change":"2023-06-22T10:53:30.935554+0000","last_active":"2023-06-22T10:53:37.732906+0000","last_peered":"2023-06-22T10:53:37.732906+0000","last_clean":"2023-06-22T10:53:37.732906+0000","last_became_active":"2023-06-22T10:53:30.935186+0000","last_became_peered":"2023-06-22T10:53:30.935186+0000","last_unstale":"2023-06-22T10:53:37.732906+0000","last_undegraded":"2023-06-22T10:53:37.732906+0000","last_fullsized":"2023-06-22T10:53:37.732906+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:12:31.122076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.279728+0000","last_change":"2023-06-22T10:53:31.939659+0000","last_active":"2023-06-22T10:53:37.279728+0000","last_peered":"2023-06-22T10:53:37.279728+0000","last_clean":"2023-06-22T10:53:37.279728+0000","last_became_active":"2023-06-22T10:53:31.939359+0000","last_became_peered":"2023-06-22T10:53:31.939359+0000","last_unstale":"2023-06-22T10:53:37.279728+0000","last_undegraded":"2023-06-22T10:53:37.279728+0000","last_fullsized":"2023-06-22T10:53:37.279728+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T20:49:06.159398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.539838+0000","last_change":"2023-06-22T10:53:35.986300+0000","last_active":"2023-06-22T10:53:37.539838+0000","last_peered":"2023-06-22T10:53:37.539838+0000","last_clean":"2023-06-22T10:53:37.539838+0000","last_became_active":"2023-06-22T10:53:35.985773+0000","last_became_peered":"2023-06-22T10:53:35.985773+0000","last_unstale":"2023-06-22T10:53:37.539838+0000","last_undegraded":"2023-06-22T10:53:37.539838+0000","last_fullsized":"2023-06-22T10:53:37.539838+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:02:57.117668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957836+0000","last_change":"2023-06-22T10:53:30.938410+0000","last_active":"2023-06-22T10:53:36.957836+0000","last_peered":"2023-06-22T10:53:36.957836+0000","last_clean":"2023-06-22T10:53:36.957836+0000","last_became_active":"2023-06-22T10:53:30.938082+0000","last_became_peered":"2023-06-22T10:53:30.938082+0000","last_unstale":"2023-06-22T10:53:36.957836+0000","last_undegraded":"2023-06-22T10:53:36.957836+0000","last_fullsized":"2023-06-22T10:53:36.957836+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:01:52.091411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.956128+0000","last_change":"2023-06-22T10:53:31.938625+0000","last_active":"2023-06-22T10:53:36.956128+0000","last_peered":"2023-06-22T10:53:36.956128+0000","last_clean":"2023-06-22T10:53:36.956128+0000","last_became_active":"2023-06-22T10:53:31.938266+0000","last_became_peered":"2023-06-22T10:53:31.938266+0000","last_unstale":"2023-06-22T10:53:36.956128+0000","last_undegraded":"2023-06-22T10:53:36.956128+0000","last_fullsized":"2023-06-22T10:53:36.956128+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:22:33.870719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.540124+0000","last_change":"2023-06-22T10:53:35.973789+0000","last_active":"2023-06-22T10:53:37.540124+0000","last_peered":"2023-06-22T10:53:37.540124+0000","last_clean":"2023-06-22T10:53:37.540124+0000","last_became_active":"2023-06-22T10:53:35.973221+0000","last_became_peered":"2023-06-22T10:53:35.973221+0000","last_unstale":"2023-06-22T10:53:37.540124+0000","last_undegraded":"2023-06-22T10:53:37.540124+0000","last_fullsized":"2023-06-22T10:53:37.540124+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:41:28.183007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.298246+0000","last_change":"2023-06-22T10:53:30.940317+0000","last_active":"2023-06-22T10:53:39.298246+0000","last_peered":"2023-06-22T10:53:39.298246+0000","last_clean":"2023-06-22T10:53:39.298246+0000","last_became_active":"2023-06-22T10:53:30.939695+0000","last_became_peered":"2023-06-22T10:53:30.939695+0000","last_unstale":"2023-06-22T10:53:39.298246+0000","last_undegraded":"2023-06-22T10:53:39.298246+0000","last_fullsized":"2023-06-22T10:53:39.298246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:19:57.424826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957974+0000","last_change":"2023-06-22T10:53:31.955337+0000","last_active":"2023-06-22T10:53:36.957974+0000","last_peered":"2023-06-22T10:53:36.957974+0000","last_clean":"2023-06-22T10:53:36.957974+0000","last_became_active":"2023-06-22T10:53:31.955009+0000","last_became_peered":"2023-06-22T10:53:31.955009+0000","last_unstale":"2023-06-22T10:53:36.957974+0000","last_undegraded":"2023-06-22T10:53:36.957974+0000","last_fullsized":"2023-06-22T10:53:36.957974+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:44:52.079657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421497+0000","last_change":"2023-06-22T10:53:35.992703+0000","last_active":"2023-06-22T10:53:38.421497+0000","last_peered":"2023-06-22T10:53:38.421497+0000","last_clean":"2023-06-22T10:53:38.421497+0000","last_became_active":"2023-06-22T10:53:35.991759+0000","last_became_peered":"2023-06-22T10:53:35.991759+0000","last_unstale":"2023-06-22T10:53:38.421497+0000","last_undegraded":"2023-06-22T10:53:38.421497+0000","last_fullsized":"2023-06-22T10:53:38.421497+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:06:55.579848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.279637+0000","last_change":"2023-06-22T10:53:30.942339+0000","last_active":"2023-06-22T10:53:37.279637+0000","last_peered":"2023-06-22T10:53:37.279637+0000","last_clean":"2023-06-22T10:53:37.279637+0000","last_became_active":"2023-06-22T10:53:30.942042+0000","last_became_peered":"2023-06-22T10:53:30.942042+0000","last_unstale":"2023-06-22T10:53:37.279637+0000","last_undegraded":"2023-06-22T10:53:37.279637+0000","last_fullsized":"2023-06-22T10:53:37.279637+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:03:54.160970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.959163+0000","last_change":"2023-06-22T10:53:31.946119+0000","last_active":"2023-06-22T10:53:36.959163+0000","last_peered":"2023-06-22T10:53:36.959163+0000","last_clean":"2023-06-22T10:53:36.959163+0000","last_became_active":"2023-06-22T10:53:31.945270+0000","last_became_peered":"2023-06-22T10:53:31.945270+0000","last_unstale":"2023-06-22T10:53:36.959163+0000","last_undegraded":"2023-06-22T10:53:36.959163+0000","last_fullsized":"2023-06-22T10:53:36.959163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:54:16.378747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958959+0000","last_change":"2023-06-22T10:53:35.981345+0000","last_active":"2023-06-22T10:53:36.958959+0000","last_peered":"2023-06-22T10:53:36.958959+0000","last_clean":"2023-06-22T10:53:36.958959+0000","last_became_active":"2023-06-22T10:53:35.980744+0000","last_became_peered":"2023-06-22T10:53:35.980744+0000","last_unstale":"2023-06-22T10:53:36.958959+0000","last_undegraded":"2023-06-22T10:53:36.958959+0000","last_fullsized":"2023-06-22T10:53:36.958959+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:54:18.568814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957001+0000","last_change":"2023-06-22T10:53:30.932306+0000","last_active":"2023-06-22T10:53:36.957001+0000","last_peered":"2023-06-22T10:53:36.957001+0000","last_clean":"2023-06-22T10:53:36.957001+0000","last_became_active":"2023-06-22T10:53:30.931997+0000","last_became_peered":"2023-06-22T10:53:30.931997+0000","last_unstale":"2023-06-22T10:53:36.957001+0000","last_undegraded":"2023-06-22T10:53:36.957001+0000","last_fullsized":"2023-06-22T10:53:36.957001+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:39:13.833606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958190+0000","last_change":"2023-06-22T10:53:31.954114+0000","last_active":"2023-06-22T10:53:36.958190+0000","last_peered":"2023-06-22T10:53:36.958190+0000","last_clean":"2023-06-22T10:53:36.958190+0000","last_became_active":"2023-06-22T10:53:31.953496+0000","last_became_peered":"2023-06-22T10:53:31.953496+0000","last_unstale":"2023-06-22T10:53:36.958190+0000","last_undegraded":"2023-06-22T10:53:36.958190+0000","last_fullsized":"2023-06-22T10:53:36.958190+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T15:22:38.636161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957711+0000","last_change":"2023-06-22T10:53:35.986282+0000","last_active":"2023-06-22T10:53:36.957711+0000","last_peered":"2023-06-22T10:53:36.957711+0000","last_clean":"2023-06-22T10:53:36.957711+0000","last_became_active":"2023-06-22T10:53:35.985805+0000","last_became_peered":"2023-06-22T10:53:35.985805+0000","last_unstale":"2023-06-22T10:53:36.957711+0000","last_undegraded":"2023-06-22T10:53:36.957711+0000","last_fullsized":"2023-06-22T10:53:36.957711+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:06:28.390109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.298108+0000","last_change":"2023-06-22T10:53:30.937943+0000","last_active":"2023-06-22T10:53:39.298108+0000","last_peered":"2023-06-22T10:53:39.298108+0000","last_clean":"2023-06-22T10:53:39.298108+0000","last_became_active":"2023-06-22T10:53:30.937648+0000","last_became_peered":"2023-06-22T10:53:30.937648+0000","last_unstale":"2023-06-22T10:53:39.298108+0000","last_undegraded":"2023-06-22T10:53:39.298108+0000","last_fullsized":"2023-06-22T10:53:39.298108+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T17:02:37.562158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421904+0000","last_change":"2023-06-22T10:53:31.930885+0000","last_active":"2023-06-22T10:53:38.421904+0000","last_peered":"2023-06-22T10:53:38.421904+0000","last_clean":"2023-06-22T10:53:38.421904+0000","last_became_active":"2023-06-22T10:53:31.930508+0000","last_became_peered":"2023-06-22T10:53:31.930508+0000","last_unstale":"2023-06-22T10:53:38.421904+0000","last_undegraded":"2023-06-22T10:53:38.421904+0000","last_fullsized":"2023-06-22T10:53:38.421904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:56:30.123428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.956198+0000","last_change":"2023-06-22T10:53:35.981990+0000","last_active":"2023-06-22T10:53:36.956198+0000","last_peered":"2023-06-22T10:53:36.956198+0000","last_clean":"2023-06-22T10:53:36.956198+0000","last_became_active":"2023-06-22T10:53:35.979743+0000","last_became_peered":"2023-06-22T10:53:35.979743+0000","last_unstale":"2023-06-22T10:53:36.956198+0000","last_undegraded":"2023-06-22T10:53:36.956198+0000","last_fullsized":"2023-06-22T10:53:36.956198+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:29:28.820265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421611+0000","last_change":"2023-06-22T10:53:25.624603+0000","last_active":"2023-06-22T10:53:38.421611+0000","last_peered":"2023-06-22T10:53:38.421611+0000","last_clean":"2023-06-22T10:53:38.421611+0000","last_became_active":"2023-06-22T10:53:25.624302+0000","last_became_peered":"2023-06-22T10:53:25.624302+0000","last_unstale":"2023-06-22T10:53:38.421611+0000","last_undegraded":"2023-06-22T10:53:38.421611+0000","last_fullsized":"2023-06-22T10:53:38.421611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_clean_scrub_stamp":"2023-06-22T10:53:24.612028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:46:56.694570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958314+0000","last_change":"2023-06-22T10:53:30.938529+0000","last_active":"2023-06-22T10:53:36.958314+0000","last_peered":"2023-06-22T10:53:36.958314+0000","last_clean":"2023-06-22T10:53:36.958314+0000","last_became_active":"2023-06-22T10:53:30.938128+0000","last_became_peered":"2023-06-22T10:53:30.938128+0000","last_unstale":"2023-06-22T10:53:36.958314+0000","last_undegraded":"2023-06-22T10:53:36.958314+0000","last_fullsized":"2023-06-22T10:53:36.958314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:19:57.424826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421209+0000","last_change":"2023-06-22T10:53:31.943591+0000","last_active":"2023-06-22T10:53:38.421209+0000","last_peered":"2023-06-22T10:53:38.421209+0000","last_clean":"2023-06-22T10:53:38.421209+0000","last_became_active":"2023-06-22T10:53:31.943246+0000","last_became_peered":"2023-06-22T10:53:31.943246+0000","last_unstale":"2023-06-22T10:53:38.421209+0000","last_undegraded":"2023-06-22T10:53:38.421209+0000","last_fullsized":"2023-06-22T10:53:38.421209+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:38:31.209670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.956370+0000","last_change":"2023-06-22T10:53:35.983928+0000","last_active":"2023-06-22T10:53:36.956370+0000","last_peered":"2023-06-22T10:53:36.956370+0000","last_clean":"2023-06-22T10:53:36.956370+0000","last_became_active":"2023-06-22T10:53:35.983547+0000","last_became_peered":"2023-06-22T10:53:35.983547+0000","last_unstale":"2023-06-22T10:53:36.956370+0000","last_undegraded":"2023-06-22T10:53:36.956370+0000","last_fullsized":"2023-06-22T10:53:36.956370+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T15:14:35.353462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957795+0000","last_change":"2023-06-22T10:53:25.624213+0000","last_active":"2023-06-22T10:53:36.957795+0000","last_peered":"2023-06-22T10:53:36.957795+0000","last_clean":"2023-06-22T10:53:36.957795+0000","last_became_active":"2023-06-22T10:53:25.623692+0000","last_became_peered":"2023-06-22T10:53:25.623692+0000","last_unstale":"2023-06-22T10:53:36.957795+0000","last_undegraded":"2023-06-22T10:53:36.957795+0000","last_fullsized":"2023-06-22T10:53:36.957795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_clean_scrub_stamp":"2023-06-22T10:53:24.612028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T11:10:32.309210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957903+0000","last_change":"2023-06-22T10:53:30.940331+0000","last_active":"2023-06-22T10:53:36.957903+0000","last_peered":"2023-06-22T10:53:36.957903+0000","last_clean":"2023-06-22T10:53:36.957903+0000","last_became_active":"2023-06-22T10:53:30.939881+0000","last_became_peered":"2023-06-22T10:53:30.939881+0000","last_unstale":"2023-06-22T10:53:36.957903+0000","last_undegraded":"2023-06-22T10:53:36.957903+0000","last_fullsized":"2023-06-22T10:53:36.957903+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:21:26.540035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421562+0000","last_change":"2023-06-22T10:53:31.934499+0000","last_active":"2023-06-22T10:53:38.421562+0000","last_peered":"2023-06-22T10:53:38.421562+0000","last_clean":"2023-06-22T10:53:38.421562+0000","last_became_active":"2023-06-22T10:53:31.934221+0000","last_became_peered":"2023-06-22T10:53:31.934221+0000","last_unstale":"2023-06-22T10:53:38.421562+0000","last_undegraded":"2023-06-22T10:53:38.421562+0000","last_fullsized":"2023-06-22T10:53:38.421562+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:08:21.094599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.540144+0000","last_change":"2023-06-22T10:53:35.973534+0000","last_active":"2023-06-22T10:53:37.540144+0000","last_peered":"2023-06-22T10:53:37.540144+0000","last_clean":"2023-06-22T10:53:37.540144+0000","last_became_active":"2023-06-22T10:53:35.973091+0000","last_became_peered":"2023-06-22T10:53:35.973091+0000","last_unstale":"2023-06-22T10:53:37.540144+0000","last_undegraded":"2023-06-22T10:53:37.540144+0000","last_fullsized":"2023-06-22T10:53:37.540144+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:21:55.271025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.539801+0000","last_change":"2023-06-22T10:53:25.679314+0000","last_active":"2023-06-22T10:53:37.539801+0000","last_peered":"2023-06-22T10:53:37.539801+0000","last_clean":"2023-06-22T10:53:37.539801+0000","last_became_active":"2023-06-22T10:53:25.678947+0000","last_became_peered":"2023-06-22T10:53:25.678947+0000","last_unstale":"2023-06-22T10:53:37.539801+0000","last_undegraded":"2023-06-22T10:53:37.539801+0000","last_fullsized":"2023-06-22T10:53:37.539801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_clean_scrub_stamp":"2023-06-22T10:53:24.612028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:08:41.570586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421091+0000","last_change":"2023-06-22T10:53:30.944583+0000","last_active":"2023-06-22T10:53:38.421091+0000","last_peered":"2023-06-22T10:53:38.421091+0000","last_clean":"2023-06-22T10:53:38.421091+0000","last_became_active":"2023-06-22T10:53:30.944251+0000","last_became_peered":"2023-06-22T10:53:30.944251+0000","last_unstale":"2023-06-22T10:53:38.421091+0000","last_undegraded":"2023-06-22T10:53:38.421091+0000","last_fullsized":"2023-06-22T10:53:38.421091+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:16:33.667495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421775+0000","last_change":"2023-06-22T10:53:31.939367+0000","last_active":"2023-06-22T10:53:38.421775+0000","last_peered":"2023-06-22T10:53:38.421775+0000","last_clean":"2023-06-22T10:53:38.421775+0000","last_became_active":"2023-06-22T10:53:31.939090+0000","last_became_peered":"2023-06-22T10:53:31.939090+0000","last_unstale":"2023-06-22T10:53:38.421775+0000","last_undegraded":"2023-06-22T10:53:38.421775+0000","last_fullsized":"2023-06-22T10:53:38.421775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:31:58.628207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.732375+0000","last_change":"2023-06-22T10:53:35.971334+0000","last_active":"2023-06-22T10:53:37.732375+0000","last_peered":"2023-06-22T10:53:37.732375+0000","last_clean":"2023-06-22T10:53:37.732375+0000","last_became_active":"2023-06-22T10:53:35.970663+0000","last_became_peered":"2023-06-22T10:53:35.970663+0000","last_unstale":"2023-06-22T10:53:37.732375+0000","last_undegraded":"2023-06-22T10:53:37.732375+0000","last_fullsized":"2023-06-22T10:53:37.732375+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T15:48:40.394252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958397+0000","last_change":"2023-06-22T10:53:25.624072+0000","last_active":"2023-06-22T10:53:36.958397+0000","last_peered":"2023-06-22T10:53:36.958397+0000","last_clean":"2023-06-22T10:53:36.958397+0000","last_became_active":"2023-06-22T10:53:25.623617+0000","last_became_peered":"2023-06-22T10:53:25.623617+0000","last_unstale":"2023-06-22T10:53:36.958397+0000","last_undegraded":"2023-06-22T10:53:36.958397+0000","last_fullsized":"2023-06-22T10:53:36.958397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_clean_scrub_stamp":"2023-06-22T10:53:24.612028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T15:48:30.067600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":183,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.732114+0000","last_change":"2023-06-22T10:53:19.693774+0000","last_active":"2023-06-22T10:53:37.732114+0000","last_peered":"2023-06-22T10:53:37.732114+0000","last_clean":"2023-06-22T10:53:37.732114+0000","last_became_active":"2023-06-22T10:53:19.692329+0000","last_became_peered":"2023-06-22T10:53:19.692329+0000","last_unstale":"2023-06-22T10:53:37.732114+0000","last_undegraded":"2023-06-22T10:53:37.732114+0000","last_fullsized":"2023-06-22T10:53:37.732114+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:17.830348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:17.830348+0000","last_clean_scrub_stamp":"2023-06-22T10:53:17.830348+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:35:38.155685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.298095+0000","last_change":"2023-06-22T10:53:30.939596+0000","last_active":"2023-06-22T10:53:39.298095+0000","last_peered":"2023-06-22T10:53:39.298095+0000","last_clean":"2023-06-22T10:53:39.298095+0000","last_became_active":"2023-06-22T10:53:30.939312+0000","last_became_peered":"2023-06-22T10:53:30.939312+0000","last_unstale":"2023-06-22T10:53:39.298095+0000","last_undegraded":"2023-06-22T10:53:39.298095+0000","last_fullsized":"2023-06-22T10:53:39.298095+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:58:40.107079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.279924+0000","last_change":"2023-06-22T10:53:31.953786+0000","last_active":"2023-06-22T10:53:37.279924+0000","last_peered":"2023-06-22T10:53:37.279924+0000","last_clean":"2023-06-22T10:53:37.279924+0000","last_became_active":"2023-06-22T10:53:31.953495+0000","last_became_peered":"2023-06-22T10:53:31.953495+0000","last_unstale":"2023-06-22T10:53:37.279924+0000","last_undegraded":"2023-06-22T10:53:37.279924+0000","last_fullsized":"2023-06-22T10:53:37.279924+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T18:35:18.801024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958642+0000","last_change":"2023-06-22T10:53:35.985942+0000","last_active":"2023-06-22T10:53:36.958642+0000","last_peered":"2023-06-22T10:53:36.958642+0000","last_clean":"2023-06-22T10:53:36.958642+0000","last_became_active":"2023-06-22T10:53:35.985552+0000","last_became_peered":"2023-06-22T10:53:35.985552+0000","last_unstale":"2023-06-22T10:53:36.958642+0000","last_undegraded":"2023-06-22T10:53:36.958642+0000","last_fullsized":"2023-06-22T10:53:36.958642+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:54:23.850496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.732378+0000","last_change":"2023-06-22T10:53:25.626890+0000","last_active":"2023-06-22T10:53:37.732378+0000","last_peered":"2023-06-22T10:53:37.732378+0000","last_clean":"2023-06-22T10:53:37.732378+0000","last_became_active":"2023-06-22T10:53:25.626558+0000","last_became_peered":"2023-06-22T10:53:25.626558+0000","last_unstale":"2023-06-22T10:53:37.732378+0000","last_undegraded":"2023-06-22T10:53:37.732378+0000","last_fullsized":"2023-06-22T10:53:37.732378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_clean_scrub_stamp":"2023-06-22T10:53:24.612028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:54:13.523844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.955533+0000","last_change":"2023-06-22T10:53:30.943578+0000","last_active":"2023-06-22T10:53:36.955533+0000","last_peered":"2023-06-22T10:53:36.955533+0000","last_clean":"2023-06-22T10:53:36.955533+0000","last_became_active":"2023-06-22T10:53:30.943117+0000","last_became_peered":"2023-06-22T10:53:30.943117+0000","last_unstale":"2023-06-22T10:53:36.955533+0000","last_undegraded":"2023-06-22T10:53:36.955533+0000","last_fullsized":"2023-06-22T10:53:36.955533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:00:06.067980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.956299+0000","last_change":"2023-06-22T10:53:31.943987+0000","last_active":"2023-06-22T10:53:36.956299+0000","last_peered":"2023-06-22T10:53:36.956299+0000","last_clean":"2023-06-22T10:53:36.956299+0000","last_became_active":"2023-06-22T10:53:31.943488+0000","last_became_peered":"2023-06-22T10:53:31.943488+0000","last_unstale":"2023-06-22T10:53:36.956299+0000","last_undegraded":"2023-06-22T10:53:36.956299+0000","last_fullsized":"2023-06-22T10:53:36.956299+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:31:56.049728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.280108+0000","last_change":"2023-06-22T10:53:35.989113+0000","last_active":"2023-06-22T10:53:37.280108+0000","last_peered":"2023-06-22T10:53:37.280108+0000","last_clean":"2023-06-22T10:53:37.280108+0000","last_became_active":"2023-06-22T10:53:35.988755+0000","last_became_peered":"2023-06-22T10:53:35.988755+0000","last_unstale":"2023-06-22T10:53:37.280108+0000","last_undegraded":"2023-06-22T10:53:37.280108+0000","last_fullsized":"2023-06-22T10:53:37.280108+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T18:28:31.706827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.732796+0000","last_change":"2023-06-22T10:53:25.626005+0000","last_active":"2023-06-22T10:53:37.732796+0000","last_peered":"2023-06-22T10:53:37.732796+0000","last_clean":"2023-06-22T10:53:37.732796+0000","last_became_active":"2023-06-22T10:53:25.625614+0000","last_became_peered":"2023-06-22T10:53:25.625614+0000","last_unstale":"2023-06-22T10:53:37.732796+0000","last_undegraded":"2023-06-22T10:53:37.732796+0000","last_fullsized":"2023-06-22T10:53:37.732796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_clean_scrub_stamp":"2023-06-22T10:53:24.612028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T17:38:17.711473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421888+0000","last_change":"2023-06-22T10:53:30.929933+0000","last_active":"2023-06-22T10:53:38.421888+0000","last_peered":"2023-06-22T10:53:38.421888+0000","last_clean":"2023-06-22T10:53:38.421888+0000","last_became_active":"2023-06-22T10:53:30.929555+0000","last_became_peered":"2023-06-22T10:53:30.929555+0000","last_unstale":"2023-06-22T10:53:38.421888+0000","last_undegraded":"2023-06-22T10:53:38.421888+0000","last_fullsized":"2023-06-22T10:53:38.421888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:54:19.597233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.956482+0000","last_change":"2023-06-22T10:53:31.947501+0000","last_active":"2023-06-22T10:53:36.956482+0000","last_peered":"2023-06-22T10:53:36.956482+0000","last_clean":"2023-06-22T10:53:36.956482+0000","last_became_active":"2023-06-22T10:53:31.947187+0000","last_became_peered":"2023-06-22T10:53:31.947187+0000","last_unstale":"2023-06-22T10:53:36.956482+0000","last_undegraded":"2023-06-22T10:53:36.956482+0000","last_fullsized":"2023-06-22T10:53:36.956482+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:16:34.673673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957362+0000","last_change":"2023-06-22T10:53:35.993805+0000","last_active":"2023-06-22T10:53:36.957362+0000","last_peered":"2023-06-22T10:53:36.957362+0000","last_clean":"2023-06-22T10:53:36.957362+0000","last_became_active":"2023-06-22T10:53:35.993328+0000","last_became_peered":"2023-06-22T10:53:35.993328+0000","last_unstale":"2023-06-22T10:53:36.957362+0000","last_undegraded":"2023-06-22T10:53:36.957362+0000","last_fullsized":"2023-06-22T10:53:36.957362+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:00:09.093418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.298382+0000","last_change":"2023-06-22T10:53:30.940900+0000","last_active":"2023-06-22T10:53:39.298382+0000","last_peered":"2023-06-22T10:53:39.298382+0000","last_clean":"2023-06-22T10:53:39.298382+0000","last_became_active":"2023-06-22T10:53:30.940629+0000","last_became_peered":"2023-06-22T10:53:30.940629+0000","last_unstale":"2023-06-22T10:53:39.298382+0000","last_undegraded":"2023-06-22T10:53:39.298382+0000","last_fullsized":"2023-06-22T10:53:39.298382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:09:13.735489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421554+0000","last_change":"2023-06-22T10:53:25.625427+0000","last_active":"2023-06-22T10:53:38.421554+0000","last_peered":"2023-06-22T10:53:38.421554+0000","last_clean":"2023-06-22T10:53:38.421554+0000","last_became_active":"2023-06-22T10:53:25.625237+0000","last_became_peered":"2023-06-22T10:53:25.625237+0000","last_unstale":"2023-06-22T10:53:38.421554+0000","last_undegraded":"2023-06-22T10:53:38.421554+0000","last_fullsized":"2023-06-22T10:53:38.421554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_clean_scrub_stamp":"2023-06-22T10:53:24.612028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:04:08.650168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.298446+0000","last_change":"2023-06-22T10:53:31.949224+0000","last_active":"2023-06-22T10:53:39.298446+0000","last_peered":"2023-06-22T10:53:39.298446+0000","last_clean":"2023-06-22T10:53:39.298446+0000","last_became_active":"2023-06-22T10:53:31.948912+0000","last_became_peered":"2023-06-22T10:53:31.948912+0000","last_unstale":"2023-06-22T10:53:39.298446+0000","last_undegraded":"2023-06-22T10:53:39.298446+0000","last_fullsized":"2023-06-22T10:53:39.298446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:54:19.812644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.298399+0000","last_change":"2023-06-22T10:53:35.983189+0000","last_active":"2023-06-22T10:53:39.298399+0000","last_peered":"2023-06-22T10:53:39.298399+0000","last_clean":"2023-06-22T10:53:39.298399+0000","last_became_active":"2023-06-22T10:53:35.982759+0000","last_became_peered":"2023-06-22T10:53:35.982759+0000","last_unstale":"2023-06-22T10:53:39.298399+0000","last_undegraded":"2023-06-22T10:53:39.298399+0000","last_fullsized":"2023-06-22T10:53:39.298399+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:01:41.849642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.280276+0000","last_change":"2023-06-22T10:53:25.625880+0000","last_active":"2023-06-22T10:53:37.280276+0000","last_peered":"2023-06-22T10:53:37.280276+0000","last_clean":"2023-06-22T10:53:37.280276+0000","last_became_active":"2023-06-22T10:53:25.625464+0000","last_became_peered":"2023-06-22T10:53:25.625464+0000","last_unstale":"2023-06-22T10:53:37.280276+0000","last_undegraded":"2023-06-22T10:53:37.280276+0000","last_fullsized":"2023-06-22T10:53:37.280276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_clean_scrub_stamp":"2023-06-22T10:53:24.612028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T18:21:03.851910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"26'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.956476+0000","last_change":"2023-06-22T10:53:30.938779+0000","last_active":"2023-06-22T10:53:36.956476+0000","last_peered":"2023-06-22T10:53:36.956476+0000","last_clean":"2023-06-22T10:53:36.956476+0000","last_became_active":"2023-06-22T10:53:30.938504+0000","last_became_peered":"2023-06-22T10:53:30.938504+0000","last_unstale":"2023-06-22T10:53:36.956476+0000","last_undegraded":"2023-06-22T10:53:36.956476+0000","last_fullsized":"2023-06-22T10:53:36.956476+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:49:19.162465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957157+0000","last_change":"2023-06-22T10:53:31.952763+0000","last_active":"2023-06-22T10:53:36.957157+0000","last_peered":"2023-06-22T10:53:36.957157+0000","last_clean":"2023-06-22T10:53:36.957157+0000","last_became_active":"2023-06-22T10:53:31.952142+0000","last_became_peered":"2023-06-22T10:53:31.952142+0000","last_unstale":"2023-06-22T10:53:36.957157+0000","last_undegraded":"2023-06-22T10:53:36.957157+0000","last_fullsized":"2023-06-22T10:53:36.957157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:16:58.055706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421993+0000","last_change":"2023-06-22T10:53:35.990183+0000","last_active":"2023-06-22T10:53:38.421993+0000","last_peered":"2023-06-22T10:53:38.421993+0000","last_clean":"2023-06-22T10:53:38.421993+0000","last_became_active":"2023-06-22T10:53:35.989752+0000","last_became_peered":"2023-06-22T10:53:35.989752+0000","last_unstale":"2023-06-22T10:53:38.421993+0000","last_undegraded":"2023-06-22T10:53:38.421993+0000","last_fullsized":"2023-06-22T10:53:38.421993+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T18:31:21.495204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.956332+0000","last_change":"2023-06-22T10:53:30.943481+0000","last_active":"2023-06-22T10:53:36.956332+0000","last_peered":"2023-06-22T10:53:36.956332+0000","last_clean":"2023-06-22T10:53:36.956332+0000","last_became_active":"2023-06-22T10:53:30.943176+0000","last_became_peered":"2023-06-22T10:53:30.943176+0000","last_unstale":"2023-06-22T10:53:36.956332+0000","last_undegraded":"2023-06-22T10:53:36.956332+0000","last_fullsized":"2023-06-22T10:53:36.956332+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T20:10:12.732255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.540111+0000","last_change":"2023-06-22T10:53:31.936896+0000","last_active":"2023-06-22T10:53:37.540111+0000","last_peered":"2023-06-22T10:53:37.540111+0000","last_clean":"2023-06-22T10:53:37.540111+0000","last_became_active":"2023-06-22T10:53:31.936564+0000","last_became_peered":"2023-06-22T10:53:31.936564+0000","last_unstale":"2023-06-22T10:53:37.540111+0000","last_undegraded":"2023-06-22T10:53:37.540111+0000","last_fullsized":"2023-06-22T10:53:37.540111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T13:21:48.372064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.732378+0000","last_change":"2023-06-22T10:53:35.978716+0000","last_active":"2023-06-22T10:53:37.732378+0000","last_peered":"2023-06-22T10:53:37.732378+0000","last_clean":"2023-06-22T10:53:37.732378+0000","last_became_active":"2023-06-22T10:53:35.978326+0000","last_became_peered":"2023-06-22T10:53:35.978326+0000","last_unstale":"2023-06-22T10:53:37.732378+0000","last_undegraded":"2023-06-22T10:53:37.732378+0000","last_fullsized":"2023-06-22T10:53:37.732378+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:01:41.849642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958008+0000","last_change":"2023-06-22T10:53:30.936749+0000","last_active":"2023-06-22T10:53:36.958008+0000","last_peered":"2023-06-22T10:53:36.958008+0000","last_clean":"2023-06-22T10:53:36.958008+0000","last_became_active":"2023-06-22T10:53:30.936447+0000","last_became_peered":"2023-06-22T10:53:30.936447+0000","last_unstale":"2023-06-22T10:53:36.958008+0000","last_undegraded":"2023-06-22T10:53:36.958008+0000","last_fullsized":"2023-06-22T10:53:36.958008+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:58:40.107079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957755+0000","last_change":"2023-06-22T10:53:31.955250+0000","last_active":"2023-06-22T10:53:36.957755+0000","last_peered":"2023-06-22T10:53:36.957755+0000","last_clean":"2023-06-22T10:53:36.957755+0000","last_became_active":"2023-06-22T10:53:31.954904+0000","last_became_peered":"2023-06-22T10:53:31.954904+0000","last_unstale":"2023-06-22T10:53:36.957755+0000","last_undegraded":"2023-06-22T10:53:36.957755+0000","last_fullsized":"2023-06-22T10:53:36.957755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:57:41.183955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958248+0000","last_change":"2023-06-22T10:53:35.977443+0000","last_active":"2023-06-22T10:53:36.958248+0000","last_peered":"2023-06-22T10:53:36.958248+0000","last_clean":"2023-06-22T10:53:36.958248+0000","last_became_active":"2023-06-22T10:53:35.977008+0000","last_became_peered":"2023-06-22T10:53:35.977008+0000","last_unstale":"2023-06-22T10:53:36.958248+0000","last_undegraded":"2023-06-22T10:53:36.958248+0000","last_fullsized":"2023-06-22T10:53:36.958248+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T17:02:42.606188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958133+0000","last_change":"2023-06-22T10:53:30.936289+0000","last_active":"2023-06-22T10:53:36.958133+0000","last_peered":"2023-06-22T10:53:36.958133+0000","last_clean":"2023-06-22T10:53:36.958133+0000","last_became_active":"2023-06-22T10:53:30.935990+0000","last_became_peered":"2023-06-22T10:53:30.935990+0000","last_unstale":"2023-06-22T10:53:36.958133+0000","last_undegraded":"2023-06-22T10:53:36.958133+0000","last_fullsized":"2023-06-22T10:53:36.958133+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:35:50.219987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957131+0000","last_change":"2023-06-22T10:53:31.941782+0000","last_active":"2023-06-22T10:53:36.957131+0000","last_peered":"2023-06-22T10:53:36.957131+0000","last_clean":"2023-06-22T10:53:36.957131+0000","last_became_active":"2023-06-22T10:53:31.940237+0000","last_became_peered":"2023-06-22T10:53:31.940237+0000","last_unstale":"2023-06-22T10:53:36.957131+0000","last_undegraded":"2023-06-22T10:53:36.957131+0000","last_fullsized":"2023-06-22T10:53:36.957131+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:49:21.017446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.956920+0000","last_change":"2023-06-22T10:53:35.989317+0000","last_active":"2023-06-22T10:53:36.956920+0000","last_peered":"2023-06-22T10:53:36.956920+0000","last_clean":"2023-06-22T10:53:36.956920+0000","last_became_active":"2023-06-22T10:53:35.988872+0000","last_became_peered":"2023-06-22T10:53:35.988872+0000","last_unstale":"2023-06-22T10:53:36.956920+0000","last_undegraded":"2023-06-22T10:53:36.956920+0000","last_fullsized":"2023-06-22T10:53:36.956920+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:12:36.166106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.298288+0000","last_change":"2023-06-22T10:53:30.936018+0000","last_active":"2023-06-22T10:53:39.298288+0000","last_peered":"2023-06-22T10:53:39.298288+0000","last_clean":"2023-06-22T10:53:39.298288+0000","last_became_active":"2023-06-22T10:53:30.935754+0000","last_became_peered":"2023-06-22T10:53:30.935754+0000","last_unstale":"2023-06-22T10:53:39.298288+0000","last_undegraded":"2023-06-22T10:53:39.298288+0000","last_fullsized":"2023-06-22T10:53:39.298288+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T15:48:35.350222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.298625+0000","last_change":"2023-06-22T10:53:31.927521+0000","last_active":"2023-06-22T10:53:39.298625+0000","last_peered":"2023-06-22T10:53:39.298625+0000","last_clean":"2023-06-22T10:53:39.298625+0000","last_became_active":"2023-06-22T10:53:31.927230+0000","last_became_peered":"2023-06-22T10:53:31.927230+0000","last_unstale":"2023-06-22T10:53:39.298625+0000","last_undegraded":"2023-06-22T10:53:39.298625+0000","last_fullsized":"2023-06-22T10:53:39.298625+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:16:42.860439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421325+0000","last_change":"2023-06-22T10:53:35.976634+0000","last_active":"2023-06-22T10:53:38.421325+0000","last_peered":"2023-06-22T10:53:38.421325+0000","last_clean":"2023-06-22T10:53:38.421325+0000","last_became_active":"2023-06-22T10:53:35.976193+0000","last_became_peered":"2023-06-22T10:53:35.976193+0000","last_unstale":"2023-06-22T10:53:38.421325+0000","last_undegraded":"2023-06-22T10:53:38.421325+0000","last_fullsized":"2023-06-22T10:53:38.421325+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T13:04:31.955833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957011+0000","last_change":"2023-06-22T10:53:30.938370+0000","last_active":"2023-06-22T10:53:36.957011+0000","last_peered":"2023-06-22T10:53:36.957011+0000","last_clean":"2023-06-22T10:53:36.957011+0000","last_became_active":"2023-06-22T10:53:30.937695+0000","last_became_peered":"2023-06-22T10:53:30.937695+0000","last_unstale":"2023-06-22T10:53:36.957011+0000","last_undegraded":"2023-06-22T10:53:36.957011+0000","last_fullsized":"2023-06-22T10:53:36.957011+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:59:49.191360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957346+0000","last_change":"2023-06-22T10:53:31.951892+0000","last_active":"2023-06-22T10:53:36.957346+0000","last_peered":"2023-06-22T10:53:36.957346+0000","last_clean":"2023-06-22T10:53:36.957346+0000","last_became_active":"2023-06-22T10:53:31.951200+0000","last_became_peered":"2023-06-22T10:53:31.951200+0000","last_unstale":"2023-06-22T10:53:36.957346+0000","last_undegraded":"2023-06-22T10:53:36.957346+0000","last_fullsized":"2023-06-22T10:53:36.957346+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T15:52:35.480952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.279886+0000","last_change":"2023-06-22T10:53:31.941076+0000","last_active":"2023-06-22T10:53:37.279886+0000","last_peered":"2023-06-22T10:53:37.279886+0000","last_clean":"2023-06-22T10:53:37.279886+0000","last_became_active":"2023-06-22T10:53:31.940796+0000","last_became_peered":"2023-06-22T10:53:31.940796+0000","last_unstale":"2023-06-22T10:53:37.279886+0000","last_undegraded":"2023-06-22T10:53:37.279886+0000","last_fullsized":"2023-06-22T10:53:37.279886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:04:33.641511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.298918+0000","last_change":"2023-06-22T10:53:31.940503+0000","last_active":"2023-06-22T10:53:39.298918+0000","last_peered":"2023-06-22T10:53:39.298918+0000","last_clean":"2023-06-22T10:53:39.298918+0000","last_became_active":"2023-06-22T10:53:31.939741+0000","last_became_peered":"2023-06-22T10:53:31.939741+0000","last_unstale":"2023-06-22T10:53:39.298918+0000","last_undegraded":"2023-06-22T10:53:39.298918+0000","last_fullsized":"2023-06-22T10:53:39.298918+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:12:32.128254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958527+0000","last_change":"2023-06-22T10:53:31.946176+0000","last_active":"2023-06-22T10:53:36.958527+0000","last_peered":"2023-06-22T10:53:36.958527+0000","last_clean":"2023-06-22T10:53:36.958527+0000","last_became_active":"2023-06-22T10:53:31.945842+0000","last_became_peered":"2023-06-22T10:53:31.945842+0000","last_unstale":"2023-06-22T10:53:36.958527+0000","last_undegraded":"2023-06-22T10:53:36.958527+0000","last_fullsized":"2023-06-22T10:53:36.958527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T18:41:56.633064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.298684+0000","last_change":"2023-06-22T10:53:31.949833+0000","last_active":"2023-06-22T10:53:39.298684+0000","last_peered":"2023-06-22T10:53:39.298684+0000","last_clean":"2023-06-22T10:53:39.298684+0000","last_became_active":"2023-06-22T10:53:31.949098+0000","last_became_peered":"2023-06-22T10:53:31.949098+0000","last_unstale":"2023-06-22T10:53:39.298684+0000","last_undegraded":"2023-06-22T10:53:39.298684+0000","last_fullsized":"2023-06-22T10:53:39.298684+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:54:14.530962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421731+0000","last_change":"2023-06-22T10:53:31.947493+0000","last_active":"2023-06-22T10:53:38.421731+0000","last_peered":"2023-06-22T10:53:38.421731+0000","last_clean":"2023-06-22T10:53:38.421731+0000","last_became_active":"2023-06-22T10:53:31.947154+0000","last_became_peered":"2023-06-22T10:53:31.947154+0000","last_unstale":"2023-06-22T10:53:38.421731+0000","last_undegraded":"2023-06-22T10:53:38.421731+0000","last_fullsized":"2023-06-22T10:53:38.421731+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T17:28:50.883566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":0,"up_from":15,"seq":64424509452,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":876,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":897024,"data_stored":714122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6059999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2440000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8420000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3180000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7689999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4059999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542158,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":900,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":921600,"data_stored":717550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":303104,"data_stored":123262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":123172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":319488,"data_stored":127022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":307200,"data_stored":123824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]}]},{"osd":2,"up_from":14,"seq":60129542156,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":123172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]}]},{"osd":6,"up_from":14,"seq":60129542157,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":123172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-22T10:54:06.994 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-22T10:54:07.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.227+0000 7f3f043ff700 1 Processor -- start 2023-06-22T10:54:07.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.228+0000 7f3f043ff700 1 -- start start 2023-06-22T10:54:07.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.229+0000 7f3f043ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3efc160a70 0x7f3efc0d0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:07.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.229+0000 7f3f043ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f3efc15d2f0 0x7f3efc15ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:07.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.229+0000 7f3f043ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3efc160ee0 con 0x7f3efc0cd3b0 2023-06-22T10:54:07.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.229+0000 7f3f043ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3efc15ce60 con 0x7f3efc160a70 2023-06-22T10:54:07.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.229+0000 7f3f043ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3efc0ce6a0 con 0x7f3efc15d2f0 2023-06-22T10:54:07.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.229+0000 7f3f0199a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3efc160a70 0x7f3efc0d0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:07.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.229+0000 7f3f0199a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3efc160a70 0x7f3efc0d0210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51010/0 (socket says 172.21.15.40:51010) 2023-06-22T10:54:07.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.229+0000 7f3f0199a700 1 -- 172.21.15.40:0/3097790777 learned_addr learned my addr 172.21.15.40:0/3097790777 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:07.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.229+0000 7f3f0299c700 1 --2- 172.21.15.40:0/3097790777 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f3efc15d2f0 0x7f3efc15ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:07.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.229+0000 7f3f0199a700 1 -- 172.21.15.40:0/3097790777 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f3efc15d2f0 msgr2=0x7f3efc15ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:07.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.229+0000 7f3f0199a700 1 --2- 172.21.15.40:0/3097790777 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f3efc15d2f0 0x7f3efc15ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:07.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.229+0000 7f3f0199a700 1 -- 172.21.15.40:0/3097790777 >> v1:172.21.15.45:6789/0 conn(0x7f3efc0cd3b0 legacy=0x7f3efc0cd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:07.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.229+0000 7f3f0199a700 1 -- 172.21.15.40:0/3097790777 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3efc0ce940 con 0x7f3efc160a70 2023-06-22T10:54:07.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.230+0000 7f3f0199a700 1 --2- 172.21.15.40:0/3097790777 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3efc160a70 0x7f3efc0d0210 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3eec0098f0 tx=0x7f3eec009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=100c5dc4778efa6a server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:07.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.230+0000 7f3f01199700 1 -- 172.21.15.40:0/3097790777 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eec011830 con 0x7f3efc160a70 2023-06-22T10:54:07.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.230+0000 7f3f01199700 1 -- 172.21.15.40:0/3097790777 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eec011990 con 0x7f3efc160a70 2023-06-22T10:54:07.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.230+0000 7f3f01199700 1 -- 172.21.15.40:0/3097790777 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eec011d20 con 0x7f3efc160a70 2023-06-22T10:54:07.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.230+0000 7f3f043ff700 1 -- 172.21.15.40:0/3097790777 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3efc160a70 msgr2=0x7f3efc0d0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:07.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.230+0000 7f3f043ff700 1 --2- 172.21.15.40:0/3097790777 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3efc160a70 0x7f3efc0d0210 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3eec0098f0 tx=0x7f3eec009c00 comp rx=0 tx=0).stop 2023-06-22T10:54:07.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.231+0000 7f3f043ff700 1 -- 172.21.15.40:0/3097790777 shutdown_connections 2023-06-22T10:54:07.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.231+0000 7f3f043ff700 1 --2- 172.21.15.40:0/3097790777 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f3efc15d2f0 0x7f3efc15ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:07.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.231+0000 7f3f043ff700 1 --2- 172.21.15.40:0/3097790777 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3efc160a70 0x7f3efc0d0210 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:07.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.231+0000 7f3f043ff700 1 -- 172.21.15.40:0/3097790777 >> 172.21.15.40:0/3097790777 conn(0x7f3efc06e630 msgr2=0x7f3efc06ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:07.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.231+0000 7f3f043ff700 1 -- 172.21.15.40:0/3097790777 shutdown_connections 2023-06-22T10:54:07.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.231+0000 7f3f043ff700 1 -- 172.21.15.40:0/3097790777 wait complete. 2023-06-22T10:54:07.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.232+0000 7f3f043ff700 1 Processor -- start 2023-06-22T10:54:07.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.233+0000 7f3f043ff700 1 -- start start 2023-06-22T10:54:07.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.233+0000 7f3f043ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3efc0cd3b0 0x7f3efc14ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:07.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.234+0000 7f3f043ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f3efc15d2f0 0x7f3efc1f2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:07.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.234+0000 7f3f043ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3efc160a70 0x7f3efc0c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:07.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.234+0000 7f3f043ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3efc14cf80 con 0x7f3efc0cd3b0 2023-06-22T10:54:07.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.234+0000 7f3f043ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3efc14d470 con 0x7f3efc160a70 2023-06-22T10:54:07.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.234+0000 7f3f043ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3efc0b4510 con 0x7f3efc15d2f0 2023-06-22T10:54:07.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.234+0000 7f3f0219b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3efc0cd3b0 0x7f3efc14ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:07.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.234+0000 7f3f0219b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3efc0cd3b0 0x7f3efc14ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51012/0 (socket says 172.21.15.40:51012) 2023-06-22T10:54:07.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.234+0000 7f3f0219b700 1 -- 172.21.15.40:0/1747638298 learned_addr learned my addr 172.21.15.40:0/1747638298 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:07.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.234+0000 7f3f0299c700 1 --2- 172.21.15.40:0/1747638298 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3efc160a70 0x7f3efc0c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:07.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.234+0000 7f3f0199a700 1 --2- 172.21.15.40:0/1747638298 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f3efc15d2f0 0x7f3efc1f2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:07.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.234+0000 7f3f0219b700 1 -- 172.21.15.40:0/1747638298 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f3efc15d2f0 msgr2=0x7f3efc1f2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:07.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.234+0000 7f3f0219b700 1 --2- 172.21.15.40:0/1747638298 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f3efc15d2f0 0x7f3efc1f2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:07.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.234+0000 7f3f0219b700 1 -- 172.21.15.40:0/1747638298 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3efc160a70 msgr2=0x7f3efc0c8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:07.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.234+0000 7f3f0219b700 1 --2- 172.21.15.40:0/1747638298 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3efc160a70 0x7f3efc0c8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:07.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.234+0000 7f3f0219b700 1 -- 172.21.15.40:0/1747638298 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eec009550 con 0x7f3efc0cd3b0 2023-06-22T10:54:07.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.235+0000 7f3f0219b700 1 --2- 172.21.15.40:0/1747638298 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3efc0cd3b0 0x7f3efc14ca40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3ef800c4d0 tx=0x7f3ef800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:07.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.235+0000 7f3ef2ffd700 1 -- 172.21.15.40:0/1747638298 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef80052d0 con 0x7f3efc0cd3b0 2023-06-22T10:54:07.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.235+0000 7f3ef2ffd700 1 -- 172.21.15.40:0/1747638298 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef8005430 con 0x7f3efc0cd3b0 2023-06-22T10:54:07.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.235+0000 7f3f043ff700 1 -- 172.21.15.40:0/1747638298 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3efc0b47f0 con 0x7f3efc0cd3b0 2023-06-22T10:54:07.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.235+0000 7f3ef2ffd700 1 -- 172.21.15.40:0/1747638298 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef80038f0 con 0x7f3efc0cd3b0 2023-06-22T10:54:07.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.235+0000 7f3f043ff700 1 -- 172.21.15.40:0/1747638298 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3efc0b4db0 con 0x7f3efc0cd3b0 2023-06-22T10:54:07.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.236+0000 7f3f043ff700 1 -- 172.21.15.40:0/1747638298 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3efc067580 con 0x7f3efc0cd3b0 2023-06-22T10:54:07.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.237+0000 7f3ef2ffd700 1 -- 172.21.15.40:0/1747638298 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3ef8003a50 con 0x7f3efc0cd3b0 2023-06-22T10:54:07.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.239+0000 7f3ef2ffd700 1 --2- 172.21.15.40:0/1747638298 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f3ee006ace0 0x7f3ee006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:07.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.239+0000 7f3ef2ffd700 1 -- 172.21.15.40:0/1747638298 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3ef8088ae0 con 0x7f3efc0cd3b0 2023-06-22T10:54:07.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.239+0000 7f3f0199a700 1 --2- 172.21.15.40:0/1747638298 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f3ee006ace0 0x7f3ee006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:07.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.240+0000 7f3f0199a700 1 --2- 172.21.15.40:0/1747638298 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f3ee006ace0 0x7f3ee006d190 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3eec009c40 tx=0x7f3eec01d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:07.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.243+0000 7f3ef2ffd700 1 -- 172.21.15.40:0/1747638298 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3ef8053890 con 0x7f3efc0cd3b0 2023-06-22T10:54:07.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.446+0000 7f3f043ff700 1 -- 172.21.15.40:0/1747638298 --> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3efc15caf0 con 0x7f3ee006ace0 2023-06-22T10:54:07.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.456+0000 7f3ef2ffd700 1 -- 172.21.15.40:0/1747638298 <== mgr.4110 v2:172.21.15.40:6832/1803669772 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367296 (secure 0 0 0) 0x7f3eec011b80 con 0x7f3ee006ace0 2023-06-22T10:54:07.461 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:54:07.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.461+0000 7f3f043ff700 1 -- 172.21.15.40:0/1747638298 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f3ee006ace0 msgr2=0x7f3ee006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:07.469 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.461+0000 7f3f043ff700 1 --2- 172.21.15.40:0/1747638298 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f3ee006ace0 0x7f3ee006d190 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3eec009c40 tx=0x7f3eec01d040 comp rx=0 tx=0).stop 2023-06-22T10:54:07.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.461+0000 7f3f043ff700 1 -- 172.21.15.40:0/1747638298 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3efc0cd3b0 msgr2=0x7f3efc14ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:07.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.461+0000 7f3f043ff700 1 --2- 172.21.15.40:0/1747638298 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3efc0cd3b0 0x7f3efc14ca40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3ef800c4d0 tx=0x7f3ef800c7e0 comp rx=0 tx=0).stop 2023-06-22T10:54:07.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.461+0000 7f3f043ff700 1 -- 172.21.15.40:0/1747638298 shutdown_connections 2023-06-22T10:54:07.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.461+0000 7f3f043ff700 1 --2- 172.21.15.40:0/1747638298 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f3ee006ace0 0x7f3ee006d190 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:07.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.461+0000 7f3f043ff700 1 --2- 172.21.15.40:0/1747638298 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3efc160a70 0x7f3efc0c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:07.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.461+0000 7f3f043ff700 1 --2- 172.21.15.40:0/1747638298 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3efc0cd3b0 0x7f3efc14ca40 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:07.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.461+0000 7f3f043ff700 1 --2- 172.21.15.40:0/1747638298 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f3efc15d2f0 0x7f3efc1f2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:07.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.461+0000 7f3f043ff700 1 -- 172.21.15.40:0/1747638298 >> 172.21.15.40:0/1747638298 conn(0x7f3efc06e630 msgr2=0x7f3efc155fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:07.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.461+0000 7f3f043ff700 1 -- 172.21.15.40:0/1747638298 shutdown_connections 2023-06-22T10:54:07.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.461+0000 7f3f043ff700 1 -- 172.21.15.40:0/1747638298 wait complete. 2023-06-22T10:54:07.471 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-06-22T10:54:07.483 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":47,"stamp":"2023-06-22T10:54:07.135025+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219176,"kb_used_data":3560,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755544,"statfs":{"total":773094113280,"available":772869677056,"internally_reserved":0,"allocated":3645440,"data_stored":2175296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004910"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.540129+0000","last_change":"2023-06-22T10:53:31.946165+0000","last_active":"2023-06-22T10:53:37.540129+0000","last_peered":"2023-06-22T10:53:37.540129+0000","last_clean":"2023-06-22T10:53:37.540129+0000","last_became_active":"2023-06-22T10:53:31.945515+0000","last_became_peered":"2023-06-22T10:53:31.945515+0000","last_unstale":"2023-06-22T10:53:37.540129+0000","last_undegraded":"2023-06-22T10:53:37.540129+0000","last_fullsized":"2023-06-22T10:53:37.540129+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T13:02:07.560484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958797+0000","last_change":"2023-06-22T10:53:31.943630+0000","last_active":"2023-06-22T10:53:36.958797+0000","last_peered":"2023-06-22T10:53:36.958797+0000","last_clean":"2023-06-22T10:53:36.958797+0000","last_became_active":"2023-06-22T10:53:31.943233+0000","last_became_peered":"2023-06-22T10:53:31.943233+0000","last_unstale":"2023-06-22T10:53:36.958797+0000","last_undegraded":"2023-06-22T10:53:36.958797+0000","last_fullsized":"2023-06-22T10:53:36.958797+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:15:20.227426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.959406+0000","last_change":"2023-06-22T10:53:31.951823+0000","last_active":"2023-06-22T10:53:36.959406+0000","last_peered":"2023-06-22T10:53:36.959406+0000","last_clean":"2023-06-22T10:53:36.959406+0000","last_became_active":"2023-06-22T10:53:31.951456+0000","last_became_peered":"2023-06-22T10:53:31.951456+0000","last_unstale":"2023-06-22T10:53:36.959406+0000","last_undegraded":"2023-06-22T10:53:36.959406+0000","last_fullsized":"2023-06-22T10:53:36.959406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T17:57:40.473883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.280096+0000","last_change":"2023-06-22T10:53:31.941895+0000","last_active":"2023-06-22T10:53:37.280096+0000","last_peered":"2023-06-22T10:53:37.280096+0000","last_clean":"2023-06-22T10:53:37.280096+0000","last_became_active":"2023-06-22T10:53:31.941630+0000","last_became_peered":"2023-06-22T10:53:31.941630+0000","last_unstale":"2023-06-22T10:53:37.280096+0000","last_undegraded":"2023-06-22T10:53:37.280096+0000","last_fullsized":"2023-06-22T10:53:37.280096+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T17:25:39.331517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.956556+0000","last_change":"2023-06-22T10:53:31.945358+0000","last_active":"2023-06-22T10:53:36.956556+0000","last_peered":"2023-06-22T10:53:36.956556+0000","last_clean":"2023-06-22T10:53:36.956556+0000","last_became_active":"2023-06-22T10:53:31.945078+0000","last_became_peered":"2023-06-22T10:53:31.945078+0000","last_unstale":"2023-06-22T10:53:36.956556+0000","last_undegraded":"2023-06-22T10:53:36.956556+0000","last_fullsized":"2023-06-22T10:53:36.956556+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T13:04:27.917981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958367+0000","last_change":"2023-06-22T10:53:31.950691+0000","last_active":"2023-06-22T10:53:36.958367+0000","last_peered":"2023-06-22T10:53:36.958367+0000","last_clean":"2023-06-22T10:53:36.958367+0000","last_became_active":"2023-06-22T10:53:31.950418+0000","last_became_peered":"2023-06-22T10:53:31.950418+0000","last_unstale":"2023-06-22T10:53:36.958367+0000","last_undegraded":"2023-06-22T10:53:36.958367+0000","last_fullsized":"2023-06-22T10:53:36.958367+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:27:48.848591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.732456+0000","last_change":"2023-06-22T10:53:31.947663+0000","last_active":"2023-06-22T10:53:37.732456+0000","last_peered":"2023-06-22T10:53:37.732456+0000","last_clean":"2023-06-22T10:53:37.732456+0000","last_became_active":"2023-06-22T10:53:31.945462+0000","last_became_peered":"2023-06-22T10:53:31.945462+0000","last_unstale":"2023-06-22T10:53:37.732456+0000","last_undegraded":"2023-06-22T10:53:37.732456+0000","last_fullsized":"2023-06-22T10:53:37.732456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:37:31.693376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957438+0000","last_change":"2023-06-22T10:53:31.953829+0000","last_active":"2023-06-22T10:53:36.957438+0000","last_peered":"2023-06-22T10:53:36.957438+0000","last_clean":"2023-06-22T10:53:36.957438+0000","last_became_active":"2023-06-22T10:53:31.953479+0000","last_became_peered":"2023-06-22T10:53:31.953479+0000","last_unstale":"2023-06-22T10:53:36.957438+0000","last_undegraded":"2023-06-22T10:53:36.957438+0000","last_fullsized":"2023-06-22T10:53:36.957438+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:56:30.123428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.956661+0000","last_change":"2023-06-22T10:53:31.944979+0000","last_active":"2023-06-22T10:53:36.956661+0000","last_peered":"2023-06-22T10:53:36.956661+0000","last_clean":"2023-06-22T10:53:36.956661+0000","last_became_active":"2023-06-22T10:53:31.944596+0000","last_became_peered":"2023-06-22T10:53:31.944596+0000","last_unstale":"2023-06-22T10:53:36.956661+0000","last_undegraded":"2023-06-22T10:53:36.956661+0000","last_fullsized":"2023-06-22T10:53:36.956661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T18:57:56.828299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.959118+0000","last_change":"2023-06-22T10:53:31.935384+0000","last_active":"2023-06-22T10:53:36.959118+0000","last_peered":"2023-06-22T10:53:36.959118+0000","last_clean":"2023-06-22T10:53:36.959118+0000","last_became_active":"2023-06-22T10:53:31.935038+0000","last_became_peered":"2023-06-22T10:53:31.935038+0000","last_unstale":"2023-06-22T10:53:36.959118+0000","last_undegraded":"2023-06-22T10:53:36.959118+0000","last_fullsized":"2023-06-22T10:53:36.959118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T17:38:24.000272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.959531+0000","last_change":"2023-06-22T10:53:31.952559+0000","last_active":"2023-06-22T10:53:36.959531+0000","last_peered":"2023-06-22T10:53:36.959531+0000","last_clean":"2023-06-22T10:53:36.959531+0000","last_became_active":"2023-06-22T10:53:31.952213+0000","last_became_peered":"2023-06-22T10:53:31.952213+0000","last_unstale":"2023-06-22T10:53:36.959531+0000","last_undegraded":"2023-06-22T10:53:36.959531+0000","last_fullsized":"2023-06-22T10:53:36.959531+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T18:02:23.289710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.539887+0000","last_change":"2023-06-22T10:53:31.957089+0000","last_active":"2023-06-22T10:53:37.539887+0000","last_peered":"2023-06-22T10:53:37.539887+0000","last_clean":"2023-06-22T10:53:37.539887+0000","last_became_active":"2023-06-22T10:53:31.956521+0000","last_became_peered":"2023-06-22T10:53:31.956521+0000","last_unstale":"2023-06-22T10:53:37.539887+0000","last_undegraded":"2023-06-22T10:53:37.539887+0000","last_fullsized":"2023-06-22T10:53:37.539887+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T11:34:19.856827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.540314+0000","last_change":"2023-06-22T10:53:31.945942+0000","last_active":"2023-06-22T10:53:37.540314+0000","last_peered":"2023-06-22T10:53:37.540314+0000","last_clean":"2023-06-22T10:53:37.540314+0000","last_became_active":"2023-06-22T10:53:31.945443+0000","last_became_peered":"2023-06-22T10:53:31.945443+0000","last_unstale":"2023-06-22T10:53:37.540314+0000","last_undegraded":"2023-06-22T10:53:37.540314+0000","last_fullsized":"2023-06-22T10:53:37.540314+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:53:17.921814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957777+0000","last_change":"2023-06-22T10:53:31.942412+0000","last_active":"2023-06-22T10:53:36.957777+0000","last_peered":"2023-06-22T10:53:36.957777+0000","last_clean":"2023-06-22T10:53:36.957777+0000","last_became_active":"2023-06-22T10:53:31.942136+0000","last_became_peered":"2023-06-22T10:53:31.942136+0000","last_unstale":"2023-06-22T10:53:36.957777+0000","last_undegraded":"2023-06-22T10:53:36.957777+0000","last_fullsized":"2023-06-22T10:53:36.957777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T18:31:17.457352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.732252+0000","last_change":"2023-06-22T10:53:31.947458+0000","last_active":"2023-06-22T10:53:37.732252+0000","last_peered":"2023-06-22T10:53:37.732252+0000","last_clean":"2023-06-22T10:53:37.732252+0000","last_became_active":"2023-06-22T10:53:31.947174+0000","last_became_peered":"2023-06-22T10:53:31.947174+0000","last_unstale":"2023-06-22T10:53:37.732252+0000","last_undegraded":"2023-06-22T10:53:37.732252+0000","last_fullsized":"2023-06-22T10:53:37.732252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:19:58.431004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957495+0000","last_change":"2023-06-22T10:53:31.952787+0000","last_active":"2023-06-22T10:53:36.957495+0000","last_peered":"2023-06-22T10:53:36.957495+0000","last_clean":"2023-06-22T10:53:36.957495+0000","last_became_active":"2023-06-22T10:53:31.951585+0000","last_became_peered":"2023-06-22T10:53:31.951585+0000","last_unstale":"2023-06-22T10:53:36.957495+0000","last_undegraded":"2023-06-22T10:53:36.957495+0000","last_fullsized":"2023-06-22T10:53:36.957495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T13:31:48.249498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.956661+0000","last_change":"2023-06-22T10:53:31.944865+0000","last_active":"2023-06-22T10:53:36.956661+0000","last_peered":"2023-06-22T10:53:36.956661+0000","last_clean":"2023-06-22T10:53:36.956661+0000","last_became_active":"2023-06-22T10:53:31.944263+0000","last_became_peered":"2023-06-22T10:53:31.944263+0000","last_unstale":"2023-06-22T10:53:36.956661+0000","last_undegraded":"2023-06-22T10:53:36.956661+0000","last_fullsized":"2023-06-22T10:53:36.956661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:47:02.983369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958024+0000","last_change":"2023-06-22T10:53:31.954328+0000","last_active":"2023-06-22T10:53:36.958024+0000","last_peered":"2023-06-22T10:53:36.958024+0000","last_clean":"2023-06-22T10:53:36.958024+0000","last_became_active":"2023-06-22T10:53:31.953823+0000","last_became_peered":"2023-06-22T10:53:31.953823+0000","last_unstale":"2023-06-22T10:53:36.958024+0000","last_undegraded":"2023-06-22T10:53:36.958024+0000","last_fullsized":"2023-06-22T10:53:36.958024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:58:30.886558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.539896+0000","last_change":"2023-06-22T10:53:31.943196+0000","last_active":"2023-06-22T10:53:37.539896+0000","last_peered":"2023-06-22T10:53:37.539896+0000","last_clean":"2023-06-22T10:53:37.539896+0000","last_became_active":"2023-06-22T10:53:31.942920+0000","last_became_peered":"2023-06-22T10:53:31.942920+0000","last_unstale":"2023-06-22T10:53:37.539896+0000","last_undegraded":"2023-06-22T10:53:37.539896+0000","last_fullsized":"2023-06-22T10:53:37.539896+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T20:10:55.019762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958201+0000","last_change":"2023-06-22T10:53:31.951020+0000","last_active":"2023-06-22T10:53:36.958201+0000","last_peered":"2023-06-22T10:53:36.958201+0000","last_clean":"2023-06-22T10:53:36.958201+0000","last_became_active":"2023-06-22T10:53:31.950755+0000","last_became_peered":"2023-06-22T10:53:31.950755+0000","last_unstale":"2023-06-22T10:53:36.958201+0000","last_undegraded":"2023-06-22T10:53:36.958201+0000","last_fullsized":"2023-06-22T10:53:36.958201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:15:38.583741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.732513+0000","last_change":"2023-06-22T10:53:31.942953+0000","last_active":"2023-06-22T10:53:37.732513+0000","last_peered":"2023-06-22T10:53:37.732513+0000","last_clean":"2023-06-22T10:53:37.732513+0000","last_became_active":"2023-06-22T10:53:31.942724+0000","last_became_peered":"2023-06-22T10:53:31.942724+0000","last_unstale":"2023-06-22T10:53:37.732513+0000","last_undegraded":"2023-06-22T10:53:37.732513+0000","last_fullsized":"2023-06-22T10:53:37.732513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T13:38:17.711538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.955830+0000","last_change":"2023-06-22T10:53:31.943005+0000","last_active":"2023-06-22T10:53:36.955830+0000","last_peered":"2023-06-22T10:53:36.955830+0000","last_clean":"2023-06-22T10:53:36.955830+0000","last_became_active":"2023-06-22T10:53:31.942716+0000","last_became_peered":"2023-06-22T10:53:31.942716+0000","last_unstale":"2023-06-22T10:53:36.955830+0000","last_undegraded":"2023-06-22T10:53:36.955830+0000","last_fullsized":"2023-06-22T10:53:36.955830+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:59:14.357071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.298489+0000","last_change":"2023-06-22T10:53:31.935496+0000","last_active":"2023-06-22T10:53:39.298489+0000","last_peered":"2023-06-22T10:53:39.298489+0000","last_clean":"2023-06-22T10:53:39.298489+0000","last_became_active":"2023-06-22T10:53:31.935201+0000","last_became_peered":"2023-06-22T10:53:31.935201+0000","last_unstale":"2023-06-22T10:53:39.298489+0000","last_undegraded":"2023-06-22T10:53:39.298489+0000","last_fullsized":"2023-06-22T10:53:39.298489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:37:31.693376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.732169+0000","last_change":"2023-06-22T10:53:31.947093+0000","last_active":"2023-06-22T10:53:37.732169+0000","last_peered":"2023-06-22T10:53:37.732169+0000","last_clean":"2023-06-22T10:53:37.732169+0000","last_became_active":"2023-06-22T10:53:31.946566+0000","last_became_peered":"2023-06-22T10:53:31.946566+0000","last_unstale":"2023-06-22T10:53:37.732169+0000","last_undegraded":"2023-06-22T10:53:37.732169+0000","last_fullsized":"2023-06-22T10:53:37.732169+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T17:02:38.568336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421688+0000","last_change":"2023-06-22T10:53:31.954476+0000","last_active":"2023-06-22T10:53:38.421688+0000","last_peered":"2023-06-22T10:53:38.421688+0000","last_clean":"2023-06-22T10:53:38.421688+0000","last_became_active":"2023-06-22T10:53:31.954161+0000","last_became_peered":"2023-06-22T10:53:31.954161+0000","last_unstale":"2023-06-22T10:53:38.421688+0000","last_undegraded":"2023-06-22T10:53:38.421688+0000","last_fullsized":"2023-06-22T10:53:38.421688+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:59:50.197538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421712+0000","last_change":"2023-06-22T10:53:31.933946+0000","last_active":"2023-06-22T10:53:38.421712+0000","last_peered":"2023-06-22T10:53:38.421712+0000","last_clean":"2023-06-22T10:53:38.421712+0000","last_became_active":"2023-06-22T10:53:31.933657+0000","last_became_peered":"2023-06-22T10:53:31.933657+0000","last_unstale":"2023-06-22T10:53:38.421712+0000","last_undegraded":"2023-06-22T10:53:38.421712+0000","last_fullsized":"2023-06-22T10:53:38.421712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T17:19:23.835283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958575+0000","last_change":"2023-06-22T10:53:31.949726+0000","last_active":"2023-06-22T10:53:36.958575+0000","last_peered":"2023-06-22T10:53:36.958575+0000","last_clean":"2023-06-22T10:53:36.958575+0000","last_became_active":"2023-06-22T10:53:31.949378+0000","last_became_peered":"2023-06-22T10:53:31.949378+0000","last_unstale":"2023-06-22T10:53:36.958575+0000","last_undegraded":"2023-06-22T10:53:36.958575+0000","last_fullsized":"2023-06-22T10:53:36.958575+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:01:37.811790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.959265+0000","last_change":"2023-06-22T10:53:35.993727+0000","last_active":"2023-06-22T10:53:36.959265+0000","last_peered":"2023-06-22T10:53:36.959265+0000","last_clean":"2023-06-22T10:53:36.959265+0000","last_became_active":"2023-06-22T10:53:35.993292+0000","last_became_peered":"2023-06-22T10:53:35.993292+0000","last_unstale":"2023-06-22T10:53:36.959265+0000","last_undegraded":"2023-06-22T10:53:36.959265+0000","last_fullsized":"2023-06-22T10:53:36.959265+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:53:08.402503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958353+0000","last_change":"2023-06-22T10:53:30.935533+0000","last_active":"2023-06-22T10:53:36.958353+0000","last_peered":"2023-06-22T10:53:36.958353+0000","last_clean":"2023-06-22T10:53:36.958353+0000","last_became_active":"2023-06-22T10:53:30.935260+0000","last_became_peered":"2023-06-22T10:53:30.935260+0000","last_unstale":"2023-06-22T10:53:36.958353+0000","last_undegraded":"2023-06-22T10:53:36.958353+0000","last_fullsized":"2023-06-22T10:53:36.958353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T11:57:57.902900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.299328+0000","last_change":"2023-06-22T10:53:31.940482+0000","last_active":"2023-06-22T10:53:39.299328+0000","last_peered":"2023-06-22T10:53:39.299328+0000","last_clean":"2023-06-22T10:53:39.299328+0000","last_became_active":"2023-06-22T10:53:31.940185+0000","last_became_peered":"2023-06-22T10:53:31.940185+0000","last_unstale":"2023-06-22T10:53:39.299328+0000","last_undegraded":"2023-06-22T10:53:39.299328+0000","last_fullsized":"2023-06-22T10:53:39.299328+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:16:58.055706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.280322+0000","last_change":"2023-06-22T10:53:35.980222+0000","last_active":"2023-06-22T10:53:37.280322+0000","last_peered":"2023-06-22T10:53:37.280322+0000","last_clean":"2023-06-22T10:53:37.280322+0000","last_became_active":"2023-06-22T10:53:35.979767+0000","last_became_peered":"2023-06-22T10:53:35.979767+0000","last_unstale":"2023-06-22T10:53:37.280322+0000","last_undegraded":"2023-06-22T10:53:37.280322+0000","last_fullsized":"2023-06-22T10:53:37.280322+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:52:53.767824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421003+0000","last_change":"2023-06-22T10:53:30.945420+0000","last_active":"2023-06-22T10:53:38.421003+0000","last_peered":"2023-06-22T10:53:38.421003+0000","last_clean":"2023-06-22T10:53:38.421003+0000","last_became_active":"2023-06-22T10:53:30.945124+0000","last_became_peered":"2023-06-22T10:53:30.945124+0000","last_unstale":"2023-06-22T10:53:38.421003+0000","last_undegraded":"2023-06-22T10:53:38.421003+0000","last_fullsized":"2023-06-22T10:53:38.421003+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T20:10:12.732255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.956493+0000","last_change":"2023-06-22T10:53:31.946696+0000","last_active":"2023-06-22T10:53:36.956493+0000","last_peered":"2023-06-22T10:53:36.956493+0000","last_clean":"2023-06-22T10:53:36.956493+0000","last_became_active":"2023-06-22T10:53:31.946424+0000","last_became_peered":"2023-06-22T10:53:31.946424+0000","last_unstale":"2023-06-22T10:53:36.956493+0000","last_undegraded":"2023-06-22T10:53:36.956493+0000","last_fullsized":"2023-06-22T10:53:36.956493+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:38:31.209670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.956801+0000","last_change":"2023-06-22T10:53:35.983086+0000","last_active":"2023-06-22T10:53:36.956801+0000","last_peered":"2023-06-22T10:53:36.956801+0000","last_clean":"2023-06-22T10:53:36.956801+0000","last_became_active":"2023-06-22T10:53:35.980183+0000","last_became_peered":"2023-06-22T10:53:35.980183+0000","last_unstale":"2023-06-22T10:53:36.956801+0000","last_undegraded":"2023-06-22T10:53:36.956801+0000","last_fullsized":"2023-06-22T10:53:36.956801+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:04:18.976819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.298108+0000","last_change":"2023-06-22T10:53:30.939562+0000","last_active":"2023-06-22T10:53:39.298108+0000","last_peered":"2023-06-22T10:53:39.298108+0000","last_clean":"2023-06-22T10:53:39.298108+0000","last_became_active":"2023-06-22T10:53:30.939268+0000","last_became_peered":"2023-06-22T10:53:30.939268+0000","last_unstale":"2023-06-22T10:53:39.298108+0000","last_undegraded":"2023-06-22T10:53:39.298108+0000","last_fullsized":"2023-06-22T10:53:39.298108+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:35:50.219987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.280368+0000","last_change":"2023-06-22T10:53:31.943624+0000","last_active":"2023-06-22T10:53:37.280368+0000","last_peered":"2023-06-22T10:53:37.280368+0000","last_clean":"2023-06-22T10:53:37.280368+0000","last_became_active":"2023-06-22T10:53:31.943277+0000","last_became_peered":"2023-06-22T10:53:31.943277+0000","last_unstale":"2023-06-22T10:53:37.280368+0000","last_undegraded":"2023-06-22T10:53:37.280368+0000","last_fullsized":"2023-06-22T10:53:37.280368+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:09:48.895446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.279534+0000","last_change":"2023-06-22T10:53:35.989354+0000","last_active":"2023-06-22T10:53:37.279534+0000","last_peered":"2023-06-22T10:53:37.279534+0000","last_clean":"2023-06-22T10:53:37.279534+0000","last_became_active":"2023-06-22T10:53:35.988867+0000","last_became_peered":"2023-06-22T10:53:35.988867+0000","last_unstale":"2023-06-22T10:53:37.279534+0000","last_undegraded":"2023-06-22T10:53:37.279534+0000","last_fullsized":"2023-06-22T10:53:37.279534+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:53:21.959666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.956819+0000","last_change":"2023-06-22T10:53:30.938551+0000","last_active":"2023-06-22T10:53:36.956819+0000","last_peered":"2023-06-22T10:53:36.956819+0000","last_clean":"2023-06-22T10:53:36.956819+0000","last_became_active":"2023-06-22T10:53:30.938065+0000","last_became_peered":"2023-06-22T10:53:30.938065+0000","last_unstale":"2023-06-22T10:53:36.956819+0000","last_undegraded":"2023-06-22T10:53:36.956819+0000","last_fullsized":"2023-06-22T10:53:36.956819+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:08:20.088422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.298566+0000","last_change":"2023-06-22T10:53:31.944695+0000","last_active":"2023-06-22T10:53:39.298566+0000","last_peered":"2023-06-22T10:53:39.298566+0000","last_clean":"2023-06-22T10:53:39.298566+0000","last_became_active":"2023-06-22T10:53:31.944401+0000","last_became_peered":"2023-06-22T10:53:31.944401+0000","last_unstale":"2023-06-22T10:53:39.298566+0000","last_undegraded":"2023-06-22T10:53:39.298566+0000","last_fullsized":"2023-06-22T10:53:39.298566+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:15:20.227426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.731901+0000","last_change":"2023-06-22T10:53:35.977551+0000","last_active":"2023-06-22T10:53:37.731901+0000","last_peered":"2023-06-22T10:53:37.731901+0000","last_clean":"2023-06-22T10:53:37.731901+0000","last_became_active":"2023-06-22T10:53:35.976931+0000","last_became_peered":"2023-06-22T10:53:35.976931+0000","last_unstale":"2023-06-22T10:53:37.731901+0000","last_undegraded":"2023-06-22T10:53:37.731901+0000","last_fullsized":"2023-06-22T10:53:37.731901+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:58:45.151109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958943+0000","last_change":"2023-06-22T10:53:30.926577+0000","last_active":"2023-06-22T10:53:36.958943+0000","last_peered":"2023-06-22T10:53:36.958943+0000","last_clean":"2023-06-22T10:53:36.958943+0000","last_became_active":"2023-06-22T10:53:30.926220+0000","last_became_peered":"2023-06-22T10:53:30.926220+0000","last_unstale":"2023-06-22T10:53:36.958943+0000","last_undegraded":"2023-06-22T10:53:36.958943+0000","last_fullsized":"2023-06-22T10:53:36.958943+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:16:41.854261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.298455+0000","last_change":"2023-06-22T10:53:31.943837+0000","last_active":"2023-06-22T10:53:39.298455+0000","last_peered":"2023-06-22T10:53:39.298455+0000","last_clean":"2023-06-22T10:53:39.298455+0000","last_became_active":"2023-06-22T10:53:31.943561+0000","last_became_peered":"2023-06-22T10:53:31.943561+0000","last_unstale":"2023-06-22T10:53:39.298455+0000","last_undegraded":"2023-06-22T10:53:39.298455+0000","last_fullsized":"2023-06-22T10:53:39.298455+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T13:38:17.711538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.298880+0000","last_change":"2023-06-22T10:53:35.980240+0000","last_active":"2023-06-22T10:53:39.298880+0000","last_peered":"2023-06-22T10:53:39.298880+0000","last_clean":"2023-06-22T10:53:39.298880+0000","last_became_active":"2023-06-22T10:53:35.979760+0000","last_became_peered":"2023-06-22T10:53:35.979760+0000","last_unstale":"2023-06-22T10:53:39.298880+0000","last_undegraded":"2023-06-22T10:53:39.298880+0000","last_fullsized":"2023-06-22T10:53:39.298880+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T17:38:28.038125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.732712+0000","last_change":"2023-06-22T10:53:30.942222+0000","last_active":"2023-06-22T10:53:37.732712+0000","last_peered":"2023-06-22T10:53:37.732712+0000","last_clean":"2023-06-22T10:53:37.732712+0000","last_became_active":"2023-06-22T10:53:30.941843+0000","last_became_peered":"2023-06-22T10:53:30.941843+0000","last_unstale":"2023-06-22T10:53:37.732712+0000","last_undegraded":"2023-06-22T10:53:37.732712+0000","last_fullsized":"2023-06-22T10:53:37.732712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:54:13.524784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421339+0000","last_change":"2023-06-22T10:53:31.940635+0000","last_active":"2023-06-22T10:53:38.421339+0000","last_peered":"2023-06-22T10:53:38.421339+0000","last_clean":"2023-06-22T10:53:38.421339+0000","last_became_active":"2023-06-22T10:53:31.940144+0000","last_became_peered":"2023-06-22T10:53:31.940144+0000","last_unstale":"2023-06-22T10:53:38.421339+0000","last_undegraded":"2023-06-22T10:53:38.421339+0000","last_fullsized":"2023-06-22T10:53:38.421339+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T18:57:56.828299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421113+0000","last_change":"2023-06-22T10:53:35.981516+0000","last_active":"2023-06-22T10:53:38.421113+0000","last_peered":"2023-06-22T10:53:38.421113+0000","last_clean":"2023-06-22T10:53:38.421113+0000","last_became_active":"2023-06-22T10:53:35.981085+0000","last_became_peered":"2023-06-22T10:53:35.981085+0000","last_unstale":"2023-06-22T10:53:38.421113+0000","last_undegraded":"2023-06-22T10:53:38.421113+0000","last_fullsized":"2023-06-22T10:53:38.421113+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:49:24.206495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'10","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:50.736031+0000","last_change":"2023-06-22T10:53:30.929674+0000","last_active":"2023-06-22T10:53:50.736031+0000","last_peered":"2023-06-22T10:53:50.736031+0000","last_clean":"2023-06-22T10:53:50.736031+0000","last_became_active":"2023-06-22T10:53:30.929103+0000","last_became_peered":"2023-06-22T10:53:30.929103+0000","last_unstale":"2023-06-22T10:53:50.736031+0000","last_undegraded":"2023-06-22T10:53:50.736031+0000","last_fullsized":"2023-06-22T10:53:50.736031+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T11:24:25.762617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958280+0000","last_change":"2023-06-22T10:53:31.950427+0000","last_active":"2023-06-22T10:53:36.958280+0000","last_peered":"2023-06-22T10:53:36.958280+0000","last_clean":"2023-06-22T10:53:36.958280+0000","last_became_active":"2023-06-22T10:53:31.950139+0000","last_became_peered":"2023-06-22T10:53:31.950139+0000","last_unstale":"2023-06-22T10:53:36.958280+0000","last_undegraded":"2023-06-22T10:53:36.958280+0000","last_fullsized":"2023-06-22T10:53:36.958280+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:32:48.965556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958792+0000","last_change":"2023-06-22T10:53:35.974441+0000","last_active":"2023-06-22T10:53:36.958792+0000","last_peered":"2023-06-22T10:53:36.958792+0000","last_clean":"2023-06-22T10:53:36.958792+0000","last_became_active":"2023-06-22T10:53:35.973542+0000","last_became_peered":"2023-06-22T10:53:35.973542+0000","last_unstale":"2023-06-22T10:53:36.958792+0000","last_undegraded":"2023-06-22T10:53:36.958792+0000","last_fullsized":"2023-06-22T10:53:36.958792+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:37:35.731228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.732330+0000","last_change":"2023-06-22T10:53:30.940712+0000","last_active":"2023-06-22T10:53:37.732330+0000","last_peered":"2023-06-22T10:53:37.732330+0000","last_clean":"2023-06-22T10:53:37.732330+0000","last_became_active":"2023-06-22T10:53:30.940318+0000","last_became_peered":"2023-06-22T10:53:30.940318+0000","last_unstale":"2023-06-22T10:53:37.732330+0000","last_undegraded":"2023-06-22T10:53:37.732330+0000","last_fullsized":"2023-06-22T10:53:37.732330+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:15:19.221249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.299326+0000","last_change":"2023-06-22T10:53:31.942026+0000","last_active":"2023-06-22T10:53:39.299326+0000","last_peered":"2023-06-22T10:53:39.299326+0000","last_clean":"2023-06-22T10:53:39.299326+0000","last_became_active":"2023-06-22T10:53:31.941695+0000","last_became_peered":"2023-06-22T10:53:31.941695+0000","last_unstale":"2023-06-22T10:53:39.299326+0000","last_undegraded":"2023-06-22T10:53:39.299326+0000","last_fullsized":"2023-06-22T10:53:39.299326+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:49:21.017446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.299153+0000","last_change":"2023-06-22T10:53:35.984076+0000","last_active":"2023-06-22T10:53:39.299153+0000","last_peered":"2023-06-22T10:53:39.299153+0000","last_clean":"2023-06-22T10:53:39.299153+0000","last_became_active":"2023-06-22T10:53:35.983702+0000","last_became_peered":"2023-06-22T10:53:35.983702+0000","last_unstale":"2023-06-22T10:53:39.299153+0000","last_undegraded":"2023-06-22T10:53:39.299153+0000","last_fullsized":"2023-06-22T10:53:39.299153+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:39:18.877636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.955629+0000","last_change":"2023-06-22T10:53:30.937271+0000","last_active":"2023-06-22T10:53:36.955629+0000","last_peered":"2023-06-22T10:53:36.955629+0000","last_clean":"2023-06-22T10:53:36.955629+0000","last_became_active":"2023-06-22T10:53:30.936656+0000","last_became_peered":"2023-06-22T10:53:30.936656+0000","last_unstale":"2023-06-22T10:53:36.955629+0000","last_undegraded":"2023-06-22T10:53:36.955629+0000","last_fullsized":"2023-06-22T10:53:36.955629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T20:35:09.275456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958456+0000","last_change":"2023-06-22T10:53:31.937743+0000","last_active":"2023-06-22T10:53:36.958456+0000","last_peered":"2023-06-22T10:53:36.958456+0000","last_clean":"2023-06-22T10:53:36.958456+0000","last_became_active":"2023-06-22T10:53:31.937458+0000","last_became_peered":"2023-06-22T10:53:31.937458+0000","last_unstale":"2023-06-22T10:53:36.958456+0000","last_undegraded":"2023-06-22T10:53:36.958456+0000","last_fullsized":"2023-06-22T10:53:36.958456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:09:14.741666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.299475+0000","last_change":"2023-06-22T10:53:35.988689+0000","last_active":"2023-06-22T10:53:39.299475+0000","last_peered":"2023-06-22T10:53:39.299475+0000","last_clean":"2023-06-22T10:53:39.299475+0000","last_became_active":"2023-06-22T10:53:35.988266+0000","last_became_peered":"2023-06-22T10:53:35.988266+0000","last_unstale":"2023-06-22T10:53:39.299475+0000","last_undegraded":"2023-06-22T10:53:39.299475+0000","last_fullsized":"2023-06-22T10:53:39.299475+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:00:09.093418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.732168+0000","last_change":"2023-06-22T10:53:30.941102+0000","last_active":"2023-06-22T10:53:37.732168+0000","last_peered":"2023-06-22T10:53:37.732168+0000","last_clean":"2023-06-22T10:53:37.732168+0000","last_became_active":"2023-06-22T10:53:30.940822+0000","last_became_peered":"2023-06-22T10:53:30.940822+0000","last_unstale":"2023-06-22T10:53:37.732168+0000","last_undegraded":"2023-06-22T10:53:37.732168+0000","last_fullsized":"2023-06-22T10:53:37.732168+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:09:13.735489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.956701+0000","last_change":"2023-06-22T10:53:31.944224+0000","last_active":"2023-06-22T10:53:36.956701+0000","last_peered":"2023-06-22T10:53:36.956701+0000","last_clean":"2023-06-22T10:53:36.956701+0000","last_became_active":"2023-06-22T10:53:31.943836+0000","last_became_peered":"2023-06-22T10:53:31.943836+0000","last_unstale":"2023-06-22T10:53:36.956701+0000","last_undegraded":"2023-06-22T10:53:36.956701+0000","last_fullsized":"2023-06-22T10:53:36.956701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:06:51.541995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958768+0000","last_change":"2023-06-22T10:53:35.972031+0000","last_active":"2023-06-22T10:53:36.958768+0000","last_peered":"2023-06-22T10:53:36.958768+0000","last_clean":"2023-06-22T10:53:36.958768+0000","last_became_active":"2023-06-22T10:53:35.971550+0000","last_became_peered":"2023-06-22T10:53:35.971550+0000","last_unstale":"2023-06-22T10:53:36.958768+0000","last_undegraded":"2023-06-22T10:53:36.958768+0000","last_fullsized":"2023-06-22T10:53:36.958768+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T13:38:21.749390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.279619+0000","last_change":"2023-06-22T10:53:30.937109+0000","last_active":"2023-06-22T10:53:37.279619+0000","last_peered":"2023-06-22T10:53:37.279619+0000","last_clean":"2023-06-22T10:53:37.279619+0000","last_became_active":"2023-06-22T10:53:30.936757+0000","last_became_peered":"2023-06-22T10:53:30.936757+0000","last_unstale":"2023-06-22T10:53:37.279619+0000","last_undegraded":"2023-06-22T10:53:37.279619+0000","last_fullsized":"2023-06-22T10:53:37.279619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T13:33:41.336023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.299478+0000","last_change":"2023-06-22T10:53:31.948662+0000","last_active":"2023-06-22T10:53:39.299478+0000","last_peered":"2023-06-22T10:53:39.299478+0000","last_clean":"2023-06-22T10:53:39.299478+0000","last_became_active":"2023-06-22T10:53:31.948201+0000","last_became_peered":"2023-06-22T10:53:31.948201+0000","last_unstale":"2023-06-22T10:53:39.299478+0000","last_undegraded":"2023-06-22T10:53:39.299478+0000","last_fullsized":"2023-06-22T10:53:39.299478+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T15:52:35.480952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.732657+0000","last_change":"2023-06-22T10:53:35.977231+0000","last_active":"2023-06-22T10:53:37.732657+0000","last_peered":"2023-06-22T10:53:37.732657+0000","last_clean":"2023-06-22T10:53:37.732657+0000","last_became_active":"2023-06-22T10:53:35.976777+0000","last_became_peered":"2023-06-22T10:53:35.976777+0000","last_unstale":"2023-06-22T10:53:37.732657+0000","last_undegraded":"2023-06-22T10:53:37.732657+0000","last_fullsized":"2023-06-22T10:53:37.732657+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:16:46.898291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.733132+0000","last_change":"2023-06-22T10:53:30.941433+0000","last_active":"2023-06-22T10:53:37.733132+0000","last_peered":"2023-06-22T10:53:37.733132+0000","last_clean":"2023-06-22T10:53:37.733132+0000","last_became_active":"2023-06-22T10:53:30.941122+0000","last_became_peered":"2023-06-22T10:53:30.941122+0000","last_unstale":"2023-06-22T10:53:37.733132+0000","last_undegraded":"2023-06-22T10:53:37.733132+0000","last_fullsized":"2023-06-22T10:53:37.733132+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:49:20.011268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957286+0000","last_change":"2023-06-22T10:53:31.946014+0000","last_active":"2023-06-22T10:53:36.957286+0000","last_peered":"2023-06-22T10:53:36.957286+0000","last_clean":"2023-06-22T10:53:36.957286+0000","last_became_active":"2023-06-22T10:53:31.945733+0000","last_became_peered":"2023-06-22T10:53:31.945733+0000","last_unstale":"2023-06-22T10:53:36.957286+0000","last_undegraded":"2023-06-22T10:53:36.957286+0000","last_fullsized":"2023-06-22T10:53:36.957286+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:54:20.603411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.539641+0000","last_change":"2023-06-22T10:53:35.976548+0000","last_active":"2023-06-22T10:53:37.539641+0000","last_peered":"2023-06-22T10:53:37.539641+0000","last_clean":"2023-06-22T10:53:37.539641+0000","last_became_active":"2023-06-22T10:53:35.975282+0000","last_became_peered":"2023-06-22T10:53:35.975282+0000","last_unstale":"2023-06-22T10:53:37.539641+0000","last_undegraded":"2023-06-22T10:53:37.539641+0000","last_fullsized":"2023-06-22T10:53:37.539641+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:47:49.439479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.733034+0000","last_change":"2023-06-22T10:53:30.940936+0000","last_active":"2023-06-22T10:53:37.733034+0000","last_peered":"2023-06-22T10:53:37.733034+0000","last_clean":"2023-06-22T10:53:37.733034+0000","last_became_active":"2023-06-22T10:53:30.940494+0000","last_became_peered":"2023-06-22T10:53:30.940494+0000","last_unstale":"2023-06-22T10:53:37.733034+0000","last_undegraded":"2023-06-22T10:53:37.733034+0000","last_fullsized":"2023-06-22T10:53:37.733034+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:39:13.833606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957664+0000","last_change":"2023-06-22T10:53:31.953007+0000","last_active":"2023-06-22T10:53:36.957664+0000","last_peered":"2023-06-22T10:53:36.957664+0000","last_clean":"2023-06-22T10:53:36.957664+0000","last_became_active":"2023-06-22T10:53:31.952493+0000","last_became_peered":"2023-06-22T10:53:31.952493+0000","last_unstale":"2023-06-22T10:53:36.957664+0000","last_undegraded":"2023-06-22T10:53:36.957664+0000","last_fullsized":"2023-06-22T10:53:36.957664+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:46:07.563474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.539899+0000","last_change":"2023-06-22T10:53:35.975271+0000","last_active":"2023-06-22T10:53:37.539899+0000","last_peered":"2023-06-22T10:53:37.539899+0000","last_clean":"2023-06-22T10:53:37.539899+0000","last_became_active":"2023-06-22T10:53:35.974796+0000","last_became_peered":"2023-06-22T10:53:35.974796+0000","last_unstale":"2023-06-22T10:53:37.539899+0000","last_undegraded":"2023-06-22T10:53:37.539899+0000","last_fullsized":"2023-06-22T10:53:37.539899+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:55:38.296763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.732906+0000","last_change":"2023-06-22T10:53:30.935554+0000","last_active":"2023-06-22T10:53:37.732906+0000","last_peered":"2023-06-22T10:53:37.732906+0000","last_clean":"2023-06-22T10:53:37.732906+0000","last_became_active":"2023-06-22T10:53:30.935186+0000","last_became_peered":"2023-06-22T10:53:30.935186+0000","last_unstale":"2023-06-22T10:53:37.732906+0000","last_undegraded":"2023-06-22T10:53:37.732906+0000","last_fullsized":"2023-06-22T10:53:37.732906+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:12:31.122076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.279728+0000","last_change":"2023-06-22T10:53:31.939659+0000","last_active":"2023-06-22T10:53:37.279728+0000","last_peered":"2023-06-22T10:53:37.279728+0000","last_clean":"2023-06-22T10:53:37.279728+0000","last_became_active":"2023-06-22T10:53:31.939359+0000","last_became_peered":"2023-06-22T10:53:31.939359+0000","last_unstale":"2023-06-22T10:53:37.279728+0000","last_undegraded":"2023-06-22T10:53:37.279728+0000","last_fullsized":"2023-06-22T10:53:37.279728+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T20:49:06.159398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.539838+0000","last_change":"2023-06-22T10:53:35.986300+0000","last_active":"2023-06-22T10:53:37.539838+0000","last_peered":"2023-06-22T10:53:37.539838+0000","last_clean":"2023-06-22T10:53:37.539838+0000","last_became_active":"2023-06-22T10:53:35.985773+0000","last_became_peered":"2023-06-22T10:53:35.985773+0000","last_unstale":"2023-06-22T10:53:37.539838+0000","last_undegraded":"2023-06-22T10:53:37.539838+0000","last_fullsized":"2023-06-22T10:53:37.539838+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:02:57.117668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957836+0000","last_change":"2023-06-22T10:53:30.938410+0000","last_active":"2023-06-22T10:53:36.957836+0000","last_peered":"2023-06-22T10:53:36.957836+0000","last_clean":"2023-06-22T10:53:36.957836+0000","last_became_active":"2023-06-22T10:53:30.938082+0000","last_became_peered":"2023-06-22T10:53:30.938082+0000","last_unstale":"2023-06-22T10:53:36.957836+0000","last_undegraded":"2023-06-22T10:53:36.957836+0000","last_fullsized":"2023-06-22T10:53:36.957836+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:01:52.091411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.956128+0000","last_change":"2023-06-22T10:53:31.938625+0000","last_active":"2023-06-22T10:53:36.956128+0000","last_peered":"2023-06-22T10:53:36.956128+0000","last_clean":"2023-06-22T10:53:36.956128+0000","last_became_active":"2023-06-22T10:53:31.938266+0000","last_became_peered":"2023-06-22T10:53:31.938266+0000","last_unstale":"2023-06-22T10:53:36.956128+0000","last_undegraded":"2023-06-22T10:53:36.956128+0000","last_fullsized":"2023-06-22T10:53:36.956128+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:22:33.870719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.540124+0000","last_change":"2023-06-22T10:53:35.973789+0000","last_active":"2023-06-22T10:53:37.540124+0000","last_peered":"2023-06-22T10:53:37.540124+0000","last_clean":"2023-06-22T10:53:37.540124+0000","last_became_active":"2023-06-22T10:53:35.973221+0000","last_became_peered":"2023-06-22T10:53:35.973221+0000","last_unstale":"2023-06-22T10:53:37.540124+0000","last_undegraded":"2023-06-22T10:53:37.540124+0000","last_fullsized":"2023-06-22T10:53:37.540124+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:41:28.183007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.298246+0000","last_change":"2023-06-22T10:53:30.940317+0000","last_active":"2023-06-22T10:53:39.298246+0000","last_peered":"2023-06-22T10:53:39.298246+0000","last_clean":"2023-06-22T10:53:39.298246+0000","last_became_active":"2023-06-22T10:53:30.939695+0000","last_became_peered":"2023-06-22T10:53:30.939695+0000","last_unstale":"2023-06-22T10:53:39.298246+0000","last_undegraded":"2023-06-22T10:53:39.298246+0000","last_fullsized":"2023-06-22T10:53:39.298246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:19:57.424826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957974+0000","last_change":"2023-06-22T10:53:31.955337+0000","last_active":"2023-06-22T10:53:36.957974+0000","last_peered":"2023-06-22T10:53:36.957974+0000","last_clean":"2023-06-22T10:53:36.957974+0000","last_became_active":"2023-06-22T10:53:31.955009+0000","last_became_peered":"2023-06-22T10:53:31.955009+0000","last_unstale":"2023-06-22T10:53:36.957974+0000","last_undegraded":"2023-06-22T10:53:36.957974+0000","last_fullsized":"2023-06-22T10:53:36.957974+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:44:52.079657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421497+0000","last_change":"2023-06-22T10:53:35.992703+0000","last_active":"2023-06-22T10:53:38.421497+0000","last_peered":"2023-06-22T10:53:38.421497+0000","last_clean":"2023-06-22T10:53:38.421497+0000","last_became_active":"2023-06-22T10:53:35.991759+0000","last_became_peered":"2023-06-22T10:53:35.991759+0000","last_unstale":"2023-06-22T10:53:38.421497+0000","last_undegraded":"2023-06-22T10:53:38.421497+0000","last_fullsized":"2023-06-22T10:53:38.421497+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:06:55.579848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.279637+0000","last_change":"2023-06-22T10:53:30.942339+0000","last_active":"2023-06-22T10:53:37.279637+0000","last_peered":"2023-06-22T10:53:37.279637+0000","last_clean":"2023-06-22T10:53:37.279637+0000","last_became_active":"2023-06-22T10:53:30.942042+0000","last_became_peered":"2023-06-22T10:53:30.942042+0000","last_unstale":"2023-06-22T10:53:37.279637+0000","last_undegraded":"2023-06-22T10:53:37.279637+0000","last_fullsized":"2023-06-22T10:53:37.279637+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:03:54.160970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.959163+0000","last_change":"2023-06-22T10:53:31.946119+0000","last_active":"2023-06-22T10:53:36.959163+0000","last_peered":"2023-06-22T10:53:36.959163+0000","last_clean":"2023-06-22T10:53:36.959163+0000","last_became_active":"2023-06-22T10:53:31.945270+0000","last_became_peered":"2023-06-22T10:53:31.945270+0000","last_unstale":"2023-06-22T10:53:36.959163+0000","last_undegraded":"2023-06-22T10:53:36.959163+0000","last_fullsized":"2023-06-22T10:53:36.959163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:54:16.378747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958959+0000","last_change":"2023-06-22T10:53:35.981345+0000","last_active":"2023-06-22T10:53:36.958959+0000","last_peered":"2023-06-22T10:53:36.958959+0000","last_clean":"2023-06-22T10:53:36.958959+0000","last_became_active":"2023-06-22T10:53:35.980744+0000","last_became_peered":"2023-06-22T10:53:35.980744+0000","last_unstale":"2023-06-22T10:53:36.958959+0000","last_undegraded":"2023-06-22T10:53:36.958959+0000","last_fullsized":"2023-06-22T10:53:36.958959+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:54:18.568814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957001+0000","last_change":"2023-06-22T10:53:30.932306+0000","last_active":"2023-06-22T10:53:36.957001+0000","last_peered":"2023-06-22T10:53:36.957001+0000","last_clean":"2023-06-22T10:53:36.957001+0000","last_became_active":"2023-06-22T10:53:30.931997+0000","last_became_peered":"2023-06-22T10:53:30.931997+0000","last_unstale":"2023-06-22T10:53:36.957001+0000","last_undegraded":"2023-06-22T10:53:36.957001+0000","last_fullsized":"2023-06-22T10:53:36.957001+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:39:13.833606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958190+0000","last_change":"2023-06-22T10:53:31.954114+0000","last_active":"2023-06-22T10:53:36.958190+0000","last_peered":"2023-06-22T10:53:36.958190+0000","last_clean":"2023-06-22T10:53:36.958190+0000","last_became_active":"2023-06-22T10:53:31.953496+0000","last_became_peered":"2023-06-22T10:53:31.953496+0000","last_unstale":"2023-06-22T10:53:36.958190+0000","last_undegraded":"2023-06-22T10:53:36.958190+0000","last_fullsized":"2023-06-22T10:53:36.958190+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T15:22:38.636161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957711+0000","last_change":"2023-06-22T10:53:35.986282+0000","last_active":"2023-06-22T10:53:36.957711+0000","last_peered":"2023-06-22T10:53:36.957711+0000","last_clean":"2023-06-22T10:53:36.957711+0000","last_became_active":"2023-06-22T10:53:35.985805+0000","last_became_peered":"2023-06-22T10:53:35.985805+0000","last_unstale":"2023-06-22T10:53:36.957711+0000","last_undegraded":"2023-06-22T10:53:36.957711+0000","last_fullsized":"2023-06-22T10:53:36.957711+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:06:28.390109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.298108+0000","last_change":"2023-06-22T10:53:30.937943+0000","last_active":"2023-06-22T10:53:39.298108+0000","last_peered":"2023-06-22T10:53:39.298108+0000","last_clean":"2023-06-22T10:53:39.298108+0000","last_became_active":"2023-06-22T10:53:30.937648+0000","last_became_peered":"2023-06-22T10:53:30.937648+0000","last_unstale":"2023-06-22T10:53:39.298108+0000","last_undegraded":"2023-06-22T10:53:39.298108+0000","last_fullsized":"2023-06-22T10:53:39.298108+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T17:02:37.562158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421904+0000","last_change":"2023-06-22T10:53:31.930885+0000","last_active":"2023-06-22T10:53:38.421904+0000","last_peered":"2023-06-22T10:53:38.421904+0000","last_clean":"2023-06-22T10:53:38.421904+0000","last_became_active":"2023-06-22T10:53:31.930508+0000","last_became_peered":"2023-06-22T10:53:31.930508+0000","last_unstale":"2023-06-22T10:53:38.421904+0000","last_undegraded":"2023-06-22T10:53:38.421904+0000","last_fullsized":"2023-06-22T10:53:38.421904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:56:30.123428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.956198+0000","last_change":"2023-06-22T10:53:35.981990+0000","last_active":"2023-06-22T10:53:36.956198+0000","last_peered":"2023-06-22T10:53:36.956198+0000","last_clean":"2023-06-22T10:53:36.956198+0000","last_became_active":"2023-06-22T10:53:35.979743+0000","last_became_peered":"2023-06-22T10:53:35.979743+0000","last_unstale":"2023-06-22T10:53:36.956198+0000","last_undegraded":"2023-06-22T10:53:36.956198+0000","last_fullsized":"2023-06-22T10:53:36.956198+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:29:28.820265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421611+0000","last_change":"2023-06-22T10:53:25.624603+0000","last_active":"2023-06-22T10:53:38.421611+0000","last_peered":"2023-06-22T10:53:38.421611+0000","last_clean":"2023-06-22T10:53:38.421611+0000","last_became_active":"2023-06-22T10:53:25.624302+0000","last_became_peered":"2023-06-22T10:53:25.624302+0000","last_unstale":"2023-06-22T10:53:38.421611+0000","last_undegraded":"2023-06-22T10:53:38.421611+0000","last_fullsized":"2023-06-22T10:53:38.421611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_clean_scrub_stamp":"2023-06-22T10:53:24.612028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:46:56.694570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958314+0000","last_change":"2023-06-22T10:53:30.938529+0000","last_active":"2023-06-22T10:53:36.958314+0000","last_peered":"2023-06-22T10:53:36.958314+0000","last_clean":"2023-06-22T10:53:36.958314+0000","last_became_active":"2023-06-22T10:53:30.938128+0000","last_became_peered":"2023-06-22T10:53:30.938128+0000","last_unstale":"2023-06-22T10:53:36.958314+0000","last_undegraded":"2023-06-22T10:53:36.958314+0000","last_fullsized":"2023-06-22T10:53:36.958314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:19:57.424826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421209+0000","last_change":"2023-06-22T10:53:31.943591+0000","last_active":"2023-06-22T10:53:38.421209+0000","last_peered":"2023-06-22T10:53:38.421209+0000","last_clean":"2023-06-22T10:53:38.421209+0000","last_became_active":"2023-06-22T10:53:31.943246+0000","last_became_peered":"2023-06-22T10:53:31.943246+0000","last_unstale":"2023-06-22T10:53:38.421209+0000","last_undegraded":"2023-06-22T10:53:38.421209+0000","last_fullsized":"2023-06-22T10:53:38.421209+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:38:31.209670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.956370+0000","last_change":"2023-06-22T10:53:35.983928+0000","last_active":"2023-06-22T10:53:36.956370+0000","last_peered":"2023-06-22T10:53:36.956370+0000","last_clean":"2023-06-22T10:53:36.956370+0000","last_became_active":"2023-06-22T10:53:35.983547+0000","last_became_peered":"2023-06-22T10:53:35.983547+0000","last_unstale":"2023-06-22T10:53:36.956370+0000","last_undegraded":"2023-06-22T10:53:36.956370+0000","last_fullsized":"2023-06-22T10:53:36.956370+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T15:14:35.353462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957795+0000","last_change":"2023-06-22T10:53:25.624213+0000","last_active":"2023-06-22T10:53:36.957795+0000","last_peered":"2023-06-22T10:53:36.957795+0000","last_clean":"2023-06-22T10:53:36.957795+0000","last_became_active":"2023-06-22T10:53:25.623692+0000","last_became_peered":"2023-06-22T10:53:25.623692+0000","last_unstale":"2023-06-22T10:53:36.957795+0000","last_undegraded":"2023-06-22T10:53:36.957795+0000","last_fullsized":"2023-06-22T10:53:36.957795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_clean_scrub_stamp":"2023-06-22T10:53:24.612028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T11:10:32.309210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957903+0000","last_change":"2023-06-22T10:53:30.940331+0000","last_active":"2023-06-22T10:53:36.957903+0000","last_peered":"2023-06-22T10:53:36.957903+0000","last_clean":"2023-06-22T10:53:36.957903+0000","last_became_active":"2023-06-22T10:53:30.939881+0000","last_became_peered":"2023-06-22T10:53:30.939881+0000","last_unstale":"2023-06-22T10:53:36.957903+0000","last_undegraded":"2023-06-22T10:53:36.957903+0000","last_fullsized":"2023-06-22T10:53:36.957903+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:21:26.540035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421562+0000","last_change":"2023-06-22T10:53:31.934499+0000","last_active":"2023-06-22T10:53:38.421562+0000","last_peered":"2023-06-22T10:53:38.421562+0000","last_clean":"2023-06-22T10:53:38.421562+0000","last_became_active":"2023-06-22T10:53:31.934221+0000","last_became_peered":"2023-06-22T10:53:31.934221+0000","last_unstale":"2023-06-22T10:53:38.421562+0000","last_undegraded":"2023-06-22T10:53:38.421562+0000","last_fullsized":"2023-06-22T10:53:38.421562+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:08:21.094599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.540144+0000","last_change":"2023-06-22T10:53:35.973534+0000","last_active":"2023-06-22T10:53:37.540144+0000","last_peered":"2023-06-22T10:53:37.540144+0000","last_clean":"2023-06-22T10:53:37.540144+0000","last_became_active":"2023-06-22T10:53:35.973091+0000","last_became_peered":"2023-06-22T10:53:35.973091+0000","last_unstale":"2023-06-22T10:53:37.540144+0000","last_undegraded":"2023-06-22T10:53:37.540144+0000","last_fullsized":"2023-06-22T10:53:37.540144+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:21:55.271025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.539801+0000","last_change":"2023-06-22T10:53:25.679314+0000","last_active":"2023-06-22T10:53:37.539801+0000","last_peered":"2023-06-22T10:53:37.539801+0000","last_clean":"2023-06-22T10:53:37.539801+0000","last_became_active":"2023-06-22T10:53:25.678947+0000","last_became_peered":"2023-06-22T10:53:25.678947+0000","last_unstale":"2023-06-22T10:53:37.539801+0000","last_undegraded":"2023-06-22T10:53:37.539801+0000","last_fullsized":"2023-06-22T10:53:37.539801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_clean_scrub_stamp":"2023-06-22T10:53:24.612028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:08:41.570586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421091+0000","last_change":"2023-06-22T10:53:30.944583+0000","last_active":"2023-06-22T10:53:38.421091+0000","last_peered":"2023-06-22T10:53:38.421091+0000","last_clean":"2023-06-22T10:53:38.421091+0000","last_became_active":"2023-06-22T10:53:30.944251+0000","last_became_peered":"2023-06-22T10:53:30.944251+0000","last_unstale":"2023-06-22T10:53:38.421091+0000","last_undegraded":"2023-06-22T10:53:38.421091+0000","last_fullsized":"2023-06-22T10:53:38.421091+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:16:33.667495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421775+0000","last_change":"2023-06-22T10:53:31.939367+0000","last_active":"2023-06-22T10:53:38.421775+0000","last_peered":"2023-06-22T10:53:38.421775+0000","last_clean":"2023-06-22T10:53:38.421775+0000","last_became_active":"2023-06-22T10:53:31.939090+0000","last_became_peered":"2023-06-22T10:53:31.939090+0000","last_unstale":"2023-06-22T10:53:38.421775+0000","last_undegraded":"2023-06-22T10:53:38.421775+0000","last_fullsized":"2023-06-22T10:53:38.421775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:31:58.628207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.732375+0000","last_change":"2023-06-22T10:53:35.971334+0000","last_active":"2023-06-22T10:53:37.732375+0000","last_peered":"2023-06-22T10:53:37.732375+0000","last_clean":"2023-06-22T10:53:37.732375+0000","last_became_active":"2023-06-22T10:53:35.970663+0000","last_became_peered":"2023-06-22T10:53:35.970663+0000","last_unstale":"2023-06-22T10:53:37.732375+0000","last_undegraded":"2023-06-22T10:53:37.732375+0000","last_fullsized":"2023-06-22T10:53:37.732375+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T15:48:40.394252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958397+0000","last_change":"2023-06-22T10:53:25.624072+0000","last_active":"2023-06-22T10:53:36.958397+0000","last_peered":"2023-06-22T10:53:36.958397+0000","last_clean":"2023-06-22T10:53:36.958397+0000","last_became_active":"2023-06-22T10:53:25.623617+0000","last_became_peered":"2023-06-22T10:53:25.623617+0000","last_unstale":"2023-06-22T10:53:36.958397+0000","last_undegraded":"2023-06-22T10:53:36.958397+0000","last_fullsized":"2023-06-22T10:53:36.958397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_clean_scrub_stamp":"2023-06-22T10:53:24.612028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T15:48:30.067600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":183,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.732114+0000","last_change":"2023-06-22T10:53:19.693774+0000","last_active":"2023-06-22T10:53:37.732114+0000","last_peered":"2023-06-22T10:53:37.732114+0000","last_clean":"2023-06-22T10:53:37.732114+0000","last_became_active":"2023-06-22T10:53:19.692329+0000","last_became_peered":"2023-06-22T10:53:19.692329+0000","last_unstale":"2023-06-22T10:53:37.732114+0000","last_undegraded":"2023-06-22T10:53:37.732114+0000","last_fullsized":"2023-06-22T10:53:37.732114+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:17.830348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:17.830348+0000","last_clean_scrub_stamp":"2023-06-22T10:53:17.830348+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:35:38.155685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.298095+0000","last_change":"2023-06-22T10:53:30.939596+0000","last_active":"2023-06-22T10:53:39.298095+0000","last_peered":"2023-06-22T10:53:39.298095+0000","last_clean":"2023-06-22T10:53:39.298095+0000","last_became_active":"2023-06-22T10:53:30.939312+0000","last_became_peered":"2023-06-22T10:53:30.939312+0000","last_unstale":"2023-06-22T10:53:39.298095+0000","last_undegraded":"2023-06-22T10:53:39.298095+0000","last_fullsized":"2023-06-22T10:53:39.298095+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:58:40.107079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.279924+0000","last_change":"2023-06-22T10:53:31.953786+0000","last_active":"2023-06-22T10:53:37.279924+0000","last_peered":"2023-06-22T10:53:37.279924+0000","last_clean":"2023-06-22T10:53:37.279924+0000","last_became_active":"2023-06-22T10:53:31.953495+0000","last_became_peered":"2023-06-22T10:53:31.953495+0000","last_unstale":"2023-06-22T10:53:37.279924+0000","last_undegraded":"2023-06-22T10:53:37.279924+0000","last_fullsized":"2023-06-22T10:53:37.279924+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T18:35:18.801024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958642+0000","last_change":"2023-06-22T10:53:35.985942+0000","last_active":"2023-06-22T10:53:36.958642+0000","last_peered":"2023-06-22T10:53:36.958642+0000","last_clean":"2023-06-22T10:53:36.958642+0000","last_became_active":"2023-06-22T10:53:35.985552+0000","last_became_peered":"2023-06-22T10:53:35.985552+0000","last_unstale":"2023-06-22T10:53:36.958642+0000","last_undegraded":"2023-06-22T10:53:36.958642+0000","last_fullsized":"2023-06-22T10:53:36.958642+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:54:23.850496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.732378+0000","last_change":"2023-06-22T10:53:25.626890+0000","last_active":"2023-06-22T10:53:37.732378+0000","last_peered":"2023-06-22T10:53:37.732378+0000","last_clean":"2023-06-22T10:53:37.732378+0000","last_became_active":"2023-06-22T10:53:25.626558+0000","last_became_peered":"2023-06-22T10:53:25.626558+0000","last_unstale":"2023-06-22T10:53:37.732378+0000","last_undegraded":"2023-06-22T10:53:37.732378+0000","last_fullsized":"2023-06-22T10:53:37.732378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_clean_scrub_stamp":"2023-06-22T10:53:24.612028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:54:13.523844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.955533+0000","last_change":"2023-06-22T10:53:30.943578+0000","last_active":"2023-06-22T10:53:36.955533+0000","last_peered":"2023-06-22T10:53:36.955533+0000","last_clean":"2023-06-22T10:53:36.955533+0000","last_became_active":"2023-06-22T10:53:30.943117+0000","last_became_peered":"2023-06-22T10:53:30.943117+0000","last_unstale":"2023-06-22T10:53:36.955533+0000","last_undegraded":"2023-06-22T10:53:36.955533+0000","last_fullsized":"2023-06-22T10:53:36.955533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:00:06.067980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.956299+0000","last_change":"2023-06-22T10:53:31.943987+0000","last_active":"2023-06-22T10:53:36.956299+0000","last_peered":"2023-06-22T10:53:36.956299+0000","last_clean":"2023-06-22T10:53:36.956299+0000","last_became_active":"2023-06-22T10:53:31.943488+0000","last_became_peered":"2023-06-22T10:53:31.943488+0000","last_unstale":"2023-06-22T10:53:36.956299+0000","last_undegraded":"2023-06-22T10:53:36.956299+0000","last_fullsized":"2023-06-22T10:53:36.956299+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:31:56.049728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.280108+0000","last_change":"2023-06-22T10:53:35.989113+0000","last_active":"2023-06-22T10:53:37.280108+0000","last_peered":"2023-06-22T10:53:37.280108+0000","last_clean":"2023-06-22T10:53:37.280108+0000","last_became_active":"2023-06-22T10:53:35.988755+0000","last_became_peered":"2023-06-22T10:53:35.988755+0000","last_unstale":"2023-06-22T10:53:37.280108+0000","last_undegraded":"2023-06-22T10:53:37.280108+0000","last_fullsized":"2023-06-22T10:53:37.280108+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T18:28:31.706827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.732796+0000","last_change":"2023-06-22T10:53:25.626005+0000","last_active":"2023-06-22T10:53:37.732796+0000","last_peered":"2023-06-22T10:53:37.732796+0000","last_clean":"2023-06-22T10:53:37.732796+0000","last_became_active":"2023-06-22T10:53:25.625614+0000","last_became_peered":"2023-06-22T10:53:25.625614+0000","last_unstale":"2023-06-22T10:53:37.732796+0000","last_undegraded":"2023-06-22T10:53:37.732796+0000","last_fullsized":"2023-06-22T10:53:37.732796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_clean_scrub_stamp":"2023-06-22T10:53:24.612028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T17:38:17.711473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421888+0000","last_change":"2023-06-22T10:53:30.929933+0000","last_active":"2023-06-22T10:53:38.421888+0000","last_peered":"2023-06-22T10:53:38.421888+0000","last_clean":"2023-06-22T10:53:38.421888+0000","last_became_active":"2023-06-22T10:53:30.929555+0000","last_became_peered":"2023-06-22T10:53:30.929555+0000","last_unstale":"2023-06-22T10:53:38.421888+0000","last_undegraded":"2023-06-22T10:53:38.421888+0000","last_fullsized":"2023-06-22T10:53:38.421888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:54:19.597233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.956482+0000","last_change":"2023-06-22T10:53:31.947501+0000","last_active":"2023-06-22T10:53:36.956482+0000","last_peered":"2023-06-22T10:53:36.956482+0000","last_clean":"2023-06-22T10:53:36.956482+0000","last_became_active":"2023-06-22T10:53:31.947187+0000","last_became_peered":"2023-06-22T10:53:31.947187+0000","last_unstale":"2023-06-22T10:53:36.956482+0000","last_undegraded":"2023-06-22T10:53:36.956482+0000","last_fullsized":"2023-06-22T10:53:36.956482+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:16:34.673673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957362+0000","last_change":"2023-06-22T10:53:35.993805+0000","last_active":"2023-06-22T10:53:36.957362+0000","last_peered":"2023-06-22T10:53:36.957362+0000","last_clean":"2023-06-22T10:53:36.957362+0000","last_became_active":"2023-06-22T10:53:35.993328+0000","last_became_peered":"2023-06-22T10:53:35.993328+0000","last_unstale":"2023-06-22T10:53:36.957362+0000","last_undegraded":"2023-06-22T10:53:36.957362+0000","last_fullsized":"2023-06-22T10:53:36.957362+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:00:09.093418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.298382+0000","last_change":"2023-06-22T10:53:30.940900+0000","last_active":"2023-06-22T10:53:39.298382+0000","last_peered":"2023-06-22T10:53:39.298382+0000","last_clean":"2023-06-22T10:53:39.298382+0000","last_became_active":"2023-06-22T10:53:30.940629+0000","last_became_peered":"2023-06-22T10:53:30.940629+0000","last_unstale":"2023-06-22T10:53:39.298382+0000","last_undegraded":"2023-06-22T10:53:39.298382+0000","last_fullsized":"2023-06-22T10:53:39.298382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:09:13.735489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421554+0000","last_change":"2023-06-22T10:53:25.625427+0000","last_active":"2023-06-22T10:53:38.421554+0000","last_peered":"2023-06-22T10:53:38.421554+0000","last_clean":"2023-06-22T10:53:38.421554+0000","last_became_active":"2023-06-22T10:53:25.625237+0000","last_became_peered":"2023-06-22T10:53:25.625237+0000","last_unstale":"2023-06-22T10:53:38.421554+0000","last_undegraded":"2023-06-22T10:53:38.421554+0000","last_fullsized":"2023-06-22T10:53:38.421554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_clean_scrub_stamp":"2023-06-22T10:53:24.612028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:04:08.650168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.298446+0000","last_change":"2023-06-22T10:53:31.949224+0000","last_active":"2023-06-22T10:53:39.298446+0000","last_peered":"2023-06-22T10:53:39.298446+0000","last_clean":"2023-06-22T10:53:39.298446+0000","last_became_active":"2023-06-22T10:53:31.948912+0000","last_became_peered":"2023-06-22T10:53:31.948912+0000","last_unstale":"2023-06-22T10:53:39.298446+0000","last_undegraded":"2023-06-22T10:53:39.298446+0000","last_fullsized":"2023-06-22T10:53:39.298446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:54:19.812644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.298399+0000","last_change":"2023-06-22T10:53:35.983189+0000","last_active":"2023-06-22T10:53:39.298399+0000","last_peered":"2023-06-22T10:53:39.298399+0000","last_clean":"2023-06-22T10:53:39.298399+0000","last_became_active":"2023-06-22T10:53:35.982759+0000","last_became_peered":"2023-06-22T10:53:35.982759+0000","last_unstale":"2023-06-22T10:53:39.298399+0000","last_undegraded":"2023-06-22T10:53:39.298399+0000","last_fullsized":"2023-06-22T10:53:39.298399+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:01:41.849642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.280276+0000","last_change":"2023-06-22T10:53:25.625880+0000","last_active":"2023-06-22T10:53:37.280276+0000","last_peered":"2023-06-22T10:53:37.280276+0000","last_clean":"2023-06-22T10:53:37.280276+0000","last_became_active":"2023-06-22T10:53:25.625464+0000","last_became_peered":"2023-06-22T10:53:25.625464+0000","last_unstale":"2023-06-22T10:53:37.280276+0000","last_undegraded":"2023-06-22T10:53:37.280276+0000","last_fullsized":"2023-06-22T10:53:37.280276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_clean_scrub_stamp":"2023-06-22T10:53:24.612028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T18:21:03.851910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"26'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.956476+0000","last_change":"2023-06-22T10:53:30.938779+0000","last_active":"2023-06-22T10:53:36.956476+0000","last_peered":"2023-06-22T10:53:36.956476+0000","last_clean":"2023-06-22T10:53:36.956476+0000","last_became_active":"2023-06-22T10:53:30.938504+0000","last_became_peered":"2023-06-22T10:53:30.938504+0000","last_unstale":"2023-06-22T10:53:36.956476+0000","last_undegraded":"2023-06-22T10:53:36.956476+0000","last_fullsized":"2023-06-22T10:53:36.956476+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:49:19.162465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957157+0000","last_change":"2023-06-22T10:53:31.952763+0000","last_active":"2023-06-22T10:53:36.957157+0000","last_peered":"2023-06-22T10:53:36.957157+0000","last_clean":"2023-06-22T10:53:36.957157+0000","last_became_active":"2023-06-22T10:53:31.952142+0000","last_became_peered":"2023-06-22T10:53:31.952142+0000","last_unstale":"2023-06-22T10:53:36.957157+0000","last_undegraded":"2023-06-22T10:53:36.957157+0000","last_fullsized":"2023-06-22T10:53:36.957157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:16:58.055706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421993+0000","last_change":"2023-06-22T10:53:35.990183+0000","last_active":"2023-06-22T10:53:38.421993+0000","last_peered":"2023-06-22T10:53:38.421993+0000","last_clean":"2023-06-22T10:53:38.421993+0000","last_became_active":"2023-06-22T10:53:35.989752+0000","last_became_peered":"2023-06-22T10:53:35.989752+0000","last_unstale":"2023-06-22T10:53:38.421993+0000","last_undegraded":"2023-06-22T10:53:38.421993+0000","last_fullsized":"2023-06-22T10:53:38.421993+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T18:31:21.495204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.956332+0000","last_change":"2023-06-22T10:53:30.943481+0000","last_active":"2023-06-22T10:53:36.956332+0000","last_peered":"2023-06-22T10:53:36.956332+0000","last_clean":"2023-06-22T10:53:36.956332+0000","last_became_active":"2023-06-22T10:53:30.943176+0000","last_became_peered":"2023-06-22T10:53:30.943176+0000","last_unstale":"2023-06-22T10:53:36.956332+0000","last_undegraded":"2023-06-22T10:53:36.956332+0000","last_fullsized":"2023-06-22T10:53:36.956332+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T20:10:12.732255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.540111+0000","last_change":"2023-06-22T10:53:31.936896+0000","last_active":"2023-06-22T10:53:37.540111+0000","last_peered":"2023-06-22T10:53:37.540111+0000","last_clean":"2023-06-22T10:53:37.540111+0000","last_became_active":"2023-06-22T10:53:31.936564+0000","last_became_peered":"2023-06-22T10:53:31.936564+0000","last_unstale":"2023-06-22T10:53:37.540111+0000","last_undegraded":"2023-06-22T10:53:37.540111+0000","last_fullsized":"2023-06-22T10:53:37.540111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T13:21:48.372064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.732378+0000","last_change":"2023-06-22T10:53:35.978716+0000","last_active":"2023-06-22T10:53:37.732378+0000","last_peered":"2023-06-22T10:53:37.732378+0000","last_clean":"2023-06-22T10:53:37.732378+0000","last_became_active":"2023-06-22T10:53:35.978326+0000","last_became_peered":"2023-06-22T10:53:35.978326+0000","last_unstale":"2023-06-22T10:53:37.732378+0000","last_undegraded":"2023-06-22T10:53:37.732378+0000","last_fullsized":"2023-06-22T10:53:37.732378+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:01:41.849642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958008+0000","last_change":"2023-06-22T10:53:30.936749+0000","last_active":"2023-06-22T10:53:36.958008+0000","last_peered":"2023-06-22T10:53:36.958008+0000","last_clean":"2023-06-22T10:53:36.958008+0000","last_became_active":"2023-06-22T10:53:30.936447+0000","last_became_peered":"2023-06-22T10:53:30.936447+0000","last_unstale":"2023-06-22T10:53:36.958008+0000","last_undegraded":"2023-06-22T10:53:36.958008+0000","last_fullsized":"2023-06-22T10:53:36.958008+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:58:40.107079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957755+0000","last_change":"2023-06-22T10:53:31.955250+0000","last_active":"2023-06-22T10:53:36.957755+0000","last_peered":"2023-06-22T10:53:36.957755+0000","last_clean":"2023-06-22T10:53:36.957755+0000","last_became_active":"2023-06-22T10:53:31.954904+0000","last_became_peered":"2023-06-22T10:53:31.954904+0000","last_unstale":"2023-06-22T10:53:36.957755+0000","last_undegraded":"2023-06-22T10:53:36.957755+0000","last_fullsized":"2023-06-22T10:53:36.957755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:57:41.183955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958248+0000","last_change":"2023-06-22T10:53:35.977443+0000","last_active":"2023-06-22T10:53:36.958248+0000","last_peered":"2023-06-22T10:53:36.958248+0000","last_clean":"2023-06-22T10:53:36.958248+0000","last_became_active":"2023-06-22T10:53:35.977008+0000","last_became_peered":"2023-06-22T10:53:35.977008+0000","last_unstale":"2023-06-22T10:53:36.958248+0000","last_undegraded":"2023-06-22T10:53:36.958248+0000","last_fullsized":"2023-06-22T10:53:36.958248+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T17:02:42.606188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958133+0000","last_change":"2023-06-22T10:53:30.936289+0000","last_active":"2023-06-22T10:53:36.958133+0000","last_peered":"2023-06-22T10:53:36.958133+0000","last_clean":"2023-06-22T10:53:36.958133+0000","last_became_active":"2023-06-22T10:53:30.935990+0000","last_became_peered":"2023-06-22T10:53:30.935990+0000","last_unstale":"2023-06-22T10:53:36.958133+0000","last_undegraded":"2023-06-22T10:53:36.958133+0000","last_fullsized":"2023-06-22T10:53:36.958133+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:35:50.219987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957131+0000","last_change":"2023-06-22T10:53:31.941782+0000","last_active":"2023-06-22T10:53:36.957131+0000","last_peered":"2023-06-22T10:53:36.957131+0000","last_clean":"2023-06-22T10:53:36.957131+0000","last_became_active":"2023-06-22T10:53:31.940237+0000","last_became_peered":"2023-06-22T10:53:31.940237+0000","last_unstale":"2023-06-22T10:53:36.957131+0000","last_undegraded":"2023-06-22T10:53:36.957131+0000","last_fullsized":"2023-06-22T10:53:36.957131+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:49:21.017446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.956920+0000","last_change":"2023-06-22T10:53:35.989317+0000","last_active":"2023-06-22T10:53:36.956920+0000","last_peered":"2023-06-22T10:53:36.956920+0000","last_clean":"2023-06-22T10:53:36.956920+0000","last_became_active":"2023-06-22T10:53:35.988872+0000","last_became_peered":"2023-06-22T10:53:35.988872+0000","last_unstale":"2023-06-22T10:53:36.956920+0000","last_undegraded":"2023-06-22T10:53:36.956920+0000","last_fullsized":"2023-06-22T10:53:36.956920+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:12:36.166106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.298288+0000","last_change":"2023-06-22T10:53:30.936018+0000","last_active":"2023-06-22T10:53:39.298288+0000","last_peered":"2023-06-22T10:53:39.298288+0000","last_clean":"2023-06-22T10:53:39.298288+0000","last_became_active":"2023-06-22T10:53:30.935754+0000","last_became_peered":"2023-06-22T10:53:30.935754+0000","last_unstale":"2023-06-22T10:53:39.298288+0000","last_undegraded":"2023-06-22T10:53:39.298288+0000","last_fullsized":"2023-06-22T10:53:39.298288+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T15:48:35.350222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.298625+0000","last_change":"2023-06-22T10:53:31.927521+0000","last_active":"2023-06-22T10:53:39.298625+0000","last_peered":"2023-06-22T10:53:39.298625+0000","last_clean":"2023-06-22T10:53:39.298625+0000","last_became_active":"2023-06-22T10:53:31.927230+0000","last_became_peered":"2023-06-22T10:53:31.927230+0000","last_unstale":"2023-06-22T10:53:39.298625+0000","last_undegraded":"2023-06-22T10:53:39.298625+0000","last_fullsized":"2023-06-22T10:53:39.298625+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:16:42.860439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421325+0000","last_change":"2023-06-22T10:53:35.976634+0000","last_active":"2023-06-22T10:53:38.421325+0000","last_peered":"2023-06-22T10:53:38.421325+0000","last_clean":"2023-06-22T10:53:38.421325+0000","last_became_active":"2023-06-22T10:53:35.976193+0000","last_became_peered":"2023-06-22T10:53:35.976193+0000","last_unstale":"2023-06-22T10:53:38.421325+0000","last_undegraded":"2023-06-22T10:53:38.421325+0000","last_fullsized":"2023-06-22T10:53:38.421325+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:34.938679+0000","last_clean_scrub_stamp":"2023-06-22T10:53:34.938679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T13:04:31.955833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957011+0000","last_change":"2023-06-22T10:53:30.938370+0000","last_active":"2023-06-22T10:53:36.957011+0000","last_peered":"2023-06-22T10:53:36.957011+0000","last_clean":"2023-06-22T10:53:36.957011+0000","last_became_active":"2023-06-22T10:53:30.937695+0000","last_became_peered":"2023-06-22T10:53:30.937695+0000","last_unstale":"2023-06-22T10:53:36.957011+0000","last_undegraded":"2023-06-22T10:53:36.957011+0000","last_fullsized":"2023-06-22T10:53:36.957011+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:29.894649+0000","last_clean_scrub_stamp":"2023-06-22T10:53:29.894649+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:59:49.191360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.957346+0000","last_change":"2023-06-22T10:53:31.951892+0000","last_active":"2023-06-22T10:53:36.957346+0000","last_peered":"2023-06-22T10:53:36.957346+0000","last_clean":"2023-06-22T10:53:36.957346+0000","last_became_active":"2023-06-22T10:53:31.951200+0000","last_became_peered":"2023-06-22T10:53:31.951200+0000","last_unstale":"2023-06-22T10:53:36.957346+0000","last_undegraded":"2023-06-22T10:53:36.957346+0000","last_fullsized":"2023-06-22T10:53:36.957346+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T15:52:35.480952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:37.279886+0000","last_change":"2023-06-22T10:53:31.941076+0000","last_active":"2023-06-22T10:53:37.279886+0000","last_peered":"2023-06-22T10:53:37.279886+0000","last_clean":"2023-06-22T10:53:37.279886+0000","last_became_active":"2023-06-22T10:53:31.940796+0000","last_became_peered":"2023-06-22T10:53:31.940796+0000","last_unstale":"2023-06-22T10:53:37.279886+0000","last_undegraded":"2023-06-22T10:53:37.279886+0000","last_fullsized":"2023-06-22T10:53:37.279886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:04:33.641511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.298918+0000","last_change":"2023-06-22T10:53:31.940503+0000","last_active":"2023-06-22T10:53:39.298918+0000","last_peered":"2023-06-22T10:53:39.298918+0000","last_clean":"2023-06-22T10:53:39.298918+0000","last_became_active":"2023-06-22T10:53:31.939741+0000","last_became_peered":"2023-06-22T10:53:31.939741+0000","last_unstale":"2023-06-22T10:53:39.298918+0000","last_undegraded":"2023-06-22T10:53:39.298918+0000","last_fullsized":"2023-06-22T10:53:39.298918+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:12:32.128254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:36.958527+0000","last_change":"2023-06-22T10:53:31.946176+0000","last_active":"2023-06-22T10:53:36.958527+0000","last_peered":"2023-06-22T10:53:36.958527+0000","last_clean":"2023-06-22T10:53:36.958527+0000","last_became_active":"2023-06-22T10:53:31.945842+0000","last_became_peered":"2023-06-22T10:53:31.945842+0000","last_unstale":"2023-06-22T10:53:36.958527+0000","last_undegraded":"2023-06-22T10:53:36.958527+0000","last_fullsized":"2023-06-22T10:53:36.958527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T18:41:56.633064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:39.298684+0000","last_change":"2023-06-22T10:53:31.949833+0000","last_active":"2023-06-22T10:53:39.298684+0000","last_peered":"2023-06-22T10:53:39.298684+0000","last_clean":"2023-06-22T10:53:39.298684+0000","last_became_active":"2023-06-22T10:53:31.949098+0000","last_became_peered":"2023-06-22T10:53:31.949098+0000","last_unstale":"2023-06-22T10:53:39.298684+0000","last_undegraded":"2023-06-22T10:53:39.298684+0000","last_fullsized":"2023-06-22T10:53:39.298684+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:54:14.530962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-22T10:53:38.421731+0000","last_change":"2023-06-22T10:53:31.947493+0000","last_active":"2023-06-22T10:53:38.421731+0000","last_peered":"2023-06-22T10:53:38.421731+0000","last_clean":"2023-06-22T10:53:38.421731+0000","last_became_active":"2023-06-22T10:53:31.947154+0000","last_became_peered":"2023-06-22T10:53:31.947154+0000","last_unstale":"2023-06-22T10:53:38.421731+0000","last_undegraded":"2023-06-22T10:53:38.421731+0000","last_fullsized":"2023-06-22T10:53:38.421731+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:30.900827+0000","last_clean_scrub_stamp":"2023-06-22T10:53:30.900827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T17:28:50.883566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":0,"up_from":15,"seq":64424509452,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":876,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":897024,"data_stored":714122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6059999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2440000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8420000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3180000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7689999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4059999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542158,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":900,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":921600,"data_stored":717550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":303104,"data_stored":123262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0059999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.7249999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.794}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.7930000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":123172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]}]},{"osd":4,"up_from":13,"seq":55834574860,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":319488,"data_stored":127022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":307200,"data_stored":123824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]}]},{"osd":2,"up_from":14,"seq":60129542156,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":123172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]}]},{"osd":6,"up_from":14,"seq":60129542157,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":123172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-22T10:54:07.492 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-06-22T10:54:07.492 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-06-22T10:54:07.492 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-06-22T10:54:07.493 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-06-22T10:54:07.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.721+0000 7f1dc3bff700 1 Processor -- start 2023-06-22T10:54:07.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.721+0000 7f1dc3bff700 1 -- start start 2023-06-22T10:54:07.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.722+0000 7f1dc3bff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1dbc0b3120 0x7f1dbc15cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:07.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.722+0000 7f1dc3bff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1dbc0b3910 0x7f1dbc0b3d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:07.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.722+0000 7f1dc3bff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dbc0b42b0 con 0x7f1dbc0add30 2023-06-22T10:54:07.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.722+0000 7f1dc3bff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dbc153bc0 con 0x7f1dbc0b3910 2023-06-22T10:54:07.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.722+0000 7f1dc3bff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dbc15a690 con 0x7f1dbc0b3120 2023-06-22T10:54:07.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.722+0000 7f1dc219c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1dbc0b3910 0x7f1dbc0b3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:07.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.723+0000 7f1dc219c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1dbc0b3910 0x7f1dbc0b3d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51018/0 (socket says 172.21.15.40:51018) 2023-06-22T10:54:07.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.723+0000 7f1dc219c700 1 -- 172.21.15.40:0/3598978283 learned_addr learned my addr 172.21.15.40:0/3598978283 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:07.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.723+0000 7f1dc199b700 1 --2- 172.21.15.40:0/3598978283 >> v2:172.21.15.45:3300/0 conn(0x7f1dbc0b3120 0x7f1dbc15cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:07.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.723+0000 7f1dc219c700 1 -- 172.21.15.40:0/3598978283 >> v2:172.21.15.45:3300/0 conn(0x7f1dbc0b3120 msgr2=0x7f1dbc15cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:07.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.723+0000 7f1dc219c700 1 --2- 172.21.15.40:0/3598978283 >> v2:172.21.15.45:3300/0 conn(0x7f1dbc0b3120 0x7f1dbc15cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:07.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.723+0000 7f1dc219c700 1 -- 172.21.15.40:0/3598978283 >> v1:172.21.15.45:6789/0 conn(0x7f1dbc0add30 legacy=0x7f1dbc159f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:07.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.723+0000 7f1dc219c700 1 -- 172.21.15.40:0/3598978283 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dbc15d560 con 0x7f1dbc0b3910 2023-06-22T10:54:07.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.723+0000 7f1dc219c700 1 --2- 172.21.15.40:0/3598978283 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1dbc0b3910 0x7f1dbc0b3d70 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc0b12e0 tx=0x7f1db400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be34381233cc7d24 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:07.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.723+0000 7f1dc0999700 1 -- 172.21.15.40:0/3598978283 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db400e070 con 0x7f1dbc0b3910 2023-06-22T10:54:07.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.724+0000 7f1dc0999700 1 -- 172.21.15.40:0/3598978283 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1db400b9c0 con 0x7f1dbc0b3910 2023-06-22T10:54:07.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.724+0000 7f1dc0999700 1 -- 172.21.15.40:0/3598978283 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db400bd70 con 0x7f1dbc0b3910 2023-06-22T10:54:07.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.724+0000 7f1dc3bff700 1 -- 172.21.15.40:0/3598978283 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1dbc0b3910 msgr2=0x7f1dbc0b3d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:07.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.724+0000 7f1dc3bff700 1 --2- 172.21.15.40:0/3598978283 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1dbc0b3910 0x7f1dbc0b3d70 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc0b12e0 tx=0x7f1db400b330 comp rx=0 tx=0).stop 2023-06-22T10:54:07.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.724+0000 7f1dc3bff700 1 -- 172.21.15.40:0/3598978283 shutdown_connections 2023-06-22T10:54:07.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.724+0000 7f1dc3bff700 1 --2- 172.21.15.40:0/3598978283 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1dbc0b3910 0x7f1dbc0b3d70 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:07.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.724+0000 7f1dc3bff700 1 --2- 172.21.15.40:0/3598978283 >> v2:172.21.15.45:3300/0 conn(0x7f1dbc0b3120 0x7f1dbc15cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:07.730 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.724+0000 7f1dc3bff700 1 -- 172.21.15.40:0/3598978283 >> 172.21.15.40:0/3598978283 conn(0x7f1dbc069f30 msgr2=0x7f1dbc06a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:07.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.724+0000 7f1dc3bff700 1 -- 172.21.15.40:0/3598978283 shutdown_connections 2023-06-22T10:54:07.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.724+0000 7f1dc3bff700 1 -- 172.21.15.40:0/3598978283 wait complete. 2023-06-22T10:54:07.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.726+0000 7f1dc3bff700 1 Processor -- start 2023-06-22T10:54:07.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.727+0000 7f1dc3bff700 1 -- start start 2023-06-22T10:54:07.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.728+0000 7f1dc3bff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1dbc0add30 0x7f1dbc1edc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:07.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.728+0000 7f1dc3bff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1dbc0b3120 0x7f1dbc14c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:07.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.728+0000 7f1dc3bff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1dbc0b3910 0x7f1dbc15b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:07.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.728+0000 7f1dc3bff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dbc1f1020 con 0x7f1dbc0add30 2023-06-22T10:54:07.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.728+0000 7f1dc3bff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dbc1ee1a0 con 0x7f1dbc0b3910 2023-06-22T10:54:07.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.728+0000 7f1dc3bff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dbc14df20 con 0x7f1dbc0b3120 2023-06-22T10:54:07.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.728+0000 7f1dc199b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1dbc0add30 0x7f1dbc1edc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:07.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.728+0000 7f1dc199b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1dbc0add30 0x7f1dbc1edc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51034/0 (socket says 172.21.15.40:51034) 2023-06-22T10:54:07.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.728+0000 7f1dc199b700 1 -- 172.21.15.40:0/590059085 learned_addr learned my addr 172.21.15.40:0/590059085 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:07.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.729+0000 7f1dc119a700 1 --2- 172.21.15.40:0/590059085 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1dbc0b3120 0x7f1dbc14c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:07.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.729+0000 7f1dc219c700 1 --2- 172.21.15.40:0/590059085 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1dbc0b3910 0x7f1dbc15b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:07.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.729+0000 7f1dc199b700 1 -- 172.21.15.40:0/590059085 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1dbc0b3120 msgr2=0x7f1dbc14c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:07.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.729+0000 7f1dc199b700 1 --2- 172.21.15.40:0/590059085 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1dbc0b3120 0x7f1dbc14c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:07.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.729+0000 7f1dc199b700 1 -- 172.21.15.40:0/590059085 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1dbc0b3910 msgr2=0x7f1dbc15b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:07.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.729+0000 7f1dc199b700 1 --2- 172.21.15.40:0/590059085 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1dbc0b3910 0x7f1dbc15b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:07.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.729+0000 7f1dc199b700 1 -- 172.21.15.40:0/590059085 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db4009b30 con 0x7f1dbc0add30 2023-06-22T10:54:07.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.729+0000 7f1dc219c700 1 --2- 172.21.15.40:0/590059085 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1dbc0b3910 0x7f1dbc15b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-22T10:54:07.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.729+0000 7f1dc119a700 1 --2- 172.21.15.40:0/590059085 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1dbc0b3120 0x7f1dbc14c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-22T10:54:07.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.729+0000 7f1dc199b700 1 --2- 172.21.15.40:0/590059085 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1dbc0add30 0x7f1dbc1edc60 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1db800e810 tx=0x7f1db800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:07.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.729+0000 7f1db27fc700 1 -- 172.21.15.40:0/590059085 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db8013610 con 0x7f1dbc0add30 2023-06-22T10:54:07.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.729+0000 7f1db27fc700 1 -- 172.21.15.40:0/590059085 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1db8013770 con 0x7f1dbc0add30 2023-06-22T10:54:07.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.729+0000 7f1dc3bff700 1 -- 172.21.15.40:0/590059085 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dbc14d310 con 0x7f1dbc0add30 2023-06-22T10:54:07.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.729+0000 7f1db27fc700 1 -- 172.21.15.40:0/590059085 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db8013b20 con 0x7f1dbc0add30 2023-06-22T10:54:07.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.730+0000 7f1dc3bff700 1 -- 172.21.15.40:0/590059085 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dbc14d8d0 con 0x7f1dbc0add30 2023-06-22T10:54:07.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.731+0000 7f1dc3bff700 1 -- 172.21.15.40:0/590059085 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dbc06d6d0 con 0x7f1dbc0add30 2023-06-22T10:54:07.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.731+0000 7f1db27fc700 1 -- 172.21.15.40:0/590059085 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1db8013c80 con 0x7f1dbc0add30 2023-06-22T10:54:07.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.732+0000 7f1db27fc700 1 --2- 172.21.15.40:0/590059085 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f1da006ad30 0x7f1da006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:07.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.733+0000 7f1db27fc700 1 -- 172.21.15.40:0/590059085 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1db80894a0 con 0x7f1dbc0add30 2023-06-22T10:54:07.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.733+0000 7f1dc119a700 1 --2- 172.21.15.40:0/590059085 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f1da006ad30 0x7f1da006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:07.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.733+0000 7f1dc119a700 1 --2- 172.21.15.40:0/590059085 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f1da006ad30 0x7f1da006d1e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc0adbf0 tx=0x7f1dac009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:07.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.737+0000 7f1db27fc700 1 -- 172.21.15.40:0/590059085 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1db8057cd0 con 0x7f1dbc0add30 2023-06-22T10:54:07.992 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.989+0000 7f1dc3bff700 1 -- 172.21.15.40:0/590059085 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f1dbc067580 con 0x7f1dbc0add30 2023-06-22T10:54:07.993 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.990+0000 7f1db27fc700 1 -- 172.21.15.40:0/590059085 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f1db8057860 con 0x7f1dbc0add30 2023-06-22T10:54:07.993 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:54:07.994 INFO:teuthology.orchestra.run.smithi040.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-06-22T10:54:07.995 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.992+0000 7f1dc3bff700 1 -- 172.21.15.40:0/590059085 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f1da006ad30 msgr2=0x7f1da006d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:07.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.992+0000 7f1dc3bff700 1 --2- 172.21.15.40:0/590059085 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f1da006ad30 0x7f1da006d1e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc0adbf0 tx=0x7f1dac009040 comp rx=0 tx=0).stop 2023-06-22T10:54:07.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.992+0000 7f1dc3bff700 1 -- 172.21.15.40:0/590059085 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1dbc0add30 msgr2=0x7f1dbc1edc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:07.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.992+0000 7f1dc3bff700 1 --2- 172.21.15.40:0/590059085 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1dbc0add30 0x7f1dbc1edc60 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1db800e810 tx=0x7f1db800ebd0 comp rx=0 tx=0).stop 2023-06-22T10:54:07.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.992+0000 7f1dc3bff700 1 -- 172.21.15.40:0/590059085 shutdown_connections 2023-06-22T10:54:07.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.992+0000 7f1dc3bff700 1 --2- 172.21.15.40:0/590059085 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f1da006ad30 0x7f1da006d1e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:07.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.992+0000 7f1dc3bff700 1 --2- 172.21.15.40:0/590059085 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1dbc0b3910 0x7f1dbc15b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:07.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.992+0000 7f1dc3bff700 1 --2- 172.21.15.40:0/590059085 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1dbc0add30 0x7f1dbc1edc60 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:07.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.992+0000 7f1dc3bff700 1 --2- 172.21.15.40:0/590059085 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1dbc0b3120 0x7f1dbc14c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:07.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.992+0000 7f1dc3bff700 1 -- 172.21.15.40:0/590059085 >> 172.21.15.40:0/590059085 conn(0x7f1dbc069f30 msgr2=0x7f1dbc0ae630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:07.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.992+0000 7f1dc3bff700 1 -- 172.21.15.40:0/590059085 shutdown_connections 2023-06-22T10:54:07.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:07.992+0000 7f1dc3bff700 1 -- 172.21.15.40:0/590059085 wait complete. 2023-06-22T10:54:08.013 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-06-22T10:54:08.014 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-22T10:54:08.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.212+0000 7f47797ff700 1 Processor -- start 2023-06-22T10:54:08.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.212+0000 7f47797ff700 1 -- start start 2023-06-22T10:54:08.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.213+0000 7f47797ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f477415c720 0x7f47740b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:08.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.213+0000 7f47797ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47740b2130 con 0x7f47740b4e30 2023-06-22T10:54:08.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.213+0000 7f47797ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4774161180 con 0x7f47740d2830 2023-06-22T10:54:08.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.213+0000 7f47797ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4774160d60 con 0x7f477415c720 2023-06-22T10:54:08.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.213+0000 7f4772ffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f477415c720 0x7f47740b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:08.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.213+0000 7f47737fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f47740b4e30 0x7f47740d0d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:58622/0 (socket says 172.21.15.40:58622) 2023-06-22T10:54:08.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.213+0000 7f47737fe700 1 -- 172.21.15.40:0/2102766467 learned_addr learned my addr 172.21.15.40:0/2102766467 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:08.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.214+0000 7f4772ffd700 1 -- 172.21.15.40:0/2102766467 >> v1:172.21.15.45:6789/0 conn(0x7f47740d2830 legacy=0x7f47740b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:08.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.214+0000 7f4772ffd700 1 -- 172.21.15.40:0/2102766467 >> v1:172.21.15.40:6789/0 conn(0x7f47740b4e30 legacy=0x7f47740d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:08.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.214+0000 7f4772ffd700 1 -- 172.21.15.40:0/2102766467 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47741603c0 con 0x7f477415c720 2023-06-22T10:54:08.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.214+0000 7f4771ffb700 1 -- 172.21.15.40:0/2102766467 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2709456482 0 0) 0x7f47740b2130 con 0x7f47740b4e30 2023-06-22T10:54:08.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.214+0000 7f4772ffd700 1 --2- 172.21.15.40:0/2102766467 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f477415c720 0x7f47740b1870 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4764009870 tx=0x7f4764009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=103e33cc867cf0ed server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:08.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.214+0000 7f4771ffb700 1 -- 172.21.15.40:0/2102766467 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4764011830 con 0x7f477415c720 2023-06-22T10:54:08.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.214+0000 7f4771ffb700 1 -- 172.21.15.40:0/2102766467 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4764011990 con 0x7f477415c720 2023-06-22T10:54:08.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.214+0000 7f4771ffb700 1 -- 172.21.15.40:0/2102766467 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4764011d20 con 0x7f477415c720 2023-06-22T10:54:08.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.215+0000 7f47797ff700 1 -- 172.21.15.40:0/2102766467 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f477415c720 msgr2=0x7f47740b1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:08.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.215+0000 7f47797ff700 1 --2- 172.21.15.40:0/2102766467 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f477415c720 0x7f47740b1870 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4764009870 tx=0x7f4764009b80 comp rx=0 tx=0).stop 2023-06-22T10:54:08.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.215+0000 7f47797ff700 1 -- 172.21.15.40:0/2102766467 shutdown_connections 2023-06-22T10:54:08.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.215+0000 7f47797ff700 1 --2- 172.21.15.40:0/2102766467 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f477415c720 0x7f47740b1870 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:08.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.215+0000 7f47797ff700 1 -- 172.21.15.40:0/2102766467 >> 172.21.15.40:0/2102766467 conn(0x7f47740cf720 msgr2=0x7f47740cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:08.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.215+0000 7f47797ff700 1 -- 172.21.15.40:0/2102766467 shutdown_connections 2023-06-22T10:54:08.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.215+0000 7f47797ff700 1 -- 172.21.15.40:0/2102766467 wait complete. 2023-06-22T10:54:08.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.217+0000 7f47797ff700 1 Processor -- start 2023-06-22T10:54:08.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.217+0000 7f47797ff700 1 -- start start 2023-06-22T10:54:08.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.218+0000 7f47797ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47740b4e30 0x7f47740b0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:08.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.218+0000 7f47797ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f47740d2830 0x7f47740b7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:08.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.218+0000 7f47797ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f477415c720 0x7f47740b7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:08.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.218+0000 7f47797ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f477415d770 con 0x7f47740b4e30 2023-06-22T10:54:08.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.218+0000 7f47797ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47741f2e70 con 0x7f477415c720 2023-06-22T10:54:08.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.218+0000 7f47797ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f477415cdd0 con 0x7f47740d2830 2023-06-22T10:54:08.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.218+0000 7f4772ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47740b4e30 0x7f47740b0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:08.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.218+0000 7f4772ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47740b4e30 0x7f47740b0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51058/0 (socket says 172.21.15.40:51058) 2023-06-22T10:54:08.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.218+0000 7f4772ffd700 1 -- 172.21.15.40:0/2619870338 learned_addr learned my addr 172.21.15.40:0/2619870338 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:08.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.218+0000 7f47727fc700 1 --2- 172.21.15.40:0/2619870338 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f47740d2830 0x7f47740b7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:08.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.218+0000 7f47737fe700 1 --2- 172.21.15.40:0/2619870338 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f477415c720 0x7f47740b7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:08.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.218+0000 7f4772ffd700 1 -- 172.21.15.40:0/2619870338 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f47740d2830 msgr2=0x7f47740b7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:08.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.218+0000 7f4772ffd700 1 --2- 172.21.15.40:0/2619870338 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f47740d2830 0x7f47740b7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:08.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.218+0000 7f4772ffd700 1 -- 172.21.15.40:0/2619870338 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f477415c720 msgr2=0x7f47740b7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:08.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.218+0000 7f4772ffd700 1 --2- 172.21.15.40:0/2619870338 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f477415c720 0x7f47740b7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:08.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.218+0000 7f4772ffd700 1 -- 172.21.15.40:0/2619870338 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47640094a0 con 0x7f47740b4e30 2023-06-22T10:54:08.224 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.218+0000 7f47727fc700 1 --2- 172.21.15.40:0/2619870338 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f47740d2830 0x7f47740b7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:54:08.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.219+0000 7f4772ffd700 1 --2- 172.21.15.40:0/2619870338 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47740b4e30 0x7f47740b0fb0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4764009bc0 tx=0x7f4764004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:08.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.219+0000 7f475b7fe700 1 -- 172.21.15.40:0/2619870338 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47640038a0 con 0x7f47740b4e30 2023-06-22T10:54:08.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.219+0000 7f475b7fe700 1 -- 172.21.15.40:0/2619870338 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f476401e070 con 0x7f47740b4e30 2023-06-22T10:54:08.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.219+0000 7f47797ff700 1 -- 172.21.15.40:0/2619870338 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f477415d0b0 con 0x7f47740b4e30 2023-06-22T10:54:08.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.219+0000 7f475b7fe700 1 -- 172.21.15.40:0/2619870338 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4764003c20 con 0x7f47740b4e30 2023-06-22T10:54:08.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.219+0000 7f47797ff700 1 -- 172.21.15.40:0/2619870338 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47741f30d0 con 0x7f47740b4e30 2023-06-22T10:54:08.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.220+0000 7f47797ff700 1 -- 172.21.15.40:0/2619870338 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4774067580 con 0x7f47740b4e30 2023-06-22T10:54:08.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.221+0000 7f475b7fe700 1 -- 172.21.15.40:0/2619870338 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f476401a420 con 0x7f47740b4e30 2023-06-22T10:54:08.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.222+0000 7f475b7fe700 1 --2- 172.21.15.40:0/2619870338 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f476006ace0 0x7f476006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:08.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.223+0000 7f475b7fe700 1 -- 172.21.15.40:0/2619870338 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4764020070 con 0x7f47740b4e30 2023-06-22T10:54:08.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.223+0000 7f47727fc700 1 --2- 172.21.15.40:0/2619870338 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f476006ace0 0x7f476006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:08.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.223+0000 7f47727fc700 1 --2- 172.21.15.40:0/2619870338 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f476006ace0 0x7f476006d190 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4768000f60 tx=0x7f4768009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:08.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.227+0000 7f475b7fe700 1 -- 172.21.15.40:0/2619870338 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4764055b30 con 0x7f47740b4e30 2023-06-22T10:54:08.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.435+0000 7f47797ff700 1 -- 172.21.15.40:0/2619870338 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f477406bb30 con 0x7f47740b4e30 2023-06-22T10:54:08.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.436+0000 7f475b7fe700 1 -- 172.21.15.40:0/2619870338 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20036 (secure 0 0 0) 0x7f4764015090 con 0x7f47740b4e30 2023-06-22T10:54:08.440 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:54:08.440 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":28,"fsid":"475560bc-1a7c-4a75-b3b6-6fc6b20bdc52","created":"2023-06-22T10:53:03.784568+0000","modified":"2023-06-22T10:53:36.483308+0000","last_up_change":"2023-06-22T10:53:17.830348+0000","last_in_change":"2023-06-22T10:53:07.329974+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-22T10:53:17.182228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-22T10:53:23.874432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-22T10:53:29.812963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-22T10:53:30.404021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-22T10:53:33.982289+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"918db6b4-053a-46ba-976d-6e1a0104017f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6809","nonce":2400162888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6811","nonce":2400162888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6815","nonce":2400162888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6813","nonce":2400162888}]},"public_addr":"172.21.15.40:6809/2400162888","cluster_addr":"172.21.15.40:6811/2400162888","heartbeat_back_addr":"172.21.15.40:6815/2400162888","heartbeat_front_addr":"172.21.15.40:6813/2400162888","state":["exists","up"]},{"osd":1,"uuid":"0c146e2b-1725-4dae-9b5c-38795943b9d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6801","nonce":230885800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6803","nonce":230885800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6807","nonce":230885800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6805","nonce":230885800}]},"public_addr":"172.21.15.40:6801/230885800","cluster_addr":"172.21.15.40:6803/230885800","heartbeat_back_addr":"172.21.15.40:6807/230885800","heartbeat_front_addr":"172.21.15.40:6805/230885800","state":["exists","up"]},{"osd":2,"uuid":"0b3727fd-f281-46d5-a675-86c8c5ab269e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6817","nonce":2681404929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6819","nonce":2681404929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6823","nonce":2681404929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6821","nonce":2681404929}]},"public_addr":"172.21.15.40:6817/2681404929","cluster_addr":"172.21.15.40:6819/2681404929","heartbeat_back_addr":"172.21.15.40:6823/2681404929","heartbeat_front_addr":"172.21.15.40:6821/2681404929","state":["exists","up"]},{"osd":3,"uuid":"2969c698-7039-4bbb-beda-f756f7a368a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6825","nonce":111110981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6827","nonce":111110981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6831","nonce":111110981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6829","nonce":111110981}]},"public_addr":"172.21.15.40:6825/111110981","cluster_addr":"172.21.15.40:6827/111110981","heartbeat_back_addr":"172.21.15.40:6831/111110981","heartbeat_front_addr":"172.21.15.40:6829/111110981","state":["exists","up"]},{"osd":4,"uuid":"3bb1d9c8-8e42-4a6b-998d-04834f34be5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6801","nonce":3625455711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6803","nonce":3625455711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6807","nonce":3625455711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6805","nonce":3625455711}]},"public_addr":"172.21.15.45:6801/3625455711","cluster_addr":"172.21.15.45:6803/3625455711","heartbeat_back_addr":"172.21.15.45:6807/3625455711","heartbeat_front_addr":"172.21.15.45:6805/3625455711","state":["exists","up"]},{"osd":5,"uuid":"f9854ee4-302c-41be-977b-bedda090a3d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6817","nonce":3354411217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6819","nonce":3354411217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6823","nonce":3354411217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6821","nonce":3354411217}]},"public_addr":"172.21.15.45:6817/3354411217","cluster_addr":"172.21.15.45:6819/3354411217","heartbeat_back_addr":"172.21.15.45:6823/3354411217","heartbeat_front_addr":"172.21.15.45:6821/3354411217","state":["exists","up"]},{"osd":6,"uuid":"bbdb1989-f6ac-4954-9b85-b8b540d683c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6809","nonce":320111074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6811","nonce":320111074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6815","nonce":320111074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6813","nonce":320111074}]},"public_addr":"172.21.15.45:6809/320111074","cluster_addr":"172.21.15.45:6811/320111074","heartbeat_back_addr":"172.21.15.45:6815/320111074","heartbeat_front_addr":"172.21.15.45:6813/320111074","state":["exists","up"]},{"osd":7,"uuid":"823d44e3-58f1-4d1d-8263-a4e4a69d4327","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6825","nonce":643617680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6827","nonce":643617680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6831","nonce":643617680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6829","nonce":643617680}]},"public_addr":"172.21.15.45:6825/643617680","cluster_addr":"172.21.15.45:6827/643617680","heartbeat_back_addr":"172.21.15.45:6831/643617680","heartbeat_front_addr":"172.21.15.45:6829/643617680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.731262+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.873226+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.898936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.666578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.645990+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.953699+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.642823+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.693395+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-22T10:54:08.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.438+0000 7f47797ff700 1 -- 172.21.15.40:0/2619870338 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f476006ace0 msgr2=0x7f476006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:08.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.438+0000 7f47797ff700 1 --2- 172.21.15.40:0/2619870338 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f476006ace0 0x7f476006d190 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4768000f60 tx=0x7f4768009040 comp rx=0 tx=0).stop 2023-06-22T10:54:08.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.438+0000 7f47797ff700 1 -- 172.21.15.40:0/2619870338 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47740b4e30 msgr2=0x7f47740b0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:08.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.438+0000 7f47797ff700 1 --2- 172.21.15.40:0/2619870338 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47740b4e30 0x7f47740b0fb0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4764009bc0 tx=0x7f4764004750 comp rx=0 tx=0).stop 2023-06-22T10:54:08.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.438+0000 7f47797ff700 1 -- 172.21.15.40:0/2619870338 shutdown_connections 2023-06-22T10:54:08.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.438+0000 7f47797ff700 1 --2- 172.21.15.40:0/2619870338 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f476006ace0 0x7f476006d190 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:08.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.438+0000 7f47797ff700 1 --2- 172.21.15.40:0/2619870338 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f477415c720 0x7f47740b7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:08.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.438+0000 7f47797ff700 1 --2- 172.21.15.40:0/2619870338 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f47740b4e30 0x7f47740b0fb0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:08.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.438+0000 7f47797ff700 1 --2- 172.21.15.40:0/2619870338 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f47740d2830 0x7f47740b7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:08.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.438+0000 7f47797ff700 1 -- 172.21.15.40:0/2619870338 >> 172.21.15.40:0/2619870338 conn(0x7f47740cf720 msgr2=0x7f47740b5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:08.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.439+0000 7f47797ff700 1 -- 172.21.15.40:0/2619870338 shutdown_connections 2023-06-22T10:54:08.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.439+0000 7f47797ff700 1 -- 172.21.15.40:0/2619870338 wait complete. 2023-06-22T10:54:08.461 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-22T10:53:17.182228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-22T10:53:23.874432+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-22T10:53:29.812963+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-22T10:53:30.404021+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-22T10:53:33.982289+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-22T10:54:08.462 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-22T10:54:08.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.662+0000 7f8d11bff700 1 Processor -- start 2023-06-22T10:54:08.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.663+0000 7f8d11bff700 1 -- start start 2023-06-22T10:54:08.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.664+0000 7f8d11bff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8d0c0b45d0 0x7f8d0c0b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:08.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.664+0000 7f8d11bff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8d0c0d2130 0x7f8d0c0cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:08.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.664+0000 7f8d11bff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8d0c0cd6e0 0x7f8d0c0b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:08.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.664+0000 7f8d11bff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d0c0d17f0 con 0x7f8d0c0cd6e0 2023-06-22T10:54:08.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.664+0000 7f8d11bff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d0c0d1be0 con 0x7f8d0c0b45d0 2023-06-22T10:54:08.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.664+0000 7f8d11bff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0c0d1360 con 0x7f8d0c0d2130 2023-06-22T10:54:08.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.664+0000 7f8d0bfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8d0c0cd6e0 0x7f8d0c0b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:08.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.664+0000 7f8d0bfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8d0c0cd6e0 0x7f8d0c0b59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52260/0 (socket says 172.21.15.40:52260) 2023-06-22T10:54:08.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.664+0000 7f8d0bfff700 1 -- 172.21.15.40:0/375239725 learned_addr learned my addr 172.21.15.40:0/375239725 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:08.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.664+0000 7f8d0b7fe700 1 --2- 172.21.15.40:0/375239725 >> v2:172.21.15.45:3300/0 conn(0x7f8d0c0b45d0 0x7f8d0c0b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:08.669 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.664+0000 7f8d03fff700 1 --2- 172.21.15.40:0/375239725 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8d0c0d2130 0x7f8d0c0cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:08.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.665+0000 7f8d0bfff700 1 -- 172.21.15.40:0/375239725 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8d0c0d2130 msgr2=0x7f8d0c0cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:08.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.665+0000 7f8d0bfff700 1 --2- 172.21.15.40:0/375239725 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8d0c0d2130 0x7f8d0c0cd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:08.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.665+0000 7f8d0bfff700 1 -- 172.21.15.40:0/375239725 >> v2:172.21.15.45:3300/0 conn(0x7f8d0c0b45d0 msgr2=0x7f8d0c0b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:08.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.665+0000 7f8d0bfff700 1 --2- 172.21.15.40:0/375239725 >> v2:172.21.15.45:3300/0 conn(0x7f8d0c0b45d0 0x7f8d0c0b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:08.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.665+0000 7f8d0bfff700 1 -- 172.21.15.40:0/375239725 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d0c0b4ee0 con 0x7f8d0c0cd6e0 2023-06-22T10:54:08.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.665+0000 7f8d0b7fe700 1 --2- 172.21.15.40:0/375239725 >> v2:172.21.15.45:3300/0 conn(0x7f8d0c0b45d0 0x7f8d0c0b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:54:08.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.665+0000 7f8d0bfff700 1 --2- 172.21.15.40:0/375239725 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8d0c0cd6e0 0x7f8d0c0b59a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c0668f0 tx=0x7f8d0400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dcfe9b1c2b06628 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:08.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.665+0000 7f8d0affd700 1 -- 172.21.15.40:0/375239725 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0400e070 con 0x7f8d0c0cd6e0 2023-06-22T10:54:08.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.665+0000 7f8d0affd700 1 -- 172.21.15.40:0/375239725 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d0400b9c0 con 0x7f8d0c0cd6e0 2023-06-22T10:54:08.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.665+0000 7f8d0affd700 1 -- 172.21.15.40:0/375239725 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0400bd70 con 0x7f8d0c0cd6e0 2023-06-22T10:54:08.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.666+0000 7f8d11bff700 1 -- 172.21.15.40:0/375239725 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8d0c0cd6e0 msgr2=0x7f8d0c0b59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:08.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.666+0000 7f8d11bff700 1 --2- 172.21.15.40:0/375239725 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8d0c0cd6e0 0x7f8d0c0b59a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c0668f0 tx=0x7f8d0400b330 comp rx=0 tx=0).stop 2023-06-22T10:54:08.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.666+0000 7f8d11bff700 1 -- 172.21.15.40:0/375239725 shutdown_connections 2023-06-22T10:54:08.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.666+0000 7f8d11bff700 1 --2- 172.21.15.40:0/375239725 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8d0c0cd6e0 0x7f8d0c0b59a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:08.672 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.666+0000 7f8d11bff700 1 --2- 172.21.15.40:0/375239725 >> v2:172.21.15.45:3300/0 conn(0x7f8d0c0b45d0 0x7f8d0c0b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:08.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.666+0000 7f8d11bff700 1 --2- 172.21.15.40:0/375239725 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8d0c0d2130 0x7f8d0c0cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:08.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.666+0000 7f8d11bff700 1 -- 172.21.15.40:0/375239725 >> 172.21.15.40:0/375239725 conn(0x7f8d0c0cf5d0 msgr2=0x7f8d0c0cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:08.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.666+0000 7f8d11bff700 1 -- 172.21.15.40:0/375239725 shutdown_connections 2023-06-22T10:54:08.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.666+0000 7f8d11bff700 1 -- 172.21.15.40:0/375239725 wait complete. 2023-06-22T10:54:08.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.668+0000 7f8d11bff700 1 Processor -- start 2023-06-22T10:54:08.673 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.668+0000 7f8d11bff700 1 -- start start 2023-06-22T10:54:08.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.669+0000 7f8d11bff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d0c0b45d0 0x7f8d0c1f16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:08.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.669+0000 7f8d11bff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8d0c0cd6e0 0x7f8d0c0b6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:08.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.669+0000 7f8d11bff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8d0c0d2130 0x7f8d0c0ca260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:08.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.669+0000 7f8d11bff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0c0b6a90 con 0x7f8d0c0d2130 2023-06-22T10:54:08.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.669+0000 7f8d11bff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0c0b6d70 con 0x7f8d0c0b45d0 2023-06-22T10:54:08.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.669+0000 7f8d11bff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0c0b7050 con 0x7f8d0c0cd6e0 2023-06-22T10:54:08.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.669+0000 7f8d0bfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8d0c0d2130 0x7f8d0c0ca260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:08.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.669+0000 7f8d0bfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8d0c0d2130 0x7f8d0c0ca260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52276/0 (socket says 172.21.15.40:52276) 2023-06-22T10:54:08.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.669+0000 7f8d0bfff700 1 -- 172.21.15.40:0/3716276623 learned_addr learned my addr 172.21.15.40:0/3716276623 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:08.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.670+0000 7f8d0b7fe700 1 --2- 172.21.15.40:0/3716276623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d0c0b45d0 0x7f8d0c1f16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:08.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.670+0000 7f8d03fff700 1 --2- 172.21.15.40:0/3716276623 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8d0c0cd6e0 0x7f8d0c0b6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:08.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.670+0000 7f8d0bfff700 1 -- 172.21.15.40:0/3716276623 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8d0c0cd6e0 msgr2=0x7f8d0c0b6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:08.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.670+0000 7f8d0bfff700 1 --2- 172.21.15.40:0/3716276623 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8d0c0cd6e0 0x7f8d0c0b6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:08.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.670+0000 7f8d0bfff700 1 -- 172.21.15.40:0/3716276623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d0c0b45d0 msgr2=0x7f8d0c1f16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:08.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.670+0000 7f8d0bfff700 1 --2- 172.21.15.40:0/3716276623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d0c0b45d0 0x7f8d0c1f16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:08.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.670+0000 7f8d0bfff700 1 -- 172.21.15.40:0/3716276623 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d04009b30 con 0x7f8d0c0d2130 2023-06-22T10:54:08.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.670+0000 7f8d0b7fe700 1 --2- 172.21.15.40:0/3716276623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d0c0b45d0 0x7f8d0c1f16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:54:08.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.670+0000 7f8d0bfff700 1 --2- 172.21.15.40:0/3716276623 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8d0c0d2130 0x7f8d0c0ca260 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c06a0c0 tx=0x7f8d04004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:08.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.670+0000 7f8d08ff9700 1 -- 172.21.15.40:0/3716276623 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d04004250 con 0x7f8d0c0d2130 2023-06-22T10:54:08.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.670+0000 7f8d08ff9700 1 -- 172.21.15.40:0/3716276623 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d040043d0 con 0x7f8d0c0d2130 2023-06-22T10:54:08.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.670+0000 7f8d08ff9700 1 -- 172.21.15.40:0/3716276623 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d04004780 con 0x7f8d0c0d2130 2023-06-22T10:54:08.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.670+0000 7f8d11bff700 1 -- 172.21.15.40:0/3716276623 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d0c0b7330 con 0x7f8d0c0d2130 2023-06-22T10:54:08.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.670+0000 7f8d11bff700 1 -- 172.21.15.40:0/3716276623 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d0c15d430 con 0x7f8d0c0d2130 2023-06-22T10:54:08.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.671+0000 7f8d11bff700 1 -- 172.21.15.40:0/3716276623 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d0c067580 con 0x7f8d0c0d2130 2023-06-22T10:54:08.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.672+0000 7f8d08ff9700 1 -- 172.21.15.40:0/3716276623 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8d0401c440 con 0x7f8d0c0d2130 2023-06-22T10:54:08.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.674+0000 7f8d08ff9700 1 --2- 172.21.15.40:0/3716276623 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f8cec06ace0 0x7f8cec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:08.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.674+0000 7f8d08ff9700 1 -- 172.21.15.40:0/3716276623 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8d0408adc0 con 0x7f8d0c0d2130 2023-06-22T10:54:08.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.674+0000 7f8d0b7fe700 1 --2- 172.21.15.40:0/3716276623 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f8cec06ace0 0x7f8cec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:08.679 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.675+0000 7f8d0b7fe700 1 --2- 172.21.15.40:0/3716276623 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f8cec06ace0 0x7f8cec06d190 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc003950 tx=0x7f8cfc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:08.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.679+0000 7f8d08ff9700 1 -- 172.21.15.40:0/3716276623 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8d04055b70 con 0x7f8d0c0d2130 2023-06-22T10:54:08.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.884+0000 7f8d11bff700 1 -- 172.21.15.40:0/3716276623 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8d0c072fb0 con 0x7f8d0c0d2130 2023-06-22T10:54:08.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.884+0000 7f8d08ff9700 1 -- 172.21.15.40:0/3716276623 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8d0402a020 con 0x7f8d0c0d2130 2023-06-22T10:54:08.888 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-06-22T10:54:08.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.886+0000 7f8d11bff700 1 -- 172.21.15.40:0/3716276623 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f8cec06ace0 msgr2=0x7f8cec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:08.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.886+0000 7f8d11bff700 1 --2- 172.21.15.40:0/3716276623 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f8cec06ace0 0x7f8cec06d190 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc003950 tx=0x7f8cfc008040 comp rx=0 tx=0).stop 2023-06-22T10:54:08.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.886+0000 7f8d11bff700 1 -- 172.21.15.40:0/3716276623 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8d0c0d2130 msgr2=0x7f8d0c0ca260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:08.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.886+0000 7f8d11bff700 1 --2- 172.21.15.40:0/3716276623 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8d0c0d2130 0x7f8d0c0ca260 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c06a0c0 tx=0x7f8d04004ad0 comp rx=0 tx=0).stop 2023-06-22T10:54:08.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.886+0000 7f8d11bff700 1 -- 172.21.15.40:0/3716276623 shutdown_connections 2023-06-22T10:54:08.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.886+0000 7f8d11bff700 1 --2- 172.21.15.40:0/3716276623 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f8cec06ace0 0x7f8cec06d190 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:08.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.886+0000 7f8d11bff700 1 --2- 172.21.15.40:0/3716276623 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8d0c0d2130 0x7f8d0c0ca260 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:08.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.886+0000 7f8d11bff700 1 --2- 172.21.15.40:0/3716276623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d0c0b45d0 0x7f8d0c1f16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:08.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.886+0000 7f8d11bff700 1 --2- 172.21.15.40:0/3716276623 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8d0c0cd6e0 0x7f8d0c0b6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:08.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.886+0000 7f8d11bff700 1 -- 172.21.15.40:0/3716276623 >> 172.21.15.40:0/3716276623 conn(0x7f8d0c0cf5d0 msgr2=0x7f8d0c15aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:08.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.886+0000 7f8d11bff700 1 -- 172.21.15.40:0/3716276623 shutdown_connections 2023-06-22T10:54:08.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:08.886+0000 7f8d11bff700 1 -- 172.21.15.40:0/3716276623 wait complete. 2023-06-22T10:54:08.907 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-22T10:54:09.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.108+0000 7f64d87ff700 1 Processor -- start 2023-06-22T10:54:09.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.108+0000 7f64d87ff700 1 -- start start 2023-06-22T10:54:09.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.109+0000 7f64d87ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f64d00d2130 0x7f64d00cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:09.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.109+0000 7f64d87ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64d00d1be0 con 0x7f64d00cd6e0 2023-06-22T10:54:09.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.109+0000 7f64d87ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64d00d1360 con 0x7f64d00b45d0 2023-06-22T10:54:09.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.109+0000 7f64d87ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64d00d17f0 con 0x7f64d00d2130 2023-06-22T10:54:09.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.109+0000 7f64d6d9c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f64d00cd6e0 0x7f64d00b59a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:54134/0 (socket says 172.21.15.40:54134) 2023-06-22T10:54:09.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.109+0000 7f64d6d9c700 1 -- 172.21.15.40:0/2779305482 learned_addr learned my addr 172.21.15.40:0/2779305482 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:09.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.110+0000 7f64d5d9a700 1 --2- 172.21.15.40:0/2779305482 >> v2:172.21.15.45:3300/0 conn(0x7f64d00d2130 0x7f64d00cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:09.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.110+0000 7f64d5599700 1 -- 172.21.15.40:0/2779305482 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3964393864 0 0) 0x7f64d00d1be0 con 0x7f64d00cd6e0 2023-06-22T10:54:09.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.110+0000 7f64d5599700 1 -- 172.21.15.40:0/2779305482 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64bc0035b0 con 0x7f64d00cd6e0 2023-06-22T10:54:09.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.110+0000 7f64d5599700 1 -- 172.21.15.40:0/2779305482 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1343669108 0 0) 0x7f64bc0035b0 con 0x7f64d00cd6e0 2023-06-22T10:54:09.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.110+0000 7f64d5599700 1 -- 172.21.15.40:0/2779305482 >> v2:172.21.15.45:3300/0 conn(0x7f64d00d2130 msgr2=0x7f64d00cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:09.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.110+0000 7f64d5599700 1 --2- 172.21.15.40:0/2779305482 >> v2:172.21.15.45:3300/0 conn(0x7f64d00d2130 0x7f64d00cd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:09.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.110+0000 7f64d5599700 1 -- 172.21.15.40:0/2779305482 >> v1:172.21.15.45:6789/0 conn(0x7f64d00b45d0 legacy=0x7f64d00b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:09.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.110+0000 7f64d5599700 1 -- 172.21.15.40:0/2779305482 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d00cef40 con 0x7f64d00cd6e0 2023-06-22T10:54:09.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.110+0000 7f64d5599700 1 -- 172.21.15.40:0/2779305482 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1490606486 0 0) 0x7f64c80019f0 con 0x7f64d00cd6e0 2023-06-22T10:54:09.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.110+0000 7f64d5599700 1 -- 172.21.15.40:0/2779305482 >> v1:172.21.15.40:6789/0 conn(0x7f64d00cd6e0 legacy=0x7f64d00b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:09.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.110+0000 7f64d5599700 1 --2- 172.21.15.40:0/2779305482 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f64bc003a00 0x7f64bc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:09.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.110+0000 7f64d5599700 1 --2- 172.21.15.40:0/2779305482 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64bc004850 0x7f64bc004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:09.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.110+0000 7f64d5599700 1 --2- 172.21.15.40:0/2779305482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64bc005200 0x7f64bc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:09.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.110+0000 7f64d5599700 1 -- 172.21.15.40:0/2779305482 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d00d17f0 con 0x7f64bc004850 2023-06-22T10:54:09.121 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.110+0000 7f64d5599700 1 -- 172.21.15.40:0/2779305482 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64bc00c060 con 0x7f64bc005200 2023-06-22T10:54:09.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.110+0000 7f64d5599700 1 -- 172.21.15.40:0/2779305482 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64bc00c220 con 0x7f64bc003a00 2023-06-22T10:54:09.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.111+0000 7f64d5d9a700 1 --2- 172.21.15.40:0/2779305482 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64bc004850 0x7f64bc004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:09.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.111+0000 7f64d659b700 1 --2- 172.21.15.40:0/2779305482 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f64bc003a00 0x7f64bc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:09.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.111+0000 7f64d6d9c700 1 --2- 172.21.15.40:0/2779305482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64bc005200 0x7f64bc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:09.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.111+0000 7f64d5d9a700 1 -- 172.21.15.40:0/2779305482 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f64bc003a00 msgr2=0x7f64bc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:09.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.111+0000 7f64d5d9a700 1 --2- 172.21.15.40:0/2779305482 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f64bc003a00 0x7f64bc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:09.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.111+0000 7f64d5d9a700 1 -- 172.21.15.40:0/2779305482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64bc005200 msgr2=0x7f64bc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:09.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.111+0000 7f64d5d9a700 1 --2- 172.21.15.40:0/2779305482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64bc005200 0x7f64bc00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:09.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.111+0000 7f64d5d9a700 1 -- 172.21.15.40:0/2779305482 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64bc0035b0 con 0x7f64bc004850 2023-06-22T10:54:09.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.111+0000 7f64d6d9c700 1 -- 172.21.15.40:0/2779305482 reap_dead start 2023-06-22T10:54:09.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.111+0000 7f64d5d9a700 1 --2- 172.21.15.40:0/2779305482 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64bc004850 0x7f64bc004cc0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f64c0009b60 tx=0x7f64bc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a0355bc79d6fccb server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:09.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.112+0000 7f64d5599700 1 -- 172.21.15.40:0/2779305482 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c000e6c0 con 0x7f64bc004850 2023-06-22T10:54:09.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.112+0000 7f64d5599700 1 -- 172.21.15.40:0/2779305482 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c000e820 con 0x7f64bc004850 2023-06-22T10:54:09.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.112+0000 7f64d5599700 1 -- 172.21.15.40:0/2779305482 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c000eb90 con 0x7f64bc004850 2023-06-22T10:54:09.125 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.112+0000 7f64d87ff700 1 -- 172.21.15.40:0/2779305482 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64bc004850 msgr2=0x7f64bc004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:09.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.112+0000 7f64d87ff700 1 --2- 172.21.15.40:0/2779305482 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64bc004850 0x7f64bc004cc0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f64c0009b60 tx=0x7f64bc005880 comp rx=0 tx=0).stop 2023-06-22T10:54:09.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.112+0000 7f64d87ff700 1 -- 172.21.15.40:0/2779305482 shutdown_connections 2023-06-22T10:54:09.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.112+0000 7f64d87ff700 1 --2- 172.21.15.40:0/2779305482 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64bc004850 0x7f64bc004cc0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:09.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.112+0000 7f64d87ff700 1 -- 172.21.15.40:0/2779305482 >> 172.21.15.40:0/2779305482 conn(0x7f64d00cf5d0 msgr2=0x7f64d00cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:09.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.112+0000 7f64d87ff700 1 -- 172.21.15.40:0/2779305482 shutdown_connections 2023-06-22T10:54:09.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.112+0000 7f64d87ff700 1 -- 172.21.15.40:0/2779305482 wait complete. 2023-06-22T10:54:09.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.114+0000 7f64d87ff700 1 Processor -- start 2023-06-22T10:54:09.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.114+0000 7f64d87ff700 1 -- start start 2023-06-22T10:54:09.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.115+0000 7f64d87ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64bc004850 0x7f64d014ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:09.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.115+0000 7f64d87ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64d0159410 0x7f64d00cb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:09.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.115+0000 7f64d87ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f64d00cb6f0 0x7f64d015e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:09.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.115+0000 7f64d87ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d00cc810 con 0x7f64d0159410 2023-06-22T10:54:09.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.115+0000 7f64d87ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d00cbb90 con 0x7f64bc004850 2023-06-22T10:54:09.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.115+0000 7f64d87ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64d00cbe70 con 0x7f64d00cb6f0 2023-06-22T10:54:09.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.115+0000 7f64d5d9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64d0159410 0x7f64d00cb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:09.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.115+0000 7f64d5d9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64d0159410 0x7f64d00cb1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52288/0 (socket says 172.21.15.40:52288) 2023-06-22T10:54:09.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.115+0000 7f64d5d9a700 1 -- 172.21.15.40:0/3340043421 learned_addr learned my addr 172.21.15.40:0/3340043421 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:09.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.116+0000 7f64d659b700 1 --2- 172.21.15.40:0/3340043421 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64bc004850 0x7f64d014ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:09.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.116+0000 7f64d6d9c700 1 --2- 172.21.15.40:0/3340043421 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f64d00cb6f0 0x7f64d015e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:09.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.116+0000 7f64d5d9a700 1 -- 172.21.15.40:0/3340043421 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f64d00cb6f0 msgr2=0x7f64d015e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:09.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.116+0000 7f64d5d9a700 1 --2- 172.21.15.40:0/3340043421 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f64d00cb6f0 0x7f64d015e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:09.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.116+0000 7f64d5d9a700 1 -- 172.21.15.40:0/3340043421 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64bc004850 msgr2=0x7f64d014ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:09.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.116+0000 7f64d5d9a700 1 --2- 172.21.15.40:0/3340043421 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64bc004850 0x7f64d014ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:09.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.116+0000 7f64d5d9a700 1 -- 172.21.15.40:0/3340043421 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d00cc150 con 0x7f64d0159410 2023-06-22T10:54:09.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.116+0000 7f64d5d9a700 1 --2- 172.21.15.40:0/3340043421 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64d0159410 0x7f64d00cb1b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f64bc00c030 tx=0x7f64c00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:09.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.116+0000 7f64c6ffd700 1 -- 172.21.15.40:0/3340043421 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c000e6c0 con 0x7f64d0159410 2023-06-22T10:54:09.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.116+0000 7f64c6ffd700 1 -- 172.21.15.40:0/3340043421 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c0003ad0 con 0x7f64d0159410 2023-06-22T10:54:09.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.116+0000 7f64c6ffd700 1 -- 172.21.15.40:0/3340043421 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c0003e80 con 0x7f64d0159410 2023-06-22T10:54:09.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.116+0000 7f64d87ff700 1 -- 172.21.15.40:0/3340043421 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64d00cc430 con 0x7f64d0159410 2023-06-22T10:54:09.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.117+0000 7f64d87ff700 1 -- 172.21.15.40:0/3340043421 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64d015ef50 con 0x7f64d0159410 2023-06-22T10:54:09.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.118+0000 7f64d87ff700 1 -- 172.21.15.40:0/3340043421 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64d0067580 con 0x7f64d0159410 2023-06-22T10:54:09.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.118+0000 7f64c6ffd700 1 -- 172.21.15.40:0/3340043421 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f64c0013470 con 0x7f64d0159410 2023-06-22T10:54:09.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.119+0000 7f64c6ffd700 1 --2- 172.21.15.40:0/3340043421 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f64b406ace0 0x7f64b406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:09.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.119+0000 7f64c6ffd700 1 -- 172.21.15.40:0/3340043421 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f64c008b2b0 con 0x7f64d0159410 2023-06-22T10:54:09.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.120+0000 7f64d659b700 1 --2- 172.21.15.40:0/3340043421 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f64b406ace0 0x7f64b406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:09.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.120+0000 7f64d659b700 1 --2- 172.21.15.40:0/3340043421 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f64b406ace0 0x7f64b406d190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f64cc000c00 tx=0x7f64cc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:09.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.124+0000 7f64c6ffd700 1 -- 172.21.15.40:0/3340043421 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f64c0056180 con 0x7f64d0159410 2023-06-22T10:54:09.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.329+0000 7f64d87ff700 1 -- 172.21.15.40:0/3340043421 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f64d00b8210 con 0x7f64d0159410 2023-06-22T10:54:09.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.330+0000 7f64c6ffd700 1 -- 172.21.15.40:0/3340043421 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f64c00597a0 con 0x7f64d0159410 2023-06-22T10:54:09.334 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 8 2023-06-22T10:54:09.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.332+0000 7f64d87ff700 1 -- 172.21.15.40:0/3340043421 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f64b406ace0 msgr2=0x7f64b406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:09.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.332+0000 7f64d87ff700 1 --2- 172.21.15.40:0/3340043421 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f64b406ace0 0x7f64b406d190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f64cc000c00 tx=0x7f64cc009040 comp rx=0 tx=0).stop 2023-06-22T10:54:09.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.332+0000 7f64d87ff700 1 -- 172.21.15.40:0/3340043421 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64d0159410 msgr2=0x7f64d00cb1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:09.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.332+0000 7f64d87ff700 1 --2- 172.21.15.40:0/3340043421 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64d0159410 0x7f64d00cb1b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f64bc00c030 tx=0x7f64c00047c0 comp rx=0 tx=0).stop 2023-06-22T10:54:09.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.333+0000 7f64d87ff700 1 -- 172.21.15.40:0/3340043421 shutdown_connections 2023-06-22T10:54:09.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.333+0000 7f64d87ff700 1 --2- 172.21.15.40:0/3340043421 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f64b406ace0 0x7f64b406d190 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:09.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.333+0000 7f64d87ff700 1 --2- 172.21.15.40:0/3340043421 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f64d00cb6f0 0x7f64d015e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:09.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.333+0000 7f64d87ff700 1 --2- 172.21.15.40:0/3340043421 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64bc004850 0x7f64d014ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:09.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.333+0000 7f64d87ff700 1 --2- 172.21.15.40:0/3340043421 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64d0159410 0x7f64d00cb1b0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:09.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.333+0000 7f64d87ff700 1 -- 172.21.15.40:0/3340043421 >> 172.21.15.40:0/3340043421 conn(0x7f64d00cf5d0 msgr2=0x7f64d0159990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:09.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.333+0000 7f64d87ff700 1 -- 172.21.15.40:0/3340043421 shutdown_connections 2023-06-22T10:54:09.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.333+0000 7f64d87ff700 1 -- 172.21.15.40:0/3340043421 wait complete. 2023-06-22T10:54:09.355 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-22T10:54:09.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.554+0000 7fdb71bff700 1 Processor -- start 2023-06-22T10:54:09.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.554+0000 7fdb71bff700 1 -- start start 2023-06-22T10:54:09.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.556+0000 7fdb71bff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdb6c0b45d0 0x7fdb6c0b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:09.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.556+0000 7fdb71bff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fdb6c0d2130 0x7fdb6c0cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:09.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.556+0000 7fdb71bff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb6c0d1be0 con 0x7fdb6c0cd6e0 2023-06-22T10:54:09.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.556+0000 7fdb71bff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb6c0d17f0 con 0x7fdb6c0b45d0 2023-06-22T10:54:09.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.556+0000 7fdb71bff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6c0d1360 con 0x7fdb6c0d2130 2023-06-22T10:54:09.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.556+0000 7fdb6affd700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fdb6c0d2130 0x7fdb6c0cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:09.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.556+0000 7fdb6b7fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdb6c0b45d0 0x7fdb6c0b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:09.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.556+0000 7fdb6bfff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fdb6c0cd6e0 0x7fdb6c0b59a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.40:48514/0 (socket says 172.21.15.40:48514) 2023-06-22T10:54:09.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.556+0000 7fdb6bfff700 1 -- 172.21.15.40:0/3058459611 learned_addr learned my addr 172.21.15.40:0/3058459611 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:09.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.556+0000 7fdb6affd700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fdb6c0d2130 0x7fdb6c0cd1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3301/0 says I am v2:172.21.15.40:37652/0 (socket says 172.21.15.40:37652) 2023-06-22T10:54:09.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.556+0000 7fdb6a7fc700 1 -- 172.21.15.40:0/3058459611 <== mon.1 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2518163049 0 0) 0x7fdb6c0d1be0 con 0x7fdb6c0cd6e0 2023-06-22T10:54:09.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.557+0000 7fdb6affd700 1 -- 172.21.15.40:0/3058459611 >> v2:172.21.15.45:3300/0 conn(0x7fdb6c0b45d0 msgr2=0x7fdb6c0b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:09.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.557+0000 7fdb6affd700 1 --2- 172.21.15.40:0/3058459611 >> v2:172.21.15.45:3300/0 conn(0x7fdb6c0b45d0 0x7fdb6c0b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:09.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.557+0000 7fdb6affd700 1 -- 172.21.15.40:0/3058459611 >> v1:172.21.15.45:6789/0 conn(0x7fdb6c0cd6e0 legacy=0x7fdb6c0b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:09.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.557+0000 7fdb6affd700 1 -- 172.21.15.40:0/3058459611 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb6c0b4ee0 con 0x7fdb6c0d2130 2023-06-22T10:54:09.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.557+0000 7fdb6b7fe700 1 --2- 172.21.15.40:0/3058459611 >> v2:172.21.15.45:3300/0 conn(0x7fdb6c0b45d0 0x7fdb6c0b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-22T10:54:09.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.557+0000 7fdb6affd700 1 --2- 172.21.15.40:0/3058459611 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fdb6c0d2130 0x7fdb6c0cd1a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdb60009840 tx=0x7fdb60009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6464f787afdb92e4 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:09.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.557+0000 7fdb6a7fc700 1 -- 172.21.15.40:0/3058459611 <== mon.2 v2:172.21.15.45:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb60011830 con 0x7fdb6c0d2130 2023-06-22T10:54:09.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.557+0000 7fdb6a7fc700 1 -- 172.21.15.40:0/3058459611 <== mon.2 v2:172.21.15.45:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb60011990 con 0x7fdb6c0d2130 2023-06-22T10:54:09.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.557+0000 7fdb6a7fc700 1 -- 172.21.15.40:0/3058459611 <== mon.2 v2:172.21.15.45:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb60011d20 con 0x7fdb6c0d2130 2023-06-22T10:54:09.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.558+0000 7fdb71bff700 1 -- 172.21.15.40:0/3058459611 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fdb6c0d2130 msgr2=0x7fdb6c0cd1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:09.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.558+0000 7fdb71bff700 1 --2- 172.21.15.40:0/3058459611 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fdb6c0d2130 0x7fdb6c0cd1a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdb60009840 tx=0x7fdb60009b50 comp rx=0 tx=0).stop 2023-06-22T10:54:09.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.558+0000 7fdb71bff700 1 -- 172.21.15.40:0/3058459611 shutdown_connections 2023-06-22T10:54:09.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.558+0000 7fdb71bff700 1 --2- 172.21.15.40:0/3058459611 >> v2:172.21.15.45:3300/0 conn(0x7fdb6c0b45d0 0x7fdb6c0b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:09.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.558+0000 7fdb71bff700 1 --2- 172.21.15.40:0/3058459611 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fdb6c0d2130 0x7fdb6c0cd1a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:09.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.558+0000 7fdb71bff700 1 -- 172.21.15.40:0/3058459611 >> 172.21.15.40:0/3058459611 conn(0x7fdb6c0cf5d0 msgr2=0x7fdb6c0cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:09.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.558+0000 7fdb71bff700 1 -- 172.21.15.40:0/3058459611 shutdown_connections 2023-06-22T10:54:09.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.558+0000 7fdb71bff700 1 -- 172.21.15.40:0/3058459611 wait complete. 2023-06-22T10:54:09.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.560+0000 7fdb71bff700 1 Processor -- start 2023-06-22T10:54:09.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.560+0000 7fdb71bff700 1 -- start start 2023-06-22T10:54:09.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.561+0000 7fdb71bff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fdb6c0b45d0 0x7fdb6c14e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:09.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.561+0000 7fdb71bff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb6c0cd6e0 0x7fdb6c0c6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:09.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.561+0000 7fdb71bff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb6c0d2130 0x7fdb6c0c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:09.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.561+0000 7fdb71bff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6c14e550 con 0x7fdb6c0d2130 2023-06-22T10:54:09.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.561+0000 7fdb71bff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6c15cf70 con 0x7fdb6c0cd6e0 2023-06-22T10:54:09.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.561+0000 7fdb71bff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6c15c660 con 0x7fdb6c0b45d0 2023-06-22T10:54:09.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.561+0000 7fdb6bfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb6c0d2130 0x7fdb6c0c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:09.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.561+0000 7fdb6bfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb6c0d2130 0x7fdb6c0c8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52300/0 (socket says 172.21.15.40:52300) 2023-06-22T10:54:09.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.561+0000 7fdb6bfff700 1 -- 172.21.15.40:0/3223187704 learned_addr learned my addr 172.21.15.40:0/3223187704 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:09.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.561+0000 7fdb6affd700 1 --2- 172.21.15.40:0/3223187704 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb6c0cd6e0 0x7fdb6c0c6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:09.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.561+0000 7fdb6b7fe700 1 --2- 172.21.15.40:0/3223187704 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fdb6c0b45d0 0x7fdb6c14e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:09.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.561+0000 7fdb6bfff700 1 -- 172.21.15.40:0/3223187704 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fdb6c0b45d0 msgr2=0x7fdb6c14e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:09.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.561+0000 7fdb6bfff700 1 --2- 172.21.15.40:0/3223187704 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fdb6c0b45d0 0x7fdb6c14e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:09.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.561+0000 7fdb6bfff700 1 -- 172.21.15.40:0/3223187704 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb6c0cd6e0 msgr2=0x7fdb6c0c6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:09.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.561+0000 7fdb6bfff700 1 --2- 172.21.15.40:0/3223187704 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb6c0cd6e0 0x7fdb6c0c6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:09.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.561+0000 7fdb6bfff700 1 -- 172.21.15.40:0/3223187704 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb5c0094a0 con 0x7fdb6c0d2130 2023-06-22T10:54:09.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.562+0000 7fdb6bfff700 1 --2- 172.21.15.40:0/3223187704 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb6c0d2130 0x7fdb6c0c8290 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fdb64002230 tx=0x7fdb6400cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:09.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.562+0000 7fdb53fff700 1 -- 172.21.15.40:0/3223187704 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6400aac0 con 0x7fdb6c0d2130 2023-06-22T10:54:09.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.562+0000 7fdb53fff700 1 -- 172.21.15.40:0/3223187704 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb6400ac40 con 0x7fdb6c0d2130 2023-06-22T10:54:09.568 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.562+0000 7fdb53fff700 1 -- 172.21.15.40:0/3223187704 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb640070d0 con 0x7fdb6c0d2130 2023-06-22T10:54:09.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.562+0000 7fdb71bff700 1 -- 172.21.15.40:0/3223187704 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb600094a0 con 0x7fdb6c0d2130 2023-06-22T10:54:09.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.562+0000 7fdb71bff700 1 -- 172.21.15.40:0/3223187704 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb6c15c920 con 0x7fdb6c0d2130 2023-06-22T10:54:09.569 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.563+0000 7fdb71bff700 1 -- 172.21.15.40:0/3223187704 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb6c15d0e0 con 0x7fdb6c0d2130 2023-06-22T10:54:09.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.564+0000 7fdb53fff700 1 -- 172.21.15.40:0/3223187704 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdb64007250 con 0x7fdb6c0d2130 2023-06-22T10:54:09.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.565+0000 7fdb53fff700 1 --2- 172.21.15.40:0/3223187704 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fdb5806ace0 0x7fdb5806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:09.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.565+0000 7fdb53fff700 1 -- 172.21.15.40:0/3223187704 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdb64089250 con 0x7fdb6c0d2130 2023-06-22T10:54:09.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.565+0000 7fdb6b7fe700 1 --2- 172.21.15.40:0/3223187704 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fdb5806ace0 0x7fdb5806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:09.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.566+0000 7fdb6b7fe700 1 --2- 172.21.15.40:0/3223187704 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fdb5806ace0 0x7fdb5806d190 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c009cd0 tx=0x7fdb5c009210 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:09.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.569+0000 7fdb53fff700 1 -- 172.21.15.40:0/3223187704 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdb64053f70 con 0x7fdb6c0d2130 2023-06-22T10:54:09.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.774+0000 7fdb71bff700 1 -- 172.21.15.40:0/3223187704 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdb6c067580 con 0x7fdb6c0d2130 2023-06-22T10:54:09.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.775+0000 7fdb53fff700 1 -- 172.21.15.40:0/3223187704 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdb64057590 con 0x7fdb6c0d2130 2023-06-22T10:54:09.779 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-06-22T10:54:09.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.777+0000 7fdb71bff700 1 -- 172.21.15.40:0/3223187704 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fdb5806ace0 msgr2=0x7fdb5806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:09.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.777+0000 7fdb71bff700 1 --2- 172.21.15.40:0/3223187704 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fdb5806ace0 0x7fdb5806d190 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c009cd0 tx=0x7fdb5c009210 comp rx=0 tx=0).stop 2023-06-22T10:54:09.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.777+0000 7fdb71bff700 1 -- 172.21.15.40:0/3223187704 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb6c0d2130 msgr2=0x7fdb6c0c8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:09.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.777+0000 7fdb71bff700 1 --2- 172.21.15.40:0/3223187704 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb6c0d2130 0x7fdb6c0c8290 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fdb64002230 tx=0x7fdb6400cf50 comp rx=0 tx=0).stop 2023-06-22T10:54:09.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.777+0000 7fdb71bff700 1 -- 172.21.15.40:0/3223187704 shutdown_connections 2023-06-22T10:54:09.781 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.777+0000 7fdb71bff700 1 --2- 172.21.15.40:0/3223187704 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fdb5806ace0 0x7fdb5806d190 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:09.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.777+0000 7fdb71bff700 1 --2- 172.21.15.40:0/3223187704 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fdb6c0b45d0 0x7fdb6c14e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:09.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.777+0000 7fdb71bff700 1 --2- 172.21.15.40:0/3223187704 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdb6c0d2130 0x7fdb6c0c8290 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:09.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.777+0000 7fdb71bff700 1 --2- 172.21.15.40:0/3223187704 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb6c0cd6e0 0x7fdb6c0c6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:09.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.777+0000 7fdb71bff700 1 -- 172.21.15.40:0/3223187704 >> 172.21.15.40:0/3223187704 conn(0x7fdb6c0cf5d0 msgr2=0x7fdb6c159940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:09.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.777+0000 7fdb71bff700 1 -- 172.21.15.40:0/3223187704 shutdown_connections 2023-06-22T10:54:09.782 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.777+0000 7fdb71bff700 1 -- 172.21.15.40:0/3223187704 wait complete. 2023-06-22T10:54:09.798 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-22T10:54:10.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.999+0000 7f8a419ff700 1 Processor -- start 2023-06-22T10:54:10.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:09.999+0000 7f8a419ff700 1 -- start start 2023-06-22T10:54:10.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.000+0000 7f8a419ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8a3c0b59a0 0x7f8a3c0b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:10.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.000+0000 7f8a419ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a3c0d1be0 con 0x7f8a3c0b45d0 2023-06-22T10:54:10.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.000+0000 7f8a419ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a3c0d1360 con 0x7f8a3c0d2130 2023-06-22T10:54:10.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.000+0000 7f8a419ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3c0d17f0 con 0x7f8a3c0b59a0 2023-06-22T10:54:10.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.000+0000 7f8a3affd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f8a3c0b45d0 0x7f8a3c0b49a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:54144/0 (socket says 172.21.15.40:54144) 2023-06-22T10:54:10.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.000+0000 7f8a3affd700 1 -- 172.21.15.40:0/3795878231 learned_addr learned my addr 172.21.15.40:0/3795878231 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:10.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.000+0000 7f8a3b7fe700 1 --2- 172.21.15.40:0/3795878231 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8a3c0b59a0 0x7f8a3c0b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:10.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.001+0000 7f8a39ffb700 1 -- 172.21.15.40:0/3795878231 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3344766363 0 0) 0x7f8a3c0d1be0 con 0x7f8a3c0b45d0 2023-06-22T10:54:10.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.001+0000 7f8a39ffb700 1 -- 172.21.15.40:0/3795878231 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a240035b0 con 0x7f8a3c0b45d0 2023-06-22T10:54:10.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.001+0000 7f8a39ffb700 1 -- 172.21.15.40:0/3795878231 <== mon.1 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2868586339 0 0) 0x7f8a3c0d1360 con 0x7f8a3c0d2130 2023-06-22T10:54:10.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.001+0000 7f8a39ffb700 1 -- 172.21.15.40:0/3795878231 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a3c0d1be0 con 0x7f8a3c0d2130 2023-06-22T10:54:10.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.001+0000 7f8a3b7fe700 1 -- 172.21.15.40:0/3795878231 >> v1:172.21.15.45:6789/0 conn(0x7f8a3c0d2130 legacy=0x7f8a3c0cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:10.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.001+0000 7f8a3b7fe700 1 -- 172.21.15.40:0/3795878231 >> v1:172.21.15.40:6789/0 conn(0x7f8a3c0b45d0 legacy=0x7f8a3c0b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:10.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.001+0000 7f8a39ffb700 1 -- 172.21.15.40:0/3795878231 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2589044427 0 0) 0x7f8a240035b0 con 0x7f8a3c0b45d0 2023-06-22T10:54:10.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.001+0000 7f8a3b7fe700 1 -- 172.21.15.40:0/3795878231 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a3c0cef40 con 0x7f8a3c0b59a0 2023-06-22T10:54:10.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.001+0000 7f8a3b7fe700 1 --2- 172.21.15.40:0/3795878231 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8a3c0b59a0 0x7f8a3c0b5e40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8a34009dc0 tx=0x7f8a3400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5a1def4b5e44743 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:10.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.002+0000 7f8a39ffb700 1 -- 172.21.15.40:0/3795878231 <== mon.2 v2:172.21.15.45:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3400e070 con 0x7f8a3c0b59a0 2023-06-22T10:54:10.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.002+0000 7f8a39ffb700 1 -- 172.21.15.40:0/3795878231 <== mon.2 v2:172.21.15.45:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a34003a20 con 0x7f8a3c0b59a0 2023-06-22T10:54:10.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.002+0000 7f8a39ffb700 1 -- 172.21.15.40:0/3795878231 <== mon.2 v2:172.21.15.45:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c001670 con 0x7f8a3c0b59a0 2023-06-22T10:54:10.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.002+0000 7f8a419ff700 1 -- 172.21.15.40:0/3795878231 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8a3c0b59a0 msgr2=0x7f8a3c0b5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:10.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.002+0000 7f8a419ff700 1 --2- 172.21.15.40:0/3795878231 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8a3c0b59a0 0x7f8a3c0b5e40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8a34009dc0 tx=0x7f8a3400b330 comp rx=0 tx=0).stop 2023-06-22T10:54:10.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.002+0000 7f8a419ff700 1 -- 172.21.15.40:0/3795878231 shutdown_connections 2023-06-22T10:54:10.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.002+0000 7f8a419ff700 1 --2- 172.21.15.40:0/3795878231 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8a3c0b59a0 0x7f8a3c0b5e40 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:10.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.002+0000 7f8a419ff700 1 -- 172.21.15.40:0/3795878231 >> 172.21.15.40:0/3795878231 conn(0x7f8a3c0cf5d0 msgr2=0x7f8a3c0cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:10.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.002+0000 7f8a419ff700 1 -- 172.21.15.40:0/3795878231 shutdown_connections 2023-06-22T10:54:10.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.002+0000 7f8a419ff700 1 -- 172.21.15.40:0/3795878231 wait complete. 2023-06-22T10:54:10.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.004+0000 7f8a419ff700 1 Processor -- start 2023-06-22T10:54:10.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.004+0000 7f8a419ff700 1 -- start start 2023-06-22T10:54:10.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.005+0000 7f8a419ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8a3c0b45d0 0x7f8a3c0cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:10.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.005+0000 7f8a419ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a3c0b59a0 0x7f8a3c1f2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:10.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.005+0000 7f8a419ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a3c0d2130 0x7f8a3c15ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:10.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.005+0000 7f8a419ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3c0cc270 con 0x7f8a3c0b59a0 2023-06-22T10:54:10.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.005+0000 7f8a419ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3c15ca80 con 0x7f8a3c0d2130 2023-06-22T10:54:10.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.005+0000 7f8a419ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3c15cd60 con 0x7f8a3c0b45d0 2023-06-22T10:54:10.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.005+0000 7f8a3a7fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a3c0b59a0 0x7f8a3c1f2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:10.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.005+0000 7f8a3a7fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a3c0b59a0 0x7f8a3c1f2ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52314/0 (socket says 172.21.15.40:52314) 2023-06-22T10:54:10.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.005+0000 7f8a3a7fc700 1 -- 172.21.15.40:0/3609069394 learned_addr learned my addr 172.21.15.40:0/3609069394 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:10.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.006+0000 7f8a3affd700 1 --2- 172.21.15.40:0/3609069394 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8a3c0b45d0 0x7f8a3c0cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:10.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.006+0000 7f8a3b7fe700 1 --2- 172.21.15.40:0/3609069394 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a3c0d2130 0x7f8a3c15ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:10.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.006+0000 7f8a3a7fc700 1 -- 172.21.15.40:0/3609069394 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8a3c0b45d0 msgr2=0x7f8a3c0cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:10.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.006+0000 7f8a3a7fc700 1 --2- 172.21.15.40:0/3609069394 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8a3c0b45d0 0x7f8a3c0cbd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:10.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.006+0000 7f8a3a7fc700 1 -- 172.21.15.40:0/3609069394 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a3c0d2130 msgr2=0x7f8a3c15ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:10.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.006+0000 7f8a3a7fc700 1 --2- 172.21.15.40:0/3609069394 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a3c0d2130 0x7f8a3c15ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:10.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.006+0000 7f8a3a7fc700 1 -- 172.21.15.40:0/3609069394 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a34009a70 con 0x7f8a3c0b59a0 2023-06-22T10:54:10.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.006+0000 7f8a3a7fc700 1 --2- 172.21.15.40:0/3609069394 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a3c0b59a0 0x7f8a3c1f2ff0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8a3000c500 tx=0x7f8a3000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:10.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.006+0000 7f8a23fff700 1 -- 172.21.15.40:0/3609069394 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a300052d0 con 0x7f8a3c0b59a0 2023-06-22T10:54:10.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.006+0000 7f8a23fff700 1 -- 172.21.15.40:0/3609069394 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a30005450 con 0x7f8a3c0b59a0 2023-06-22T10:54:10.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.006+0000 7f8a419ff700 1 -- 172.21.15.40:0/3609069394 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a3c15d040 con 0x7f8a3c0b59a0 2023-06-22T10:54:10.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.006+0000 7f8a23fff700 1 -- 172.21.15.40:0/3609069394 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a300038c0 con 0x7f8a3c0b59a0 2023-06-22T10:54:10.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.006+0000 7f8a419ff700 1 -- 172.21.15.40:0/3609069394 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a3c1f3530 con 0x7f8a3c0b59a0 2023-06-22T10:54:10.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.007+0000 7f8a419ff700 1 -- 172.21.15.40:0/3609069394 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a3c1f1fe0 con 0x7f8a3c0b59a0 2023-06-22T10:54:10.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.008+0000 7f8a23fff700 1 -- 172.21.15.40:0/3609069394 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8a30003a20 con 0x7f8a3c0b59a0 2023-06-22T10:54:10.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.009+0000 7f8a23fff700 1 --2- 172.21.15.40:0/3609069394 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f8a2806ace0 0x7f8a2806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:10.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.009+0000 7f8a23fff700 1 -- 172.21.15.40:0/3609069394 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8a30088cc0 con 0x7f8a3c0b59a0 2023-06-22T10:54:10.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.010+0000 7f8a3affd700 1 --2- 172.21.15.40:0/3609069394 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f8a2806ace0 0x7f8a2806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:10.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.010+0000 7f8a3affd700 1 --2- 172.21.15.40:0/3609069394 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f8a2806ace0 0x7f8a2806d190 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c001380 tx=0x7f8a2c0015f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:10.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.014+0000 7f8a23fff700 1 -- 172.21.15.40:0/3609069394 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8a3c1f1fe0 con 0x7f8a3c0b59a0 2023-06-22T10:54:10.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.219+0000 7f8a419ff700 1 -- 172.21.15.40:0/3609069394 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8a3c1f1fe0 con 0x7f8a3c0b59a0 2023-06-22T10:54:10.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.220+0000 7f8a23fff700 1 -- 172.21.15.40:0/3609069394 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8a30017020 con 0x7f8a3c0b59a0 2023-06-22T10:54:10.223 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-06-22T10:54:10.225 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.222+0000 7f8a419ff700 1 -- 172.21.15.40:0/3609069394 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f8a2806ace0 msgr2=0x7f8a2806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:10.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.222+0000 7f8a419ff700 1 --2- 172.21.15.40:0/3609069394 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f8a2806ace0 0x7f8a2806d190 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c001380 tx=0x7f8a2c0015f0 comp rx=0 tx=0).stop 2023-06-22T10:54:10.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.222+0000 7f8a419ff700 1 -- 172.21.15.40:0/3609069394 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a3c0b59a0 msgr2=0x7f8a3c1f2ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:10.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.222+0000 7f8a419ff700 1 --2- 172.21.15.40:0/3609069394 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a3c0b59a0 0x7f8a3c1f2ff0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8a3000c500 tx=0x7f8a3000c8c0 comp rx=0 tx=0).stop 2023-06-22T10:54:10.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.222+0000 7f8a419ff700 1 -- 172.21.15.40:0/3609069394 shutdown_connections 2023-06-22T10:54:10.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.222+0000 7f8a419ff700 1 --2- 172.21.15.40:0/3609069394 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f8a2806ace0 0x7f8a2806d190 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:10.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.222+0000 7f8a419ff700 1 --2- 172.21.15.40:0/3609069394 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8a3c0b45d0 0x7f8a3c0cbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:10.226 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.222+0000 7f8a419ff700 1 --2- 172.21.15.40:0/3609069394 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a3c0d2130 0x7f8a3c15ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:10.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.222+0000 7f8a419ff700 1 --2- 172.21.15.40:0/3609069394 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a3c0b59a0 0x7f8a3c1f2ff0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:10.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.222+0000 7f8a419ff700 1 -- 172.21.15.40:0/3609069394 >> 172.21.15.40:0/3609069394 conn(0x7f8a3c0cf5d0 msgr2=0x7f8a3c06b360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:10.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.222+0000 7f8a419ff700 1 -- 172.21.15.40:0/3609069394 shutdown_connections 2023-06-22T10:54:10.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.222+0000 7f8a419ff700 1 -- 172.21.15.40:0/3609069394 wait complete. 2023-06-22T10:54:10.243 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-22T10:54:10.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.445+0000 7f63ad3ff700 1 Processor -- start 2023-06-22T10:54:10.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.446+0000 7f63ad3ff700 1 -- start start 2023-06-22T10:54:10.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.447+0000 7f63ad3ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f63a80b45d0 0x7f63a80b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:10.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.447+0000 7f63ad3ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f63a80b59a0 0x7f63a80b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:10.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.447+0000 7f63ad3ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63a80d1be0 con 0x7f63a80d2130 2023-06-22T10:54:10.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.447+0000 7f63ad3ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63a80d17f0 con 0x7f63a80b59a0 2023-06-22T10:54:10.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.447+0000 7f63ad3ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63a80d1360 con 0x7f63a80b45d0 2023-06-22T10:54:10.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.447+0000 7f639ffff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f63a80d2130 0x7f63a80cd1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:54148/0 (socket says 172.21.15.40:54148) 2023-06-22T10:54:10.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.447+0000 7f639ffff700 1 -- 172.21.15.40:0/1133916528 learned_addr learned my addr 172.21.15.40:0/1133916528 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:10.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.447+0000 7f63a6ffd700 1 --2- 172.21.15.40:0/1133916528 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f63a80b45d0 0x7f63a80b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:10.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.447+0000 7f63a77fe700 1 --2- 172.21.15.40:0/1133916528 >> v2:172.21.15.45:3300/0 conn(0x7f63a80b59a0 0x7f63a80b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:10.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.448+0000 7f63a67fc700 1 -- 172.21.15.40:0/1133916528 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 314465335 0 0) 0x7f63a80d1be0 con 0x7f63a80d2130 2023-06-22T10:54:10.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.448+0000 7f63a67fc700 1 -- 172.21.15.40:0/1133916528 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63940035b0 con 0x7f63a80d2130 2023-06-22T10:54:10.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.448+0000 7f63a6ffd700 1 -- 172.21.15.40:0/1133916528 >> v2:172.21.15.45:3300/0 conn(0x7f63a80b59a0 msgr2=0x7f63a80b5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:10.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.448+0000 7f63a6ffd700 1 --2- 172.21.15.40:0/1133916528 >> v2:172.21.15.45:3300/0 conn(0x7f63a80b59a0 0x7f63a80b5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:10.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.448+0000 7f63a6ffd700 1 -- 172.21.15.40:0/1133916528 >> v1:172.21.15.40:6789/0 conn(0x7f63a80d2130 legacy=0x7f63a80cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:10.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.448+0000 7f63a6ffd700 1 -- 172.21.15.40:0/1133916528 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a80b4ee0 con 0x7f63a80b45d0 2023-06-22T10:54:10.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.448+0000 7f63a77fe700 1 --2- 172.21.15.40:0/1133916528 >> v2:172.21.15.45:3300/0 conn(0x7f63a80b59a0 0x7f63a80b5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-22T10:54:10.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.448+0000 7f63a6ffd700 1 --2- 172.21.15.40:0/1133916528 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f63a80b45d0 0x7f63a80b49a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6398009840 tx=0x7f6398009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27458c92710a456e server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:10.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.449+0000 7f63a67fc700 1 -- 172.21.15.40:0/1133916528 <== mon.2 v2:172.21.15.45:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6398011830 con 0x7f63a80b45d0 2023-06-22T10:54:10.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.449+0000 7f63a67fc700 1 -- 172.21.15.40:0/1133916528 <== mon.2 v2:172.21.15.45:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6398011990 con 0x7f63a80b45d0 2023-06-22T10:54:10.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.449+0000 7f63a67fc700 1 -- 172.21.15.40:0/1133916528 <== mon.2 v2:172.21.15.45:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6398011d00 con 0x7f63a80b45d0 2023-06-22T10:54:10.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.449+0000 7f63ad3ff700 1 -- 172.21.15.40:0/1133916528 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f63a80b45d0 msgr2=0x7f63a80b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:10.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.449+0000 7f63ad3ff700 1 --2- 172.21.15.40:0/1133916528 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f63a80b45d0 0x7f63a80b49a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6398009840 tx=0x7f6398009b50 comp rx=0 tx=0).stop 2023-06-22T10:54:10.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.449+0000 7f63ad3ff700 1 -- 172.21.15.40:0/1133916528 shutdown_connections 2023-06-22T10:54:10.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.449+0000 7f63ad3ff700 1 --2- 172.21.15.40:0/1133916528 >> v2:172.21.15.45:3300/0 conn(0x7f63a80b59a0 0x7f63a80b5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:10.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.449+0000 7f63ad3ff700 1 --2- 172.21.15.40:0/1133916528 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f63a80b45d0 0x7f63a80b49a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:10.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.449+0000 7f63ad3ff700 1 -- 172.21.15.40:0/1133916528 >> 172.21.15.40:0/1133916528 conn(0x7f63a80cf5d0 msgr2=0x7f63a80cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:10.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.449+0000 7f63ad3ff700 1 -- 172.21.15.40:0/1133916528 shutdown_connections 2023-06-22T10:54:10.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.450+0000 7f63ad3ff700 1 -- 172.21.15.40:0/1133916528 wait complete. 2023-06-22T10:54:10.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.451+0000 7f63ad3ff700 1 Processor -- start 2023-06-22T10:54:10.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.451+0000 7f63ad3ff700 1 -- start start 2023-06-22T10:54:10.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.452+0000 7f63ad3ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63a80b45d0 0x7f63a8156920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:10.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.452+0000 7f63ad3ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f63a80b59a0 0x7f63a8152b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:10.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.452+0000 7f63ad3ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63a80d2130 0x7f63a8159df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:10.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.452+0000 7f63ad3ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a8156e60 con 0x7f63a80d2130 2023-06-22T10:54:10.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.452+0000 7f63ad3ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a8158d50 con 0x7f63a80b45d0 2023-06-22T10:54:10.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.452+0000 7f63ad3ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63a8159030 con 0x7f63a80b59a0 2023-06-22T10:54:10.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.453+0000 7f63a77fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63a80d2130 0x7f63a8159df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:10.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.453+0000 7f63a6ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63a80b45d0 0x7f63a8156920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:10.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.453+0000 7f639ffff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f63a80b59a0 0x7f63a8152b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:10.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.453+0000 7f63a6ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63a80b45d0 0x7f63a8156920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.40:43692/0 (socket says 172.21.15.40:43692) 2023-06-22T10:54:10.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.453+0000 7f63a6ffd700 1 -- 172.21.15.40:0/413339413 learned_addr learned my addr 172.21.15.40:0/413339413 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:10.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.453+0000 7f63a6ffd700 1 -- 172.21.15.40:0/413339413 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f63a80b59a0 msgr2=0x7f63a8152b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:10.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.453+0000 7f63a6ffd700 1 --2- 172.21.15.40:0/413339413 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f63a80b59a0 0x7f63a8152b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:10.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.453+0000 7f63a6ffd700 1 -- 172.21.15.40:0/413339413 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63a80d2130 msgr2=0x7f63a8159df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:10.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.453+0000 7f63a6ffd700 1 --2- 172.21.15.40:0/413339413 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63a80d2130 0x7f63a8159df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:10.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.453+0000 7f63a6ffd700 1 -- 172.21.15.40:0/413339413 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a0009a70 con 0x7f63a80b45d0 2023-06-22T10:54:10.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.453+0000 7f63a6ffd700 1 --2- 172.21.15.40:0/413339413 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63a80b45d0 0x7f63a8156920 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6398000c00 tx=0x7f6398004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:10.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.454+0000 7f639f7fe700 1 -- 172.21.15.40:0/413339413 <== mon.1 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63980045d0 con 0x7f63a80b45d0 2023-06-22T10:54:10.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.454+0000 7f639f7fe700 1 -- 172.21.15.40:0/413339413 <== mon.1 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f639801e070 con 0x7f63a80b45d0 2023-06-22T10:54:10.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.454+0000 7f639f7fe700 1 -- 172.21.15.40:0/413339413 <== mon.1 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63980038c0 con 0x7f63a80b45d0 2023-06-22T10:54:10.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.454+0000 7f63ad3ff700 1 -- 172.21.15.40:0/413339413 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63980094a0 con 0x7f63a80b45d0 2023-06-22T10:54:10.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.454+0000 7f63ad3ff700 1 -- 172.21.15.40:0/413339413 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63a81595f0 con 0x7f63a80b45d0 2023-06-22T10:54:10.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.455+0000 7f63ad3ff700 1 -- 172.21.15.40:0/413339413 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63a8067580 con 0x7f63a80b45d0 2023-06-22T10:54:10.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.456+0000 7f639f7fe700 1 -- 172.21.15.40:0/413339413 <== mon.1 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6398003a20 con 0x7f63a80b45d0 2023-06-22T10:54:10.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.457+0000 7f639f7fe700 1 --2- 172.21.15.40:0/413339413 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f638806ace0 0x7f638806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:10.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.457+0000 7f639f7fe700 1 -- 172.21.15.40:0/413339413 <== mon.1 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f639808a600 con 0x7f63a80b45d0 2023-06-22T10:54:10.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.457+0000 7f639ffff700 1 --2- 172.21.15.40:0/413339413 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f638806ace0 0x7f638806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:10.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.458+0000 7f639ffff700 1 --2- 172.21.15.40:0/413339413 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f638806ace0 0x7f638806d190 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6390007fd0 tx=0x7f6390009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:10.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.462+0000 7f639f7fe700 1 -- 172.21.15.40:0/413339413 <== mon.1 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f63980553b0 con 0x7f63a80b45d0 2023-06-22T10:54:10.670 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.667+0000 7f63ad3ff700 1 -- 172.21.15.40:0/413339413 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f63a80b7290 con 0x7f63a80b45d0 2023-06-22T10:54:10.671 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.668+0000 7f639f7fe700 1 -- 172.21.15.40:0/413339413 <== mon.1 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f63980589d0 con 0x7f63a80b45d0 2023-06-22T10:54:10.671 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-06-22T10:54:10.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.670+0000 7f63ad3ff700 1 -- 172.21.15.40:0/413339413 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f638806ace0 msgr2=0x7f638806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:10.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.670+0000 7f63ad3ff700 1 --2- 172.21.15.40:0/413339413 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f638806ace0 0x7f638806d190 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6390007fd0 tx=0x7f6390009040 comp rx=0 tx=0).stop 2023-06-22T10:54:10.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.670+0000 7f63ad3ff700 1 -- 172.21.15.40:0/413339413 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63a80b45d0 msgr2=0x7f63a8156920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:10.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.670+0000 7f63ad3ff700 1 --2- 172.21.15.40:0/413339413 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63a80b45d0 0x7f63a8156920 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6398000c00 tx=0x7f6398004750 comp rx=0 tx=0).stop 2023-06-22T10:54:10.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.670+0000 7f63ad3ff700 1 -- 172.21.15.40:0/413339413 shutdown_connections 2023-06-22T10:54:10.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.670+0000 7f63ad3ff700 1 --2- 172.21.15.40:0/413339413 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f638806ace0 0x7f638806d190 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:10.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.670+0000 7f63ad3ff700 1 --2- 172.21.15.40:0/413339413 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63a80d2130 0x7f63a8159df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:10.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.670+0000 7f63ad3ff700 1 --2- 172.21.15.40:0/413339413 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63a80b45d0 0x7f63a8156920 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:10.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.671+0000 7f63ad3ff700 1 --2- 172.21.15.40:0/413339413 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f63a80b59a0 0x7f63a8152b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:10.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.671+0000 7f63ad3ff700 1 -- 172.21.15.40:0/413339413 >> 172.21.15.40:0/413339413 conn(0x7f63a80cf5d0 msgr2=0x7f63a80cce70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:10.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.671+0000 7f63ad3ff700 1 -- 172.21.15.40:0/413339413 shutdown_connections 2023-06-22T10:54:10.675 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.671+0000 7f63ad3ff700 1 -- 172.21.15.40:0/413339413 wait complete. 2023-06-22T10:54:10.691 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-22T10:54:10.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.889+0000 7fc8a67ff700 1 Processor -- start 2023-06-22T10:54:10.893 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.889+0000 7fc8a67ff700 1 -- start start 2023-06-22T10:54:10.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.890+0000 7fc8a67ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc8a015c720 0x7fc8a00b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:10.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.890+0000 7fc8a67ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc8a00d2830 0x7fc8a00b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:10.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.891+0000 7fc8a67ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8a00b50a0 con 0x7fc8a00b4c60 2023-06-22T10:54:10.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.891+0000 7fc8a67ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8a0160d60 con 0x7fc8a00d2830 2023-06-22T10:54:10.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.891+0000 7fc8a67ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8a00b2130 con 0x7fc8a015c720 2023-06-22T10:54:10.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.891+0000 7fc89f7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc8a00d2830 0x7fc8a00b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:10.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.891+0000 7fc8a4d9c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc8a00b4c60 0x7fc8a006b4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:54154/0 (socket says 172.21.15.40:54154) 2023-06-22T10:54:10.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.891+0000 7fc8a4d9c700 1 -- 172.21.15.40:0/2798360749 learned_addr learned my addr 172.21.15.40:0/2798360749 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:10.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.891+0000 7fc89ffff700 1 --2- 172.21.15.40:0/2798360749 >> v2:172.21.15.45:3300/0 conn(0x7fc8a015c720 0x7fc8a00b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:10.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.891+0000 7fc89f7fe700 1 -- 172.21.15.40:0/2798360749 >> v2:172.21.15.45:3300/0 conn(0x7fc8a015c720 msgr2=0x7fc8a00b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:10.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.891+0000 7fc89f7fe700 1 --2- 172.21.15.40:0/2798360749 >> v2:172.21.15.45:3300/0 conn(0x7fc8a015c720 0x7fc8a00b1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:10.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.891+0000 7fc89effd700 1 -- 172.21.15.40:0/2798360749 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 448752941 0 0) 0x7fc8a00b50a0 con 0x7fc8a00b4c60 2023-06-22T10:54:10.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.891+0000 7fc89f7fe700 1 -- 172.21.15.40:0/2798360749 >> v1:172.21.15.40:6789/0 conn(0x7fc8a00b4c60 legacy=0x7fc8a006b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:10.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.891+0000 7fc89f7fe700 1 -- 172.21.15.40:0/2798360749 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a0161180 con 0x7fc8a00d2830 2023-06-22T10:54:10.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.892+0000 7fc89f7fe700 1 --2- 172.21.15.40:0/2798360749 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8a00d2830 0x7fc8a00b4720 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc894009840 tx=0x7fc894009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67b3c59f78197139 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:10.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.892+0000 7fc89effd700 1 -- 172.21.15.40:0/2798360749 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc894011830 con 0x7fc8a00d2830 2023-06-22T10:54:10.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.892+0000 7fc89effd700 1 -- 172.21.15.40:0/2798360749 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc894011990 con 0x7fc8a00d2830 2023-06-22T10:54:10.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.892+0000 7fc89effd700 1 -- 172.21.15.40:0/2798360749 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc894011d20 con 0x7fc8a00d2830 2023-06-22T10:54:10.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.892+0000 7fc8a67ff700 1 -- 172.21.15.40:0/2798360749 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8a00d2830 msgr2=0x7fc8a00b4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:10.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.892+0000 7fc8a67ff700 1 --2- 172.21.15.40:0/2798360749 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8a00d2830 0x7fc8a00b4720 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc894009840 tx=0x7fc894009b50 comp rx=0 tx=0).stop 2023-06-22T10:54:10.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.892+0000 7fc8a67ff700 1 -- 172.21.15.40:0/2798360749 shutdown_connections 2023-06-22T10:54:10.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.892+0000 7fc8a67ff700 1 --2- 172.21.15.40:0/2798360749 >> v2:172.21.15.45:3300/0 conn(0x7fc8a015c720 0x7fc8a00b1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:10.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.892+0000 7fc8a67ff700 1 --2- 172.21.15.40:0/2798360749 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8a00d2830 0x7fc8a00b4720 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:10.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.892+0000 7fc8a67ff700 1 -- 172.21.15.40:0/2798360749 >> 172.21.15.40:0/2798360749 conn(0x7fc8a00cf720 msgr2=0x7fc8a00cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:10.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.893+0000 7fc8a67ff700 1 -- 172.21.15.40:0/2798360749 shutdown_connections 2023-06-22T10:54:10.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.893+0000 7fc8a67ff700 1 -- 172.21.15.40:0/2798360749 wait complete. 2023-06-22T10:54:10.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.894+0000 7fc8a67ff700 1 Processor -- start 2023-06-22T10:54:10.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.894+0000 7fc8a67ff700 1 -- start start 2023-06-22T10:54:10.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.895+0000 7fc8a67ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8a00b4c60 0x7fc8a0159230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:10.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.895+0000 7fc8a67ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8a00d2830 0x7fc8a00cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:10.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.895+0000 7fc8a67ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fc8a015c720 0x7fc8a00cc480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:10.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.895+0000 7fc8a67ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a01f2be0 con 0x7fc8a00b4c60 2023-06-22T10:54:10.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.895+0000 7fc8a67ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a0159770 con 0x7fc8a00d2830 2023-06-22T10:54:10.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.895+0000 7fc8a67ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a01f22b0 con 0x7fc8a015c720 2023-06-22T10:54:10.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.896+0000 7fc89ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8a00b4c60 0x7fc8a0159230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:10.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.896+0000 7fc89ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8a00b4c60 0x7fc8a0159230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52344/0 (socket says 172.21.15.40:52344) 2023-06-22T10:54:10.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.896+0000 7fc89ffff700 1 -- 172.21.15.40:0/116868135 learned_addr learned my addr 172.21.15.40:0/116868135 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:10.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.896+0000 7fc89f7fe700 1 --2- 172.21.15.40:0/116868135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8a00d2830 0x7fc8a00cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:10.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.896+0000 7fc8a4d9c700 1 --2- 172.21.15.40:0/116868135 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fc8a015c720 0x7fc8a00cc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:10.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.896+0000 7fc89ffff700 1 -- 172.21.15.40:0/116868135 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fc8a015c720 msgr2=0x7fc8a00cc480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:10.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.896+0000 7fc89ffff700 1 --2- 172.21.15.40:0/116868135 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fc8a015c720 0x7fc8a00cc480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:10.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.896+0000 7fc89ffff700 1 -- 172.21.15.40:0/116868135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8a00d2830 msgr2=0x7fc8a00cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:10.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.896+0000 7fc89ffff700 1 --2- 172.21.15.40:0/116868135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8a00d2830 0x7fc8a00cbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:10.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.896+0000 7fc89ffff700 1 -- 172.21.15.40:0/116868135 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8940094a0 con 0x7fc8a00b4c60 2023-06-22T10:54:10.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.896+0000 7fc8a4d9c700 1 --2- 172.21.15.40:0/116868135 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fc8a015c720 0x7fc8a00cc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:54:10.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.896+0000 7fc89ffff700 1 --2- 172.21.15.40:0/116868135 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8a00b4c60 0x7fc8a0159230 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc89000e810 tx=0x7fc89000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:10.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.897+0000 7fc89cff9700 1 -- 172.21.15.40:0/116868135 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc890013610 con 0x7fc8a00b4c60 2023-06-22T10:54:10.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.897+0000 7fc89cff9700 1 -- 172.21.15.40:0/116868135 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc890013770 con 0x7fc8a00b4c60 2023-06-22T10:54:10.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.897+0000 7fc89cff9700 1 -- 172.21.15.40:0/116868135 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc890013b20 con 0x7fc8a00b4c60 2023-06-22T10:54:10.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.897+0000 7fc8a67ff700 1 -- 172.21.15.40:0/116868135 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8a01f2590 con 0x7fc8a00b4c60 2023-06-22T10:54:10.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.897+0000 7fc8a67ff700 1 -- 172.21.15.40:0/116868135 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8a01f1f20 con 0x7fc8a00b4c60 2023-06-22T10:54:10.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.898+0000 7fc8a67ff700 1 -- 172.21.15.40:0/116868135 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8a0067580 con 0x7fc8a00b4c60 2023-06-22T10:54:10.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.899+0000 7fc89cff9700 1 -- 172.21.15.40:0/116868135 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc890013c80 con 0x7fc8a00b4c60 2023-06-22T10:54:10.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.900+0000 7fc89cff9700 1 --2- 172.21.15.40:0/116868135 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fc88c06ace0 0x7fc88c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:10.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.900+0000 7fc89cff9700 1 -- 172.21.15.40:0/116868135 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc890089460 con 0x7fc8a00b4c60 2023-06-22T10:54:10.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.900+0000 7fc89f7fe700 1 --2- 172.21.15.40:0/116868135 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fc88c06ace0 0x7fc88c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:10.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.901+0000 7fc89f7fe700 1 --2- 172.21.15.40:0/116868135 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fc88c06ace0 0x7fc88c06d190 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc8a00d2c70 tx=0x7fc89401c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:10.910 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:10.904+0000 7fc89cff9700 1 -- 172.21.15.40:0/116868135 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc890057c20 con 0x7fc8a00b4c60 2023-06-22T10:54:11.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.161+0000 7fc8a67ff700 1 -- 172.21.15.40:0/116868135 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc8a006bd60 con 0x7fc8a00b4c60 2023-06-22T10:54:11.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.162+0000 7fc89cff9700 1 -- 172.21.15.40:0/116868135 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4664 (secure 0 0 0) 0x7fc8900577b0 con 0x7fc8a00b4c60 2023-06-22T10:54:11.165 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:54:11.166 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/627935577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":627935577},{"type":"v1","addr":"172.21.15.40:6835","nonce":627935577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3018871402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3018871402},{"type":"v1","addr":"172.21.15.40:6837","nonce":3018871402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/4036649607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":4036649607},{"type":"v1","addr":"172.21.15.45:6834","nonce":4036649607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-22T10:53:31.430326+0000","modified":"2023-06-22T10:53:59.666730+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4303},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4303":{"gid":4303,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/1579627519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":1579627519},{"type":"v1","addr":"172.21.15.45:6835","nonce":1579627519}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-22T10:54:11.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.164+0000 7fc8a67ff700 1 -- 172.21.15.40:0/116868135 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fc88c06ace0 msgr2=0x7fc88c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:11.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.164+0000 7fc8a67ff700 1 --2- 172.21.15.40:0/116868135 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fc88c06ace0 0x7fc88c06d190 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc8a00d2c70 tx=0x7fc89401c040 comp rx=0 tx=0).stop 2023-06-22T10:54:11.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.164+0000 7fc8a67ff700 1 -- 172.21.15.40:0/116868135 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8a00b4c60 msgr2=0x7fc8a0159230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:11.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.164+0000 7fc8a67ff700 1 --2- 172.21.15.40:0/116868135 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8a00b4c60 0x7fc8a0159230 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc89000e810 tx=0x7fc89000eb20 comp rx=0 tx=0).stop 2023-06-22T10:54:11.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.165+0000 7fc8a67ff700 1 -- 172.21.15.40:0/116868135 shutdown_connections 2023-06-22T10:54:11.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.165+0000 7fc8a67ff700 1 --2- 172.21.15.40:0/116868135 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fc88c06ace0 0x7fc88c06d190 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:11.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.165+0000 7fc8a67ff700 1 --2- 172.21.15.40:0/116868135 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fc8a015c720 0x7fc8a00cc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:11.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.165+0000 7fc8a67ff700 1 --2- 172.21.15.40:0/116868135 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc8a00b4c60 0x7fc8a0159230 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:11.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.165+0000 7fc8a67ff700 1 --2- 172.21.15.40:0/116868135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8a00d2830 0x7fc8a00cbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:11.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.165+0000 7fc8a67ff700 1 -- 172.21.15.40:0/116868135 >> 172.21.15.40:0/116868135 conn(0x7fc8a00cf720 msgr2=0x7fc8a015b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:11.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.165+0000 7fc8a67ff700 1 -- 172.21.15.40:0/116868135 shutdown_connections 2023-06-22T10:54:11.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.165+0000 7fc8a67ff700 1 -- 172.21.15.40:0/116868135 wait complete. 2023-06-22T10:54:11.170 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 9 2023-06-22T10:54:11.186 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-22T10:54:11.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.385+0000 7fb87b3ff700 1 Processor -- start 2023-06-22T10:54:11.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.385+0000 7fb87b3ff700 1 -- start start 2023-06-22T10:54:11.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.386+0000 7fb87b3ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb87415c720 0x7fb8740b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:11.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.386+0000 7fb87b3ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8740b2130 con 0x7fb8740d2830 2023-06-22T10:54:11.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.386+0000 7fb87b3ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb874161180 con 0x7fb8740b4e30 2023-06-22T10:54:11.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.386+0000 7fb87b3ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb874160d60 con 0x7fb87415c720 2023-06-22T10:54:11.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.386+0000 7fb87899a700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb8740d2830 0x7fb8740b4720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:54168/0 (socket says 172.21.15.40:54168) 2023-06-22T10:54:11.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.386+0000 7fb87899a700 1 -- 172.21.15.40:0/1243220380 learned_addr learned my addr 172.21.15.40:0/1243220380 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:11.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.386+0000 7fb87919b700 1 --2- 172.21.15.40:0/1243220380 >> v2:172.21.15.45:3300/0 conn(0x7fb87415c720 0x7fb8740b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:11.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.387+0000 7fb86bfff700 1 -- 172.21.15.40:0/1243220380 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1477133975 0 0) 0x7fb8740b2130 con 0x7fb8740d2830 2023-06-22T10:54:11.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.387+0000 7fb86bfff700 1 -- 172.21.15.40:0/1243220380 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8600035b0 con 0x7fb8740d2830 2023-06-22T10:54:11.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.387+0000 7fb86bfff700 1 -- 172.21.15.40:0/1243220380 <== mon.1 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1662256649 0 0) 0x7fb874161180 con 0x7fb8740b4e30 2023-06-22T10:54:11.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.387+0000 7fb86bfff700 1 -- 172.21.15.40:0/1243220380 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8740b2130 con 0x7fb8740b4e30 2023-06-22T10:54:11.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.387+0000 7fb87919b700 1 -- 172.21.15.40:0/1243220380 >> v1:172.21.15.45:6789/0 conn(0x7fb8740b4e30 legacy=0x7fb8740d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:11.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.387+0000 7fb87919b700 1 -- 172.21.15.40:0/1243220380 >> v1:172.21.15.40:6789/0 conn(0x7fb8740d2830 legacy=0x7fb8740b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:11.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.387+0000 7fb87919b700 1 -- 172.21.15.40:0/1243220380 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8741603c0 con 0x7fb87415c720 2023-06-22T10:54:11.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.387+0000 7fb87919b700 1 --2- 172.21.15.40:0/1243220380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb87415c720 0x7fb8740b1870 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb870009870 tx=0x7fb870009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7f4f108c428b59c server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:11.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.388+0000 7fb86bfff700 1 -- 172.21.15.40:0/1243220380 <== mon.1 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb870011830 con 0x7fb87415c720 2023-06-22T10:54:11.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.388+0000 7fb86bfff700 1 -- 172.21.15.40:0/1243220380 <== mon.1 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb870011990 con 0x7fb87415c720 2023-06-22T10:54:11.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.388+0000 7fb86bfff700 1 -- 172.21.15.40:0/1243220380 <== mon.1 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb870011d00 con 0x7fb87415c720 2023-06-22T10:54:11.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.388+0000 7fb87b3ff700 1 -- 172.21.15.40:0/1243220380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb87415c720 msgr2=0x7fb8740b1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:11.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.388+0000 7fb87b3ff700 1 --2- 172.21.15.40:0/1243220380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb87415c720 0x7fb8740b1870 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb870009870 tx=0x7fb870009b80 comp rx=0 tx=0).stop 2023-06-22T10:54:11.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.388+0000 7fb87b3ff700 1 -- 172.21.15.40:0/1243220380 shutdown_connections 2023-06-22T10:54:11.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.388+0000 7fb87b3ff700 1 --2- 172.21.15.40:0/1243220380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb87415c720 0x7fb8740b1870 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:11.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.388+0000 7fb87b3ff700 1 -- 172.21.15.40:0/1243220380 >> 172.21.15.40:0/1243220380 conn(0x7fb8740cf720 msgr2=0x7fb8740cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:11.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.388+0000 7fb87b3ff700 1 -- 172.21.15.40:0/1243220380 shutdown_connections 2023-06-22T10:54:11.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.388+0000 7fb87b3ff700 1 -- 172.21.15.40:0/1243220380 wait complete. 2023-06-22T10:54:11.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.390+0000 7fb87b3ff700 1 Processor -- start 2023-06-22T10:54:11.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.390+0000 7fb87b3ff700 1 -- start start 2023-06-22T10:54:11.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.391+0000 7fb87b3ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8740b4e30 0x7fb874158e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:11.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.391+0000 7fb87b3ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fb8740d2830 0x7fb8741f1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:11.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.391+0000 7fb87b3ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb87415c720 0x7fb8741f5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:11.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.391+0000 7fb87b3ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8740cc920 con 0x7fb8740b4e30 2023-06-22T10:54:11.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.391+0000 7fb87b3ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8741f63c0 con 0x7fb87415c720 2023-06-22T10:54:11.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.391+0000 7fb87b3ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8741f24d0 con 0x7fb8740d2830 2023-06-22T10:54:11.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.391+0000 7fb87919b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8740b4e30 0x7fb874158e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:11.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.391+0000 7fb87919b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8740b4e30 0x7fb874158e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52356/0 (socket says 172.21.15.40:52356) 2023-06-22T10:54:11.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.391+0000 7fb87919b700 1 -- 172.21.15.40:0/3896265482 learned_addr learned my addr 172.21.15.40:0/3896265482 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:11.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.392+0000 7fb87999c700 1 --2- 172.21.15.40:0/3896265482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb87415c720 0x7fb8741f5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:11.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.392+0000 7fb87899a700 1 --2- 172.21.15.40:0/3896265482 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fb8740d2830 0x7fb8741f1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:11.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.392+0000 7fb87919b700 1 -- 172.21.15.40:0/3896265482 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fb8740d2830 msgr2=0x7fb8741f1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:11.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.392+0000 7fb87919b700 1 --2- 172.21.15.40:0/3896265482 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fb8740d2830 0x7fb8741f1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:11.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.392+0000 7fb87919b700 1 -- 172.21.15.40:0/3896265482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb87415c720 msgr2=0x7fb8741f5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:11.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.392+0000 7fb87919b700 1 --2- 172.21.15.40:0/3896265482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb87415c720 0x7fb8741f5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:11.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.392+0000 7fb87919b700 1 -- 172.21.15.40:0/3896265482 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8700094a0 con 0x7fb8740b4e30 2023-06-22T10:54:11.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.392+0000 7fb87899a700 1 --2- 172.21.15.40:0/3896265482 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fb8740d2830 0x7fb8741f1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-22T10:54:11.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.392+0000 7fb87919b700 1 --2- 172.21.15.40:0/3896265482 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8740b4e30 0x7fb874158e70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb8700090b0 tx=0x7fb870004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:11.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.392+0000 7fb869ffb700 1 -- 172.21.15.40:0/3896265482 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb87001aa70 con 0x7fb8740b4e30 2023-06-22T10:54:11.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.392+0000 7fb869ffb700 1 -- 172.21.15.40:0/3896265482 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb87001abd0 con 0x7fb8740b4e30 2023-06-22T10:54:11.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.392+0000 7fb87b3ff700 1 -- 172.21.15.40:0/3896265482 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8741f27b0 con 0x7fb8740b4e30 2023-06-22T10:54:11.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.392+0000 7fb869ffb700 1 -- 172.21.15.40:0/3896265482 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8700243f0 con 0x7fb8740b4e30 2023-06-22T10:54:11.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.393+0000 7fb87b3ff700 1 -- 172.21.15.40:0/3896265482 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8741f2d70 con 0x7fb8740b4e30 2023-06-22T10:54:11.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.394+0000 7fb87b3ff700 1 -- 172.21.15.40:0/3896265482 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8740cca60 con 0x7fb8740b4e30 2023-06-22T10:54:11.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.394+0000 7fb869ffb700 1 -- 172.21.15.40:0/3896265482 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb870024550 con 0x7fb8740b4e30 2023-06-22T10:54:11.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.396+0000 7fb869ffb700 1 --2- 172.21.15.40:0/3896265482 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fb85806ace0 0x7fb85806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:11.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.396+0000 7fb869ffb700 1 -- 172.21.15.40:0/3896265482 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb87008ad40 con 0x7fb8740b4e30 2023-06-22T10:54:11.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.396+0000 7fb87899a700 1 --2- 172.21.15.40:0/3896265482 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fb85806ace0 0x7fb85806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:11.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.397+0000 7fb87899a700 1 --2- 172.21.15.40:0/3896265482 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fb85806ace0 0x7fb85806d190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb8740b7800 tx=0x7fb864009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:11.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.400+0000 7fb869ffb700 1 -- 172.21.15.40:0/3896265482 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb8740cca60 con 0x7fb8740b4e30 2023-06-22T10:54:11.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.609+0000 7fb87b3ff700 1 -- 172.21.15.40:0/3896265482 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb8740cca60 con 0x7fb8740b4e30 2023-06-22T10:54:11.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.611+0000 7fb869ffb700 1 -- 172.21.15.40:0/3896265482 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20036 (secure 0 0 0) 0x7fb8740cca60 con 0x7fb8740b4e30 2023-06-22T10:54:11.614 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:54:11.615 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":28,"fsid":"475560bc-1a7c-4a75-b3b6-6fc6b20bdc52","created":"2023-06-22T10:53:03.784568+0000","modified":"2023-06-22T10:53:36.483308+0000","last_up_change":"2023-06-22T10:53:17.830348+0000","last_in_change":"2023-06-22T10:53:07.329974+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-22T10:53:17.182228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-22T10:53:23.874432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-22T10:53:29.812963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-22T10:53:30.404021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-22T10:53:33.982289+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"918db6b4-053a-46ba-976d-6e1a0104017f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6809","nonce":2400162888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6811","nonce":2400162888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6815","nonce":2400162888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6813","nonce":2400162888}]},"public_addr":"172.21.15.40:6809/2400162888","cluster_addr":"172.21.15.40:6811/2400162888","heartbeat_back_addr":"172.21.15.40:6815/2400162888","heartbeat_front_addr":"172.21.15.40:6813/2400162888","state":["exists","up"]},{"osd":1,"uuid":"0c146e2b-1725-4dae-9b5c-38795943b9d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6801","nonce":230885800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6803","nonce":230885800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6807","nonce":230885800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6805","nonce":230885800}]},"public_addr":"172.21.15.40:6801/230885800","cluster_addr":"172.21.15.40:6803/230885800","heartbeat_back_addr":"172.21.15.40:6807/230885800","heartbeat_front_addr":"172.21.15.40:6805/230885800","state":["exists","up"]},{"osd":2,"uuid":"0b3727fd-f281-46d5-a675-86c8c5ab269e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6817","nonce":2681404929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6819","nonce":2681404929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6823","nonce":2681404929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6821","nonce":2681404929}]},"public_addr":"172.21.15.40:6817/2681404929","cluster_addr":"172.21.15.40:6819/2681404929","heartbeat_back_addr":"172.21.15.40:6823/2681404929","heartbeat_front_addr":"172.21.15.40:6821/2681404929","state":["exists","up"]},{"osd":3,"uuid":"2969c698-7039-4bbb-beda-f756f7a368a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6825","nonce":111110981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6827","nonce":111110981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6831","nonce":111110981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6829","nonce":111110981}]},"public_addr":"172.21.15.40:6825/111110981","cluster_addr":"172.21.15.40:6827/111110981","heartbeat_back_addr":"172.21.15.40:6831/111110981","heartbeat_front_addr":"172.21.15.40:6829/111110981","state":["exists","up"]},{"osd":4,"uuid":"3bb1d9c8-8e42-4a6b-998d-04834f34be5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6801","nonce":3625455711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6803","nonce":3625455711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6807","nonce":3625455711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6805","nonce":3625455711}]},"public_addr":"172.21.15.45:6801/3625455711","cluster_addr":"172.21.15.45:6803/3625455711","heartbeat_back_addr":"172.21.15.45:6807/3625455711","heartbeat_front_addr":"172.21.15.45:6805/3625455711","state":["exists","up"]},{"osd":5,"uuid":"f9854ee4-302c-41be-977b-bedda090a3d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6817","nonce":3354411217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6819","nonce":3354411217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6823","nonce":3354411217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6821","nonce":3354411217}]},"public_addr":"172.21.15.45:6817/3354411217","cluster_addr":"172.21.15.45:6819/3354411217","heartbeat_back_addr":"172.21.15.45:6823/3354411217","heartbeat_front_addr":"172.21.15.45:6821/3354411217","state":["exists","up"]},{"osd":6,"uuid":"bbdb1989-f6ac-4954-9b85-b8b540d683c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6809","nonce":320111074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6811","nonce":320111074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6815","nonce":320111074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6813","nonce":320111074}]},"public_addr":"172.21.15.45:6809/320111074","cluster_addr":"172.21.15.45:6811/320111074","heartbeat_back_addr":"172.21.15.45:6815/320111074","heartbeat_front_addr":"172.21.15.45:6813/320111074","state":["exists","up"]},{"osd":7,"uuid":"823d44e3-58f1-4d1d-8263-a4e4a69d4327","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6825","nonce":643617680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6827","nonce":643617680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6831","nonce":643617680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6829","nonce":643617680}]},"public_addr":"172.21.15.45:6825/643617680","cluster_addr":"172.21.15.45:6827/643617680","heartbeat_back_addr":"172.21.15.45:6831/643617680","heartbeat_front_addr":"172.21.15.45:6829/643617680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.731262+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.873226+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.898936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.666578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.645990+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.953699+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.642823+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.693395+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-22T10:54:11.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.613+0000 7fb87b3ff700 1 -- 172.21.15.40:0/3896265482 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fb85806ace0 msgr2=0x7fb85806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:11.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.613+0000 7fb87b3ff700 1 --2- 172.21.15.40:0/3896265482 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fb85806ace0 0x7fb85806d190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb8740b7800 tx=0x7fb864009040 comp rx=0 tx=0).stop 2023-06-22T10:54:11.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.613+0000 7fb87b3ff700 1 -- 172.21.15.40:0/3896265482 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8740b4e30 msgr2=0x7fb874158e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:11.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.613+0000 7fb87b3ff700 1 --2- 172.21.15.40:0/3896265482 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8740b4e30 0x7fb874158e70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb8700090b0 tx=0x7fb870004750 comp rx=0 tx=0).stop 2023-06-22T10:54:11.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.613+0000 7fb87b3ff700 1 -- 172.21.15.40:0/3896265482 shutdown_connections 2023-06-22T10:54:11.617 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.613+0000 7fb87b3ff700 1 --2- 172.21.15.40:0/3896265482 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fb85806ace0 0x7fb85806d190 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:11.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.613+0000 7fb87b3ff700 1 --2- 172.21.15.40:0/3896265482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb87415c720 0x7fb8741f5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:11.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.613+0000 7fb87b3ff700 1 --2- 172.21.15.40:0/3896265482 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8740b4e30 0x7fb874158e70 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:11.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.613+0000 7fb87b3ff700 1 --2- 172.21.15.40:0/3896265482 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fb8740d2830 0x7fb8741f1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:11.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.614+0000 7fb87b3ff700 1 -- 172.21.15.40:0/3896265482 >> 172.21.15.40:0/3896265482 conn(0x7fb8740cf720 msgr2=0x7fb87415b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:11.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.614+0000 7fb87b3ff700 1 -- 172.21.15.40:0/3896265482 shutdown_connections 2023-06-22T10:54:11.618 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.614+0000 7fb87b3ff700 1 -- 172.21.15.40:0/3896265482 wait complete. 2023-06-22T10:54:11.635 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-22T10:53:17.182228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-22T10:53:23.874432+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-22T10:53:29.812963+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-22T10:53:30.404021+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-22T10:53:33.982289+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-22T10:54:11.636 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-22T10:54:11.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.840+0000 7fd5ab3ff700 1 Processor -- start 2023-06-22T10:54:11.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.840+0000 7fd5ab3ff700 1 -- start start 2023-06-22T10:54:11.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.841+0000 7fd5ab3ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd5a40b45d0 0x7fd5a40b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:11.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.841+0000 7fd5ab3ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd5a40b59a0 0x7fd5a40b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:11.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.841+0000 7fd5ab3ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5a40d1be0 con 0x7fd5a40d2130 2023-06-22T10:54:11.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.841+0000 7fd5ab3ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5a40d17f0 con 0x7fd5a40b45d0 2023-06-22T10:54:11.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.841+0000 7fd5ab3ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a40d1360 con 0x7fd5a40b59a0 2023-06-22T10:54:11.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.841+0000 7fd5a899a700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd5a40d2130 0x7fd5a40cd1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:54172/0 (socket says 172.21.15.40:54172) 2023-06-22T10:54:11.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.841+0000 7fd5a899a700 1 -- 172.21.15.40:0/4242869211 learned_addr learned my addr 172.21.15.40:0/4242869211 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:11.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.841+0000 7fd5a919b700 1 --2- 172.21.15.40:0/4242869211 >> v2:172.21.15.45:3300/0 conn(0x7fd5a40b45d0 0x7fd5a40b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:11.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.842+0000 7fd5a999c700 1 --2- 172.21.15.40:0/4242869211 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd5a40b59a0 0x7fd5a40b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:11.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.842+0000 7fd59bfff700 1 -- 172.21.15.40:0/4242869211 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4207316038 0 0) 0x7fd5a40d1be0 con 0x7fd5a40d2130 2023-06-22T10:54:11.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.842+0000 7fd59bfff700 1 -- 172.21.15.40:0/4242869211 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5900035b0 con 0x7fd5a40d2130 2023-06-22T10:54:11.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.842+0000 7fd5a919b700 1 -- 172.21.15.40:0/4242869211 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd5a40b59a0 msgr2=0x7fd5a40b5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:11.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.842+0000 7fd5a919b700 1 --2- 172.21.15.40:0/4242869211 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd5a40b59a0 0x7fd5a40b5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:11.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.842+0000 7fd5a919b700 1 -- 172.21.15.40:0/4242869211 >> v1:172.21.15.40:6789/0 conn(0x7fd5a40d2130 legacy=0x7fd5a40cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:11.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.842+0000 7fd5a919b700 1 -- 172.21.15.40:0/4242869211 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a40b4ee0 con 0x7fd5a40b45d0 2023-06-22T10:54:11.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.842+0000 7fd5a919b700 1 --2- 172.21.15.40:0/4242869211 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5a40b45d0 0x7fd5a40b49a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd5a0009840 tx=0x7fd5a0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b77355a70c3197c server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:11.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.843+0000 7fd59bfff700 1 -- 172.21.15.40:0/4242869211 <== mon.1 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a0011830 con 0x7fd5a40b45d0 2023-06-22T10:54:11.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.843+0000 7fd59bfff700 1 -- 172.21.15.40:0/4242869211 <== mon.1 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a0011990 con 0x7fd5a40b45d0 2023-06-22T10:54:11.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.843+0000 7fd59bfff700 1 -- 172.21.15.40:0/4242869211 <== mon.1 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a0011d20 con 0x7fd5a40b45d0 2023-06-22T10:54:11.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.843+0000 7fd5ab3ff700 1 -- 172.21.15.40:0/4242869211 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5a40b45d0 msgr2=0x7fd5a40b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:11.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.843+0000 7fd5ab3ff700 1 --2- 172.21.15.40:0/4242869211 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5a40b45d0 0x7fd5a40b49a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd5a0009840 tx=0x7fd5a0009b50 comp rx=0 tx=0).stop 2023-06-22T10:54:11.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.843+0000 7fd5ab3ff700 1 -- 172.21.15.40:0/4242869211 shutdown_connections 2023-06-22T10:54:11.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.843+0000 7fd5ab3ff700 1 --2- 172.21.15.40:0/4242869211 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd5a40b59a0 0x7fd5a40b5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:11.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.843+0000 7fd5ab3ff700 1 --2- 172.21.15.40:0/4242869211 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5a40b45d0 0x7fd5a40b49a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:11.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.843+0000 7fd5ab3ff700 1 -- 172.21.15.40:0/4242869211 >> 172.21.15.40:0/4242869211 conn(0x7fd5a40cf5d0 msgr2=0x7fd5a40cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:11.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.843+0000 7fd5ab3ff700 1 -- 172.21.15.40:0/4242869211 shutdown_connections 2023-06-22T10:54:11.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.843+0000 7fd5ab3ff700 1 -- 172.21.15.40:0/4242869211 wait complete. 2023-06-22T10:54:11.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.845+0000 7fd5ab3ff700 1 Processor -- start 2023-06-22T10:54:11.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.845+0000 7fd5ab3ff700 1 -- start start 2023-06-22T10:54:11.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.846+0000 7fd5ab3ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5a40b45d0 0x7fd5a4156020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:11.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.846+0000 7fd5ab3ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5a40b59a0 0x7fd5a41f22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:11.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.846+0000 7fd5ab3ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd5a40d2130 0x7fd5a41538f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:11.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.846+0000 7fd5ab3ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a41f27e0 con 0x7fd5a40b59a0 2023-06-22T10:54:11.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.846+0000 7fd5ab3ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a41f17f0 con 0x7fd5a40b45d0 2023-06-22T10:54:11.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.846+0000 7fd5ab3ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a4153e30 con 0x7fd5a40d2130 2023-06-22T10:54:11.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.846+0000 7fd5a899a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5a40b59a0 0x7fd5a41f22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:11.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.846+0000 7fd5a899a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5a40b59a0 0x7fd5a41f22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52372/0 (socket says 172.21.15.40:52372) 2023-06-22T10:54:11.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.847+0000 7fd5a899a700 1 -- 172.21.15.40:0/2023413760 learned_addr learned my addr 172.21.15.40:0/2023413760 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:11.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.847+0000 7fd5a919b700 1 --2- 172.21.15.40:0/2023413760 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5a40b45d0 0x7fd5a4156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:11.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.847+0000 7fd5a999c700 1 --2- 172.21.15.40:0/2023413760 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd5a40d2130 0x7fd5a41538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:11.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.847+0000 7fd5a899a700 1 -- 172.21.15.40:0/2023413760 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd5a40d2130 msgr2=0x7fd5a41538f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:11.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.847+0000 7fd5a899a700 1 --2- 172.21.15.40:0/2023413760 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd5a40d2130 0x7fd5a41538f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:11.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.847+0000 7fd5a899a700 1 -- 172.21.15.40:0/2023413760 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5a40b45d0 msgr2=0x7fd5a4156020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:11.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.847+0000 7fd5a899a700 1 --2- 172.21.15.40:0/2023413760 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5a40b45d0 0x7fd5a4156020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:11.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.847+0000 7fd5a899a700 1 -- 172.21.15.40:0/2023413760 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a00094a0 con 0x7fd5a40b59a0 2023-06-22T10:54:11.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.847+0000 7fd5a899a700 1 --2- 172.21.15.40:0/2023413760 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5a40b59a0 0x7fd5a41f22a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd59400c700 tx=0x7fd59400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:11.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.847+0000 7fd599ffb700 1 -- 172.21.15.40:0/2023413760 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd594005d70 con 0x7fd5a40b59a0 2023-06-22T10:54:11.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.847+0000 7fd599ffb700 1 -- 172.21.15.40:0/2023413760 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5940070d0 con 0x7fd5a40b59a0 2023-06-22T10:54:11.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.847+0000 7fd5ab3ff700 1 -- 172.21.15.40:0/2023413760 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5a4156700 con 0x7fd5a40b59a0 2023-06-22T10:54:11.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.847+0000 7fd599ffb700 1 -- 172.21.15.40:0/2023413760 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd594007460 con 0x7fd5a40b59a0 2023-06-22T10:54:11.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.848+0000 7fd5ab3ff700 1 -- 172.21.15.40:0/2023413760 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5a41f1aa0 con 0x7fd5a40b59a0 2023-06-22T10:54:11.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.849+0000 7fd5ab3ff700 1 -- 172.21.15.40:0/2023413760 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5a4067580 con 0x7fd5a40b59a0 2023-06-22T10:54:11.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.849+0000 7fd599ffb700 1 -- 172.21.15.40:0/2023413760 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd5940075c0 con 0x7fd5a40b59a0 2023-06-22T10:54:11.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.851+0000 7fd599ffb700 1 --2- 172.21.15.40:0/2023413760 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fd58806ace0 0x7fd58806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:11.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.851+0000 7fd599ffb700 1 -- 172.21.15.40:0/2023413760 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd594088b70 con 0x7fd5a40b59a0 2023-06-22T10:54:11.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.851+0000 7fd5a919b700 1 --2- 172.21.15.40:0/2023413760 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fd58806ace0 0x7fd58806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:11.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.852+0000 7fd5a919b700 1 --2- 172.21.15.40:0/2023413760 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fd58806ace0 0x7fd58806d190 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd5a0000c00 tx=0x7fd5a001c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:11.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:11.855+0000 7fd599ffb700 1 -- 172.21.15.40:0/2023413760 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd594053980 con 0x7fd5a40b59a0 2023-06-22T10:54:12.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.072+0000 7fd5ab3ff700 1 -- 172.21.15.40:0/2023413760 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd5a40b7100 con 0x7fd5a40b59a0 2023-06-22T10:54:12.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.072+0000 7fd599ffb700 1 -- 172.21.15.40:0/2023413760 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd5940170a0 con 0x7fd5a40b59a0 2023-06-22T10:54:12.076 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-06-22T10:54:12.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.074+0000 7fd5ab3ff700 1 -- 172.21.15.40:0/2023413760 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fd58806ace0 msgr2=0x7fd58806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:12.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.074+0000 7fd5ab3ff700 1 --2- 172.21.15.40:0/2023413760 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fd58806ace0 0x7fd58806d190 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd5a0000c00 tx=0x7fd5a001c040 comp rx=0 tx=0).stop 2023-06-22T10:54:12.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.074+0000 7fd5ab3ff700 1 -- 172.21.15.40:0/2023413760 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5a40b59a0 msgr2=0x7fd5a41f22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:12.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.074+0000 7fd5ab3ff700 1 --2- 172.21.15.40:0/2023413760 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5a40b59a0 0x7fd5a41f22a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd59400c700 tx=0x7fd59400ca10 comp rx=0 tx=0).stop 2023-06-22T10:54:12.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.074+0000 7fd5ab3ff700 1 -- 172.21.15.40:0/2023413760 shutdown_connections 2023-06-22T10:54:12.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.074+0000 7fd5ab3ff700 1 --2- 172.21.15.40:0/2023413760 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fd58806ace0 0x7fd58806d190 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:12.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.074+0000 7fd5ab3ff700 1 --2- 172.21.15.40:0/2023413760 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd5a40d2130 0x7fd5a41538f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:12.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.074+0000 7fd5ab3ff700 1 --2- 172.21.15.40:0/2023413760 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5a40b45d0 0x7fd5a4156020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:12.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.074+0000 7fd5ab3ff700 1 --2- 172.21.15.40:0/2023413760 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5a40b59a0 0x7fd5a41f22a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:12.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.074+0000 7fd5ab3ff700 1 -- 172.21.15.40:0/2023413760 >> 172.21.15.40:0/2023413760 conn(0x7fd5a40cf5d0 msgr2=0x7fd5a40ccd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:12.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.074+0000 7fd5ab3ff700 1 -- 172.21.15.40:0/2023413760 shutdown_connections 2023-06-22T10:54:12.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.075+0000 7fd5ab3ff700 1 -- 172.21.15.40:0/2023413760 wait complete. 2023-06-22T10:54:12.096 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-22T10:54:12.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.297+0000 7f1f93fff700 1 Processor -- start 2023-06-22T10:54:12.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.298+0000 7f1f93fff700 1 -- start start 2023-06-22T10:54:12.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.299+0000 7f1f93fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1f8c0b45d0 0x7f1f8c0b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:12.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.299+0000 7f1f93fff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1f8c0d2130 0x7f1f8c0cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:12.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.299+0000 7f1f93fff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f8c0d1be0 con 0x7f1f8c0cd6e0 2023-06-22T10:54:12.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.299+0000 7f1f93fff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f8c0d17f0 con 0x7f1f8c0b45d0 2023-06-22T10:54:12.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.299+0000 7f1f93fff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8c0d1360 con 0x7f1f8c0d2130 2023-06-22T10:54:12.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.299+0000 7f1f9259c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f1f8c0cd6e0 0x7f1f8c0b59a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:54186/0 (socket says 172.21.15.40:54186) 2023-06-22T10:54:12.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.299+0000 7f1f9259c700 1 -- 172.21.15.40:0/1194968361 learned_addr learned my addr 172.21.15.40:0/1194968361 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:12.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.299+0000 7f1f9159a700 1 --2- 172.21.15.40:0/1194968361 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1f8c0d2130 0x7f1f8c0cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:12.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.299+0000 7f1f91d9b700 1 --2- 172.21.15.40:0/1194968361 >> v2:172.21.15.45:3300/0 conn(0x7f1f8c0b45d0 0x7f1f8c0b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:12.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.300+0000 7f1f90d99700 1 -- 172.21.15.40:0/1194968361 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4085104323 0 0) 0x7f1f8c0d1be0 con 0x7f1f8c0cd6e0 2023-06-22T10:54:12.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.300+0000 7f1f90d99700 1 -- 172.21.15.40:0/1194968361 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f780035b0 con 0x7f1f8c0cd6e0 2023-06-22T10:54:12.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.300+0000 7f1f91d9b700 1 -- 172.21.15.40:0/1194968361 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1f8c0d2130 msgr2=0x7f1f8c0cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:12.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.300+0000 7f1f91d9b700 1 --2- 172.21.15.40:0/1194968361 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1f8c0d2130 0x7f1f8c0cd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:12.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.300+0000 7f1f91d9b700 1 -- 172.21.15.40:0/1194968361 >> v1:172.21.15.40:6789/0 conn(0x7f1f8c0cd6e0 legacy=0x7f1f8c0b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:12.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.300+0000 7f1f91d9b700 1 -- 172.21.15.40:0/1194968361 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f8c0b4ee0 con 0x7f1f8c0b45d0 2023-06-22T10:54:12.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.300+0000 7f1f9159a700 1 --2- 172.21.15.40:0/1194968361 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1f8c0d2130 0x7f1f8c0cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-22T10:54:12.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.300+0000 7f1f91d9b700 1 --2- 172.21.15.40:0/1194968361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f8c0b45d0 0x7f1f8c0b49a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1f88009840 tx=0x7f1f88009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c5c120c0fda5e54 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:12.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.300+0000 7f1f90d99700 1 -- 172.21.15.40:0/1194968361 <== mon.1 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f88011830 con 0x7f1f8c0b45d0 2023-06-22T10:54:12.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.301+0000 7f1f90d99700 1 -- 172.21.15.40:0/1194968361 <== mon.1 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f88011990 con 0x7f1f8c0b45d0 2023-06-22T10:54:12.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.301+0000 7f1f90d99700 1 -- 172.21.15.40:0/1194968361 <== mon.1 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f88011d00 con 0x7f1f8c0b45d0 2023-06-22T10:54:12.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.301+0000 7f1f93fff700 1 -- 172.21.15.40:0/1194968361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f8c0b45d0 msgr2=0x7f1f8c0b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:12.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.301+0000 7f1f93fff700 1 --2- 172.21.15.40:0/1194968361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f8c0b45d0 0x7f1f8c0b49a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1f88009840 tx=0x7f1f88009b50 comp rx=0 tx=0).stop 2023-06-22T10:54:12.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.301+0000 7f1f93fff700 1 -- 172.21.15.40:0/1194968361 shutdown_connections 2023-06-22T10:54:12.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.301+0000 7f1f93fff700 1 --2- 172.21.15.40:0/1194968361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f8c0b45d0 0x7f1f8c0b49a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:12.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.301+0000 7f1f93fff700 1 --2- 172.21.15.40:0/1194968361 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1f8c0d2130 0x7f1f8c0cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:12.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.301+0000 7f1f93fff700 1 -- 172.21.15.40:0/1194968361 >> 172.21.15.40:0/1194968361 conn(0x7f1f8c0cf5d0 msgr2=0x7f1f8c0cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:12.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.301+0000 7f1f93fff700 1 -- 172.21.15.40:0/1194968361 shutdown_connections 2023-06-22T10:54:12.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.301+0000 7f1f93fff700 1 -- 172.21.15.40:0/1194968361 wait complete. 2023-06-22T10:54:12.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.303+0000 7f1f93fff700 1 Processor -- start 2023-06-22T10:54:12.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.303+0000 7f1f93fff700 1 -- start start 2023-06-22T10:54:12.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.304+0000 7f1f93fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f8c0b45d0 0x7f1f8c0c81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:12.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.304+0000 7f1f93fff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1f8c0cd6e0 0x7f1f8c1f5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:12.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.304+0000 7f1f93fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f8c0d2130 0x7f1f8c0c6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:12.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.304+0000 7f1f93fff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8c0c8890 con 0x7f1f8c0b45d0 2023-06-22T10:54:12.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.304+0000 7f1f93fff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8c0c8b70 con 0x7f1f8c0d2130 2023-06-22T10:54:12.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.304+0000 7f1f93fff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8c0c8e50 con 0x7f1f8c0cd6e0 2023-06-22T10:54:12.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.304+0000 7f1f91d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f8c0b45d0 0x7f1f8c0c81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:12.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.304+0000 7f1f91d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f8c0b45d0 0x7f1f8c0c81f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52380/0 (socket says 172.21.15.40:52380) 2023-06-22T10:54:12.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.304+0000 7f1f91d9b700 1 -- 172.21.15.40:0/2485165491 learned_addr learned my addr 172.21.15.40:0/2485165491 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:12.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.304+0000 7f1f9159a700 1 --2- 172.21.15.40:0/2485165491 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1f8c0cd6e0 0x7f1f8c1f5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:12.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.304+0000 7f1f9259c700 1 --2- 172.21.15.40:0/2485165491 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f8c0d2130 0x7f1f8c0c6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:12.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.305+0000 7f1f91d9b700 1 -- 172.21.15.40:0/2485165491 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1f8c0cd6e0 msgr2=0x7f1f8c1f5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:12.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.305+0000 7f1f91d9b700 1 --2- 172.21.15.40:0/2485165491 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1f8c0cd6e0 0x7f1f8c1f5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:12.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.305+0000 7f1f91d9b700 1 -- 172.21.15.40:0/2485165491 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f8c0d2130 msgr2=0x7f1f8c0c6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:12.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.305+0000 7f1f91d9b700 1 --2- 172.21.15.40:0/2485165491 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f8c0d2130 0x7f1f8c0c6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:12.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.305+0000 7f1f91d9b700 1 -- 172.21.15.40:0/2485165491 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f7c0094a0 con 0x7f1f8c0b45d0 2023-06-22T10:54:12.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.305+0000 7f1f91d9b700 1 --2- 172.21.15.40:0/2485165491 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f8c0b45d0 0x7f1f8c0c81f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1f880090b0 tx=0x7f1f88004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:12.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.305+0000 7f1f827fc700 1 -- 172.21.15.40:0/2485165491 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f88004550 con 0x7f1f8c0b45d0 2023-06-22T10:54:12.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.305+0000 7f1f827fc700 1 -- 172.21.15.40:0/2485165491 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f8801e070 con 0x7f1f8c0b45d0 2023-06-22T10:54:12.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.305+0000 7f1f93fff700 1 -- 172.21.15.40:0/2485165491 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f880094a0 con 0x7f1f8c0b45d0 2023-06-22T10:54:12.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.305+0000 7f1f827fc700 1 -- 172.21.15.40:0/2485165491 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f880038a0 con 0x7f1f8c0b45d0 2023-06-22T10:54:12.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.305+0000 7f1f93fff700 1 -- 172.21.15.40:0/2485165491 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f8c0c9410 con 0x7f1f8c0b45d0 2023-06-22T10:54:12.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.306+0000 7f1f93fff700 1 -- 172.21.15.40:0/2485165491 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f8c067580 con 0x7f1f8c0b45d0 2023-06-22T10:54:12.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.307+0000 7f1f827fc700 1 -- 172.21.15.40:0/2485165491 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1f88003a00 con 0x7f1f8c0b45d0 2023-06-22T10:54:12.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.308+0000 7f1f827fc700 1 --2- 172.21.15.40:0/2485165491 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f1f7006ace0 0x7f1f7006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:12.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.309+0000 7f1f827fc700 1 -- 172.21.15.40:0/2485165491 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1f8808a630 con 0x7f1f8c0b45d0 2023-06-22T10:54:12.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.309+0000 7f1f9159a700 1 --2- 172.21.15.40:0/2485165491 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f1f7006ace0 0x7f1f7006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:12.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.309+0000 7f1f9159a700 1 --2- 172.21.15.40:0/2485165491 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f1f7006ace0 0x7f1f7006d190 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c0cd1e0 tx=0x7f1f7c009210 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:12.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.313+0000 7f1f827fc700 1 -- 172.21.15.40:0/2485165491 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1f88055440 con 0x7f1f8c0b45d0 2023-06-22T10:54:12.521 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.518+0000 7f1f93fff700 1 -- 172.21.15.40:0/2485165491 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1f8c0ce3c0 con 0x7f1f8c0b45d0 2023-06-22T10:54:12.522 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.519+0000 7f1f827fc700 1 -- 172.21.15.40:0/2485165491 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1f88003cb0 con 0x7f1f8c0b45d0 2023-06-22T10:54:12.522 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 8 2023-06-22T10:54:12.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.521+0000 7f1f93fff700 1 -- 172.21.15.40:0/2485165491 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f1f7006ace0 msgr2=0x7f1f7006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:12.524 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.521+0000 7f1f93fff700 1 --2- 172.21.15.40:0/2485165491 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f1f7006ace0 0x7f1f7006d190 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c0cd1e0 tx=0x7f1f7c009210 comp rx=0 tx=0).stop 2023-06-22T10:54:12.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.521+0000 7f1f93fff700 1 -- 172.21.15.40:0/2485165491 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f8c0b45d0 msgr2=0x7f1f8c0c81f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:12.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.521+0000 7f1f93fff700 1 --2- 172.21.15.40:0/2485165491 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f8c0b45d0 0x7f1f8c0c81f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1f880090b0 tx=0x7f1f88004750 comp rx=0 tx=0).stop 2023-06-22T10:54:12.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.521+0000 7f1f93fff700 1 -- 172.21.15.40:0/2485165491 shutdown_connections 2023-06-22T10:54:12.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.521+0000 7f1f93fff700 1 --2- 172.21.15.40:0/2485165491 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f1f7006ace0 0x7f1f7006d190 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:12.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.521+0000 7f1f93fff700 1 --2- 172.21.15.40:0/2485165491 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f8c0d2130 0x7f1f8c0c6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:12.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.521+0000 7f1f93fff700 1 --2- 172.21.15.40:0/2485165491 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f8c0b45d0 0x7f1f8c0c81f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:12.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.521+0000 7f1f93fff700 1 --2- 172.21.15.40:0/2485165491 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1f8c0cd6e0 0x7f1f8c1f5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:12.525 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.521+0000 7f1f93fff700 1 -- 172.21.15.40:0/2485165491 >> 172.21.15.40:0/2485165491 conn(0x7f1f8c0cf5d0 msgr2=0x7f1f8c0b3e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:12.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.521+0000 7f1f93fff700 1 -- 172.21.15.40:0/2485165491 shutdown_connections 2023-06-22T10:54:12.526 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.521+0000 7f1f93fff700 1 -- 172.21.15.40:0/2485165491 wait complete. 2023-06-22T10:54:12.542 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-22T10:54:12.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.744+0000 7f92cfdff700 1 Processor -- start 2023-06-22T10:54:12.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.744+0000 7f92cfdff700 1 -- start start 2023-06-22T10:54:12.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.746+0000 7f92cfdff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f92c80b45d0 0x7f92c80b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:12.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.746+0000 7f92cfdff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f92c80b59a0 0x7f92c80b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:12.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.746+0000 7f92cfdff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92c80d1be0 con 0x7f92c80d2130 2023-06-22T10:54:12.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.746+0000 7f92cfdff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92c80d17f0 con 0x7f92c80b59a0 2023-06-22T10:54:12.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.746+0000 7f92cfdff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92c80d1360 con 0x7f92c80b45d0 2023-06-22T10:54:12.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.746+0000 7f92cd39a700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f92c80d2130 0x7f92c80cd1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:54200/0 (socket says 172.21.15.40:54200) 2023-06-22T10:54:12.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.746+0000 7f92cd39a700 1 -- 172.21.15.40:0/1689007281 learned_addr learned my addr 172.21.15.40:0/1689007281 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:12.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.746+0000 7f92ce39c700 1 --2- 172.21.15.40:0/1689007281 >> v2:172.21.15.40:3300/0 conn(0x7f92c80b59a0 0x7f92c80b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:12.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.747+0000 7f92cdb9b700 1 --2- 172.21.15.40:0/1689007281 >> v2:172.21.15.45:3300/0 conn(0x7f92c80b45d0 0x7f92c80b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:12.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.747+0000 7f92ccb99700 1 -- 172.21.15.40:0/1689007281 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3432198169 0 0) 0x7f92c80d1be0 con 0x7f92c80d2130 2023-06-22T10:54:12.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.747+0000 7f92ccb99700 1 -- 172.21.15.40:0/1689007281 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92b40035b0 con 0x7f92c80d2130 2023-06-22T10:54:12.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.747+0000 7f92ce39c700 1 -- 172.21.15.40:0/1689007281 >> v2:172.21.15.45:3300/0 conn(0x7f92c80b45d0 msgr2=0x7f92c80b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:12.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.747+0000 7f92ce39c700 1 --2- 172.21.15.40:0/1689007281 >> v2:172.21.15.45:3300/0 conn(0x7f92c80b45d0 0x7f92c80b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:12.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.747+0000 7f92ce39c700 1 -- 172.21.15.40:0/1689007281 >> v1:172.21.15.40:6789/0 conn(0x7f92c80d2130 legacy=0x7f92c80cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:12.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.747+0000 7f92ce39c700 1 -- 172.21.15.40:0/1689007281 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c80b4ee0 con 0x7f92c80b59a0 2023-06-22T10:54:12.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.747+0000 7f92ce39c700 1 --2- 172.21.15.40:0/1689007281 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92c80b59a0 0x7f92c80b5e40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f92c80668f0 tx=0x7f92c000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=233847e4fb0f9e9f server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:12.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.747+0000 7f92ccb99700 1 -- 172.21.15.40:0/1689007281 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c000e070 con 0x7f92c80b59a0 2023-06-22T10:54:12.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.747+0000 7f92ccb99700 1 -- 172.21.15.40:0/1689007281 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c000bb20 con 0x7f92c80b59a0 2023-06-22T10:54:12.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.747+0000 7f92ccb99700 1 -- 172.21.15.40:0/1689007281 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c0012430 con 0x7f92c80b59a0 2023-06-22T10:54:12.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.748+0000 7f92cfdff700 1 -- 172.21.15.40:0/1689007281 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92c80b59a0 msgr2=0x7f92c80b5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:12.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.748+0000 7f92cfdff700 1 --2- 172.21.15.40:0/1689007281 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92c80b59a0 0x7f92c80b5e40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f92c80668f0 tx=0x7f92c000b330 comp rx=0 tx=0).stop 2023-06-22T10:54:12.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.748+0000 7f92cfdff700 1 -- 172.21.15.40:0/1689007281 shutdown_connections 2023-06-22T10:54:12.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.748+0000 7f92cfdff700 1 --2- 172.21.15.40:0/1689007281 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92c80b59a0 0x7f92c80b5e40 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:12.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.748+0000 7f92cfdff700 1 --2- 172.21.15.40:0/1689007281 >> v2:172.21.15.45:3300/0 conn(0x7f92c80b45d0 0x7f92c80b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:12.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.748+0000 7f92cfdff700 1 -- 172.21.15.40:0/1689007281 >> 172.21.15.40:0/1689007281 conn(0x7f92c80cf5d0 msgr2=0x7f92c80cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:12.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.748+0000 7f92cfdff700 1 -- 172.21.15.40:0/1689007281 shutdown_connections 2023-06-22T10:54:12.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.748+0000 7f92cfdff700 1 -- 172.21.15.40:0/1689007281 wait complete. 2023-06-22T10:54:12.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.750+0000 7f92cfdff700 1 Processor -- start 2023-06-22T10:54:12.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.750+0000 7f92cfdff700 1 -- start start 2023-06-22T10:54:12.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.751+0000 7f92cfdff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92c80b45d0 0x7f92c815b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:12.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.751+0000 7f92cfdff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f92c80b59a0 0x7f92c80aa490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:12.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.751+0000 7f92cfdff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92c80d2130 0x7f92c81f52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:12.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.751+0000 7f92cfdff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c81f5d30 con 0x7f92c80d2130 2023-06-22T10:54:12.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.751+0000 7f92cfdff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c81f6010 con 0x7f92c80b45d0 2023-06-22T10:54:12.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.751+0000 7f92cfdff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c80a9c90 con 0x7f92c80b59a0 2023-06-22T10:54:12.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.751+0000 7f92ce39c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92c80d2130 0x7f92c81f52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:12.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.751+0000 7f92ce39c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92c80d2130 0x7f92c81f52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52398/0 (socket says 172.21.15.40:52398) 2023-06-22T10:54:12.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.751+0000 7f92ce39c700 1 -- 172.21.15.40:0/892670707 learned_addr learned my addr 172.21.15.40:0/892670707 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:12.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.751+0000 7f92cdb9b700 1 --2- 172.21.15.40:0/892670707 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92c80b45d0 0x7f92c815b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:12.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.751+0000 7f92cd39a700 1 --2- 172.21.15.40:0/892670707 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f92c80b59a0 0x7f92c80aa490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:12.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.751+0000 7f92ce39c700 1 -- 172.21.15.40:0/892670707 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f92c80b59a0 msgr2=0x7f92c80aa490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:12.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.751+0000 7f92ce39c700 1 --2- 172.21.15.40:0/892670707 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f92c80b59a0 0x7f92c80aa490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:12.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.751+0000 7f92ce39c700 1 -- 172.21.15.40:0/892670707 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92c80b45d0 msgr2=0x7f92c815b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:12.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.751+0000 7f92ce39c700 1 --2- 172.21.15.40:0/892670707 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92c80b45d0 0x7f92c815b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:12.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.752+0000 7f92ce39c700 1 -- 172.21.15.40:0/892670707 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c0009a70 con 0x7f92c80d2130 2023-06-22T10:54:12.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.752+0000 7f92cd39a700 1 --2- 172.21.15.40:0/892670707 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f92c80b59a0 0x7f92c80aa490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-22T10:54:12.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.752+0000 7f92ce39c700 1 --2- 172.21.15.40:0/892670707 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92c80d2130 0x7f92c81f52b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f92c000b370 tx=0x7f92c0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:12.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.752+0000 7f92be7fc700 1 -- 172.21.15.40:0/892670707 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c0012430 con 0x7f92c80d2130 2023-06-22T10:54:12.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.752+0000 7f92be7fc700 1 -- 172.21.15.40:0/892670707 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c0020070 con 0x7f92c80d2130 2023-06-22T10:54:12.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.752+0000 7f92be7fc700 1 -- 172.21.15.40:0/892670707 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c0004280 con 0x7f92c80d2130 2023-06-22T10:54:12.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.752+0000 7f92cfdff700 1 -- 172.21.15.40:0/892670707 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92c80a9f70 con 0x7f92c80d2130 2023-06-22T10:54:12.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.752+0000 7f92cfdff700 1 -- 172.21.15.40:0/892670707 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92c815b740 con 0x7f92c80d2130 2023-06-22T10:54:12.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.753+0000 7f92cfdff700 1 -- 172.21.15.40:0/892670707 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92c8067580 con 0x7f92c80d2130 2023-06-22T10:54:12.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.754+0000 7f92be7fc700 1 -- 172.21.15.40:0/892670707 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f92c00043e0 con 0x7f92c80d2130 2023-06-22T10:54:12.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.756+0000 7f92be7fc700 1 --2- 172.21.15.40:0/892670707 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f92ac06ace0 0x7f92ac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:12.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.756+0000 7f92be7fc700 1 -- 172.21.15.40:0/892670707 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f92c0022070 con 0x7f92c80d2130 2023-06-22T10:54:12.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.756+0000 7f92cdb9b700 1 --2- 172.21.15.40:0/892670707 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f92ac06ace0 0x7f92ac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:12.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.757+0000 7f92cdb9b700 1 --2- 172.21.15.40:0/892670707 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f92ac06ace0 0x7f92ac06d190 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f92c4009ad0 tx=0x7f92c4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:12.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.760+0000 7f92be7fc700 1 -- 172.21.15.40:0/892670707 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f92c0056270 con 0x7f92c80d2130 2023-06-22T10:54:12.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.970+0000 7f92cfdff700 1 -- 172.21.15.40:0/892670707 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f92c80b3110 con 0x7f92c80d2130 2023-06-22T10:54:12.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.970+0000 7f92be7fc700 1 -- 172.21.15.40:0/892670707 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7f92c0059890 con 0x7f92c80d2130 2023-06-22T10:54:12.974 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-06-22T10:54:12.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.972+0000 7f92cfdff700 1 -- 172.21.15.40:0/892670707 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f92ac06ace0 msgr2=0x7f92ac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:12.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.972+0000 7f92cfdff700 1 --2- 172.21.15.40:0/892670707 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f92ac06ace0 0x7f92ac06d190 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f92c4009ad0 tx=0x7f92c4008040 comp rx=0 tx=0).stop 2023-06-22T10:54:12.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.973+0000 7f92cfdff700 1 -- 172.21.15.40:0/892670707 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92c80d2130 msgr2=0x7f92c81f52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:12.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.973+0000 7f92cfdff700 1 --2- 172.21.15.40:0/892670707 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92c80d2130 0x7f92c81f52b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f92c000b370 tx=0x7f92c0004ad0 comp rx=0 tx=0).stop 2023-06-22T10:54:12.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.973+0000 7f92cfdff700 1 -- 172.21.15.40:0/892670707 shutdown_connections 2023-06-22T10:54:12.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.973+0000 7f92cfdff700 1 --2- 172.21.15.40:0/892670707 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f92ac06ace0 0x7f92ac06d190 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:12.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.973+0000 7f92cfdff700 1 --2- 172.21.15.40:0/892670707 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92c80d2130 0x7f92c81f52b0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:12.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.973+0000 7f92cfdff700 1 --2- 172.21.15.40:0/892670707 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92c80b45d0 0x7f92c815b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:12.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.973+0000 7f92cfdff700 1 --2- 172.21.15.40:0/892670707 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f92c80b59a0 0x7f92c80aa490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:12.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.973+0000 7f92cfdff700 1 -- 172.21.15.40:0/892670707 >> 172.21.15.40:0/892670707 conn(0x7f92c80cf5d0 msgr2=0x7f92c80cbc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:12.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.973+0000 7f92cfdff700 1 -- 172.21.15.40:0/892670707 shutdown_connections 2023-06-22T10:54:12.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:12.973+0000 7f92cfdff700 1 -- 172.21.15.40:0/892670707 wait complete. 2023-06-22T10:54:12.994 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-22T10:54:13.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.197+0000 7f816e5ff700 1 Processor -- start 2023-06-22T10:54:13.201 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.197+0000 7f816e5ff700 1 -- start start 2023-06-22T10:54:13.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.198+0000 7f816e5ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f81680b45d0 0x7f81680b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:13.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.198+0000 7f816e5ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f81680b59a0 0x7f81680b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:13.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.198+0000 7f816e5ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81680d1be0 con 0x7f81680d2130 2023-06-22T10:54:13.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.198+0000 7f816e5ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81680d17f0 con 0x7f81680b45d0 2023-06-22T10:54:13.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.198+0000 7f816e5ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81680d1360 con 0x7f81680b59a0 2023-06-22T10:54:13.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.199+0000 7f81677fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f81680d2130 0x7f81680cd1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:54206/0 (socket says 172.21.15.40:54206) 2023-06-22T10:54:13.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.199+0000 7f81677fe700 1 -- 172.21.15.40:0/42231606 learned_addr learned my addr 172.21.15.40:0/42231606 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:13.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.199+0000 7f8167fff700 1 --2- 172.21.15.40:0/42231606 >> v2:172.21.15.40:3300/0 conn(0x7f81680b45d0 0x7f81680b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:13.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.199+0000 7f816cb9c700 1 --2- 172.21.15.40:0/42231606 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f81680b59a0 0x7f81680b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:13.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.199+0000 7f8166ffd700 1 -- 172.21.15.40:0/42231606 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3558114299 0 0) 0x7f81680d1be0 con 0x7f81680d2130 2023-06-22T10:54:13.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.199+0000 7f8167fff700 1 -- 172.21.15.40:0/42231606 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f81680b59a0 msgr2=0x7f81680b5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:13.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.199+0000 7f8167fff700 1 --2- 172.21.15.40:0/42231606 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f81680b59a0 0x7f81680b5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:13.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.199+0000 7f8167fff700 1 -- 172.21.15.40:0/42231606 >> v1:172.21.15.40:6789/0 conn(0x7f81680d2130 legacy=0x7f81680cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:13.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.199+0000 7f8167fff700 1 -- 172.21.15.40:0/42231606 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81680b4ee0 con 0x7f81680b45d0 2023-06-22T10:54:13.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.199+0000 7f8167fff700 1 --2- 172.21.15.40:0/42231606 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81680b45d0 0x7f81680b49a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8158009840 tx=0x7f8158009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a0a5e81555cf8e4 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:13.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.200+0000 7f8166ffd700 1 -- 172.21.15.40:0/42231606 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8158011830 con 0x7f81680b45d0 2023-06-22T10:54:13.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.200+0000 7f8166ffd700 1 -- 172.21.15.40:0/42231606 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8158011990 con 0x7f81680b45d0 2023-06-22T10:54:13.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.200+0000 7f8166ffd700 1 -- 172.21.15.40:0/42231606 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8158011d20 con 0x7f81680b45d0 2023-06-22T10:54:13.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.200+0000 7f816e5ff700 1 -- 172.21.15.40:0/42231606 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81680b45d0 msgr2=0x7f81680b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:13.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.200+0000 7f816e5ff700 1 --2- 172.21.15.40:0/42231606 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81680b45d0 0x7f81680b49a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8158009840 tx=0x7f8158009b50 comp rx=0 tx=0).stop 2023-06-22T10:54:13.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.200+0000 7f816e5ff700 1 -- 172.21.15.40:0/42231606 shutdown_connections 2023-06-22T10:54:13.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.200+0000 7f816e5ff700 1 --2- 172.21.15.40:0/42231606 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f81680b59a0 0x7f81680b5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:13.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.200+0000 7f816e5ff700 1 --2- 172.21.15.40:0/42231606 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81680b45d0 0x7f81680b49a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:13.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.200+0000 7f816e5ff700 1 -- 172.21.15.40:0/42231606 >> 172.21.15.40:0/42231606 conn(0x7f81680cf5d0 msgr2=0x7f81680cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:13.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.200+0000 7f816e5ff700 1 -- 172.21.15.40:0/42231606 shutdown_connections 2023-06-22T10:54:13.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.200+0000 7f816e5ff700 1 -- 172.21.15.40:0/42231606 wait complete. 2023-06-22T10:54:13.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.202+0000 7f816e5ff700 1 Processor -- start 2023-06-22T10:54:13.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.202+0000 7f816e5ff700 1 -- start start 2023-06-22T10:54:13.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.203+0000 7f816e5ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81680b45d0 0x7f8168158f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:13.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.203+0000 7f816e5ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f81680b59a0 0x7f816815c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:13.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.203+0000 7f816e5ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81680d2130 0x7f81680b38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:13.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.203+0000 7f816e5ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f816815dc30 con 0x7f81680b45d0 2023-06-22T10:54:13.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.203+0000 7f816e5ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f816815cfd0 con 0x7f81680d2130 2023-06-22T10:54:13.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.203+0000 7f816e5ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f816815d2b0 con 0x7f81680b59a0 2023-06-22T10:54:13.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.203+0000 7f8167fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81680b45d0 0x7f8168158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:13.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.204+0000 7f8167fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81680b45d0 0x7f8168158f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52428/0 (socket says 172.21.15.40:52428) 2023-06-22T10:54:13.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.204+0000 7f8167fff700 1 -- 172.21.15.40:0/1460222720 learned_addr learned my addr 172.21.15.40:0/1460222720 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:13.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.204+0000 7f8167fff700 1 -- 172.21.15.40:0/1460222720 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f81680b59a0 msgr2=0x7f816815c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:13.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.204+0000 7f8167fff700 1 --2- 172.21.15.40:0/1460222720 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f81680b59a0 0x7f816815c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:13.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.204+0000 7f8167fff700 1 -- 172.21.15.40:0/1460222720 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81680d2130 msgr2=0x7f81680b38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:13.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.204+0000 7f8167fff700 1 --2- 172.21.15.40:0/1460222720 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81680d2130 0x7f81680b38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:13.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.204+0000 7f8167fff700 1 -- 172.21.15.40:0/1460222720 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81580094a0 con 0x7f81680b45d0 2023-06-22T10:54:13.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.204+0000 7f8167fff700 1 --2- 172.21.15.40:0/1460222720 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81680b45d0 0x7f8168158f00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8158000c00 tx=0x7f8158004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:13.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.204+0000 7f8164ff9700 1 -- 172.21.15.40:0/1460222720 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81580036a0 con 0x7f81680b45d0 2023-06-22T10:54:13.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.204+0000 7f8164ff9700 1 -- 172.21.15.40:0/1460222720 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f815801e070 con 0x7f81680b45d0 2023-06-22T10:54:13.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.204+0000 7f816e5ff700 1 -- 172.21.15.40:0/1460222720 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f816815d590 con 0x7f81680b45d0 2023-06-22T10:54:13.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.204+0000 7f8164ff9700 1 -- 172.21.15.40:0/1460222720 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8158003a60 con 0x7f81680b45d0 2023-06-22T10:54:13.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.205+0000 7f816e5ff700 1 -- 172.21.15.40:0/1460222720 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8168159440 con 0x7f81680b45d0 2023-06-22T10:54:13.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.206+0000 7f816e5ff700 1 -- 172.21.15.40:0/1460222720 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8168067580 con 0x7f81680b45d0 2023-06-22T10:54:13.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.206+0000 7f8164ff9700 1 -- 172.21.15.40:0/1460222720 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8158003bc0 con 0x7f81680b45d0 2023-06-22T10:54:13.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.207+0000 7f8164ff9700 1 --2- 172.21.15.40:0/1460222720 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f815406ace0 0x7f815406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:13.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.208+0000 7f8164ff9700 1 -- 172.21.15.40:0/1460222720 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f815808a8b0 con 0x7f81680b45d0 2023-06-22T10:54:13.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.208+0000 7f81677fe700 1 --2- 172.21.15.40:0/1460222720 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f815406ace0 0x7f815406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:13.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.208+0000 7f81677fe700 1 --2- 172.21.15.40:0/1460222720 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f815406ace0 0x7f815406d190 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f815c0011e0 tx=0x7f815c0079b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:13.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.212+0000 7f8164ff9700 1 -- 172.21.15.40:0/1460222720 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8158055620 con 0x7f81680b45d0 2023-06-22T10:54:13.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.419+0000 7f816e5ff700 1 -- 172.21.15.40:0/1460222720 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f81680b51a0 con 0x7f81680b45d0 2023-06-22T10:54:13.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.420+0000 7f8164ff9700 1 -- 172.21.15.40:0/1460222720 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8158058c40 con 0x7f81680b45d0 2023-06-22T10:54:13.423 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-06-22T10:54:13.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.422+0000 7f816e5ff700 1 -- 172.21.15.40:0/1460222720 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f815406ace0 msgr2=0x7f815406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:13.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.422+0000 7f816e5ff700 1 --2- 172.21.15.40:0/1460222720 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f815406ace0 0x7f815406d190 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f815c0011e0 tx=0x7f815c0079b0 comp rx=0 tx=0).stop 2023-06-22T10:54:13.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.422+0000 7f816e5ff700 1 -- 172.21.15.40:0/1460222720 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81680b45d0 msgr2=0x7f8168158f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:13.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.422+0000 7f816e5ff700 1 --2- 172.21.15.40:0/1460222720 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81680b45d0 0x7f8168158f00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8158000c00 tx=0x7f8158004750 comp rx=0 tx=0).stop 2023-06-22T10:54:13.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.422+0000 7f816e5ff700 1 -- 172.21.15.40:0/1460222720 shutdown_connections 2023-06-22T10:54:13.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.422+0000 7f816e5ff700 1 --2- 172.21.15.40:0/1460222720 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f815406ace0 0x7f815406d190 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:13.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.422+0000 7f816e5ff700 1 --2- 172.21.15.40:0/1460222720 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81680d2130 0x7f81680b38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:13.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.422+0000 7f816e5ff700 1 --2- 172.21.15.40:0/1460222720 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f81680b45d0 0x7f8168158f00 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:13.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.422+0000 7f816e5ff700 1 --2- 172.21.15.40:0/1460222720 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f81680b59a0 0x7f816815c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:13.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.422+0000 7f816e5ff700 1 -- 172.21.15.40:0/1460222720 >> 172.21.15.40:0/1460222720 conn(0x7f81680cf5d0 msgr2=0x7f81680c9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:13.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.423+0000 7f816e5ff700 1 -- 172.21.15.40:0/1460222720 shutdown_connections 2023-06-22T10:54:13.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.423+0000 7f816e5ff700 1 -- 172.21.15.40:0/1460222720 wait complete. 2023-06-22T10:54:13.443 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-22T10:54:13.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.645+0000 7f97875ff700 1 Processor -- start 2023-06-22T10:54:13.648 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.645+0000 7f97875ff700 1 -- start start 2023-06-22T10:54:13.649 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.646+0000 7f97875ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f97800b45d0 0x7f97800b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:13.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.646+0000 7f97875ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f97800d2130 0x7f97800cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:13.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.646+0000 7f97875ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97800d1be0 con 0x7f97800cd6e0 2023-06-22T10:54:13.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.646+0000 7f97875ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97800d17f0 con 0x7f97800d2130 2023-06-22T10:54:13.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.646+0000 7f97875ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97800d1360 con 0x7f97800b45d0 2023-06-22T10:54:13.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.647+0000 7f9784b9a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f97800d2130 0x7f97800cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:13.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.647+0000 7f978539b700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f97800b45d0 0x7f97800b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:13.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.647+0000 7f978539b700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f97800b45d0 0x7f97800b49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3301/0 says I am v2:172.21.15.40:37792/0 (socket says 172.21.15.40:37792) 2023-06-22T10:54:13.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.647+0000 7f978539b700 1 -- 172.21.15.40:0/2992553406 learned_addr learned my addr 172.21.15.40:0/2992553406 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:13.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.647+0000 7f9785b9c700 1 --1- 172.21.15.40:0/2992553406 >> v1:172.21.15.45:6789/0 conn(0x7f97800cd6e0 0x7f97800b59a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.40:48544/0 (socket says 172.21.15.40:48544) 2023-06-22T10:54:13.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.647+0000 7f978539b700 1 -- 172.21.15.40:0/2992553406 >> v2:172.21.15.45:3300/0 conn(0x7f97800d2130 msgr2=0x7f97800cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:13.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.647+0000 7f978539b700 1 --2- 172.21.15.40:0/2992553406 >> v2:172.21.15.45:3300/0 conn(0x7f97800d2130 0x7f97800cd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:13.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.647+0000 7f978539b700 1 -- 172.21.15.40:0/2992553406 >> v1:172.21.15.45:6789/0 conn(0x7f97800cd6e0 legacy=0x7f97800b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:13.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.647+0000 7f978539b700 1 -- 172.21.15.40:0/2992553406 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97800b4ee0 con 0x7f97800b45d0 2023-06-22T10:54:13.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.647+0000 7f978539b700 1 --2- 172.21.15.40:0/2992553406 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f97800b45d0 0x7f97800b49a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f977c0098f0 tx=0x7f977c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2308a4278cb5667 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:13.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.648+0000 7f9777fff700 1 -- 172.21.15.40:0/2992553406 <== mon.2 v2:172.21.15.45:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977c011830 con 0x7f97800b45d0 2023-06-22T10:54:13.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.648+0000 7f9777fff700 1 -- 172.21.15.40:0/2992553406 <== mon.2 v2:172.21.15.45:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f977c011990 con 0x7f97800b45d0 2023-06-22T10:54:13.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.648+0000 7f9777fff700 1 -- 172.21.15.40:0/2992553406 <== mon.2 v2:172.21.15.45:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977c011d20 con 0x7f97800b45d0 2023-06-22T10:54:13.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.648+0000 7f97875ff700 1 -- 172.21.15.40:0/2992553406 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f97800b45d0 msgr2=0x7f97800b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:13.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.648+0000 7f97875ff700 1 --2- 172.21.15.40:0/2992553406 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f97800b45d0 0x7f97800b49a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f977c0098f0 tx=0x7f977c009c00 comp rx=0 tx=0).stop 2023-06-22T10:54:13.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.648+0000 7f97875ff700 1 -- 172.21.15.40:0/2992553406 shutdown_connections 2023-06-22T10:54:13.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.648+0000 7f97875ff700 1 --2- 172.21.15.40:0/2992553406 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f97800b45d0 0x7f97800b49a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:13.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.648+0000 7f97875ff700 1 --2- 172.21.15.40:0/2992553406 >> v2:172.21.15.45:3300/0 conn(0x7f97800d2130 0x7f97800cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:13.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.648+0000 7f97875ff700 1 -- 172.21.15.40:0/2992553406 >> 172.21.15.40:0/2992553406 conn(0x7f97800cf5d0 msgr2=0x7f97800cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:13.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.648+0000 7f97875ff700 1 -- 172.21.15.40:0/2992553406 shutdown_connections 2023-06-22T10:54:13.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.649+0000 7f97875ff700 1 -- 172.21.15.40:0/2992553406 wait complete. 2023-06-22T10:54:13.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.650+0000 7f97875ff700 1 Processor -- start 2023-06-22T10:54:13.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.650+0000 7f97875ff700 1 -- start start 2023-06-22T10:54:13.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.651+0000 7f97875ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97800b45d0 0x7f9780157e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:13.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.651+0000 7f97875ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97800cd6e0 0x7f97800b3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:13.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.651+0000 7f97875ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f97800d2130 0x7f978015d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:13.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.651+0000 7f97875ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97800c7ad0 con 0x7f97800b45d0 2023-06-22T10:54:13.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.651+0000 7f97875ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97800b4370 con 0x7f97800cd6e0 2023-06-22T10:54:13.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.651+0000 7f97875ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97800c7510 con 0x7f97800d2130 2023-06-22T10:54:13.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.651+0000 7f978539b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97800b45d0 0x7f9780157e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:13.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.652+0000 7f978539b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97800b45d0 0x7f9780157e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52444/0 (socket says 172.21.15.40:52444) 2023-06-22T10:54:13.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.652+0000 7f978539b700 1 -- 172.21.15.40:0/557611555 learned_addr learned my addr 172.21.15.40:0/557611555 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:13.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.652+0000 7f9785b9c700 1 --2- 172.21.15.40:0/557611555 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f97800d2130 0x7f978015d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:13.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.652+0000 7f9784b9a700 1 --2- 172.21.15.40:0/557611555 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97800cd6e0 0x7f97800b3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:13.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.652+0000 7f978539b700 1 -- 172.21.15.40:0/557611555 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f97800d2130 msgr2=0x7f978015d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:13.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.652+0000 7f978539b700 1 --2- 172.21.15.40:0/557611555 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f97800d2130 0x7f978015d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:13.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.652+0000 7f978539b700 1 -- 172.21.15.40:0/557611555 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97800cd6e0 msgr2=0x7f97800b3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:13.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.652+0000 7f978539b700 1 --2- 172.21.15.40:0/557611555 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97800cd6e0 0x7f97800b3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:13.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.652+0000 7f978539b700 1 -- 172.21.15.40:0/557611555 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f977c009550 con 0x7f97800b45d0 2023-06-22T10:54:13.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.652+0000 7f978539b700 1 --2- 172.21.15.40:0/557611555 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97800b45d0 0x7f9780157e10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f977c014040 tx=0x7f977c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:13.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.652+0000 7f9775ffb700 1 -- 172.21.15.40:0/557611555 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977c004510 con 0x7f97800b45d0 2023-06-22T10:54:13.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.652+0000 7f9775ffb700 1 -- 172.21.15.40:0/557611555 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f977c01e070 con 0x7f97800b45d0 2023-06-22T10:54:13.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.653+0000 7f97875ff700 1 -- 172.21.15.40:0/557611555 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97800c77f0 con 0x7f97800b45d0 2023-06-22T10:54:13.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.653+0000 7f9775ffb700 1 -- 172.21.15.40:0/557611555 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977c0038e0 con 0x7f97800b45d0 2023-06-22T10:54:13.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.653+0000 7f97875ff700 1 -- 172.21.15.40:0/557611555 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97800c82a0 con 0x7f97800b45d0 2023-06-22T10:54:13.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.654+0000 7f97875ff700 1 -- 172.21.15.40:0/557611555 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97800c7e20 con 0x7f97800b45d0 2023-06-22T10:54:13.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.654+0000 7f9775ffb700 1 -- 172.21.15.40:0/557611555 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f977c003a40 con 0x7f97800b45d0 2023-06-22T10:54:13.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.655+0000 7f9775ffb700 1 --2- 172.21.15.40:0/557611555 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f976406ace0 0x7f976406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:13.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.656+0000 7f9775ffb700 1 -- 172.21.15.40:0/557611555 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f977c08a6d0 con 0x7f97800b45d0 2023-06-22T10:54:13.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.656+0000 7f9784b9a700 1 --2- 172.21.15.40:0/557611555 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f976406ace0 0x7f976406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:13.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.656+0000 7f9784b9a700 1 --2- 172.21.15.40:0/557611555 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f976406ace0 0x7f976406d190 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f97800b2980 tx=0x7f9770009210 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:13.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.660+0000 7f9775ffb700 1 -- 172.21.15.40:0/557611555 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f97800c7e20 con 0x7f97800b45d0 2023-06-22T10:54:13.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.869+0000 7f97875ff700 1 -- 172.21.15.40:0/557611555 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f97800c7e20 con 0x7f97800b45d0 2023-06-22T10:54:13.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.869+0000 7f9775ffb700 1 -- 172.21.15.40:0/557611555 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7f97800c7e20 con 0x7f97800b45d0 2023-06-22T10:54:13.873 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-06-22T10:54:13.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.872+0000 7f97875ff700 1 -- 172.21.15.40:0/557611555 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f976406ace0 msgr2=0x7f976406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:13.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.872+0000 7f97875ff700 1 --2- 172.21.15.40:0/557611555 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f976406ace0 0x7f976406d190 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f97800b2980 tx=0x7f9770009210 comp rx=0 tx=0).stop 2023-06-22T10:54:13.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.872+0000 7f97875ff700 1 -- 172.21.15.40:0/557611555 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97800b45d0 msgr2=0x7f9780157e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:13.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.872+0000 7f97875ff700 1 --2- 172.21.15.40:0/557611555 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97800b45d0 0x7f9780157e10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f977c014040 tx=0x7f977c004750 comp rx=0 tx=0).stop 2023-06-22T10:54:13.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.872+0000 7f97875ff700 1 -- 172.21.15.40:0/557611555 shutdown_connections 2023-06-22T10:54:13.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.872+0000 7f97875ff700 1 --2- 172.21.15.40:0/557611555 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f976406ace0 0x7f976406d190 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:13.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.872+0000 7f97875ff700 1 --2- 172.21.15.40:0/557611555 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f97800d2130 0x7f978015d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:13.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.872+0000 7f97875ff700 1 --2- 172.21.15.40:0/557611555 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97800b45d0 0x7f9780157e10 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:13.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.872+0000 7f97875ff700 1 --2- 172.21.15.40:0/557611555 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f97800cd6e0 0x7f97800b3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:13.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.872+0000 7f97875ff700 1 -- 172.21.15.40:0/557611555 >> 172.21.15.40:0/557611555 conn(0x7f97800cf5d0 msgr2=0x7f97800b7990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:13.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.872+0000 7f97875ff700 1 -- 172.21.15.40:0/557611555 shutdown_connections 2023-06-22T10:54:13.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:13.872+0000 7f97875ff700 1 -- 172.21.15.40:0/557611555 wait complete. 2023-06-22T10:54:13.894 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-22T10:54:14.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.091+0000 7f42279ff700 1 Processor -- start 2023-06-22T10:54:14.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.091+0000 7f42279ff700 1 -- start start 2023-06-22T10:54:14.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.092+0000 7f42279ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f42200d2830 0x7f42200b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:14.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.092+0000 7f42279ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42200b50a0 con 0x7f42200b4c60 2023-06-22T10:54:14.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.092+0000 7f42279ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42200b2130 con 0x7f422015c720 2023-06-22T10:54:14.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.092+0000 7f42279ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4220160d60 con 0x7f42200d2830 2023-06-22T10:54:14.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.092+0000 7f4225f9c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f42200b4c60 0x7f42200d0d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:54208/0 (socket says 172.21.15.40:54208) 2023-06-22T10:54:14.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.092+0000 7f4225f9c700 1 -- 172.21.15.40:0/4172176487 learned_addr learned my addr 172.21.15.40:0/4172176487 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:14.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.092+0000 7f4224f9a700 1 --2- 172.21.15.40:0/4172176487 >> v2:172.21.15.45:3300/0 conn(0x7f42200d2830 0x7f42200b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:14.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.093+0000 7f4217fff700 1 -- 172.21.15.40:0/4172176487 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 69546296 0 0) 0x7f42200b50a0 con 0x7f42200b4c60 2023-06-22T10:54:14.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.093+0000 7f4217fff700 1 -- 172.21.15.40:0/4172176487 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f420c0035b0 con 0x7f42200b4c60 2023-06-22T10:54:14.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.093+0000 7f4217fff700 1 -- 172.21.15.40:0/4172176487 <== mon.1 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2612564925 0 0) 0x7f42200b2130 con 0x7f422015c720 2023-06-22T10:54:14.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.093+0000 7f4224f9a700 1 -- 172.21.15.40:0/4172176487 >> v1:172.21.15.45:6789/0 conn(0x7f422015c720 legacy=0x7f42200b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:14.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.093+0000 7f4224f9a700 1 -- 172.21.15.40:0/4172176487 >> v1:172.21.15.40:6789/0 conn(0x7f42200b4c60 legacy=0x7f42200d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:14.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.093+0000 7f4224f9a700 1 -- 172.21.15.40:0/4172176487 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4220161180 con 0x7f42200d2830 2023-06-22T10:54:14.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.093+0000 7f4224f9a700 1 --2- 172.21.15.40:0/4172176487 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42200d2830 0x7f42200b4720 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4210009870 tx=0x7f4210009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20a7c622cae39244 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:14.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.093+0000 7f4217fff700 1 -- 172.21.15.40:0/4172176487 <== mon.1 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4210011830 con 0x7f42200d2830 2023-06-22T10:54:14.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.093+0000 7f4217fff700 1 -- 172.21.15.40:0/4172176487 <== mon.1 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4210011990 con 0x7f42200d2830 2023-06-22T10:54:14.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.093+0000 7f4217fff700 1 -- 172.21.15.40:0/4172176487 <== mon.1 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4210011d20 con 0x7f42200d2830 2023-06-22T10:54:14.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.094+0000 7f42279ff700 1 -- 172.21.15.40:0/4172176487 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42200d2830 msgr2=0x7f42200b4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:14.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.094+0000 7f42279ff700 1 --2- 172.21.15.40:0/4172176487 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42200d2830 0x7f42200b4720 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4210009870 tx=0x7f4210009b80 comp rx=0 tx=0).stop 2023-06-22T10:54:14.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.094+0000 7f42279ff700 1 -- 172.21.15.40:0/4172176487 shutdown_connections 2023-06-22T10:54:14.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.094+0000 7f42279ff700 1 --2- 172.21.15.40:0/4172176487 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42200d2830 0x7f42200b4720 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:14.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.094+0000 7f42279ff700 1 -- 172.21.15.40:0/4172176487 >> 172.21.15.40:0/4172176487 conn(0x7f42200cf720 msgr2=0x7f42200cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:14.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.094+0000 7f42279ff700 1 -- 172.21.15.40:0/4172176487 shutdown_connections 2023-06-22T10:54:14.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.094+0000 7f42279ff700 1 -- 172.21.15.40:0/4172176487 wait complete. 2023-06-22T10:54:14.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.096+0000 7f42279ff700 1 Processor -- start 2023-06-22T10:54:14.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.096+0000 7f42279ff700 1 -- start start 2023-06-22T10:54:14.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.097+0000 7f42279ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f42200b4c60 0x7f4220145fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:14.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.097+0000 7f42279ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42200d2830 0x7f42200b6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:14.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.097+0000 7f42279ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f422015c720 0x7f42200b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:14.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.097+0000 7f42279ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4220160040 con 0x7f42200d2830 2023-06-22T10:54:14.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.097+0000 7f42279ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42201464f0 con 0x7f422015c720 2023-06-22T10:54:14.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.097+0000 7f42279ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4220156920 con 0x7f42200b4c60 2023-06-22T10:54:14.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.097+0000 7f4224f9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42200d2830 0x7f42200b6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:14.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.097+0000 7f4224f9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42200d2830 0x7f42200b6e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52446/0 (socket says 172.21.15.40:52446) 2023-06-22T10:54:14.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.097+0000 7f4224f9a700 1 -- 172.21.15.40:0/816252161 learned_addr learned my addr 172.21.15.40:0/816252161 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:14.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.097+0000 7f422579b700 1 --2- 172.21.15.40:0/816252161 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f42200b4c60 0x7f4220145fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:14.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.097+0000 7f4225f9c700 1 --2- 172.21.15.40:0/816252161 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f422015c720 0x7f42200b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:14.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.097+0000 7f4224f9a700 1 -- 172.21.15.40:0/816252161 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f42200b4c60 msgr2=0x7f4220145fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:14.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.097+0000 7f4224f9a700 1 --2- 172.21.15.40:0/816252161 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f42200b4c60 0x7f4220145fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:14.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.098+0000 7f4224f9a700 1 -- 172.21.15.40:0/816252161 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f422015c720 msgr2=0x7f42200b7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:14.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.098+0000 7f4224f9a700 1 --2- 172.21.15.40:0/816252161 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f422015c720 0x7f42200b7910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:14.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.098+0000 7f4224f9a700 1 -- 172.21.15.40:0/816252161 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42100094a0 con 0x7f42200d2830 2023-06-22T10:54:14.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.098+0000 7f4225f9c700 1 --2- 172.21.15.40:0/816252161 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f422015c720 0x7f42200b7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:54:14.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.098+0000 7f4224f9a700 1 --2- 172.21.15.40:0/816252161 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42200d2830 0x7f42200b6e90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4210000c00 tx=0x7f4210004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:14.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.098+0000 7f4215ffb700 1 -- 172.21.15.40:0/816252161 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421001aa70 con 0x7f42200d2830 2023-06-22T10:54:14.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.098+0000 7f4215ffb700 1 -- 172.21.15.40:0/816252161 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f421001abd0 con 0x7f42200d2830 2023-06-22T10:54:14.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.098+0000 7f42279ff700 1 -- 172.21.15.40:0/816252161 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f422015d090 con 0x7f42200d2830 2023-06-22T10:54:14.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.098+0000 7f4215ffb700 1 -- 172.21.15.40:0/816252161 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42100243f0 con 0x7f42200d2830 2023-06-22T10:54:14.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.098+0000 7f42279ff700 1 -- 172.21.15.40:0/816252161 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f422015fd60 con 0x7f42200d2830 2023-06-22T10:54:14.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.099+0000 7f42279ff700 1 -- 172.21.15.40:0/816252161 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4220067580 con 0x7f42200d2830 2023-06-22T10:54:14.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.100+0000 7f4215ffb700 1 -- 172.21.15.40:0/816252161 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f421002d450 con 0x7f42200d2830 2023-06-22T10:54:14.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.101+0000 7f4215ffb700 1 --2- 172.21.15.40:0/816252161 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f420406ad10 0x7f420406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:14.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.101+0000 7f4215ffb700 1 -- 172.21.15.40:0/816252161 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f421008ac40 con 0x7f42200d2830 2023-06-22T10:54:14.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.101+0000 7f422579b700 1 --2- 172.21.15.40:0/816252161 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f420406ad10 0x7f420406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:14.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.102+0000 7f422579b700 1 --2- 172.21.15.40:0/816252161 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f420406ad10 0x7f420406d1c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f421c007fd0 tx=0x7f421c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:14.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.105+0000 7f4215ffb700 1 -- 172.21.15.40:0/816252161 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4210055ad0 con 0x7f42200d2830 2023-06-22T10:54:14.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.359+0000 7f42279ff700 1 -- 172.21.15.40:0/816252161 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f42200b26d0 con 0x7f42200d2830 2023-06-22T10:54:14.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.360+0000 7f4215ffb700 1 -- 172.21.15.40:0/816252161 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4664 (secure 0 0 0) 0x7f4210015020 con 0x7f42200d2830 2023-06-22T10:54:14.363 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:54:14.364 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/627935577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":627935577},{"type":"v1","addr":"172.21.15.40:6835","nonce":627935577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3018871402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3018871402},{"type":"v1","addr":"172.21.15.40:6837","nonce":3018871402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/4036649607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":4036649607},{"type":"v1","addr":"172.21.15.45:6834","nonce":4036649607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-22T10:53:31.430326+0000","modified":"2023-06-22T10:53:59.666730+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4303},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4303":{"gid":4303,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/1579627519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":1579627519},{"type":"v1","addr":"172.21.15.45:6835","nonce":1579627519}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-22T10:54:14.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.362+0000 7f42279ff700 1 -- 172.21.15.40:0/816252161 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f420406ad10 msgr2=0x7f420406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:14.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.362+0000 7f42279ff700 1 --2- 172.21.15.40:0/816252161 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f420406ad10 0x7f420406d1c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f421c007fd0 tx=0x7f421c009040 comp rx=0 tx=0).stop 2023-06-22T10:54:14.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.362+0000 7f42279ff700 1 -- 172.21.15.40:0/816252161 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42200d2830 msgr2=0x7f42200b6e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:14.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.362+0000 7f42279ff700 1 --2- 172.21.15.40:0/816252161 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42200d2830 0x7f42200b6e90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4210000c00 tx=0x7f4210004750 comp rx=0 tx=0).stop 2023-06-22T10:54:14.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.362+0000 7f42279ff700 1 -- 172.21.15.40:0/816252161 shutdown_connections 2023-06-22T10:54:14.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.362+0000 7f42279ff700 1 --2- 172.21.15.40:0/816252161 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f420406ad10 0x7f420406d1c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:14.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.362+0000 7f42279ff700 1 --2- 172.21.15.40:0/816252161 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f42200b4c60 0x7f4220145fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:14.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.363+0000 7f42279ff700 1 --2- 172.21.15.40:0/816252161 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f422015c720 0x7f42200b7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:14.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.363+0000 7f42279ff700 1 --2- 172.21.15.40:0/816252161 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42200d2830 0x7f42200b6e90 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:14.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.363+0000 7f42279ff700 1 -- 172.21.15.40:0/816252161 >> 172.21.15.40:0/816252161 conn(0x7f42200cf720 msgr2=0x7f422015af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:14.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.363+0000 7f42279ff700 1 -- 172.21.15.40:0/816252161 shutdown_connections 2023-06-22T10:54:14.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.363+0000 7f42279ff700 1 -- 172.21.15.40:0/816252161 wait complete. 2023-06-22T10:54:14.368 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 9 2023-06-22T10:54:14.383 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-22T10:54:14.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.581+0000 7fcca75ff700 1 Processor -- start 2023-06-22T10:54:14.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.581+0000 7fcca75ff700 1 -- start start 2023-06-22T10:54:14.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.582+0000 7fcca75ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcca00cd3b0 0x7fcca0160a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:14.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.582+0000 7fcca75ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcca015ce60 con 0x7fcca015d2f0 2023-06-22T10:54:14.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.582+0000 7fcca75ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcca00ce6a0 con 0x7fcca00cd780 2023-06-22T10:54:14.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.582+0000 7fcca75ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcca00ce940 con 0x7fcca00cd3b0 2023-06-22T10:54:14.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.582+0000 7fcca539b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcca00cd3b0 0x7fcca0160a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:14.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.582+0000 7fcca5b9c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fcca015d2f0 0x7fcca015ddb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:54220/0 (socket says 172.21.15.40:54220) 2023-06-22T10:54:14.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.582+0000 7fcca5b9c700 1 -- 172.21.15.40:0/785418061 learned_addr learned my addr 172.21.15.40:0/785418061 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:14.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.583+0000 7fcca539b700 1 -- 172.21.15.40:0/785418061 >> v1:172.21.15.45:6789/0 conn(0x7fcca00cd780 legacy=0x7fcca00d0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:14.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.583+0000 7fcca539b700 1 -- 172.21.15.40:0/785418061 >> v1:172.21.15.40:6789/0 conn(0x7fcca015d2f0 legacy=0x7fcca015ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:14.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.583+0000 7fcca539b700 1 -- 172.21.15.40:0/785418061 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca015caf0 con 0x7fcca00cd3b0 2023-06-22T10:54:14.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.583+0000 7fcca539b700 1 --2- 172.21.15.40:0/785418061 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcca00cd3b0 0x7fcca0160a70 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c009820 tx=0x7fcc9c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3395b6b605c6aad2 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:14.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.583+0000 7fcc97fff700 1 -- 172.21.15.40:0/785418061 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9c005e30 con 0x7fcca00cd3b0 2023-06-22T10:54:14.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.583+0000 7fcc97fff700 1 -- 172.21.15.40:0/785418061 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc9c006030 con 0x7fcca00cd3b0 2023-06-22T10:54:14.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.583+0000 7fcc97fff700 1 -- 172.21.15.40:0/785418061 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9c0063e0 con 0x7fcca00cd3b0 2023-06-22T10:54:14.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.584+0000 7fcca75ff700 1 -- 172.21.15.40:0/785418061 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcca00cd3b0 msgr2=0x7fcca0160a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:14.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.584+0000 7fcca75ff700 1 --2- 172.21.15.40:0/785418061 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcca00cd3b0 0x7fcca0160a70 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c009820 tx=0x7fcc9c009b30 comp rx=0 tx=0).stop 2023-06-22T10:54:14.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.584+0000 7fcca75ff700 1 -- 172.21.15.40:0/785418061 shutdown_connections 2023-06-22T10:54:14.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.584+0000 7fcca75ff700 1 --2- 172.21.15.40:0/785418061 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcca00cd3b0 0x7fcca0160a70 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:14.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.584+0000 7fcca75ff700 1 -- 172.21.15.40:0/785418061 >> 172.21.15.40:0/785418061 conn(0x7fcca006e630 msgr2=0x7fcca006ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:14.590 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.584+0000 7fcca75ff700 1 -- 172.21.15.40:0/785418061 shutdown_connections 2023-06-22T10:54:14.591 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.584+0000 7fcca75ff700 1 -- 172.21.15.40:0/785418061 wait complete. 2023-06-22T10:54:14.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.586+0000 7fcca75ff700 1 Processor -- start 2023-06-22T10:54:14.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.586+0000 7fcca75ff700 1 -- start start 2023-06-22T10:54:14.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.587+0000 7fcca75ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fcca00cd3b0 0x7fcca0154460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:14.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.587+0000 7fcca75ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcca00cd780 0x7fcca01e5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:14.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.587+0000 7fcca75ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcca015d2f0 0x7fcca00b1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:14.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.587+0000 7fcca75ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca00c8ea0 con 0x7fcca015d2f0 2023-06-22T10:54:14.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.587+0000 7fcca75ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca00c9180 con 0x7fcca00cd780 2023-06-22T10:54:14.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.587+0000 7fcca75ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca00c9460 con 0x7fcca00cd3b0 2023-06-22T10:54:14.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.587+0000 7fcca5b9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcca015d2f0 0x7fcca00b1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:14.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.587+0000 7fcca5b9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcca015d2f0 0x7fcca00b1b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52464/0 (socket says 172.21.15.40:52464) 2023-06-22T10:54:14.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.587+0000 7fcca5b9c700 1 -- 172.21.15.40:0/1247868501 learned_addr learned my addr 172.21.15.40:0/1247868501 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:14.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.587+0000 7fcca4b9a700 1 --2- 172.21.15.40:0/1247868501 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcca00cd780 0x7fcca01e5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:14.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.587+0000 7fcca539b700 1 --2- 172.21.15.40:0/1247868501 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fcca00cd3b0 0x7fcca0154460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:14.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.588+0000 7fcca5b9c700 1 -- 172.21.15.40:0/1247868501 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fcca00cd3b0 msgr2=0x7fcca0154460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:14.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.588+0000 7fcca5b9c700 1 --2- 172.21.15.40:0/1247868501 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fcca00cd3b0 0x7fcca0154460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:14.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.588+0000 7fcca5b9c700 1 -- 172.21.15.40:0/1247868501 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcca00cd780 msgr2=0x7fcca01e5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:14.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.588+0000 7fcca5b9c700 1 --2- 172.21.15.40:0/1247868501 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcca00cd780 0x7fcca01e5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:14.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.588+0000 7fcca5b9c700 1 -- 172.21.15.40:0/1247868501 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc9c009430 con 0x7fcca015d2f0 2023-06-22T10:54:14.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.588+0000 7fcca5b9c700 1 --2- 172.21.15.40:0/1247868501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcca015d2f0 0x7fcca00b1b60 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fcc9800ca80 tx=0x7fcc9800cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:14.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.588+0000 7fcc95ffb700 1 -- 172.21.15.40:0/1247868501 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc9800a9e0 con 0x7fcca015d2f0 2023-06-22T10:54:14.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.588+0000 7fcc95ffb700 1 -- 172.21.15.40:0/1247868501 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc9800ab40 con 0x7fcca015d2f0 2023-06-22T10:54:14.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.588+0000 7fcca75ff700 1 -- 172.21.15.40:0/1247868501 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcca00c9740 con 0x7fcca015d2f0 2023-06-22T10:54:14.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.588+0000 7fcc95ffb700 1 -- 172.21.15.40:0/1247868501 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc98012400 con 0x7fcca015d2f0 2023-06-22T10:54:14.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.588+0000 7fcca75ff700 1 -- 172.21.15.40:0/1247868501 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcca01e62c0 con 0x7fcca015d2f0 2023-06-22T10:54:14.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.589+0000 7fcca75ff700 1 -- 172.21.15.40:0/1247868501 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcca0067580 con 0x7fcca015d2f0 2023-06-22T10:54:14.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.590+0000 7fcc95ffb700 1 -- 172.21.15.40:0/1247868501 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcc9801b3b0 con 0x7fcca015d2f0 2023-06-22T10:54:14.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.592+0000 7fcc95ffb700 1 --2- 172.21.15.40:0/1247868501 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fcc8406ad10 0x7fcc8406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:14.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.592+0000 7fcc95ffb700 1 -- 172.21.15.40:0/1247868501 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fcc98089310 con 0x7fcca015d2f0 2023-06-22T10:54:14.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.592+0000 7fcca539b700 1 --2- 172.21.15.40:0/1247868501 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fcc8406ad10 0x7fcc8406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:14.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.593+0000 7fcca539b700 1 --2- 172.21.15.40:0/1247868501 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fcc8406ad10 0x7fcc8406d1c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c013040 tx=0x7fcc9c008070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:14.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.596+0000 7fcc95ffb700 1 -- 172.21.15.40:0/1247868501 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcc98054010 con 0x7fcca015d2f0 2023-06-22T10:54:14.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.804+0000 7fcca75ff700 1 -- 172.21.15.40:0/1247868501 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcca00c4250 con 0x7fcca015d2f0 2023-06-22T10:54:14.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.805+0000 7fcc95ffb700 1 -- 172.21.15.40:0/1247868501 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20132 (secure 0 0 0) 0x7fcc98057630 con 0x7fcca015d2f0 2023-06-22T10:54:14.809 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:54:14.809 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":30,"fsid":"475560bc-1a7c-4a75-b3b6-6fc6b20bdc52","created":"2023-06-22T10:53:03.784568+0000","modified":"2023-06-22T10:54:12.717204+0000","last_up_change":"2023-06-22T10:53:17.830348+0000","last_in_change":"2023-06-22T10:53:07.329974+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-22T10:53:17.182228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-22T10:53:23.874432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-22T10:53:29.812963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-22T10:53:30.404021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-22T10:53:33.982289+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"918db6b4-053a-46ba-976d-6e1a0104017f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6809","nonce":2400162888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6811","nonce":2400162888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6815","nonce":2400162888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6813","nonce":2400162888}]},"public_addr":"172.21.15.40:6809/2400162888","cluster_addr":"172.21.15.40:6811/2400162888","heartbeat_back_addr":"172.21.15.40:6815/2400162888","heartbeat_front_addr":"172.21.15.40:6813/2400162888","state":["exists","up"]},{"osd":1,"uuid":"0c146e2b-1725-4dae-9b5c-38795943b9d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6801","nonce":230885800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6803","nonce":230885800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6807","nonce":230885800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6805","nonce":230885800}]},"public_addr":"172.21.15.40:6801/230885800","cluster_addr":"172.21.15.40:6803/230885800","heartbeat_back_addr":"172.21.15.40:6807/230885800","heartbeat_front_addr":"172.21.15.40:6805/230885800","state":["exists","up"]},{"osd":2,"uuid":"0b3727fd-f281-46d5-a675-86c8c5ab269e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6817","nonce":2681404929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6819","nonce":2681404929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6823","nonce":2681404929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6821","nonce":2681404929}]},"public_addr":"172.21.15.40:6817/2681404929","cluster_addr":"172.21.15.40:6819/2681404929","heartbeat_back_addr":"172.21.15.40:6823/2681404929","heartbeat_front_addr":"172.21.15.40:6821/2681404929","state":["exists","up"]},{"osd":3,"uuid":"2969c698-7039-4bbb-beda-f756f7a368a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6825","nonce":111110981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6827","nonce":111110981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6831","nonce":111110981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6829","nonce":111110981}]},"public_addr":"172.21.15.40:6825/111110981","cluster_addr":"172.21.15.40:6827/111110981","heartbeat_back_addr":"172.21.15.40:6831/111110981","heartbeat_front_addr":"172.21.15.40:6829/111110981","state":["exists","up"]},{"osd":4,"uuid":"3bb1d9c8-8e42-4a6b-998d-04834f34be5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6801","nonce":3625455711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6803","nonce":3625455711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6807","nonce":3625455711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6805","nonce":3625455711}]},"public_addr":"172.21.15.45:6801/3625455711","cluster_addr":"172.21.15.45:6803/3625455711","heartbeat_back_addr":"172.21.15.45:6807/3625455711","heartbeat_front_addr":"172.21.15.45:6805/3625455711","state":["exists","up"]},{"osd":5,"uuid":"f9854ee4-302c-41be-977b-bedda090a3d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6817","nonce":3354411217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6819","nonce":3354411217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6823","nonce":3354411217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6821","nonce":3354411217}]},"public_addr":"172.21.15.45:6817/3354411217","cluster_addr":"172.21.15.45:6819/3354411217","heartbeat_back_addr":"172.21.15.45:6823/3354411217","heartbeat_front_addr":"172.21.15.45:6821/3354411217","state":["exists","up"]},{"osd":6,"uuid":"bbdb1989-f6ac-4954-9b85-b8b540d683c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6809","nonce":320111074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6811","nonce":320111074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6815","nonce":320111074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6813","nonce":320111074}]},"public_addr":"172.21.15.45:6809/320111074","cluster_addr":"172.21.15.45:6811/320111074","heartbeat_back_addr":"172.21.15.45:6815/320111074","heartbeat_front_addr":"172.21.15.45:6813/320111074","state":["exists","up"]},{"osd":7,"uuid":"823d44e3-58f1-4d1d-8263-a4e4a69d4327","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6825","nonce":643617680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6827","nonce":643617680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6831","nonce":643617680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6829","nonce":643617680}]},"public_addr":"172.21.15.45:6825/643617680","cluster_addr":"172.21.15.45:6827/643617680","heartbeat_back_addr":"172.21.15.45:6831/643617680","heartbeat_front_addr":"172.21.15.45:6829/643617680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.731262+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.873226+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.898936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.666578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.645990+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.953699+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.642823+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.693395+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1b","mappings":[{"from":3,"to":2}]},{"pgid":"4.2a","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-22T10:54:14.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.808+0000 7fcca75ff700 1 -- 172.21.15.40:0/1247868501 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fcc8406ad10 msgr2=0x7fcc8406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:14.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.808+0000 7fcca75ff700 1 --2- 172.21.15.40:0/1247868501 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fcc8406ad10 0x7fcc8406d1c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c013040 tx=0x7fcc9c008070 comp rx=0 tx=0).stop 2023-06-22T10:54:14.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.808+0000 7fcca75ff700 1 -- 172.21.15.40:0/1247868501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcca015d2f0 msgr2=0x7fcca00b1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:14.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.808+0000 7fcca75ff700 1 --2- 172.21.15.40:0/1247868501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcca015d2f0 0x7fcca00b1b60 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fcc9800ca80 tx=0x7fcc9800cd90 comp rx=0 tx=0).stop 2023-06-22T10:54:14.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.808+0000 7fcca75ff700 1 -- 172.21.15.40:0/1247868501 shutdown_connections 2023-06-22T10:54:14.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.808+0000 7fcca75ff700 1 --2- 172.21.15.40:0/1247868501 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fcc8406ad10 0x7fcc8406d1c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:14.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.808+0000 7fcca75ff700 1 --2- 172.21.15.40:0/1247868501 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fcca00cd3b0 0x7fcca0154460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:14.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.808+0000 7fcca75ff700 1 --2- 172.21.15.40:0/1247868501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcca015d2f0 0x7fcca00b1b60 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:14.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.808+0000 7fcca75ff700 1 --2- 172.21.15.40:0/1247868501 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcca00cd780 0x7fcca01e5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:14.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.808+0000 7fcca75ff700 1 -- 172.21.15.40:0/1247868501 >> 172.21.15.40:0/1247868501 conn(0x7fcca006e630 msgr2=0x7fcca006b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:14.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.808+0000 7fcca75ff700 1 -- 172.21.15.40:0/1247868501 shutdown_connections 2023-06-22T10:54:14.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:14.808+0000 7fcca75ff700 1 -- 172.21.15.40:0/1247868501 wait complete. 2023-06-22T10:54:14.829 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-22T10:54:15.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.026+0000 7f2e85fff700 1 Processor -- start 2023-06-22T10:54:15.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.027+0000 7f2e85fff700 1 -- start start 2023-06-22T10:54:15.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.028+0000 7f2e85fff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f2e8015c720 0x7f2e800b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:15.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.028+0000 7f2e85fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2e800d2830 0x7f2e800b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:15.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.028+0000 7f2e85fff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e800b2130 con 0x7f2e800b4c60 2023-06-22T10:54:15.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.028+0000 7f2e85fff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e80160d60 con 0x7f2e800d2830 2023-06-22T10:54:15.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.028+0000 7f2e85fff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e800b50e0 con 0x7f2e8015c720 2023-06-22T10:54:15.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.028+0000 7f2e7effd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2e800d2830 0x7f2e800b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:15.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.028+0000 7f2e7effd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2e800d2830 0x7f2e800b4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52470/0 (socket says 172.21.15.40:52470) 2023-06-22T10:54:15.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.028+0000 7f2e7effd700 1 -- 172.21.15.40:0/2673789638 learned_addr learned my addr 172.21.15.40:0/2673789638 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:15.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.028+0000 7f2e7f7fe700 1 --2- 172.21.15.40:0/2673789638 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f2e8015c720 0x7f2e800b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:15.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.029+0000 7f2e7effd700 1 -- 172.21.15.40:0/2673789638 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f2e8015c720 msgr2=0x7f2e800b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:15.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.029+0000 7f2e7effd700 1 --2- 172.21.15.40:0/2673789638 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f2e8015c720 0x7f2e800b1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:15.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.029+0000 7f2e7effd700 1 -- 172.21.15.40:0/2673789638 >> v1:172.21.15.45:6789/0 conn(0x7f2e800b4c60 legacy=0x7f2e8006b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:15.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.029+0000 7f2e7effd700 1 -- 172.21.15.40:0/2673789638 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e80161180 con 0x7f2e800d2830 2023-06-22T10:54:15.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.029+0000 7f2e7effd700 1 --2- 172.21.15.40:0/2673789638 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e800d2830 0x7f2e800b4720 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2e740098f0 tx=0x7f2e74009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=823cbbfe39c3a28e server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:15.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.029+0000 7f2e7e7fc700 1 -- 172.21.15.40:0/2673789638 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e74011830 con 0x7f2e800d2830 2023-06-22T10:54:15.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.029+0000 7f2e7e7fc700 1 -- 172.21.15.40:0/2673789638 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e74011990 con 0x7f2e800d2830 2023-06-22T10:54:15.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.029+0000 7f2e7e7fc700 1 -- 172.21.15.40:0/2673789638 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e74011d20 con 0x7f2e800d2830 2023-06-22T10:54:15.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.030+0000 7f2e85fff700 1 -- 172.21.15.40:0/2673789638 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e800d2830 msgr2=0x7f2e800b4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:15.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.030+0000 7f2e85fff700 1 --2- 172.21.15.40:0/2673789638 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e800d2830 0x7f2e800b4720 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2e740098f0 tx=0x7f2e74009c00 comp rx=0 tx=0).stop 2023-06-22T10:54:15.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.030+0000 7f2e85fff700 1 -- 172.21.15.40:0/2673789638 shutdown_connections 2023-06-22T10:54:15.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.030+0000 7f2e85fff700 1 --2- 172.21.15.40:0/2673789638 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f2e8015c720 0x7f2e800b1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:15.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.030+0000 7f2e85fff700 1 --2- 172.21.15.40:0/2673789638 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e800d2830 0x7f2e800b4720 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:15.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.030+0000 7f2e85fff700 1 -- 172.21.15.40:0/2673789638 >> 172.21.15.40:0/2673789638 conn(0x7f2e800cf720 msgr2=0x7f2e800cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:15.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.030+0000 7f2e85fff700 1 -- 172.21.15.40:0/2673789638 shutdown_connections 2023-06-22T10:54:15.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.030+0000 7f2e85fff700 1 -- 172.21.15.40:0/2673789638 wait complete. 2023-06-22T10:54:15.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.032+0000 7f2e85fff700 1 Processor -- start 2023-06-22T10:54:15.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.032+0000 7f2e85fff700 1 -- start start 2023-06-22T10:54:15.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.033+0000 7f2e85fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e800b4c60 0x7f2e8015cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:15.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.033+0000 7f2e85fff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f2e800d2830 0x7f2e801f2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:15.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.033+0000 7f2e85fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e8015c720 0x7f2e800c9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:15.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.033+0000 7f2e85fff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e800c6a50 con 0x7f2e800b4c60 2023-06-22T10:54:15.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.033+0000 7f2e85fff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e801f3220 con 0x7f2e8015c720 2023-06-22T10:54:15.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.033+0000 7f2e85fff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8015d2f0 con 0x7f2e800d2830 2023-06-22T10:54:15.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.033+0000 7f2e7f7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e800b4c60 0x7f2e8015cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:15.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.033+0000 7f2e7f7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e800b4c60 0x7f2e8015cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52486/0 (socket says 172.21.15.40:52486) 2023-06-22T10:54:15.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.033+0000 7f2e7f7fe700 1 -- 172.21.15.40:0/840784120 learned_addr learned my addr 172.21.15.40:0/840784120 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:15.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.033+0000 7f2e7f7fe700 1 -- 172.21.15.40:0/840784120 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f2e800d2830 msgr2=0x7f2e801f2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:15.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.033+0000 7f2e7f7fe700 1 --2- 172.21.15.40:0/840784120 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f2e800d2830 0x7f2e801f2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:15.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.033+0000 7f2e7f7fe700 1 -- 172.21.15.40:0/840784120 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e8015c720 msgr2=0x7f2e800c9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:15.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.033+0000 7f2e7ffff700 1 --2- 172.21.15.40:0/840784120 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e8015c720 0x7f2e800c9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:15.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.034+0000 7f2e7f7fe700 1 --2- 172.21.15.40:0/840784120 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e8015c720 0x7f2e800c9110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:15.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.034+0000 7f2e7f7fe700 1 -- 172.21.15.40:0/840784120 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e74009550 con 0x7f2e800b4c60 2023-06-22T10:54:15.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.034+0000 7f2e7ffff700 1 --2- 172.21.15.40:0/840784120 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e8015c720 0x7f2e800c9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-22T10:54:15.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.034+0000 7f2e7f7fe700 1 --2- 172.21.15.40:0/840784120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e800b4c60 0x7f2e8015cdb0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2e7000e870 tx=0x7f2e7000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:15.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.034+0000 7f2e67fff700 1 -- 172.21.15.40:0/840784120 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e70009590 con 0x7f2e800b4c60 2023-06-22T10:54:15.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.034+0000 7f2e67fff700 1 -- 172.21.15.40:0/840784120 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e7000ee70 con 0x7f2e800b4c60 2023-06-22T10:54:15.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.034+0000 7f2e85fff700 1 -- 172.21.15.40:0/840784120 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e801f2750 con 0x7f2e800b4c60 2023-06-22T10:54:15.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.034+0000 7f2e67fff700 1 -- 172.21.15.40:0/840784120 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7000ca50 con 0x7f2e800b4c60 2023-06-22T10:54:15.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.034+0000 7f2e85fff700 1 -- 172.21.15.40:0/840784120 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e800c9650 con 0x7f2e800b4c60 2023-06-22T10:54:15.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.035+0000 7f2e85fff700 1 -- 172.21.15.40:0/840784120 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e800c67b0 con 0x7f2e800b4c60 2023-06-22T10:54:15.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.036+0000 7f2e67fff700 1 -- 172.21.15.40:0/840784120 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2e7000cbb0 con 0x7f2e800b4c60 2023-06-22T10:54:15.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.037+0000 7f2e67fff700 1 --2- 172.21.15.40:0/840784120 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f2e6c06ace0 0x7f2e6c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:15.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.037+0000 7f2e67fff700 1 -- 172.21.15.40:0/840784120 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2e70089820 con 0x7f2e800b4c60 2023-06-22T10:54:15.042 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.037+0000 7f2e7effd700 1 --2- 172.21.15.40:0/840784120 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f2e6c06ace0 0x7f2e6c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:15.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.038+0000 7f2e7effd700 1 --2- 172.21.15.40:0/840784120 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f2e6c06ace0 0x7f2e6c06d190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2e800c6610 tx=0x7f2e74010000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:15.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.041+0000 7f2e67fff700 1 -- 172.21.15.40:0/840784120 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2e70057f90 con 0x7f2e800b4c60 2023-06-22T10:54:15.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.293+0000 7f2e85fff700 1 -- 172.21.15.40:0/840784120 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2e800c6cc0 con 0x7f2e800b4c60 2023-06-22T10:54:15.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.293+0000 7f2e67fff700 1 -- 172.21.15.40:0/840784120 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4664 (secure 0 0 0) 0x7f2e7000ce60 con 0x7f2e800b4c60 2023-06-22T10:54:15.297 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:54:15.297 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/627935577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":627935577},{"type":"v1","addr":"172.21.15.40:6835","nonce":627935577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3018871402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3018871402},{"type":"v1","addr":"172.21.15.40:6837","nonce":3018871402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/4036649607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":4036649607},{"type":"v1","addr":"172.21.15.45:6834","nonce":4036649607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-22T10:53:31.430326+0000","modified":"2023-06-22T10:53:59.666730+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4303},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4303":{"gid":4303,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/1579627519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":1579627519},{"type":"v1","addr":"172.21.15.45:6835","nonce":1579627519}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-22T10:54:15.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.296+0000 7f2e85fff700 1 -- 172.21.15.40:0/840784120 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f2e6c06ace0 msgr2=0x7f2e6c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:15.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.296+0000 7f2e85fff700 1 --2- 172.21.15.40:0/840784120 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f2e6c06ace0 0x7f2e6c06d190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2e800c6610 tx=0x7f2e74010000 comp rx=0 tx=0).stop 2023-06-22T10:54:15.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.296+0000 7f2e85fff700 1 -- 172.21.15.40:0/840784120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e800b4c60 msgr2=0x7f2e8015cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:15.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.296+0000 7f2e85fff700 1 --2- 172.21.15.40:0/840784120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e800b4c60 0x7f2e8015cdb0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2e7000e870 tx=0x7f2e7000ec30 comp rx=0 tx=0).stop 2023-06-22T10:54:15.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.296+0000 7f2e85fff700 1 -- 172.21.15.40:0/840784120 shutdown_connections 2023-06-22T10:54:15.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.296+0000 7f2e85fff700 1 --2- 172.21.15.40:0/840784120 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f2e6c06ace0 0x7f2e6c06d190 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:15.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.296+0000 7f2e85fff700 1 --2- 172.21.15.40:0/840784120 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e8015c720 0x7f2e800c9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:15.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.296+0000 7f2e85fff700 1 --2- 172.21.15.40:0/840784120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e800b4c60 0x7f2e8015cdb0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:15.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.296+0000 7f2e85fff700 1 --2- 172.21.15.40:0/840784120 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f2e800d2830 0x7f2e801f2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:15.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.296+0000 7f2e85fff700 1 -- 172.21.15.40:0/840784120 >> 172.21.15.40:0/840784120 conn(0x7f2e800cf720 msgr2=0x7f2e800d0ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:15.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.296+0000 7f2e85fff700 1 -- 172.21.15.40:0/840784120 shutdown_connections 2023-06-22T10:54:15.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.296+0000 7f2e85fff700 1 -- 172.21.15.40:0/840784120 wait complete. 2023-06-22T10:54:15.301 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 9 2023-06-22T10:54:15.720 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-06-22T10:53:31.430326+0000', 'modified': '2023-06-22T10:53:59.666730+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4303}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4303': {'gid': 4303, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.45:6835/1579627519', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6833', 'nonce': 1579627519}, {'type': 'v1', 'addr': '172.21.15.45:6835', 'nonce': 1579627519}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-06-22T10:54:15.720 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-06-22T10:54:15.721 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-06-22T10:54:15.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.923+0000 7f09551ff700 1 Processor -- start 2023-06-22T10:54:15.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.923+0000 7f09551ff700 1 -- start start 2023-06-22T10:54:15.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.924+0000 7f09551ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f09500d2830 0x7f09500b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:15.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.924+0000 7f09551ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09500b50a0 con 0x7f09500b4c60 2023-06-22T10:54:15.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.924+0000 7f09551ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09500b2130 con 0x7f095015c720 2023-06-22T10:54:15.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.924+0000 7f09551ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0950160d60 con 0x7f09500d2830 2023-06-22T10:54:15.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.924+0000 7f094f59e700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f09500b4c60 0x7f09500d0d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:54234/0 (socket says 172.21.15.40:54234) 2023-06-22T10:54:15.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.924+0000 7f094e59c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f09500d2830 0x7f09500b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:15.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.924+0000 7f094f59e700 1 -- 172.21.15.40:0/3694980554 learned_addr learned my addr 172.21.15.40:0/3694980554 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:15.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.925+0000 7f094e59c700 1 -- 172.21.15.40:0/3694980554 >> v1:172.21.15.45:6789/0 conn(0x7f095015c720 legacy=0x7f09500b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:15.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.925+0000 7f094e59c700 1 -- 172.21.15.40:0/3694980554 >> v1:172.21.15.40:6789/0 conn(0x7f09500b4c60 legacy=0x7f09500d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:15.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.925+0000 7f094e59c700 1 -- 172.21.15.40:0/3694980554 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0950161180 con 0x7f09500d2830 2023-06-22T10:54:15.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.925+0000 7f094dd9b700 1 -- 172.21.15.40:0/3694980554 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3862664799 0 0) 0x7f09500b50a0 con 0x7f09500b4c60 2023-06-22T10:54:15.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.925+0000 7f094e59c700 1 --2- 172.21.15.40:0/3694980554 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09500d2830 0x7f09500b4720 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0944009870 tx=0x7f0944009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=139c4574a2b706f1 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:15.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.925+0000 7f094dd9b700 1 -- 172.21.15.40:0/3694980554 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0944011830 con 0x7f09500d2830 2023-06-22T10:54:15.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.925+0000 7f094dd9b700 1 -- 172.21.15.40:0/3694980554 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0944011990 con 0x7f09500d2830 2023-06-22T10:54:15.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.925+0000 7f094dd9b700 1 -- 172.21.15.40:0/3694980554 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0944011d20 con 0x7f09500d2830 2023-06-22T10:54:15.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.926+0000 7f09551ff700 1 -- 172.21.15.40:0/3694980554 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09500d2830 msgr2=0x7f09500b4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:15.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.926+0000 7f09551ff700 1 --2- 172.21.15.40:0/3694980554 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09500d2830 0x7f09500b4720 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0944009870 tx=0x7f0944009b80 comp rx=0 tx=0).stop 2023-06-22T10:54:15.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.926+0000 7f09551ff700 1 -- 172.21.15.40:0/3694980554 shutdown_connections 2023-06-22T10:54:15.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.926+0000 7f09551ff700 1 --2- 172.21.15.40:0/3694980554 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09500d2830 0x7f09500b4720 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:15.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.926+0000 7f09551ff700 1 -- 172.21.15.40:0/3694980554 >> 172.21.15.40:0/3694980554 conn(0x7f09500cf720 msgr2=0x7f09500cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:15.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.926+0000 7f09551ff700 1 -- 172.21.15.40:0/3694980554 shutdown_connections 2023-06-22T10:54:15.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.926+0000 7f09551ff700 1 -- 172.21.15.40:0/3694980554 wait complete. 2023-06-22T10:54:15.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.928+0000 7f09551ff700 1 Processor -- start 2023-06-22T10:54:15.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.928+0000 7f09551ff700 1 -- start start 2023-06-22T10:54:15.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.929+0000 7f09551ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f09500b4c60 0x7f0950153460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:15.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.929+0000 7f09551ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09500d2830 0x7f095015f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:15.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.929+0000 7f09551ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f095015c720 0x7f095015e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:15.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.929+0000 7f09551ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09500ccbe0 con 0x7f09500d2830 2023-06-22T10:54:15.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.929+0000 7f09551ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09500cc900 con 0x7f095015c720 2023-06-22T10:54:15.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.929+0000 7f09551ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09500b7d40 con 0x7f09500b4c60 2023-06-22T10:54:15.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.929+0000 7f094e59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09500d2830 0x7f095015f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:15.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.929+0000 7f094e59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09500d2830 0x7f095015f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52504/0 (socket says 172.21.15.40:52504) 2023-06-22T10:54:15.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.929+0000 7f094e59c700 1 -- 172.21.15.40:0/4267331504 learned_addr learned my addr 172.21.15.40:0/4267331504 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:15.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.929+0000 7f094f59e700 1 --2- 172.21.15.40:0/4267331504 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f095015c720 0x7f095015e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:15.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.929+0000 7f094ed9d700 1 --2- 172.21.15.40:0/4267331504 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f09500b4c60 0x7f0950153460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:15.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.930+0000 7f094e59c700 1 -- 172.21.15.40:0/4267331504 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f09500b4c60 msgr2=0x7f0950153460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:15.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.930+0000 7f094e59c700 1 --2- 172.21.15.40:0/4267331504 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f09500b4c60 0x7f0950153460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:15.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.930+0000 7f094e59c700 1 -- 172.21.15.40:0/4267331504 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f095015c720 msgr2=0x7f095015e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:15.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.930+0000 7f094e59c700 1 --2- 172.21.15.40:0/4267331504 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f095015c720 0x7f095015e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:15.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.930+0000 7f094e59c700 1 -- 172.21.15.40:0/4267331504 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09440094a0 con 0x7f09500d2830 2023-06-22T10:54:15.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.930+0000 7f094e59c700 1 --2- 172.21.15.40:0/4267331504 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09500d2830 0x7f095015f4e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f09440097c0 tx=0x7f0944004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:15.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.930+0000 7f09377fe700 1 -- 172.21.15.40:0/4267331504 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09440038a0 con 0x7f09500d2830 2023-06-22T10:54:15.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.930+0000 7f09377fe700 1 -- 172.21.15.40:0/4267331504 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f094401f070 con 0x7f09500d2830 2023-06-22T10:54:15.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.930+0000 7f09377fe700 1 -- 172.21.15.40:0/4267331504 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0944003c60 con 0x7f09500d2830 2023-06-22T10:54:15.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.930+0000 7f09551ff700 1 -- 172.21.15.40:0/4267331504 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09500b8020 con 0x7f09500d2830 2023-06-22T10:54:15.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.930+0000 7f09551ff700 1 -- 172.21.15.40:0/4267331504 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f095015ef80 con 0x7f09500d2830 2023-06-22T10:54:15.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.934+0000 7f09377fe700 1 -- 172.21.15.40:0/4267331504 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f094401a430 con 0x7f09500d2830 2023-06-22T10:54:15.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.935+0000 7f09377fe700 1 --2- 172.21.15.40:0/4267331504 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f093c06ace0 0x7f093c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:15.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.935+0000 7f09377fe700 1 -- 172.21.15.40:0/4267331504 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0944021070 con 0x7f09500d2830 2023-06-22T10:54:15.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.935+0000 7f094ed9d700 1 --2- 172.21.15.40:0/4267331504 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f093c06ace0 0x7f093c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:15.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.935+0000 7f094ed9d700 1 --2- 172.21.15.40:0/4267331504 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f093c06ace0 0x7f093c06d190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f095015c0e0 tx=0x7f0940009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:15.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.936+0000 7f0968a61b80 1 Processor -- start 2023-06-22T10:54:15.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.936+0000 7f0968a61b80 1 -- start start 2023-06-22T10:54:15.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.937+0000 7f0968a61b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564b58a89320 0x564b58a896f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:15.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.937+0000 7f0968a61b80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564b58a5c6d0 0x564b58a5f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:15.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.937+0000 7f0968a61b80 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x564b58a5a5b0 0x564b58a86510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:15.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.937+0000 7f0968a61b80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b589d3ea0 con 0x564b58a5c6d0 2023-06-22T10:54:15.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.937+0000 7f0968a61b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b58947600 con 0x564b58a89320 2023-06-22T10:54:15.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.937+0000 7f0968a61b80 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x564b589b6910 con 0x564b58a5a5b0 2023-06-22T10:54:15.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.938+0000 7f094e59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564b58a5c6d0 0x564b58a5f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:15.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.938+0000 7f094e59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564b58a5c6d0 0x564b58a5f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52520/0 (socket says 172.21.15.40:52520) 2023-06-22T10:54:15.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.938+0000 7f094e59c700 1 -- 172.21.15.40:0/418479322 learned_addr learned my addr 172.21.15.40:0/418479322 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:15.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.938+0000 7f094f59e700 1 --2- 172.21.15.40:0/418479322 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x564b58a5a5b0 0x564b58a86510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:15.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.938+0000 7f094ed9d700 1 --2- 172.21.15.40:0/418479322 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564b58a89320 0x564b58a896f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:15.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.938+0000 7f094e59c700 1 -- 172.21.15.40:0/418479322 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x564b58a5a5b0 msgr2=0x564b58a86510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:15.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.938+0000 7f094e59c700 1 --2- 172.21.15.40:0/418479322 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x564b58a5a5b0 0x564b58a86510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:15.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.938+0000 7f094e59c700 1 -- 172.21.15.40:0/418479322 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564b58a89320 msgr2=0x564b58a896f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:15.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.938+0000 7f094e59c700 1 --2- 172.21.15.40:0/418479322 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564b58a89320 0x564b58a896f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:15.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.938+0000 7f094e59c700 1 -- 172.21.15.40:0/418479322 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564b587a3790 con 0x564b58a5c6d0 2023-06-22T10:54:15.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.938+0000 7f094ed9d700 1 --2- 172.21.15.40:0/418479322 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564b58a89320 0x564b58a896f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-22T10:54:15.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.938+0000 7f094e59c700 1 --2- 172.21.15.40:0/418479322 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564b58a5c6d0 0x564b58a5f500 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0944059a30 tx=0x7f0944059870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc07e92c269e9e8d server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:15.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.938+0000 7f09357fa700 1 -- 172.21.15.40:0/418479322 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094408b0c0 con 0x564b58a5c6d0 2023-06-22T10:54:15.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.938+0000 7f09357fa700 1 -- 172.21.15.40:0/418479322 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0944062080 con 0x564b58a5c6d0 2023-06-22T10:54:15.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.938+0000 7f09357fa700 1 -- 172.21.15.40:0/418479322 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09440580d0 con 0x564b58a5c6d0 2023-06-22T10:54:15.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.939+0000 7f0968a61b80 1 -- 172.21.15.40:0/418479322 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564b58a5c6d0 msgr2=0x564b58a5f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:15.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.939+0000 7f0968a61b80 1 --2- 172.21.15.40:0/418479322 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564b58a5c6d0 0x564b58a5f500 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0944059a30 tx=0x7f0944059870 comp rx=0 tx=0).stop 2023-06-22T10:54:15.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.939+0000 7f0968a61b80 1 -- 172.21.15.40:0/418479322 shutdown_connections 2023-06-22T10:54:15.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.939+0000 7f0968a61b80 1 --2- 172.21.15.40:0/418479322 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x564b58a5a5b0 0x564b58a86510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:15.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.939+0000 7f0968a61b80 1 --2- 172.21.15.40:0/418479322 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564b58a89320 0x564b58a896f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:15.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.939+0000 7f0968a61b80 1 --2- 172.21.15.40:0/418479322 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564b58a5c6d0 0x564b58a5f500 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:15.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.939+0000 7f0968a61b80 1 -- 172.21.15.40:0/418479322 >> 172.21.15.40:0/418479322 conn(0x564b58a53dd0 msgr2=0x564b58aa4130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:15.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.939+0000 7f0968a61b80 1 -- 172.21.15.40:0/418479322 shutdown_connections 2023-06-22T10:54:15.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.939+0000 7f0968a61b80 1 -- 172.21.15.40:0/418479322 wait complete. 2023-06-22T10:54:15.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.940+0000 7f0968a61b80 1 -- start start 2023-06-22T10:54:15.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.940+0000 7f0968a61b80 1 Processor -- start 2023-06-22T10:54:15.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.941+0000 7f0968a61b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564b58a5a5b0 0x564b58a803d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:15.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.941+0000 7f0968a61b80 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x564b58a5c6d0 0x564b58a83490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:15.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.941+0000 7f0968a61b80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564b58a89320 0x564b58aa55b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:15.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.941+0000 7f0968a61b80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b589afbe0 con 0x564b58a89320 2023-06-22T10:54:15.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.941+0000 7f0968a61b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b5896d5b0 con 0x564b58a5a5b0 2023-06-22T10:54:15.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.941+0000 7f0968a61b80 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x564b58953910 con 0x564b58a5c6d0 2023-06-22T10:54:15.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.941+0000 7f0968a61b80 10 client.0 _ll_register_callbacks cb 0x564b5896bb70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-22T10:54:15.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.942+0000 7f094f59e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564b58a89320 0x564b58aa55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:15.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.942+0000 7f094ed9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564b58a5a5b0 0x564b58a803d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:15.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.942+0000 7f094f59e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564b58a89320 0x564b58aa55b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52528/0 (socket says 172.21.15.40:52528) 2023-06-22T10:54:15.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.942+0000 7f094f59e700 1 -- 172.21.15.40:0/3527310194 learned_addr learned my addr 172.21.15.40:0/3527310194 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:15.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.942+0000 7f094e59c700 1 --2- 172.21.15.40:0/3527310194 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x564b58a5c6d0 0x564b58a83490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:15.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.942+0000 7f094f59e700 1 -- 172.21.15.40:0/3527310194 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x564b58a5c6d0 msgr2=0x564b58a83490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:15.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.942+0000 7f094f59e700 1 --2- 172.21.15.40:0/3527310194 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x564b58a5c6d0 0x564b58a83490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:15.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.942+0000 7f094f59e700 1 -- 172.21.15.40:0/3527310194 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564b58a5a5b0 msgr2=0x564b58a803d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:15.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.942+0000 7f094f59e700 1 --2- 172.21.15.40:0/3527310194 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564b58a5a5b0 0x564b58a803d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:15.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.942+0000 7f094f59e700 1 -- 172.21.15.40:0/3527310194 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f095015ef80 con 0x564b58a89320 2023-06-22T10:54:15.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.942+0000 7f094f59e700 1 --2- 172.21.15.40:0/3527310194 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564b58a89320 0x564b58aa55b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0948007690 tx=0x7f09480079a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0d62f2698101aa server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:15.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.942+0000 7f092dffb700 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-06-22T10:54:15.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.943+0000 7f092dffb700 1 -- 172.21.15.40:0/3527310194 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0948010ae0 con 0x564b58a89320 2023-06-22T10:54:15.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.943+0000 7f0968a61b80 1 -- 172.21.15.40:0/3527310194 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564b58a513e0 con 0x564b58a89320 2023-06-22T10:54:15.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.943+0000 7f092dffb700 1 -- 172.21.15.40:0/3527310194 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0948010c40 con 0x564b58a89320 2023-06-22T10:54:15.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.943+0000 7f092dffb700 1 -- 172.21.15.40:0/3527310194 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0948010e00 con 0x564b58a89320 2023-06-22T10:54:15.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.943+0000 7f0968a61b80 10 client.4881 fetch_fsmap learned FSMap version 9 2023-06-22T10:54:15.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.943+0000 7f0968a61b80 1 -- 172.21.15.40:0/3527310194 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x564b588900a0 con 0x564b58a89320 2023-06-22T10:54:15.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.943+0000 7f092dffb700 1 -- 172.21.15.40:0/3527310194 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564b58a513e0 con 0x564b58a89320 2023-06-22T10:54:15.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.943+0000 7f092dffb700 1 -- 172.21.15.40:0/3527310194 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 9) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f094801d3f0 con 0x564b58a89320 2023-06-22T10:54:15.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.943+0000 7f0968a61b80 10 client.4881 fetch_fsmap finished waiting for FSMap version 9 2023-06-22T10:54:15.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.943+0000 7f0968a61b80 10 client.4881 resolve_mds: resolved name 'd' to daemon mds.d 2023-06-22T10:54:15.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.943+0000 7f0968a61b80 20 client.4881 populate_metadata read hostname 'smithi040' 2023-06-22T10:54:15.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.943+0000 7f0968a61b80 1 --2- 172.21.15.40:0/3527310194 >> [v2:172.21.15.45:6833/1579627519,v1:172.21.15.45:6835/1579627519] conn(0x564b58a873b0 0x564b58a87780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:15.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.943+0000 7f0968a61b80 4 client.4881 mds_command: new command op to 4303 tid=0[{"prefix": "get_command_descriptions"}] 2023-06-22T10:54:15.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.943+0000 7f0968a61b80 1 -- 172.21.15.40:0/3527310194 --> [v2:172.21.15.45:6833/1579627519,v1:172.21.15.45:6835/1579627519] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564b58a2da50 con 0x564b58a873b0 2023-06-22T10:54:15.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.944+0000 7f094ed9d700 1 --2- 172.21.15.40:0/3527310194 >> [v2:172.21.15.45:6833/1579627519,v1:172.21.15.45:6835/1579627519] conn(0x564b58a873b0 0x564b58a87780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:15.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.944+0000 7f094ed9d700 1 --2- 172.21.15.40:0/3527310194 >> [v2:172.21.15.45:6833/1579627519,v1:172.21.15.45:6835/1579627519] conn(0x564b58a873b0 0x564b58a87780 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2790a97df68d244e server_cookie=bfadc49fd3db880e in_seq=0 out_seq=0 2023-06-22T10:54:15.959 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.944+0000 7f092dffb700 10 client.4881 ms_handle_connect on v2:172.21.15.45:6833/1579627519 2023-06-22T10:54:15.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.945+0000 7f092dffb700 1 -- 172.21.15.40:0/3527310194 <== mds.0 v2:172.21.15.45:6833/1579627519 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x564b58a2da50 con 0x564b58a873b0 2023-06-22T10:54:15.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.945+0000 7f092dffb700 10 client.4881 handle_command_reply: tid=0 2023-06-22T10:54:15.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.945+0000 7f0968a61b80 1 client.4881 shutdown 2023-06-22T10:54:15.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.945+0000 7f0968a61b80 1 -- 172.21.15.40:0/3527310194 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564b58a89320 msgr2=0x564b58aa55b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:15.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.945+0000 7f0968a61b80 1 --2- 172.21.15.40:0/3527310194 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564b58a89320 0x564b58aa55b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0948007690 tx=0x7f09480079a0 comp rx=0 tx=0).stop 2023-06-22T10:54:15.960 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.945+0000 7f0968a61b80 1 -- 172.21.15.40:0/3527310194 shutdown_connections 2023-06-22T10:54:15.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.945+0000 7f0968a61b80 1 --2- 172.21.15.40:0/3527310194 >> [v2:172.21.15.45:6833/1579627519,v1:172.21.15.45:6835/1579627519] conn(0x564b58a873b0 0x564b58a87780 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:15.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.945+0000 7f0968a61b80 1 --2- 172.21.15.40:0/3527310194 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564b58a89320 0x564b58aa55b0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:15.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.945+0000 7f0968a61b80 1 --2- 172.21.15.40:0/3527310194 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564b58a5a5b0 0x564b58a803d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:15.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.945+0000 7f0968a61b80 1 --2- 172.21.15.40:0/3527310194 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x564b58a5c6d0 0x564b58a83490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:15.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.945+0000 7f0968a61b80 1 -- 172.21.15.40:0/3527310194 >> 172.21.15.40:0/3527310194 conn(0x564b58a53dd0 msgr2=0x564b58a844d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:15.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.945+0000 7f092dffb700 0 client.4881 ms_handle_reset on v2:172.21.15.45:6833/1579627519 2023-06-22T10:54:15.961 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.946+0000 7f0968a61b80 1 -- 172.21.15.40:0/3527310194 shutdown_connections 2023-06-22T10:54:15.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.946+0000 7f0968a61b80 1 -- 172.21.15.40:0/3527310194 wait complete. 2023-06-22T10:54:15.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.946+0000 7f0968a61b80 20 client.4881 trim_cache size 0 max 16384 2023-06-22T10:54:15.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.964+0000 7f0968a61b80 1 Processor -- start 2023-06-22T10:54:15.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.964+0000 7f0968a61b80 1 -- start start 2023-06-22T10:54:15.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.965+0000 7f0968a61b80 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x564b58a5a5b0 0x564b58aa7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:15.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.965+0000 7f0968a61b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564b58a5c6d0 0x564b58aa55b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:15.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.965+0000 7f0968a61b80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564b58a89320 0x564b58a898e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:15.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.965+0000 7f0968a61b80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b587a4390 con 0x564b58a89320 2023-06-22T10:54:15.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.965+0000 7f0968a61b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b58a5a2f0 con 0x564b58a5c6d0 2023-06-22T10:54:15.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.965+0000 7f0968a61b80 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x564b58a553b0 con 0x564b58a5a5b0 2023-06-22T10:54:15.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.965+0000 7f094f59e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564b58a89320 0x564b58a898e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:15.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.966+0000 7f094f59e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564b58a89320 0x564b58a898e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52538/0 (socket says 172.21.15.40:52538) 2023-06-22T10:54:15.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.966+0000 7f094f59e700 1 -- 172.21.15.40:0/2807913508 learned_addr learned my addr 172.21.15.40:0/2807913508 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:15.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.966+0000 7f094ed9d700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x564b58a5a5b0 0x564b58aa7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:15.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.966+0000 7f094e59c700 1 --2- 172.21.15.40:0/2807913508 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564b58a5c6d0 0x564b58aa55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:15.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.966+0000 7f094f59e700 1 -- 172.21.15.40:0/2807913508 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x564b58a5a5b0 msgr2=0x564b58aa7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:15.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.966+0000 7f094f59e700 1 --2- 172.21.15.40:0/2807913508 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x564b58a5a5b0 0x564b58aa7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:15.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.966+0000 7f094f59e700 1 -- 172.21.15.40:0/2807913508 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564b58a5c6d0 msgr2=0x564b58aa55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:15.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.966+0000 7f094f59e700 1 --2- 172.21.15.40:0/2807913508 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564b58a5c6d0 0x564b58aa55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:15.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.966+0000 7f094f59e700 1 -- 172.21.15.40:0/2807913508 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564b58975b10 con 0x564b58a89320 2023-06-22T10:54:15.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.966+0000 7f094f59e700 1 --2- 172.21.15.40:0/2807913508 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564b58a89320 0x564b58a898e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0948001220 tx=0x7f0948014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8abdb9a9310f8e6 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:15.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.966+0000 7f0935ffb700 1 -- 172.21.15.40:0/2807913508 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0948001d10 con 0x564b58a89320 2023-06-22T10:54:15.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.966+0000 7f0935ffb700 1 -- 172.21.15.40:0/2807913508 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09480104c0 con 0x564b58a89320 2023-06-22T10:54:15.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.966+0000 7f0935ffb700 1 -- 172.21.15.40:0/2807913508 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094801d950 con 0x564b58a89320 2023-06-22T10:54:15.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.967+0000 7f0968a61b80 1 -- 172.21.15.40:0/2807913508 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564b58a89320 msgr2=0x564b58a898e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:15.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.967+0000 7f0968a61b80 1 --2- 172.21.15.40:0/2807913508 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564b58a89320 0x564b58a898e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0948001220 tx=0x7f0948014000 comp rx=0 tx=0).stop 2023-06-22T10:54:15.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.967+0000 7f0968a61b80 1 -- 172.21.15.40:0/2807913508 shutdown_connections 2023-06-22T10:54:15.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.967+0000 7f0968a61b80 1 --2- 172.21.15.40:0/2807913508 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x564b58a5a5b0 0x564b58aa7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:15.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.967+0000 7f0968a61b80 1 --2- 172.21.15.40:0/2807913508 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564b58a89320 0x564b58a898e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:15.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.967+0000 7f0968a61b80 1 --2- 172.21.15.40:0/2807913508 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564b58a5c6d0 0x564b58aa55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:15.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.967+0000 7f0968a61b80 1 -- 172.21.15.40:0/2807913508 >> 172.21.15.40:0/2807913508 conn(0x564b58a53dd0 msgr2=0x564b58a83b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:15.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.967+0000 7f0968a61b80 1 -- 172.21.15.40:0/2807913508 shutdown_connections 2023-06-22T10:54:15.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.967+0000 7f0968a61b80 1 -- 172.21.15.40:0/2807913508 wait complete. 2023-06-22T10:54:15.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.968+0000 7f0968a61b80 1 -- start start 2023-06-22T10:54:15.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.968+0000 7f0968a61b80 1 Processor -- start 2023-06-22T10:54:15.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.969+0000 7f0968a61b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564b58a5a5b0 0x564b58b0ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:15.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.969+0000 7f0968a61b80 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x564b58a5c6d0 0x564b58a7f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:15.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.969+0000 7f0968a61b80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564b58a89320 0x564b58a7f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:15.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.969+0000 7f0968a61b80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b58a88ae0 con 0x564b58a89320 2023-06-22T10:54:15.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.969+0000 7f0968a61b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b58aa41f0 con 0x564b58a5a5b0 2023-06-22T10:54:15.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.969+0000 7f0968a61b80 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x564b58a5b210 con 0x564b58a5c6d0 2023-06-22T10:54:15.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.969+0000 7f0968a61b80 10 client.0 _ll_register_callbacks cb 0x7f0948001af0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-22T10:54:15.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.969+0000 7f094f59e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564b58a89320 0x564b58a7f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:15.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.969+0000 7f094f59e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564b58a89320 0x564b58a7f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52548/0 (socket says 172.21.15.40:52548) 2023-06-22T10:54:15.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.969+0000 7f094e59c700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x564b58a5c6d0 0x564b58a7f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:15.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.969+0000 7f094f59e700 1 -- 172.21.15.40:0/1280904140 learned_addr learned my addr 172.21.15.40:0/1280904140 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:15.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.969+0000 7f094ed9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564b58a5a5b0 0x564b58b0ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:15.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.970+0000 7f094f59e700 1 -- 172.21.15.40:0/1280904140 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x564b58a5c6d0 msgr2=0x564b58a7f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:15.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.970+0000 7f094f59e700 1 --2- 172.21.15.40:0/1280904140 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x564b58a5c6d0 0x564b58a7f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:15.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.970+0000 7f094f59e700 1 -- 172.21.15.40:0/1280904140 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564b58a5a5b0 msgr2=0x564b58b0ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:15.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.970+0000 7f094f59e700 1 --2- 172.21.15.40:0/1280904140 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564b58a5a5b0 0x564b58b0ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:15.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.970+0000 7f094f59e700 1 -- 172.21.15.40:0/1280904140 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564b588900a0 con 0x564b58a89320 2023-06-22T10:54:15.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.970+0000 7f094f59e700 1 --2- 172.21.15.40:0/1280904140 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564b58a89320 0x564b58a7f800 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f09480079e0 tx=0x7f0948001400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc52f69ce4306ebf server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:15.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.970+0000 7f092dffb700 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-06-22T10:54:15.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.970+0000 7f092dffb700 1 -- 172.21.15.40:0/1280904140 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0948007390 con 0x564b58a89320 2023-06-22T10:54:15.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.970+0000 7f092dffb700 1 -- 172.21.15.40:0/1280904140 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f09480108e0 con 0x564b58a89320 2023-06-22T10:54:15.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.970+0000 7f0968a61b80 1 -- 172.21.15.40:0/1280904140 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0944062080 con 0x564b58a89320 2023-06-22T10:54:15.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.970+0000 7f092dffb700 1 -- 172.21.15.40:0/1280904140 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0948010aa0 con 0x564b58a89320 2023-06-22T10:54:15.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.971+0000 7f0968a61b80 10 client.4887 fetch_fsmap learned FSMap version 9 2023-06-22T10:54:15.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.971+0000 7f0968a61b80 1 -- 172.21.15.40:0/1280904140 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x564b588041d0 con 0x564b58a89320 2023-06-22T10:54:15.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.971+0000 7f092dffb700 1 -- 172.21.15.40:0/1280904140 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0944062080 con 0x564b58a89320 2023-06-22T10:54:15.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.971+0000 7f092dffb700 1 -- 172.21.15.40:0/1280904140 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 9) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f0948010c00 con 0x564b58a89320 2023-06-22T10:54:15.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.971+0000 7f0968a61b80 10 client.4887 fetch_fsmap finished waiting for FSMap version 9 2023-06-22T10:54:15.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.971+0000 7f0968a61b80 10 client.4887 resolve_mds: resolved name 'd' to daemon mds.d 2023-06-22T10:54:15.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.971+0000 7f0968a61b80 20 client.4887 populate_metadata read hostname 'smithi040' 2023-06-22T10:54:15.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.971+0000 7f0968a61b80 1 --2- 172.21.15.40:0/1280904140 >> [v2:172.21.15.45:6833/1579627519,v1:172.21.15.45:6835/1579627519] conn(0x564b58a5e1f0 0x564b58a5e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:15.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.971+0000 7f0968a61b80 4 client.4887 mds_command: new command op to 4303 tid=0[{"prefix": "status"}] 2023-06-22T10:54:15.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.971+0000 7f0968a61b80 1 -- 172.21.15.40:0/1280904140 --> [v2:172.21.15.45:6833/1579627519,v1:172.21.15.45:6835/1579627519] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564b589a8d20 con 0x564b58a5e1f0 2023-06-22T10:54:15.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.971+0000 7f094ed9d700 1 --2- 172.21.15.40:0/1280904140 >> [v2:172.21.15.45:6833/1579627519,v1:172.21.15.45:6835/1579627519] conn(0x564b58a5e1f0 0x564b58a5e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:15.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.972+0000 7f094ed9d700 1 --2- 172.21.15.40:0/1280904140 >> [v2:172.21.15.45:6833/1579627519,v1:172.21.15.45:6835/1579627519] conn(0x564b58a5e1f0 0x564b58a5e5c0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d19e684c272c7179 server_cookie=1c7b3fc4cd429cd0 in_seq=0 out_seq=0 2023-06-22T10:54:15.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.972+0000 7f092dffb700 10 client.4887 ms_handle_connect on v2:172.21.15.45:6833/1579627519 2023-06-22T10:54:15.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.972+0000 7f092dffb700 1 -- 172.21.15.40:0/1280904140 <== mds.0 v2:172.21.15.45:6833/1579627519 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x564b589a8d20 con 0x564b58a5e1f0 2023-06-22T10:54:15.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.972+0000 7f092dffb700 10 client.4887 handle_command_reply: tid=0 2023-06-22T10:54:15.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.972+0000 7f0968a61b80 1 client.4887 shutdown 2023-06-22T10:54:15.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.972+0000 7f0968a61b80 1 -- 172.21.15.40:0/1280904140 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564b58a89320 msgr2=0x564b58a7f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:15.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.972+0000 7f0968a61b80 1 --2- 172.21.15.40:0/1280904140 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564b58a89320 0x564b58a7f800 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f09480079e0 tx=0x7f0948001400 comp rx=0 tx=0).stop 2023-06-22T10:54:15.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.973+0000 7f0968a61b80 1 -- 172.21.15.40:0/1280904140 shutdown_connections 2023-06-22T10:54:15.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.973+0000 7f0968a61b80 1 --2- 172.21.15.40:0/1280904140 >> [v2:172.21.15.45:6833/1579627519,v1:172.21.15.45:6835/1579627519] conn(0x564b58a5e1f0 0x564b58a5e5c0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:15.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.973+0000 7f0968a61b80 1 --2- 172.21.15.40:0/1280904140 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x564b58a89320 0x564b58a7f800 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:15.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.973+0000 7f0968a61b80 1 --2- 172.21.15.40:0/1280904140 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564b58a5a5b0 0x564b58b0ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:15.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.973+0000 7f0968a61b80 1 --2- 172.21.15.40:0/1280904140 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x564b58a5c6d0 0x564b58a7f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:15.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.973+0000 7f092dffb700 0 client.4887 ms_handle_reset on v2:172.21.15.45:6833/1579627519 2023-06-22T10:54:15.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.973+0000 7f0968a61b80 1 -- 172.21.15.40:0/1280904140 >> 172.21.15.40:0/1280904140 conn(0x564b58a53dd0 msgr2=0x564b58a84560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:15.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.973+0000 7f0968a61b80 1 -- 172.21.15.40:0/1280904140 shutdown_connections 2023-06-22T10:54:15.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.973+0000 7f0968a61b80 1 -- 172.21.15.40:0/1280904140 wait complete. 2023-06-22T10:54:15.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.973+0000 7f0968a61b80 20 client.4887 trim_cache size 0 max 16384 2023-06-22T10:54:15.987 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-06-22T10:54:15.987 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "475560bc-1a7c-4a75-b3b6-6fc6b20bdc52", 2023-06-22T10:54:15.988 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 0, 2023-06-22T10:54:15.988 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 4303, 2023-06-22T10:54:15.988 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2023-06-22T10:54:15.988 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2023-06-22T10:54:15.988 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2023-06-22T10:54:15.988 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 44.058864405999998, 2023-06-22T10:54:15.988 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 9, 2023-06-22T10:54:15.989 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 30, 2023-06-22T10:54:15.989 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 28, 2023-06-22T10:54:15.989 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 50.145902921999998 2023-06-22T10:54:15.989 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-06-22T10:54:15.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.974+0000 7f09551ff700 1 -- 172.21.15.40:0/4267331504 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f093c06ace0 msgr2=0x7f093c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:15.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.974+0000 7f09551ff700 1 --2- 172.21.15.40:0/4267331504 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f093c06ace0 0x7f093c06d190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f095015c0e0 tx=0x7f0940009040 comp rx=0 tx=0).stop 2023-06-22T10:54:15.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.974+0000 7f09551ff700 1 -- 172.21.15.40:0/4267331504 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09500d2830 msgr2=0x7f095015f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:15.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.974+0000 7f09551ff700 1 --2- 172.21.15.40:0/4267331504 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09500d2830 0x7f095015f4e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f09440097c0 tx=0x7f0944004750 comp rx=0 tx=0).stop 2023-06-22T10:54:15.990 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.974+0000 7f09551ff700 1 -- 172.21.15.40:0/4267331504 shutdown_connections 2023-06-22T10:54:15.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.974+0000 7f09551ff700 1 --2- 172.21.15.40:0/4267331504 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f093c06ace0 0x7f093c06d190 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:15.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.974+0000 7f09551ff700 1 --2- 172.21.15.40:0/4267331504 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f09500b4c60 0x7f0950153460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:15.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.974+0000 7f09551ff700 1 --2- 172.21.15.40:0/4267331504 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f095015c720 0x7f095015e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:15.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.974+0000 7f09551ff700 1 --2- 172.21.15.40:0/4267331504 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09500d2830 0x7f095015f4e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:15.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.974+0000 7f09551ff700 1 -- 172.21.15.40:0/4267331504 >> 172.21.15.40:0/4267331504 conn(0x7f09500cf720 msgr2=0x7f095015b610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:15.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.974+0000 7f09551ff700 1 -- 172.21.15.40:0/4267331504 shutdown_connections 2023-06-22T10:54:15.991 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:15.974+0000 7f09551ff700 1 -- 172.21.15.40:0/4267331504 wait complete. 2023-06-22T10:54:15.997 INFO:teuthology.run_tasks:Running task kclient... 2023-06-22T10:54:16.010 INFO:tasks.kclient:Mounting kernel clients... 2023-06-22T10:54:16.010 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-06-22T10:54:16.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:16.011 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2023-06-22T10:54:16.057 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-06-22T10:54:16.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:16.059 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-06-22T10:54:16.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:16.130 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link delete ceph-brx 2023-06-22T10:54:16.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:16.246 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2023-06-22T10:54:16.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:16.297 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link delete ceph-brx 2023-06-22T10:54:16.370 INFO:teuthology.orchestra.run.smithi040.stderr:Cannot find device "ceph-brx" 2023-06-22T10:54:16.373 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-22T10:54:16.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:16.374 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-06-22T10:54:16.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:16.427 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link delete ceph-brx 2023-06-22T10:54:16.504 INFO:teuthology.orchestra.run.smithi045.stderr:Cannot find device "ceph-brx" 2023-06-22T10:54:16.507 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-22T10:54:16.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:16.508 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-06-22T10:54:16.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:16.556 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link delete ceph-brx 2023-06-22T10:54:16.628 INFO:teuthology.orchestra.run.smithi045.stderr:Cannot find device "ceph-brx" 2023-06-22T10:54:16.631 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-22T10:54:16.631 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-06-22T10:54:16.632 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-06-22T10:54:16.632 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-06-22T10:54:16.632 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-22T10:54:16.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:16.831+0000 7f11273ff700 1 Processor -- start 2023-06-22T10:54:16.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:16.831+0000 7f11273ff700 1 -- start start 2023-06-22T10:54:16.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:16.833+0000 7f11273ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f112015a130 0x7f11200cd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:16.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:16.833+0000 7f11273ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f112006df20 0x7f11200caa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:16.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:16.833+0000 7f11273ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f11200b3b60 0x7f11200b3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:16.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:16.833+0000 7f11273ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11200b4520 con 0x7f11200b3b60 2023-06-22T10:54:16.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:16.833+0000 7f11273ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11200b05e0 con 0x7f112006df20 2023-06-22T10:54:16.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:16.833+0000 7f11273ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11200b0880 con 0x7f112015a130 2023-06-22T10:54:16.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:16.833+0000 7f112599c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f11200b3b60 0x7f11200b3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:16.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:16.833+0000 7f112599c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f11200b3b60 0x7f11200b3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52558/0 (socket says 172.21.15.40:52558) 2023-06-22T10:54:16.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:16.833+0000 7f112599c700 1 -- 172.21.15.40:0/2787288180 learned_addr learned my addr 172.21.15.40:0/2787288180 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:16.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:16.833+0000 7f112499a700 1 --2- 172.21.15.40:0/2787288180 >> v2:172.21.15.45:3300/0 conn(0x7f112006df20 0x7f11200caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:16.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:16.833+0000 7f112519b700 1 --2- 172.21.15.40:0/2787288180 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f112015a130 0x7f11200cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:16.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:16.834+0000 7f112499a700 1 -- 172.21.15.40:0/2787288180 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f112015a130 msgr2=0x7f11200cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:16.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:16.834+0000 7f112499a700 1 --2- 172.21.15.40:0/2787288180 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f112015a130 0x7f11200cd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:16.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:16.834+0000 7f112499a700 1 -- 172.21.15.40:0/2787288180 >> v2:172.21.15.40:3300/0 conn(0x7f11200b3b60 msgr2=0x7f11200b3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:16.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:16.834+0000 7f112499a700 1 --2- 172.21.15.40:0/2787288180 >> v2:172.21.15.40:3300/0 conn(0x7f11200b3b60 0x7f11200b3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:16.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:16.834+0000 7f112499a700 1 -- 172.21.15.40:0/2787288180 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11200b0b60 con 0x7f112006df20 2023-06-22T10:54:16.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:16.834+0000 7f112599c700 1 --2- 172.21.15.40:0/2787288180 >> v2:172.21.15.40:3300/0 conn(0x7f11200b3b60 0x7f11200b3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-22T10:54:16.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:16.834+0000 7f112499a700 1 --2- 172.21.15.40:0/2787288180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f112006df20 0x7f11200caa40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f112006ae80 tx=0x7f1110009b00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=236768d12687e707 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:16.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:16.834+0000 7f1117fff700 1 -- 172.21.15.40:0/2787288180 <== mon.1 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1110005e30 con 0x7f112006df20 2023-06-22T10:54:16.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:16.834+0000 7f1117fff700 1 -- 172.21.15.40:0/2787288180 <== mon.1 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1110006030 con 0x7f112006df20 2023-06-22T10:54:16.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:16.834+0000 7f1117fff700 1 -- 172.21.15.40:0/2787288180 <== mon.1 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11100063c0 con 0x7f112006df20 2023-06-22T10:54:16.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:16.835+0000 7f11273ff700 1 -- 172.21.15.40:0/2787288180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f112006df20 msgr2=0x7f11200caa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:16.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:16.835+0000 7f11273ff700 1 --2- 172.21.15.40:0/2787288180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f112006df20 0x7f11200caa40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f112006ae80 tx=0x7f1110009b00 comp rx=0 tx=0).stop 2023-06-22T10:54:16.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:16.835+0000 7f11273ff700 1 -- 172.21.15.40:0/2787288180 shutdown_connections 2023-06-22T10:54:16.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:16.835+0000 7f11273ff700 1 --2- 172.21.15.40:0/2787288180 >> v2:172.21.15.40:3300/0 conn(0x7f11200b3b60 0x7f11200b3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:16.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:16.835+0000 7f11273ff700 1 --2- 172.21.15.40:0/2787288180 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f112015a130 0x7f11200cd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:16.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:16.835+0000 7f11273ff700 1 --2- 172.21.15.40:0/2787288180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f112006df20 0x7f11200caa40 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:16.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:16.835+0000 7f11273ff700 1 -- 172.21.15.40:0/2787288180 >> 172.21.15.40:0/2787288180 conn(0x7f1120069f30 msgr2=0x7f112006a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:16.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:16.835+0000 7f11273ff700 1 -- 172.21.15.40:0/2787288180 shutdown_connections 2023-06-22T10:54:16.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:16.835+0000 7f11273ff700 1 -- 172.21.15.40:0/2787288180 wait complete. 2023-06-22T10:54:16.846 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:16.837+0000 7f11273ff700 1 Processor -- start 2023-06-22T10:54:16.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:16.837+0000 7f11273ff700 1 -- start start 2023-06-22T10:54:16.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:16.838+0000 7f11273ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f112006df20 0x7f112014fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:16.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:16.838+0000 7f11273ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11200b3b60 0x7f112014e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:16.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:16.838+0000 7f11273ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f112015a130 0x7f112014e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:16.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:16.838+0000 7f11273ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1120152fb0 con 0x7f11200b3b60 2023-06-22T10:54:16.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:16.838+0000 7f11273ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1120150130 con 0x7f112015a130 2023-06-22T10:54:16.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:16.838+0000 7f11273ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11201f3a30 con 0x7f112006df20 2023-06-22T10:54:16.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:16.838+0000 7f112499a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11200b3b60 0x7f112014e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:16.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:16.838+0000 7f112499a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11200b3b60 0x7f112014e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52572/0 (socket says 172.21.15.40:52572) 2023-06-22T10:54:16.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:16.838+0000 7f112499a700 1 -- 172.21.15.40:0/1692425700 learned_addr learned my addr 172.21.15.40:0/1692425700 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:16.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:16.839+0000 7f112599c700 1 --2- 172.21.15.40:0/1692425700 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f112015a130 0x7f112014e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:16.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:16.839+0000 7f112519b700 1 --2- 172.21.15.40:0/1692425700 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f112006df20 0x7f112014fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:16.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:16.839+0000 7f112499a700 1 -- 172.21.15.40:0/1692425700 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f112006df20 msgr2=0x7f112014fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:16.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:16.839+0000 7f112499a700 1 --2- 172.21.15.40:0/1692425700 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f112006df20 0x7f112014fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:16.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:16.839+0000 7f112499a700 1 -- 172.21.15.40:0/1692425700 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f112015a130 msgr2=0x7f112014e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:16.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:16.839+0000 7f112499a700 1 --2- 172.21.15.40:0/1692425700 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f112015a130 0x7f112014e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:16.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:16.839+0000 7f112499a700 1 -- 172.21.15.40:0/1692425700 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1118009b30 con 0x7f11200b3b60 2023-06-22T10:54:16.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:16.839+0000 7f112499a700 1 --2- 172.21.15.40:0/1692425700 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11200b3b60 0x7f112014e200 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1110000c00 tx=0x7f1110004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:16.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:16.839+0000 7f1115ffb700 1 -- 172.21.15.40:0/1692425700 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11100061a0 con 0x7f11200b3b60 2023-06-22T10:54:16.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:16.839+0000 7f1115ffb700 1 -- 172.21.15.40:0/1692425700 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1110020070 con 0x7f11200b3b60 2023-06-22T10:54:16.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:16.839+0000 7f1115ffb700 1 -- 172.21.15.40:0/1692425700 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1110006560 con 0x7f11200b3b60 2023-06-22T10:54:16.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:16.839+0000 7f11273ff700 1 -- 172.21.15.40:0/1692425700 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1110009430 con 0x7f11200b3b60 2023-06-22T10:54:16.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:16.840+0000 7f11273ff700 1 -- 172.21.15.40:0/1692425700 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1120152cd0 con 0x7f11200b3b60 2023-06-22T10:54:16.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:16.841+0000 7f11273ff700 1 -- 172.21.15.40:0/1692425700 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1120067580 con 0x7f11200b3b60 2023-06-22T10:54:16.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:16.842+0000 7f1115ffb700 1 -- 172.21.15.40:0/1692425700 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1110022030 con 0x7f11200b3b60 2023-06-22T10:54:16.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:16.843+0000 7f1115ffb700 1 --2- 172.21.15.40:0/1692425700 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f110406ace0 0x7f110406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:16.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:16.843+0000 7f1115ffb700 1 -- 172.21.15.40:0/1692425700 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f111008afa0 con 0x7f11200b3b60 2023-06-22T10:54:16.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:16.843+0000 7f112519b700 1 --2- 172.21.15.40:0/1692425700 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f110406ace0 0x7f110406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:16.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:16.844+0000 7f112519b700 1 --2- 172.21.15.40:0/1692425700 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f110406ace0 0x7f110406d190 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1120142d40 tx=0x7f111c009210 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:16.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:16.846+0000 7f1115ffb700 1 -- 172.21.15.40:0/1692425700 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1110055d90 con 0x7f11200b3b60 2023-06-22T10:54:17.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:17.097+0000 7f11273ff700 1 -- 172.21.15.40:0/1692425700 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f11201f3b70 con 0x7f11200b3b60 2023-06-22T10:54:17.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:17.097+0000 7f1115ffb700 1 -- 172.21.15.40:0/1692425700 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f11100593b0 con 0x7f11200b3b60 2023-06-22T10:54:17.101 INFO:teuthology.orchestra.run.smithi040.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-06-22T10:54:17.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:17.099+0000 7f11273ff700 1 -- 172.21.15.40:0/1692425700 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f110406ace0 msgr2=0x7f110406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:17.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:17.099+0000 7f11273ff700 1 --2- 172.21.15.40:0/1692425700 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f110406ace0 0x7f110406d190 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1120142d40 tx=0x7f111c009210 comp rx=0 tx=0).stop 2023-06-22T10:54:17.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:17.099+0000 7f11273ff700 1 -- 172.21.15.40:0/1692425700 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11200b3b60 msgr2=0x7f112014e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:17.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:17.099+0000 7f11273ff700 1 --2- 172.21.15.40:0/1692425700 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11200b3b60 0x7f112014e200 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1110000c00 tx=0x7f1110004750 comp rx=0 tx=0).stop 2023-06-22T10:54:17.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:17.099+0000 7f11273ff700 1 -- 172.21.15.40:0/1692425700 shutdown_connections 2023-06-22T10:54:17.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:17.099+0000 7f11273ff700 1 --2- 172.21.15.40:0/1692425700 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f110406ace0 0x7f110406d190 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:17.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:17.099+0000 7f11273ff700 1 --2- 172.21.15.40:0/1692425700 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f112006df20 0x7f112014fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:17.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:17.099+0000 7f11273ff700 1 --2- 172.21.15.40:0/1692425700 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f112015a130 0x7f112014e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:17.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:17.099+0000 7f11273ff700 1 --2- 172.21.15.40:0/1692425700 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f11200b3b60 0x7f112014e200 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:17.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:17.099+0000 7f11273ff700 1 -- 172.21.15.40:0/1692425700 >> 172.21.15.40:0/1692425700 conn(0x7f1120069f30 msgr2=0x7f112015a760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:17.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:17.100+0000 7f11273ff700 1 -- 172.21.15.40:0/1692425700 shutdown_connections 2023-06-22T10:54:17.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:17.100+0000 7f11273ff700 1 -- 172.21.15.40:0/1692425700 wait complete. 2023-06-22T10:54:17.120 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-22T10:54:17.121 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-22T10:54:17.121 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi040.front.sepia.ceph.com 2023-06-22T10:54:17.121 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-06-22T10:54:17.121 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-06-22T10:54:17.122 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-22T10:54:17.122 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-22T10:54:17.122 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-22T10:54:17.122 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-22T10:54:17.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:17.123 DEBUG:teuthology.orchestra.run.smithi040:> ip addr 2023-06-22T10:54:17.169 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-22T10:54:17.169 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-22T10:54:17.169 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2023-06-22T10:54:17.170 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-06-22T10:54:17.170 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2023-06-22T10:54:17.170 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-06-22T10:54:17.170 INFO:teuthology.orchestra.run.smithi040.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-22T10:54:17.171 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:16 brd ff:ff:ff:ff:ff:ff 2023-06-22T10:54:17.171 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f0 2023-06-22T10:54:17.171 INFO:teuthology.orchestra.run.smithi040.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-22T10:54:17.171 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:17 brd ff:ff:ff:ff:ff:ff 2023-06-22T10:54:17.171 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f1 2023-06-22T10:54:17.171 INFO:teuthology.orchestra.run.smithi040.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-22T10:54:17.171 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cc brd ff:ff:ff:ff:ff:ff 2023-06-22T10:54:17.172 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f0 2023-06-22T10:54:17.172 INFO:teuthology.orchestra.run.smithi040.stdout: inet 172.21.15.40/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-06-22T10:54:17.172 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft 42290sec preferred_lft 42290sec 2023-06-22T10:54:17.172 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::ec4:7aff:febd:12cc/64 scope link 2023-06-22T10:54:17.172 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-06-22T10:54:17.172 INFO:teuthology.orchestra.run.smithi040.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-22T10:54:17.172 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cd brd ff:ff:ff:ff:ff:ff 2023-06-22T10:54:17.173 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f1 2023-06-22T10:54:17.173 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-06-22T10:54:17.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:17.174 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-06-22T10:54:17.174 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-06-22T10:54:17.175 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link add name ceph-brx type bridge 2023-06-22T10:54:17.175 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip addr flush dev ceph-brx 2023-06-22T10:54:17.175 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set ceph-brx up 2023-06-22T10:54:17.175 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-06-22T10:54:17.175 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-06-22T10:54:17.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:17.374 DEBUG:teuthology.orchestra.run.smithi040:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-22T10:54:17.443 INFO:teuthology.orchestra.run.smithi040.stdout:1 2023-06-22T10:54:17.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:17.447 DEBUG:teuthology.orchestra.run.smithi040:> route 2023-06-22T10:54:17.495 INFO:teuthology.orchestra.run.smithi040.stdout:Kernel IP routing table 2023-06-22T10:54:17.496 INFO:teuthology.orchestra.run.smithi040.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-22T10:54:17.496 INFO:teuthology.orchestra.run.smithi040.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-06-22T10:54:17.496 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-06-22T10:54:17.496 INFO:teuthology.orchestra.run.smithi040.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-22T10:54:17.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:17.498 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-06-22T10:54:17.498 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-06-22T10:54:17.498 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-06-22T10:54:17.498 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-06-22T10:54:17.498 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-06-22T10:54:17.499 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-06-22T10:54:17.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:17.669 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2023-06-22T10:54:17.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:17.716 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list-id 2023-06-22T10:54:17.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:17.766 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-06-22T10:54:17.767 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-06-22T10:54:17.767 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-06-22T10:54:17.767 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-06-22T10:54:17.768 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-06-22T10:54:17.910 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-06-22T10:54:17.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:17.911 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-06-22T10:54:17.911 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-06-22T10:54:17.911 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-06-22T10:54:17.911 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-06-22T10:54:17.911 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-06-22T10:54:17.912 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-06-22T10:54:17.912 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-06-22T10:54:17.912 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-06-22T10:54:18.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:18.163 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-06-22T10:54:18.163 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-06-22T10:54:18.164 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set brx.0 up 2023-06-22T10:54:18.164 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set dev brx.0 master ceph-brx 2023-06-22T10:54:18.164 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-06-22T10:54:18.343 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-22T10:54:18.344 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-06-22T10:54:18.389 INFO:teuthology.orchestra.run.smithi040.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-06-22T10:54:18.390 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-22T10:54:18.390 DEBUG:teuthology.orchestra.run.smithi040:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-06-22T10:54:18.473 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-06-22T10:54:18.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:18.474 DEBUG:teuthology.orchestra.run.smithi040:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-22T10:54:18.621 INFO:teuthology.orchestra.run.smithi040.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-22T10:54:18.621 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-22T10:54:19.076 INFO:teuthology.orchestra.run.smithi040.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-22T10:54:19.076 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-22T10:54:19.077 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: resolved to: "172.21.15.40:3300,172.21.15.45:3300,172.21.15.45:3301" 2023-06-22T10:54:19.077 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: trying mount with new device syntax: 0@475560bc-1a7c-4a75-b3b6-6fc6b20bdc52.cephfs=/ 2023-06-22T10:54:19.077 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.40:3300/172.21.15.45:3300/172.21.15.45:3301" will pass to kernel 2023-06-22T10:54:19.082 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-06-22T10:54:19.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:19.082 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-06-22T10:54:19.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:19.153 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-22T10:54:19.241 INFO:teuthology.orchestra.run.smithi040.stdout:client4896 2023-06-22T10:54:19.241 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-06-22T10:54:19.242 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-22T10:54:19.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:19.290 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-22T10:54:19.417 INFO:teuthology.orchestra.run.smithi040.stdout:client4896 2023-06-22T10:54:19.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:19.418 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-22T10:54:19.506 INFO:teuthology.orchestra.run.smithi040.stdout:client4896 2023-06-22T10:54:19.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:19.507 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/475560bc-1a7c-4a75-b3b6-6fc6b20bdc52.client4896/status') 2023-06-22T10:54:19.616 INFO:teuthology.orchestra.run.smithi040.stdout:instance: client.4896 (3)192.168.0.1:0/762758652 2023-06-22T10:54:19.617 INFO:teuthology.orchestra.run.smithi040.stdout:blocklisted: false 2023-06-22T10:54:19.617 INFO:teuthology.orchestra.run.smithi040.stderr:0+1 records in 2023-06-22T10:54:19.617 INFO:teuthology.orchestra.run.smithi040.stderr:0+1 records out 2023-06-22T10:54:19.618 INFO:teuthology.orchestra.run.smithi040.stderr:68 bytes copied, 5.6457e-05 s, 1.2 MB/s 2023-06-22T10:54:19.619 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2023-06-22T10:54:19.620 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-06-22T10:54:19.620 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-06-22T10:54:19.621 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-22T10:54:19.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:19.818+0000 7f1de1fff700 1 Processor -- start 2023-06-22T10:54:19.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:19.819+0000 7f1de1fff700 1 -- start start 2023-06-22T10:54:19.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:19.820+0000 7f1de1fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1ddc15a130 0x7f1ddc0cd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:19.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:19.820+0000 7f1de1fff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ddc0b05e0 con 0x7f1ddc0b3b60 2023-06-22T10:54:19.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:19.820+0000 7f1de1fff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ddc0b0880 con 0x7f1ddc06df20 2023-06-22T10:54:19.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:19.820+0000 7f1de1fff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ddc0b0b60 con 0x7f1ddc15a130 2023-06-22T10:54:19.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:19.820+0000 7f1ddbfff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f1ddc0b3b60 0x7f1ddc0b3f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60568/0 (socket says 172.21.15.40:60568) 2023-06-22T10:54:19.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:19.820+0000 7f1ddbfff700 1 -- 172.21.15.40:0/2149054699 learned_addr learned my addr 172.21.15.40:0/2149054699 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:19.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:19.820+0000 7f1ddb7fe700 1 --2- 172.21.15.40:0/2149054699 >> v2:172.21.15.45:3300/0 conn(0x7f1ddc15a130 0x7f1ddc0cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:19.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:19.821+0000 7f1dda7fc700 1 -- 172.21.15.40:0/2149054699 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2131585433 0 0) 0x7f1ddc0b05e0 con 0x7f1ddc0b3b60 2023-06-22T10:54:19.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:19.821+0000 7f1dda7fc700 1 -- 172.21.15.40:0/2149054699 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1dc40035b0 con 0x7f1ddc0b3b60 2023-06-22T10:54:19.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:19.821+0000 7f1ddb7fe700 1 -- 172.21.15.40:0/2149054699 >> v1:172.21.15.45:6789/0 conn(0x7f1ddc06df20 legacy=0x7f1ddc0caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:19.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:19.821+0000 7f1ddb7fe700 1 -- 172.21.15.40:0/2149054699 >> v1:172.21.15.40:6789/0 conn(0x7f1ddc0b3b60 legacy=0x7f1ddc0b3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:19.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:19.821+0000 7f1ddb7fe700 1 -- 172.21.15.40:0/2149054699 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ddc0b0e40 con 0x7f1ddc15a130 2023-06-22T10:54:19.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:19.821+0000 7f1ddb7fe700 1 --2- 172.21.15.40:0/2149054699 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ddc15a130 0x7f1ddc0cd220 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc009840 tx=0x7f1dcc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66b65abd0126a33c server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:19.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:19.821+0000 7f1dda7fc700 1 -- 172.21.15.40:0/2149054699 <== mon.1 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc011830 con 0x7f1ddc15a130 2023-06-22T10:54:19.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:19.821+0000 7f1dda7fc700 1 -- 172.21.15.40:0/2149054699 <== mon.1 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dcc011990 con 0x7f1ddc15a130 2023-06-22T10:54:19.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:19.821+0000 7f1dda7fc700 1 -- 172.21.15.40:0/2149054699 <== mon.1 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc011d20 con 0x7f1ddc15a130 2023-06-22T10:54:19.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:19.822+0000 7f1de1fff700 1 -- 172.21.15.40:0/2149054699 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ddc15a130 msgr2=0x7f1ddc0cd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:19.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:19.822+0000 7f1de1fff700 1 --2- 172.21.15.40:0/2149054699 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ddc15a130 0x7f1ddc0cd220 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc009840 tx=0x7f1dcc009b50 comp rx=0 tx=0).stop 2023-06-22T10:54:19.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:19.822+0000 7f1de1fff700 1 -- 172.21.15.40:0/2149054699 shutdown_connections 2023-06-22T10:54:19.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:19.822+0000 7f1de1fff700 1 --2- 172.21.15.40:0/2149054699 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ddc15a130 0x7f1ddc0cd220 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:19.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:19.822+0000 7f1de1fff700 1 -- 172.21.15.40:0/2149054699 >> 172.21.15.40:0/2149054699 conn(0x7f1ddc069f30 msgr2=0x7f1ddc06a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:19.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:19.822+0000 7f1de1fff700 1 -- 172.21.15.40:0/2149054699 shutdown_connections 2023-06-22T10:54:19.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:19.822+0000 7f1de1fff700 1 -- 172.21.15.40:0/2149054699 wait complete. 2023-06-22T10:54:19.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:19.824+0000 7f1de1fff700 1 Processor -- start 2023-06-22T10:54:19.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:19.824+0000 7f1de1fff700 1 -- start start 2023-06-22T10:54:19.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:19.825+0000 7f1de1fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ddc06df20 0x7f1ddc0b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:19.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:19.825+0000 7f1de1fff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1ddc0b3b60 0x7f1ddc159030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:19.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:19.825+0000 7f1de1fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ddc15a130 0x7f1ddc0b1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:19.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:19.825+0000 7f1de1fff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ddc0b2180 con 0x7f1ddc06df20 2023-06-22T10:54:19.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:19.825+0000 7f1de1fff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ddc0b2420 con 0x7f1ddc15a130 2023-06-22T10:54:19.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:19.825+0000 7f1de1fff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ddc0b2700 con 0x7f1ddc0b3b60 2023-06-22T10:54:19.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:19.825+0000 7f1ddb7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ddc06df20 0x7f1ddc0b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:19.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:19.825+0000 7f1ddb7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ddc06df20 0x7f1ddc0b34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44812/0 (socket says 172.21.15.40:44812) 2023-06-22T10:54:19.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:19.825+0000 7f1ddb7fe700 1 -- 172.21.15.40:0/1544069134 learned_addr learned my addr 172.21.15.40:0/1544069134 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:19.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:19.826+0000 7f1ddbfff700 1 --2- 172.21.15.40:0/1544069134 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ddc15a130 0x7f1ddc0b1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:19.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:19.826+0000 7f1ddaffd700 1 --2- 172.21.15.40:0/1544069134 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1ddc0b3b60 0x7f1ddc159030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:19.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:19.826+0000 7f1ddb7fe700 1 -- 172.21.15.40:0/1544069134 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1ddc0b3b60 msgr2=0x7f1ddc159030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:19.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:19.826+0000 7f1ddb7fe700 1 --2- 172.21.15.40:0/1544069134 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1ddc0b3b60 0x7f1ddc159030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:19.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:19.826+0000 7f1ddb7fe700 1 -- 172.21.15.40:0/1544069134 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ddc15a130 msgr2=0x7f1ddc0b1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:19.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:19.826+0000 7f1ddb7fe700 1 --2- 172.21.15.40:0/1544069134 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ddc15a130 0x7f1ddc0b1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:19.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:19.826+0000 7f1ddb7fe700 1 -- 172.21.15.40:0/1544069134 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dcc0094a0 con 0x7f1ddc06df20 2023-06-22T10:54:19.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:19.826+0000 7f1ddaffd700 1 --2- 172.21.15.40:0/1544069134 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1ddc0b3b60 0x7f1ddc159030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-22T10:54:19.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:19.826+0000 7f1ddb7fe700 1 --2- 172.21.15.40:0/1544069134 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ddc06df20 0x7f1ddc0b34c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc009b90 tx=0x7f1dcc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:19.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:19.826+0000 7f1dc3fff700 1 -- 172.21.15.40:0/1544069134 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc0038a0 con 0x7f1ddc06df20 2023-06-22T10:54:19.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:19.826+0000 7f1dc3fff700 1 -- 172.21.15.40:0/1544069134 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dcc01e070 con 0x7f1ddc06df20 2023-06-22T10:54:19.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:19.826+0000 7f1dc3fff700 1 -- 172.21.15.40:0/1544069134 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc003c40 con 0x7f1ddc06df20 2023-06-22T10:54:19.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:19.826+0000 7f1de1fff700 1 -- 172.21.15.40:0/1544069134 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ddc0b29e0 con 0x7f1ddc06df20 2023-06-22T10:54:19.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:19.827+0000 7f1de1fff700 1 -- 172.21.15.40:0/1544069134 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ddc0b2fa0 con 0x7f1ddc06df20 2023-06-22T10:54:19.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:19.828+0000 7f1de1fff700 1 -- 172.21.15.40:0/1544069134 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ddc067580 con 0x7f1ddc06df20 2023-06-22T10:54:19.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:19.829+0000 7f1dc3fff700 1 -- 172.21.15.40:0/1544069134 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1dcc02d450 con 0x7f1ddc06df20 2023-06-22T10:54:19.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:19.829+0000 7f1dc3fff700 1 --2- 172.21.15.40:0/1544069134 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f1dc806ace0 0x7f1dc806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:19.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:19.830+0000 7f1dc3fff700 1 -- 172.21.15.40:0/1544069134 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1dcc08a820 con 0x7f1ddc06df20 2023-06-22T10:54:19.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:19.830+0000 7f1ddaffd700 1 --2- 172.21.15.40:0/1544069134 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f1dc806ace0 0x7f1dc806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:19.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:19.830+0000 7f1ddaffd700 1 --2- 172.21.15.40:0/1544069134 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f1dc806ace0 0x7f1dc806d190 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1dd0000fb0 tx=0x7f1dd0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:19.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:19.834+0000 7f1dc3fff700 1 -- 172.21.15.40:0/1544069134 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1dcc055590 con 0x7f1ddc06df20 2023-06-22T10:54:20.090 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:20.087+0000 7f1de1fff700 1 -- 172.21.15.40:0/1544069134 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1ddc071030 con 0x7f1ddc06df20 2023-06-22T10:54:20.091 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:20.087+0000 7f1dc3fff700 1 -- 172.21.15.40:0/1544069134 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f1dcc058bb0 con 0x7f1ddc06df20 2023-06-22T10:54:20.091 INFO:teuthology.orchestra.run.smithi040.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-06-22T10:54:20.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:20.090+0000 7f1de1fff700 1 -- 172.21.15.40:0/1544069134 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f1dc806ace0 msgr2=0x7f1dc806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:20.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:20.090+0000 7f1de1fff700 1 --2- 172.21.15.40:0/1544069134 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f1dc806ace0 0x7f1dc806d190 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1dd0000fb0 tx=0x7f1dd0009040 comp rx=0 tx=0).stop 2023-06-22T10:54:20.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:20.090+0000 7f1de1fff700 1 -- 172.21.15.40:0/1544069134 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ddc06df20 msgr2=0x7f1ddc0b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:20.093 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:20.090+0000 7f1de1fff700 1 --2- 172.21.15.40:0/1544069134 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ddc06df20 0x7f1ddc0b34c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc009b90 tx=0x7f1dcc004750 comp rx=0 tx=0).stop 2023-06-22T10:54:20.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:20.090+0000 7f1de1fff700 1 -- 172.21.15.40:0/1544069134 shutdown_connections 2023-06-22T10:54:20.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:20.090+0000 7f1de1fff700 1 --2- 172.21.15.40:0/1544069134 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f1dc806ace0 0x7f1dc806d190 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:20.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:20.090+0000 7f1de1fff700 1 --2- 172.21.15.40:0/1544069134 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ddc15a130 0x7f1ddc0b1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:20.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:20.090+0000 7f1de1fff700 1 --2- 172.21.15.40:0/1544069134 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1ddc06df20 0x7f1ddc0b34c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:20.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:20.090+0000 7f1de1fff700 1 --2- 172.21.15.40:0/1544069134 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1ddc0b3b60 0x7f1ddc159030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:20.094 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:20.090+0000 7f1de1fff700 1 -- 172.21.15.40:0/1544069134 >> 172.21.15.40:0/1544069134 conn(0x7f1ddc069f30 msgr2=0x7f1ddc06c590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:20.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:20.090+0000 7f1de1fff700 1 -- 172.21.15.40:0/1544069134 shutdown_connections 2023-06-22T10:54:20.095 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:20.090+0000 7f1de1fff700 1 -- 172.21.15.40:0/1544069134 wait complete. 2023-06-22T10:54:20.111 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-22T10:54:20.112 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-22T10:54:20.112 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi040.front.sepia.ceph.com 2023-06-22T10:54:20.112 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-06-22T10:54:20.113 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-06-22T10:54:20.113 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-22T10:54:20.113 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-22T10:54:20.114 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-22T10:54:20.114 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-06-22T10:54:20.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:20.115 DEBUG:teuthology.orchestra.run.smithi040:> ip addr 2023-06-22T10:54:20.162 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-22T10:54:20.163 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-22T10:54:20.163 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2023-06-22T10:54:20.163 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-06-22T10:54:20.163 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2023-06-22T10:54:20.163 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-06-22T10:54:20.163 INFO:teuthology.orchestra.run.smithi040.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-22T10:54:20.163 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:16 brd ff:ff:ff:ff:ff:ff 2023-06-22T10:54:20.164 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f0 2023-06-22T10:54:20.164 INFO:teuthology.orchestra.run.smithi040.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-22T10:54:20.164 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:17 brd ff:ff:ff:ff:ff:ff 2023-06-22T10:54:20.164 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f1 2023-06-22T10:54:20.164 INFO:teuthology.orchestra.run.smithi040.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-22T10:54:20.165 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cc brd ff:ff:ff:ff:ff:ff 2023-06-22T10:54:20.165 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f0 2023-06-22T10:54:20.165 INFO:teuthology.orchestra.run.smithi040.stdout: inet 172.21.15.40/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-06-22T10:54:20.165 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft 42287sec preferred_lft 42287sec 2023-06-22T10:54:20.165 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::ec4:7aff:febd:12cc/64 scope link 2023-06-22T10:54:20.165 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-06-22T10:54:20.165 INFO:teuthology.orchestra.run.smithi040.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-22T10:54:20.166 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cd brd ff:ff:ff:ff:ff:ff 2023-06-22T10:54:20.166 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f1 2023-06-22T10:54:20.166 INFO:teuthology.orchestra.run.smithi040.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-22T10:54:20.166 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 72:0a:de:69:ab:12 brd ff:ff:ff:ff:ff:ff 2023-06-22T10:54:20.166 INFO:teuthology.orchestra.run.smithi040.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-06-22T10:54:20.166 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-06-22T10:54:20.166 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::cd8:5cff:fe09:affb/64 scope link 2023-06-22T10:54:20.166 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-06-22T10:54:20.167 INFO:teuthology.orchestra.run.smithi040.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-22T10:54:20.167 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 72:0a:de:69:ab:12 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-06-22T10:54:20.167 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::700a:deff:fe69:ab12/64 scope link 2023-06-22T10:54:20.167 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-06-22T10:54:20.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:20.169 DEBUG:teuthology.orchestra.run.smithi040:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-22T10:54:20.236 INFO:teuthology.orchestra.run.smithi040.stdout:1 2023-06-22T10:54:20.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:20.240 DEBUG:teuthology.orchestra.run.smithi040:> route 2023-06-22T10:54:20.289 INFO:teuthology.orchestra.run.smithi040.stdout:Kernel IP routing table 2023-06-22T10:54:20.290 INFO:teuthology.orchestra.run.smithi040.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-22T10:54:20.290 INFO:teuthology.orchestra.run.smithi040.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-06-22T10:54:20.290 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-06-22T10:54:20.290 INFO:teuthology.orchestra.run.smithi040.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-22T10:54:20.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:20.292 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-06-22T10:54:20.292 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-06-22T10:54:20.292 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-06-22T10:54:20.293 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-06-22T10:54:20.293 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-06-22T10:54:20.293 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-06-22T10:54:20.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:20.463 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2023-06-22T10:54:20.511 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-06-22T10:54:20.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:20.513 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list-id 2023-06-22T10:54:20.597 INFO:teuthology.orchestra.run.smithi040.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-06-22T10:54:20.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:20.598 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-06-22T10:54:20.598 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-06-22T10:54:20.599 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-06-22T10:54:20.599 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-06-22T10:54:20.599 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-06-22T10:54:20.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:20.780 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-06-22T10:54:20.851 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-22T10:54:20.851 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-22T10:54:20.852 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2023-06-22T10:54:20.852 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-06-22T10:54:20.852 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2023-06-22T10:54:20.852 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-06-22T10:54:20.852 INFO:teuthology.orchestra.run.smithi040.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-22T10:54:20.852 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 4e:ce:d7:f8:fc:e3 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-06-22T10:54:20.852 INFO:teuthology.orchestra.run.smithi040.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-06-22T10:54:20.853 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-06-22T10:54:20.853 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::4cce:d7ff:fef8:fce3/64 scope link 2023-06-22T10:54:20.853 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-06-22T10:54:20.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:20.854 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-06-22T10:54:20.925 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-22T10:54:20.926 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-22T10:54:20.926 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2023-06-22T10:54:20.926 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-06-22T10:54:20.926 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2023-06-22T10:54:20.926 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-06-22T10:54:20.926 INFO:teuthology.orchestra.run.smithi040.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-22T10:54:20.926 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 4e:ce:d7:f8:fc:e3 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-06-22T10:54:20.926 INFO:teuthology.orchestra.run.smithi040.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-06-22T10:54:20.927 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-06-22T10:54:20.927 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::4cce:d7ff:fef8:fce3/64 scope link 2023-06-22T10:54:20.927 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-06-22T10:54:20.929 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-06-22T10:54:20.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:20.930 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-06-22T10:54:20.930 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-06-22T10:54:20.931 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-06-22T10:54:20.931 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-06-22T10:54:20.932 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-06-22T10:54:20.932 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-06-22T10:54:20.933 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-06-22T10:54:20.933 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-06-22T10:54:21.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:21.177 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-06-22T10:54:21.178 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-06-22T10:54:21.178 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set brx.1 up 2023-06-22T10:54:21.179 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set dev brx.1 master ceph-brx 2023-06-22T10:54:21.179 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-06-22T10:54:21.360 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-22T10:54:21.361 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-06-22T10:54:21.407 INFO:teuthology.orchestra.run.smithi040.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-06-22T10:54:21.407 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-22T10:54:21.408 DEBUG:teuthology.orchestra.run.smithi040:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-06-22T10:54:21.492 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2023-06-22T10:54:21.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:21.493 DEBUG:teuthology.orchestra.run.smithi040:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-22T10:54:21.638 INFO:teuthology.orchestra.run.smithi040.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-22T10:54:21.638 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-22T10:54:21.665 INFO:teuthology.orchestra.run.smithi040.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-22T10:54:21.665 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-22T10:54:21.665 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: resolved to: "172.21.15.40:3300,172.21.15.45:3300,172.21.15.45:3301" 2023-06-22T10:54:21.666 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: trying mount with new device syntax: 2@475560bc-1a7c-4a75-b3b6-6fc6b20bdc52.cephfs=/ 2023-06-22T10:54:21.666 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.40:3300/172.21.15.45:3300/172.21.15.45:3301" will pass to kernel 2023-06-22T10:54:21.669 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-06-22T10:54:21.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:21.670 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-06-22T10:54:21.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:21.740 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-22T10:54:21.828 INFO:teuthology.orchestra.run.smithi040.stdout:client4905 2023-06-22T10:54:21.828 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-06-22T10:54:21.829 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-22T10:54:21.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:21.875 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-22T10:54:22.005 INFO:teuthology.orchestra.run.smithi040.stdout:client4905 2023-06-22T10:54:22.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:22.006 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-22T10:54:22.093 INFO:teuthology.orchestra.run.smithi040.stdout:client4905 2023-06-22T10:54:22.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:22.095 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/475560bc-1a7c-4a75-b3b6-6fc6b20bdc52.client4905/status') 2023-06-22T10:54:22.203 INFO:teuthology.orchestra.run.smithi040.stdout:instance: client.4905 (3)192.168.0.2:0/2159750328 2023-06-22T10:54:22.204 INFO:teuthology.orchestra.run.smithi040.stdout:blocklisted: false 2023-06-22T10:54:22.204 INFO:teuthology.orchestra.run.smithi040.stderr:0+1 records in 2023-06-22T10:54:22.204 INFO:teuthology.orchestra.run.smithi040.stderr:0+1 records out 2023-06-22T10:54:22.204 INFO:teuthology.orchestra.run.smithi040.stderr:69 bytes copied, 5.4415e-05 s, 1.3 MB/s 2023-06-22T10:54:22.206 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-06-22T10:54:22.207 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-06-22T10:54:22.207 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-06-22T10:54:22.207 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-22T10:54:22.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.404+0000 7f9b573ff700 1 Processor -- start 2023-06-22T10:54:22.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.404+0000 7f9b573ff700 1 -- start start 2023-06-22T10:54:22.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.405+0000 7f9b573ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9b500b4630 0x7f9b500cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:22.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.405+0000 7f9b573ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9b500cd200 0x7f9b500d1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:22.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.405+0000 7f9b573ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b500d1b60 con 0x7f9b500b4a00 2023-06-22T10:54:22.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.405+0000 7f9b573ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b500d2530 con 0x7f9b500cd200 2023-06-22T10:54:22.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.405+0000 7f9b573ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b500d1230 con 0x7f9b500b4630 2023-06-22T10:54:22.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.405+0000 7f9b5499a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9b500cd200 0x7f9b500d1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:22.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.405+0000 7f9b5499a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9b500cd200 0x7f9b500d1ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44816/0 (socket says 172.21.15.40:44816) 2023-06-22T10:54:22.409 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.405+0000 7f9b5499a700 1 -- 172.21.15.40:0/870074188 learned_addr learned my addr 172.21.15.40:0/870074188 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:22.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.405+0000 7f9b5519b700 1 --2- 172.21.15.40:0/870074188 >> v2:172.21.15.45:3300/0 conn(0x7f9b500b4630 0x7f9b500cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:22.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.406+0000 7f9b5499a700 1 -- 172.21.15.40:0/870074188 >> v2:172.21.15.45:3300/0 conn(0x7f9b500b4630 msgr2=0x7f9b500cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:22.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.406+0000 7f9b5499a700 1 --2- 172.21.15.40:0/870074188 >> v2:172.21.15.45:3300/0 conn(0x7f9b500b4630 0x7f9b500cf050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:22.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.406+0000 7f9b5499a700 1 -- 172.21.15.40:0/870074188 >> v1:172.21.15.40:6789/0 conn(0x7f9b500b4a00 legacy=0x7f9b500b5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:22.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.406+0000 7f9b5499a700 1 -- 172.21.15.40:0/870074188 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b500d1510 con 0x7f9b500cd200 2023-06-22T10:54:22.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.406+0000 7f9b5519b700 1 --2- 172.21.15.40:0/870074188 >> v2:172.21.15.45:3300/0 conn(0x7f9b500b4630 0x7f9b500cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:54:22.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.406+0000 7f9b47fff700 1 -- 172.21.15.40:0/870074188 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4044533684 0 0) 0x7f9b500d1b60 con 0x7f9b500b4a00 2023-06-22T10:54:22.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.406+0000 7f9b5499a700 1 --2- 172.21.15.40:0/870074188 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b500cd200 0x7f9b500d1ff0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9b5006cce0 tx=0x7f9b40009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37f1ddbff064162f server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:22.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.406+0000 7f9b47fff700 1 -- 172.21.15.40:0/870074188 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4000b870 con 0x7f9b500cd200 2023-06-22T10:54:22.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.406+0000 7f9b47fff700 1 -- 172.21.15.40:0/870074188 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b4000b9d0 con 0x7f9b500cd200 2023-06-22T10:54:22.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.406+0000 7f9b47fff700 1 -- 172.21.15.40:0/870074188 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4000bd60 con 0x7f9b500cd200 2023-06-22T10:54:22.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.407+0000 7f9b573ff700 1 -- 172.21.15.40:0/870074188 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b500cd200 msgr2=0x7f9b500d1ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:22.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.407+0000 7f9b573ff700 1 --2- 172.21.15.40:0/870074188 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b500cd200 0x7f9b500d1ff0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9b5006cce0 tx=0x7f9b40009bd0 comp rx=0 tx=0).stop 2023-06-22T10:54:22.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.407+0000 7f9b573ff700 1 -- 172.21.15.40:0/870074188 shutdown_connections 2023-06-22T10:54:22.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.407+0000 7f9b573ff700 1 --2- 172.21.15.40:0/870074188 >> v2:172.21.15.45:3300/0 conn(0x7f9b500b4630 0x7f9b500cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:22.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.407+0000 7f9b573ff700 1 --2- 172.21.15.40:0/870074188 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b500cd200 0x7f9b500d1ff0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:22.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.407+0000 7f9b573ff700 1 -- 172.21.15.40:0/870074188 >> 172.21.15.40:0/870074188 conn(0x7f9b500cf630 msgr2=0x7f9b500cfa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:22.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.407+0000 7f9b573ff700 1 -- 172.21.15.40:0/870074188 shutdown_connections 2023-06-22T10:54:22.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.407+0000 7f9b573ff700 1 -- 172.21.15.40:0/870074188 wait complete. 2023-06-22T10:54:22.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.409+0000 7f9b573ff700 1 Processor -- start 2023-06-22T10:54:22.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.409+0000 7f9b573ff700 1 -- start start 2023-06-22T10:54:22.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.410+0000 7f9b573ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9b500b4630 0x7f9b501f1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:22.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.410+0000 7f9b573ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b500b4a00 0x7f9b500d29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:22.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.410+0000 7f9b573ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b500cd200 0x7f9b500d2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:22.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.410+0000 7f9b573ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b50146300 con 0x7f9b500b4a00 2023-06-22T10:54:22.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.410+0000 7f9b573ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b500cc680 con 0x7f9b500cd200 2023-06-22T10:54:22.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.410+0000 7f9b573ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b500cc960 con 0x7f9b500b4630 2023-06-22T10:54:22.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.410+0000 7f9b5499a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b500b4a00 0x7f9b500d29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:22.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.410+0000 7f9b5499a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b500b4a00 0x7f9b500d29b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44832/0 (socket says 172.21.15.40:44832) 2023-06-22T10:54:22.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.410+0000 7f9b5499a700 1 -- 172.21.15.40:0/899499042 learned_addr learned my addr 172.21.15.40:0/899499042 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:22.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.410+0000 7f9b5499a700 1 -- 172.21.15.40:0/899499042 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9b500b4630 msgr2=0x7f9b501f1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:22.416 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.410+0000 7f9b5499a700 1 --2- 172.21.15.40:0/899499042 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9b500b4630 0x7f9b501f1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:22.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.410+0000 7f9b5499a700 1 -- 172.21.15.40:0/899499042 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b500cd200 msgr2=0x7f9b500d2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:22.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.410+0000 7f9b5499a700 1 --2- 172.21.15.40:0/899499042 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b500cd200 0x7f9b500d2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:22.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.411+0000 7f9b5499a700 1 -- 172.21.15.40:0/899499042 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b40009550 con 0x7f9b500b4a00 2023-06-22T10:54:22.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.411+0000 7f9b5499a700 1 --2- 172.21.15.40:0/899499042 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b500b4a00 0x7f9b500d29b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9b40009c10 tx=0x7f9b40004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:22.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.411+0000 7f9b45ffb700 1 -- 172.21.15.40:0/899499042 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b40004520 con 0x7f9b500b4a00 2023-06-22T10:54:22.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.411+0000 7f9b45ffb700 1 -- 172.21.15.40:0/899499042 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b4001e070 con 0x7f9b500b4a00 2023-06-22T10:54:22.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.411+0000 7f9b45ffb700 1 -- 172.21.15.40:0/899499042 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b400038e0 con 0x7f9b500b4a00 2023-06-22T10:54:22.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.411+0000 7f9b573ff700 1 -- 172.21.15.40:0/899499042 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b500ccc40 con 0x7f9b500b4a00 2023-06-22T10:54:22.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.411+0000 7f9b573ff700 1 -- 172.21.15.40:0/899499042 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b501f1980 con 0x7f9b500b4a00 2023-06-22T10:54:22.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.412+0000 7f9b573ff700 1 -- 172.21.15.40:0/899499042 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b50067580 con 0x7f9b500b4a00 2023-06-22T10:54:22.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.413+0000 7f9b45ffb700 1 -- 172.21.15.40:0/899499042 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9b40003a40 con 0x7f9b500b4a00 2023-06-22T10:54:22.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.414+0000 7f9b45ffb700 1 --2- 172.21.15.40:0/899499042 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f9b3406ace0 0x7f9b3406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:22.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.414+0000 7f9b45ffb700 1 -- 172.21.15.40:0/899499042 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9b40020070 con 0x7f9b500b4a00 2023-06-22T10:54:22.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.414+0000 7f9b5519b700 1 --2- 172.21.15.40:0/899499042 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f9b3406ace0 0x7f9b3406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:22.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.415+0000 7f9b5519b700 1 --2- 172.21.15.40:0/899499042 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f9b3406ace0 0x7f9b3406d190 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9b500cfe20 tx=0x7f9b4c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:22.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.418+0000 7f9b45ffb700 1 -- 172.21.15.40:0/899499042 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9b40055ae0 con 0x7f9b500b4a00 2023-06-22T10:54:22.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.674+0000 7f9b573ff700 1 -- 172.21.15.40:0/899499042 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9b50146440 con 0x7f9b500b4a00 2023-06-22T10:54:22.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.675+0000 7f9b45ffb700 1 -- 172.21.15.40:0/899499042 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f9b4002a070 con 0x7f9b500b4a00 2023-06-22T10:54:22.678 INFO:teuthology.orchestra.run.smithi040.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-06-22T10:54:22.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.678+0000 7f9b573ff700 1 -- 172.21.15.40:0/899499042 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f9b3406ace0 msgr2=0x7f9b3406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:22.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.678+0000 7f9b573ff700 1 --2- 172.21.15.40:0/899499042 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f9b3406ace0 0x7f9b3406d190 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9b500cfe20 tx=0x7f9b4c008040 comp rx=0 tx=0).stop 2023-06-22T10:54:22.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.678+0000 7f9b573ff700 1 -- 172.21.15.40:0/899499042 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b500b4a00 msgr2=0x7f9b500d29b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:22.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.678+0000 7f9b573ff700 1 --2- 172.21.15.40:0/899499042 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b500b4a00 0x7f9b500d29b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9b40009c10 tx=0x7f9b40004750 comp rx=0 tx=0).stop 2023-06-22T10:54:22.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.678+0000 7f9b573ff700 1 -- 172.21.15.40:0/899499042 shutdown_connections 2023-06-22T10:54:22.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.678+0000 7f9b573ff700 1 --2- 172.21.15.40:0/899499042 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f9b3406ace0 0x7f9b3406d190 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:22.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.678+0000 7f9b573ff700 1 --2- 172.21.15.40:0/899499042 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9b500b4630 0x7f9b501f1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:22.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.678+0000 7f9b573ff700 1 --2- 172.21.15.40:0/899499042 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b500cd200 0x7f9b500d2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:22.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.678+0000 7f9b573ff700 1 --2- 172.21.15.40:0/899499042 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b500b4a00 0x7f9b500d29b0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:22.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.678+0000 7f9b573ff700 1 -- 172.21.15.40:0/899499042 >> 172.21.15.40:0/899499042 conn(0x7f9b500cf630 msgr2=0x7f9b500b25d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:22.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.679+0000 7f9b573ff700 1 -- 172.21.15.40:0/899499042 shutdown_connections 2023-06-22T10:54:22.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:22.679+0000 7f9b573ff700 1 -- 172.21.15.40:0/899499042 wait complete. 2023-06-22T10:54:22.702 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-22T10:54:22.702 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-22T10:54:22.703 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2023-06-22T10:54:22.703 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-06-22T10:54:22.703 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-06-22T10:54:22.703 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-22T10:54:22.703 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-22T10:54:22.704 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-22T10:54:22.704 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-06-22T10:54:22.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:22.704 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2023-06-22T10:54:22.755 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-22T10:54:22.756 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-22T10:54:22.756 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-06-22T10:54:22.756 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-06-22T10:54:22.756 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-06-22T10:54:22.756 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-06-22T10:54:22.756 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-22T10:54:22.757 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2023-06-22T10:54:22.757 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f0 2023-06-22T10:54:22.757 INFO:teuthology.orchestra.run.smithi045.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-22T10:54:22.757 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2023-06-22T10:54:22.757 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f1 2023-06-22T10:54:22.757 INFO:teuthology.orchestra.run.smithi045.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-22T10:54:22.757 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2023-06-22T10:54:22.758 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f0 2023-06-22T10:54:22.758 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-06-22T10:54:22.758 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 41900sec preferred_lft 41900sec 2023-06-22T10:54:22.758 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link 2023-06-22T10:54:22.758 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-06-22T10:54:22.758 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-22T10:54:22.758 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2023-06-22T10:54:22.758 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f1 2023-06-22T10:54:22.760 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-06-22T10:54:22.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:22.761 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-06-22T10:54:22.761 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-06-22T10:54:22.761 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link add name ceph-brx type bridge 2023-06-22T10:54:22.761 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip addr flush dev ceph-brx 2023-06-22T10:54:22.761 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set ceph-brx up 2023-06-22T10:54:22.762 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-06-22T10:54:22.762 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-06-22T10:54:23.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:23.204 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-22T10:54:23.307 INFO:teuthology.orchestra.run.smithi045.stdout:1 2023-06-22T10:54:23.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:23.310 DEBUG:teuthology.orchestra.run.smithi045:> route 2023-06-22T10:54:23.381 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2023-06-22T10:54:23.381 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-22T10:54:23.382 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-06-22T10:54:23.382 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-06-22T10:54:23.382 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-22T10:54:23.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:23.383 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-06-22T10:54:23.384 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-06-22T10:54:23.384 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-06-22T10:54:23.384 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-06-22T10:54:23.385 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-06-22T10:54:23.385 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-06-22T10:54:24.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:24.090 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-06-22T10:54:24.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:24.137 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list-id 2023-06-22T10:54:24.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:24.185 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-06-22T10:54:24.185 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-06-22T10:54:24.185 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-06-22T10:54:24.185 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-06-22T10:54:24.186 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-06-22T10:54:24.330 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-06-22T10:54:24.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:24.331 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-06-22T10:54:24.331 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-06-22T10:54:24.331 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-06-22T10:54:24.331 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-06-22T10:54:24.332 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-06-22T10:54:24.332 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-06-22T10:54:24.332 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-06-22T10:54:24.333 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-06-22T10:54:24.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:24.601 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-06-22T10:54:24.601 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-06-22T10:54:24.602 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.0 up 2023-06-22T10:54:24.602 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set dev brx.0 master ceph-brx 2023-06-22T10:54:24.602 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-06-22T10:54:24.770 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T10:54:24.775 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T10:54:24.782 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-22T10:54:24.783 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-06-22T10:54:24.869 INFO:teuthology.orchestra.run.smithi045.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-06-22T10:54:24.870 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-22T10:54:24.870 DEBUG:teuthology.orchestra.run.smithi045:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-06-22T10:54:24.955 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-06-22T10:54:24.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:24.956 DEBUG:teuthology.orchestra.run.smithi045:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-22T10:54:25.101 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-22T10:54:25.102 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-22T10:54:25.528 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-22T10:54:25.528 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-22T10:54:25.529 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: resolved to: "172.21.15.40:3300,172.21.15.45:3300,172.21.15.45:3301" 2023-06-22T10:54:25.529 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: trying mount with new device syntax: 1@475560bc-1a7c-4a75-b3b6-6fc6b20bdc52.cephfs=/ 2023-06-22T10:54:25.529 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.40:3300/172.21.15.45:3300/172.21.15.45:3301" will pass to kernel 2023-06-22T10:54:25.533 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-06-22T10:54:25.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:25.534 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-06-22T10:54:25.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:25.604 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-22T10:54:25.703 INFO:teuthology.orchestra.run.smithi045.stdout:client4917 2023-06-22T10:54:25.703 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-06-22T10:54:25.704 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-22T10:54:25.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:25.749 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-22T10:54:25.876 INFO:teuthology.orchestra.run.smithi045.stdout:client4917 2023-06-22T10:54:25.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:25.877 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-22T10:54:25.964 INFO:teuthology.orchestra.run.smithi045.stdout:client4917 2023-06-22T10:54:25.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:25.965 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/475560bc-1a7c-4a75-b3b6-6fc6b20bdc52.client4917/status') 2023-06-22T10:54:26.074 INFO:teuthology.orchestra.run.smithi045.stdout:instance: client.4917 (3)172.21.15.45:0/268194444 2023-06-22T10:54:26.074 INFO:teuthology.orchestra.run.smithi045.stdout:blocklisted: false 2023-06-22T10:54:26.074 INFO:teuthology.orchestra.run.smithi045.stderr:0+1 records in 2023-06-22T10:54:26.074 INFO:teuthology.orchestra.run.smithi045.stderr:0+1 records out 2023-06-22T10:54:26.075 INFO:teuthology.orchestra.run.smithi045.stderr:69 bytes copied, 5.1371e-05 s, 1.3 MB/s 2023-06-22T10:54:26.077 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2023-06-22T10:54:26.077 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-06-22T10:54:26.077 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-06-22T10:54:26.078 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-22T10:54:26.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.287+0000 7fbb2afff700 1 Processor -- start 2023-06-22T10:54:26.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.287+0000 7fbb2afff700 1 -- start start 2023-06-22T10:54:26.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.288+0000 7fbb2afff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbb240add30 0x7fbb24159f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:26.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.288+0000 7fbb2afff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fbb240b3910 0x7fbb240b3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:26.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.288+0000 7fbb2afff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb240b4280 con 0x7fbb240b3120 2023-06-22T10:54:26.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.288+0000 7fbb2afff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb2415d370 con 0x7fbb240add30 2023-06-22T10:54:26.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.288+0000 7fbb2afff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb24153bc0 con 0x7fbb240b3910 2023-06-22T10:54:26.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.289+0000 7fbb23fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbb240add30 0x7fbb24159f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:26.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.289+0000 7fbb2959c700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fbb240b3910 0x7fbb240b3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:26.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.289+0000 7fbb28d9b700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fbb240b3120 0x7fbb2415cc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.40:42504/0 (socket says 172.21.15.40:42504) 2023-06-22T10:54:26.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.289+0000 7fbb28d9b700 1 -- 172.21.15.40:0/3605016474 learned_addr learned my addr 172.21.15.40:0/3605016474 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:26.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.289+0000 7fbb23fff700 1 -- 172.21.15.40:0/3605016474 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fbb240b3910 msgr2=0x7fbb240b3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:26.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.289+0000 7fbb23fff700 1 --2- 172.21.15.40:0/3605016474 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fbb240b3910 0x7fbb240b3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:26.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.289+0000 7fbb23fff700 1 -- 172.21.15.40:0/3605016474 >> v1:172.21.15.45:6789/0 conn(0x7fbb240b3120 legacy=0x7fbb2415cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:26.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.289+0000 7fbb23fff700 1 -- 172.21.15.40:0/3605016474 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb2415d560 con 0x7fbb240add30 2023-06-22T10:54:26.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.289+0000 7fbb237fe700 1 -- 172.21.15.40:0/3605016474 <== mon.1 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2965573701 0 0) 0x7fbb240b4280 con 0x7fbb240b3120 2023-06-22T10:54:26.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.290+0000 7fbb23fff700 1 --2- 172.21.15.40:0/3605016474 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb240add30 0x7fbb24159f80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbb10009820 tx=0x7fbb10009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b79701dd57b8992 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:26.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.290+0000 7fbb237fe700 1 -- 172.21.15.40:0/3605016474 <== mon.1 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb10005e30 con 0x7fbb240add30 2023-06-22T10:54:26.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.290+0000 7fbb237fe700 1 -- 172.21.15.40:0/3605016474 <== mon.1 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb10006030 con 0x7fbb240add30 2023-06-22T10:54:26.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.290+0000 7fbb237fe700 1 -- 172.21.15.40:0/3605016474 <== mon.1 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb100063c0 con 0x7fbb240add30 2023-06-22T10:54:26.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.290+0000 7fbb2afff700 1 -- 172.21.15.40:0/3605016474 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb240add30 msgr2=0x7fbb24159f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:26.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.290+0000 7fbb2afff700 1 --2- 172.21.15.40:0/3605016474 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb240add30 0x7fbb24159f80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbb10009820 tx=0x7fbb10009b30 comp rx=0 tx=0).stop 2023-06-22T10:54:26.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.290+0000 7fbb2afff700 1 -- 172.21.15.40:0/3605016474 shutdown_connections 2023-06-22T10:54:26.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.290+0000 7fbb2afff700 1 --2- 172.21.15.40:0/3605016474 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fbb240b3910 0x7fbb240b3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:26.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.290+0000 7fbb2afff700 1 --2- 172.21.15.40:0/3605016474 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb240add30 0x7fbb24159f80 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:26.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.290+0000 7fbb2afff700 1 -- 172.21.15.40:0/3605016474 >> 172.21.15.40:0/3605016474 conn(0x7fbb24069f30 msgr2=0x7fbb2406a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:26.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.291+0000 7fbb2afff700 1 -- 172.21.15.40:0/3605016474 shutdown_connections 2023-06-22T10:54:26.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.291+0000 7fbb2afff700 1 -- 172.21.15.40:0/3605016474 wait complete. 2023-06-22T10:54:26.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.292+0000 7fbb2afff700 1 Processor -- start 2023-06-22T10:54:26.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.292+0000 7fbb2afff700 1 -- start start 2023-06-22T10:54:26.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.293+0000 7fbb2afff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb240add30 0x7fbb241583b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:26.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.293+0000 7fbb2afff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb240b3120 0x7fbb241f0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:26.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.293+0000 7fbb2afff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fbb240b3910 0x7fbb241f14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:26.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.293+0000 7fbb2afff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb241f2840 con 0x7fbb240add30 2023-06-22T10:54:26.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.293+0000 7fbb2afff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb241f1bc0 con 0x7fbb240b3120 2023-06-22T10:54:26.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.293+0000 7fbb2afff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb241f1ea0 con 0x7fbb240b3910 2023-06-22T10:54:26.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.294+0000 7fbb28d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb240add30 0x7fbb241583b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:26.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.294+0000 7fbb23fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb240b3120 0x7fbb241f0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:26.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.294+0000 7fbb28d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb240add30 0x7fbb241583b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:44838/0 (socket says 172.21.15.40:44838) 2023-06-22T10:54:26.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.294+0000 7fbb28d9b700 1 -- 172.21.15.40:0/2862061714 learned_addr learned my addr 172.21.15.40:0/2862061714 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:26.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.294+0000 7fbb2959c700 1 --2- 172.21.15.40:0/2862061714 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fbb240b3910 0x7fbb241f14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:26.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.294+0000 7fbb23fff700 1 -- 172.21.15.40:0/2862061714 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fbb240b3910 msgr2=0x7fbb241f14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:26.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.294+0000 7fbb23fff700 1 --2- 172.21.15.40:0/2862061714 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fbb240b3910 0x7fbb241f14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:26.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.294+0000 7fbb23fff700 1 -- 172.21.15.40:0/2862061714 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb240add30 msgr2=0x7fbb241583b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:26.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.294+0000 7fbb23fff700 1 --2- 172.21.15.40:0/2862061714 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb240add30 0x7fbb241583b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:26.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.294+0000 7fbb23fff700 1 -- 172.21.15.40:0/2862061714 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb10009430 con 0x7fbb240b3120 2023-06-22T10:54:26.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.294+0000 7fbb28d9b700 1 --2- 172.21.15.40:0/2862061714 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb240add30 0x7fbb241583b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-22T10:54:26.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.294+0000 7fbb23fff700 1 --2- 172.21.15.40:0/2862061714 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb240b3120 0x7fbb241f0f70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbb10017000 tx=0x7fbb10004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:26.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.295+0000 7fbb217fa700 1 -- 172.21.15.40:0/2862061714 <== mon.1 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb10004460 con 0x7fbb240b3120 2023-06-22T10:54:26.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.295+0000 7fbb217fa700 1 -- 172.21.15.40:0/2862061714 <== mon.1 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb100045e0 con 0x7fbb240b3120 2023-06-22T10:54:26.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.295+0000 7fbb217fa700 1 -- 172.21.15.40:0/2862061714 <== mon.1 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb100038e0 con 0x7fbb240b3120 2023-06-22T10:54:26.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.295+0000 7fbb2afff700 1 -- 172.21.15.40:0/2862061714 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb241f2180 con 0x7fbb240b3120 2023-06-22T10:54:26.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.295+0000 7fbb2afff700 1 -- 172.21.15.40:0/2862061714 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb241588f0 con 0x7fbb240b3120 2023-06-22T10:54:26.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.296+0000 7fbb2afff700 1 -- 172.21.15.40:0/2862061714 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb24158a80 con 0x7fbb240b3120 2023-06-22T10:54:26.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.297+0000 7fbb217fa700 1 -- 172.21.15.40:0/2862061714 <== mon.1 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbb10003a40 con 0x7fbb240b3120 2023-06-22T10:54:26.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.298+0000 7fbb217fa700 1 --2- 172.21.15.40:0/2862061714 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fbb0806ace0 0x7fbb0806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:26.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.298+0000 7fbb217fa700 1 -- 172.21.15.40:0/2862061714 <== mon.1 v2:172.21.15.45:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fbb1008a820 con 0x7fbb240b3120 2023-06-22T10:54:26.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.298+0000 7fbb28d9b700 1 --2- 172.21.15.40:0/2862061714 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fbb0806ace0 0x7fbb0806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:26.303 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.298+0000 7fbb28d9b700 1 --2- 172.21.15.40:0/2862061714 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fbb0806ace0 0x7fbb0806d190 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbb18000f60 tx=0x7fbb18007ea0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:26.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.302+0000 7fbb217fa700 1 -- 172.21.15.40:0/2862061714 <== mon.1 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbb10055590 con 0x7fbb240b3120 2023-06-22T10:54:26.561 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.558+0000 7fbb2afff700 1 -- 172.21.15.40:0/2862061714 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbb24067580 con 0x7fbb240b3120 2023-06-22T10:54:26.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.559+0000 7fbb217fa700 1 -- 172.21.15.40:0/2862061714 <== mon.1 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fbb10058bb0 con 0x7fbb240b3120 2023-06-22T10:54:26.562 INFO:teuthology.orchestra.run.smithi040.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-06-22T10:54:26.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.561+0000 7fbb2afff700 1 -- 172.21.15.40:0/2862061714 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fbb0806ace0 msgr2=0x7fbb0806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:26.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.561+0000 7fbb2afff700 1 --2- 172.21.15.40:0/2862061714 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fbb0806ace0 0x7fbb0806d190 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbb18000f60 tx=0x7fbb18007ea0 comp rx=0 tx=0).stop 2023-06-22T10:54:26.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.561+0000 7fbb2afff700 1 -- 172.21.15.40:0/2862061714 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb240b3120 msgr2=0x7fbb241f0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:26.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.561+0000 7fbb2afff700 1 --2- 172.21.15.40:0/2862061714 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb240b3120 0x7fbb241f0f70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbb10017000 tx=0x7fbb10004750 comp rx=0 tx=0).stop 2023-06-22T10:54:26.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.562+0000 7fbb2afff700 1 -- 172.21.15.40:0/2862061714 shutdown_connections 2023-06-22T10:54:26.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.562+0000 7fbb2afff700 1 --2- 172.21.15.40:0/2862061714 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fbb0806ace0 0x7fbb0806d190 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:26.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.562+0000 7fbb2afff700 1 --2- 172.21.15.40:0/2862061714 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fbb240b3910 0x7fbb241f14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:26.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.562+0000 7fbb2afff700 1 --2- 172.21.15.40:0/2862061714 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb240add30 0x7fbb241583b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:26.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.562+0000 7fbb2afff700 1 --2- 172.21.15.40:0/2862061714 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb240b3120 0x7fbb241f0f70 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:26.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.562+0000 7fbb2afff700 1 -- 172.21.15.40:0/2862061714 >> 172.21.15.40:0/2862061714 conn(0x7fbb24069f30 msgr2=0x7fbb240b1b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:26.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.562+0000 7fbb2afff700 1 -- 172.21.15.40:0/2862061714 shutdown_connections 2023-06-22T10:54:26.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:26.562+0000 7fbb2afff700 1 -- 172.21.15.40:0/2862061714 wait complete. 2023-06-22T10:54:26.583 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-22T10:54:26.583 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-22T10:54:26.583 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2023-06-22T10:54:26.584 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-06-22T10:54:26.584 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-06-22T10:54:26.584 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-22T10:54:26.584 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-22T10:54:26.584 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-22T10:54:26.585 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-06-22T10:54:26.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:26.585 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2023-06-22T10:54:26.633 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-22T10:54:26.634 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-22T10:54:26.634 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-06-22T10:54:26.634 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-06-22T10:54:26.634 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-06-22T10:54:26.634 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-06-22T10:54:26.634 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-22T10:54:26.635 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2023-06-22T10:54:26.635 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f0 2023-06-22T10:54:26.635 INFO:teuthology.orchestra.run.smithi045.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-22T10:54:26.635 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2023-06-22T10:54:26.635 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f1 2023-06-22T10:54:26.635 INFO:teuthology.orchestra.run.smithi045.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-22T10:54:26.635 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2023-06-22T10:54:26.636 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f0 2023-06-22T10:54:26.636 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-06-22T10:54:26.636 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 41896sec preferred_lft 41896sec 2023-06-22T10:54:26.636 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link 2023-06-22T10:54:26.636 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-06-22T10:54:26.636 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-22T10:54:26.636 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2023-06-22T10:54:26.636 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f1 2023-06-22T10:54:26.637 INFO:teuthology.orchestra.run.smithi045.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-22T10:54:26.637 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether ae:dc:93:63:8b:dd brd ff:ff:ff:ff:ff:ff 2023-06-22T10:54:26.637 INFO:teuthology.orchestra.run.smithi045.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-06-22T10:54:26.637 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-06-22T10:54:26.637 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::74b3:63ff:fef4:a108/64 scope link 2023-06-22T10:54:26.637 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-06-22T10:54:26.637 INFO:teuthology.orchestra.run.smithi045.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-22T10:54:26.638 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether ae:dc:93:63:8b:dd brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-06-22T10:54:26.638 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::acdc:93ff:fe63:8bdd/64 scope link 2023-06-22T10:54:26.638 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-06-22T10:54:26.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:26.639 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-22T10:54:26.707 INFO:teuthology.orchestra.run.smithi045.stdout:1 2023-06-22T10:54:26.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:26.711 DEBUG:teuthology.orchestra.run.smithi045:> route 2023-06-22T10:54:26.759 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2023-06-22T10:54:26.759 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-22T10:54:26.759 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-06-22T10:54:26.759 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-06-22T10:54:26.759 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-22T10:54:26.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:26.761 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-06-22T10:54:26.761 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-06-22T10:54:26.761 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-06-22T10:54:26.761 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-06-22T10:54:26.762 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-06-22T10:54:26.762 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-06-22T10:54:26.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:26.933 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-06-22T10:54:26.981 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-06-22T10:54:26.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:26.982 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list-id 2023-06-22T10:54:27.028 INFO:teuthology.orchestra.run.smithi045.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-06-22T10:54:27.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:27.029 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-06-22T10:54:27.030 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-06-22T10:54:27.030 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-06-22T10:54:27.030 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-06-22T10:54:27.030 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-06-22T10:54:27.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:27.172 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-06-22T10:54:27.243 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-22T10:54:27.244 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-22T10:54:27.244 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-06-22T10:54:27.244 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-06-22T10:54:27.244 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-06-22T10:54:27.244 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-06-22T10:54:27.244 INFO:teuthology.orchestra.run.smithi045.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-22T10:54:27.244 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether b2:33:b3:6c:e2:61 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-06-22T10:54:27.245 INFO:teuthology.orchestra.run.smithi045.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-06-22T10:54:27.245 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-06-22T10:54:27.245 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::b033:b3ff:fe6c:e261/64 scope link 2023-06-22T10:54:27.245 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-06-22T10:54:27.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:27.246 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-06-22T10:54:27.317 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-22T10:54:27.317 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-22T10:54:27.318 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-06-22T10:54:27.318 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-06-22T10:54:27.318 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-06-22T10:54:27.318 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-06-22T10:54:27.319 INFO:teuthology.orchestra.run.smithi045.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-22T10:54:27.319 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether b2:33:b3:6c:e2:61 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-06-22T10:54:27.319 INFO:teuthology.orchestra.run.smithi045.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-06-22T10:54:27.319 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-06-22T10:54:27.319 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::b033:b3ff:fe6c:e261/64 scope link 2023-06-22T10:54:27.320 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-06-22T10:54:27.321 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-06-22T10:54:27.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:27.322 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-06-22T10:54:27.322 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-06-22T10:54:27.323 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-06-22T10:54:27.324 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-06-22T10:54:27.324 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-06-22T10:54:27.325 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-06-22T10:54:27.326 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-06-22T10:54:27.327 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-06-22T10:54:27.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:27.583 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-06-22T10:54:27.583 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-06-22T10:54:27.584 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.1 up 2023-06-22T10:54:27.584 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set dev brx.1 master ceph-brx 2023-06-22T10:54:27.584 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-06-22T10:54:27.769 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-22T10:54:27.769 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-06-22T10:54:27.819 INFO:teuthology.orchestra.run.smithi045.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-06-22T10:54:27.819 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-22T10:54:27.819 DEBUG:teuthology.orchestra.run.smithi045:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-06-22T10:54:27.904 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2023-06-22T10:54:27.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:27.905 DEBUG:teuthology.orchestra.run.smithi045:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-22T10:54:28.054 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-22T10:54:28.054 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-22T10:54:28.081 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-22T10:54:28.081 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-22T10:54:28.082 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: resolved to: "172.21.15.40:3300,172.21.15.45:3300,172.21.15.45:3301" 2023-06-22T10:54:28.082 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: trying mount with new device syntax: 3@475560bc-1a7c-4a75-b3b6-6fc6b20bdc52.cephfs=/ 2023-06-22T10:54:28.082 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.40:3300/172.21.15.45:3300/172.21.15.45:3301" will pass to kernel 2023-06-22T10:54:28.088 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-06-22T10:54:28.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:28.089 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-06-22T10:54:28.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:28.159 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-22T10:54:28.246 INFO:teuthology.orchestra.run.smithi045.stdout:client4628 2023-06-22T10:54:28.246 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-06-22T10:54:28.247 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-22T10:54:28.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:28.292 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-22T10:54:28.421 INFO:teuthology.orchestra.run.smithi045.stdout:client4628 2023-06-22T10:54:28.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:28.421 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-22T10:54:28.508 INFO:teuthology.orchestra.run.smithi045.stdout:client4628 2023-06-22T10:54:28.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:28.509 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/475560bc-1a7c-4a75-b3b6-6fc6b20bdc52.client4628/status') 2023-06-22T10:54:28.617 INFO:teuthology.orchestra.run.smithi045.stdout:instance: client.4628 (3)192.168.0.2:0/1421962079 2023-06-22T10:54:28.617 INFO:teuthology.orchestra.run.smithi045.stdout:blocklisted: false 2023-06-22T10:54:28.617 INFO:teuthology.orchestra.run.smithi045.stderr:0+1 records in 2023-06-22T10:54:28.617 INFO:teuthology.orchestra.run.smithi045.stderr:0+1 records out 2023-06-22T10:54:28.618 INFO:teuthology.orchestra.run.smithi045.stderr:69 bytes copied, 5.5606e-05 s, 1.2 MB/s 2023-06-22T10:54:28.620 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-06-22T10:54:28.640 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-22T10:54:28.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:28.850+0000 7f08851ff700 1 Processor -- start 2023-06-22T10:54:28.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:28.850+0000 7f08851ff700 1 -- start start 2023-06-22T10:54:28.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:28.851+0000 7f08851ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f08800b4d40 0x7f08800d1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:28.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:28.852+0000 7f08851ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08800d25f0 con 0x7f08800b84a0 2023-06-22T10:54:28.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:28.852+0000 7f08851ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0880160930 con 0x7f08800d2000 2023-06-22T10:54:28.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:28.852+0000 7f08851ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0880160cb0 con 0x7f08800b4d40 2023-06-22T10:54:28.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:28.852+0000 7f087ed9d700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f08800b84a0 0x7f08800cd200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51954/0 (socket says 172.21.15.40:51954) 2023-06-22T10:54:28.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:28.852+0000 7f087ed9d700 1 -- 172.21.15.40:0/2837900430 learned_addr learned my addr 172.21.15.40:0/2837900430 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:28.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:28.852+0000 7f087f59e700 1 --2- 172.21.15.40:0/2837900430 >> v2:172.21.15.40:3300/0 conn(0x7f08800b4d40 0x7f08800d1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:28.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:28.852+0000 7f087dd9b700 1 -- 172.21.15.40:0/2837900430 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4256064082 0 0) 0x7f08800d25f0 con 0x7f08800b84a0 2023-06-22T10:54:28.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:28.852+0000 7f087dd9b700 1 -- 172.21.15.40:0/2837900430 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08680035b0 con 0x7f08800b84a0 2023-06-22T10:54:28.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:28.852+0000 7f087dd9b700 1 -- 172.21.15.40:0/2837900430 <== mon.1 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3873433391 0 0) 0x7f0880160930 con 0x7f08800d2000 2023-06-22T10:54:28.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:28.852+0000 7f087f59e700 1 -- 172.21.15.40:0/2837900430 >> v1:172.21.15.45:6789/0 conn(0x7f08800d2000 legacy=0x7f08800b4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:28.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:28.852+0000 7f087f59e700 1 -- 172.21.15.40:0/2837900430 >> v1:172.21.15.40:6789/0 conn(0x7f08800b84a0 legacy=0x7f08800cd200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:28.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:28.852+0000 7f087f59e700 1 -- 172.21.15.40:0/2837900430 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08800d2860 con 0x7f08800b4d40 2023-06-22T10:54:28.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:28.853+0000 7f087f59e700 1 --2- 172.21.15.40:0/2837900430 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08800b4d40 0x7f08800d1a40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0878009d90 tx=0x7f087800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5677b86dc1fcf917 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:28.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:28.853+0000 7f087dd9b700 1 -- 172.21.15.40:0/2837900430 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087800e070 con 0x7f08800b4d40 2023-06-22T10:54:28.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:28.853+0000 7f087dd9b700 1 -- 172.21.15.40:0/2837900430 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f087800bb20 con 0x7f08800b4d40 2023-06-22T10:54:28.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:28.853+0000 7f087dd9b700 1 -- 172.21.15.40:0/2837900430 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087800bed0 con 0x7f08800b4d40 2023-06-22T10:54:28.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:28.853+0000 7f08851ff700 1 -- 172.21.15.40:0/2837900430 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08800b4d40 msgr2=0x7f08800d1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:28.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:28.853+0000 7f08851ff700 1 --2- 172.21.15.40:0/2837900430 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08800b4d40 0x7f08800d1a40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0878009d90 tx=0x7f087800b330 comp rx=0 tx=0).stop 2023-06-22T10:54:28.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:28.853+0000 7f08851ff700 1 -- 172.21.15.40:0/2837900430 shutdown_connections 2023-06-22T10:54:28.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:28.853+0000 7f08851ff700 1 --2- 172.21.15.40:0/2837900430 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08800b4d40 0x7f08800d1a40 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:28.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:28.853+0000 7f08851ff700 1 -- 172.21.15.40:0/2837900430 >> 172.21.15.40:0/2837900430 conn(0x7f08800cf630 msgr2=0x7f08800cfa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:28.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:28.854+0000 7f08851ff700 1 -- 172.21.15.40:0/2837900430 shutdown_connections 2023-06-22T10:54:28.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:28.854+0000 7f08851ff700 1 -- 172.21.15.40:0/2837900430 wait complete. 2023-06-22T10:54:28.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:28.855+0000 7f08851ff700 1 Processor -- start 2023-06-22T10:54:28.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:28.855+0000 7f08851ff700 1 -- start start 2023-06-22T10:54:28.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:28.856+0000 7f08851ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08800b4d40 0x7f088015cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:28.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:28.856+0000 7f08851ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08800b84a0 0x7f08801f5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:28.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:28.856+0000 7f08851ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f08800d2000 0x7f08800c90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:28.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:28.856+0000 7f08851ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0880157940 con 0x7f08800b4d40 2023-06-22T10:54:28.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:28.856+0000 7f08851ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f088015dc10 con 0x7f08800b84a0 2023-06-22T10:54:28.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:28.856+0000 7f08851ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f088015def0 con 0x7f08800d2000 2023-06-22T10:54:28.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:28.856+0000 7f087ed9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08800b4d40 0x7f088015cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:28.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:28.857+0000 7f087ed9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08800b4d40 0x7f088015cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39256/0 (socket says 172.21.15.40:39256) 2023-06-22T10:54:28.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:28.857+0000 7f087ed9d700 1 -- 172.21.15.40:0/1027218921 learned_addr learned my addr 172.21.15.40:0/1027218921 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:28.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:28.857+0000 7f087e59c700 1 --2- 172.21.15.40:0/1027218921 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08800b84a0 0x7f08801f5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:28.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:28.857+0000 7f087f59e700 1 --2- 172.21.15.40:0/1027218921 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f08800d2000 0x7f08800c90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:28.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:28.857+0000 7f087ed9d700 1 -- 172.21.15.40:0/1027218921 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f08800d2000 msgr2=0x7f08800c90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:28.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:28.857+0000 7f087ed9d700 1 --2- 172.21.15.40:0/1027218921 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f08800d2000 0x7f08800c90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:28.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:28.857+0000 7f087ed9d700 1 -- 172.21.15.40:0/1027218921 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08800b84a0 msgr2=0x7f08801f5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:28.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:28.857+0000 7f087ed9d700 1 --2- 172.21.15.40:0/1027218921 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08800b84a0 0x7f08801f5b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:28.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:28.857+0000 7f087ed9d700 1 -- 172.21.15.40:0/1027218921 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0878009a70 con 0x7f08800b4d40 2023-06-22T10:54:28.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:28.857+0000 7f087ed9d700 1 --2- 172.21.15.40:0/1027218921 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08800b4d40 0x7f088015cb50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f087000c420 tx=0x7f087000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:28.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:28.857+0000 7f08677fe700 1 -- 172.21.15.40:0/1027218921 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0870005d70 con 0x7f08800b4d40 2023-06-22T10:54:28.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:28.857+0000 7f08677fe700 1 -- 172.21.15.40:0/1027218921 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08700070d0 con 0x7f08800b4d40 2023-06-22T10:54:28.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:28.857+0000 7f08851ff700 1 -- 172.21.15.40:0/1027218921 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08801f5030 con 0x7f08800b4d40 2023-06-22T10:54:28.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:28.857+0000 7f08677fe700 1 -- 172.21.15.40:0/1027218921 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0870007440 con 0x7f08800b4d40 2023-06-22T10:54:28.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:28.858+0000 7f08851ff700 1 -- 172.21.15.40:0/1027218921 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08801f55f0 con 0x7f08800b4d40 2023-06-22T10:54:28.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:28.859+0000 7f08851ff700 1 -- 172.21.15.40:0/1027218921 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0880067580 con 0x7f08800b4d40 2023-06-22T10:54:28.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:28.860+0000 7f08677fe700 1 -- 172.21.15.40:0/1027218921 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f08700075a0 con 0x7f08800b4d40 2023-06-22T10:54:28.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:28.861+0000 7f08677fe700 1 --2- 172.21.15.40:0/1027218921 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f086c06ace0 0x7f086c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:28.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:28.861+0000 7f08677fe700 1 -- 172.21.15.40:0/1027218921 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0870088bb0 con 0x7f08800b4d40 2023-06-22T10:54:28.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:28.861+0000 7f087e59c700 1 --2- 172.21.15.40:0/1027218921 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f086c06ace0 0x7f086c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:28.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:28.862+0000 7f087e59c700 1 --2- 172.21.15.40:0/1027218921 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f086c06ace0 0x7f086c06d190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f088015d350 tx=0x7f0874009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:28.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:28.866+0000 7f08677fe700 1 -- 172.21.15.40:0/1027218921 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0870053940 con 0x7f08800b4d40 2023-06-22T10:54:29.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.075+0000 7f08851ff700 1 -- 172.21.15.40:0/1027218921 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f088015fc70 con 0x7f08800b4d40 2023-06-22T10:54:29.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.077+0000 7f08677fe700 1 -- 172.21.15.40:0/1027218921 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20132 (secure 0 0 0) 0x7f0870056f60 con 0x7f08800b4d40 2023-06-22T10:54:29.081 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:54:29.081 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":30,"fsid":"475560bc-1a7c-4a75-b3b6-6fc6b20bdc52","created":"2023-06-22T10:53:03.784568+0000","modified":"2023-06-22T10:54:12.717204+0000","last_up_change":"2023-06-22T10:53:17.830348+0000","last_in_change":"2023-06-22T10:53:07.329974+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-22T10:53:17.182228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-22T10:53:23.874432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-22T10:53:29.812963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-22T10:53:30.404021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-22T10:53:33.982289+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"918db6b4-053a-46ba-976d-6e1a0104017f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6809","nonce":2400162888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6811","nonce":2400162888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6815","nonce":2400162888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6813","nonce":2400162888}]},"public_addr":"172.21.15.40:6809/2400162888","cluster_addr":"172.21.15.40:6811/2400162888","heartbeat_back_addr":"172.21.15.40:6815/2400162888","heartbeat_front_addr":"172.21.15.40:6813/2400162888","state":["exists","up"]},{"osd":1,"uuid":"0c146e2b-1725-4dae-9b5c-38795943b9d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6801","nonce":230885800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6803","nonce":230885800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6807","nonce":230885800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6805","nonce":230885800}]},"public_addr":"172.21.15.40:6801/230885800","cluster_addr":"172.21.15.40:6803/230885800","heartbeat_back_addr":"172.21.15.40:6807/230885800","heartbeat_front_addr":"172.21.15.40:6805/230885800","state":["exists","up"]},{"osd":2,"uuid":"0b3727fd-f281-46d5-a675-86c8c5ab269e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6817","nonce":2681404929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6819","nonce":2681404929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6823","nonce":2681404929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6821","nonce":2681404929}]},"public_addr":"172.21.15.40:6817/2681404929","cluster_addr":"172.21.15.40:6819/2681404929","heartbeat_back_addr":"172.21.15.40:6823/2681404929","heartbeat_front_addr":"172.21.15.40:6821/2681404929","state":["exists","up"]},{"osd":3,"uuid":"2969c698-7039-4bbb-beda-f756f7a368a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6825","nonce":111110981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6827","nonce":111110981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6831","nonce":111110981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6829","nonce":111110981}]},"public_addr":"172.21.15.40:6825/111110981","cluster_addr":"172.21.15.40:6827/111110981","heartbeat_back_addr":"172.21.15.40:6831/111110981","heartbeat_front_addr":"172.21.15.40:6829/111110981","state":["exists","up"]},{"osd":4,"uuid":"3bb1d9c8-8e42-4a6b-998d-04834f34be5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6801","nonce":3625455711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6803","nonce":3625455711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6807","nonce":3625455711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6805","nonce":3625455711}]},"public_addr":"172.21.15.45:6801/3625455711","cluster_addr":"172.21.15.45:6803/3625455711","heartbeat_back_addr":"172.21.15.45:6807/3625455711","heartbeat_front_addr":"172.21.15.45:6805/3625455711","state":["exists","up"]},{"osd":5,"uuid":"f9854ee4-302c-41be-977b-bedda090a3d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6817","nonce":3354411217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6819","nonce":3354411217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6823","nonce":3354411217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6821","nonce":3354411217}]},"public_addr":"172.21.15.45:6817/3354411217","cluster_addr":"172.21.15.45:6819/3354411217","heartbeat_back_addr":"172.21.15.45:6823/3354411217","heartbeat_front_addr":"172.21.15.45:6821/3354411217","state":["exists","up"]},{"osd":6,"uuid":"bbdb1989-f6ac-4954-9b85-b8b540d683c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6809","nonce":320111074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6811","nonce":320111074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6815","nonce":320111074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6813","nonce":320111074}]},"public_addr":"172.21.15.45:6809/320111074","cluster_addr":"172.21.15.45:6811/320111074","heartbeat_back_addr":"172.21.15.45:6815/320111074","heartbeat_front_addr":"172.21.15.45:6813/320111074","state":["exists","up"]},{"osd":7,"uuid":"823d44e3-58f1-4d1d-8263-a4e4a69d4327","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6825","nonce":643617680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6827","nonce":643617680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6831","nonce":643617680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6829","nonce":643617680}]},"public_addr":"172.21.15.45:6825/643617680","cluster_addr":"172.21.15.45:6827/643617680","heartbeat_back_addr":"172.21.15.45:6831/643617680","heartbeat_front_addr":"172.21.15.45:6829/643617680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.731262+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.873226+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.898936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.666578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.645990+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.953699+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.642823+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.693395+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1b","mappings":[{"from":3,"to":2}]},{"pgid":"4.2a","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-22T10:54:29.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.079+0000 7f08851ff700 1 -- 172.21.15.40:0/1027218921 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f086c06ace0 msgr2=0x7f086c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:29.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.079+0000 7f08851ff700 1 --2- 172.21.15.40:0/1027218921 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f086c06ace0 0x7f086c06d190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f088015d350 tx=0x7f0874009040 comp rx=0 tx=0).stop 2023-06-22T10:54:29.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.079+0000 7f08851ff700 1 -- 172.21.15.40:0/1027218921 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08800b4d40 msgr2=0x7f088015cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:29.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.079+0000 7f08851ff700 1 --2- 172.21.15.40:0/1027218921 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08800b4d40 0x7f088015cb50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f087000c420 tx=0x7f087000c7e0 comp rx=0 tx=0).stop 2023-06-22T10:54:29.083 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.079+0000 7f08851ff700 1 -- 172.21.15.40:0/1027218921 shutdown_connections 2023-06-22T10:54:29.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.079+0000 7f08851ff700 1 --2- 172.21.15.40:0/1027218921 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f086c06ace0 0x7f086c06d190 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:29.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.079+0000 7f08851ff700 1 --2- 172.21.15.40:0/1027218921 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f08800d2000 0x7f08800c90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:29.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.079+0000 7f08851ff700 1 --2- 172.21.15.40:0/1027218921 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f08800b4d40 0x7f088015cb50 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:29.084 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.079+0000 7f08851ff700 1 --2- 172.21.15.40:0/1027218921 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08800b84a0 0x7f08801f5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:29.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.079+0000 7f08851ff700 1 -- 172.21.15.40:0/1027218921 >> 172.21.15.40:0/1027218921 conn(0x7f08800cf630 msgr2=0x7f08800b6be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:29.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.079+0000 7f08851ff700 1 -- 172.21.15.40:0/1027218921 shutdown_connections 2023-06-22T10:54:29.085 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.079+0000 7f08851ff700 1 -- 172.21.15.40:0/1027218921 wait complete. 2023-06-22T10:54:29.101 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-22T10:53:17.182228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-22T10:53:23.874432+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-22T10:53:29.812963+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-22T10:53:30.404021+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-22T10:53:33.982289+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-22T10:54:29.102 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-22T10:54:29.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.303+0000 7fe0b75ff700 1 Processor -- start 2023-06-22T10:54:29.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.303+0000 7fe0b75ff700 1 -- start start 2023-06-22T10:54:29.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.304+0000 7fe0b75ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe0b00b45d0 0x7fe0b00b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:29.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.304+0000 7fe0b75ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe0b00b59a0 0x7fe0b00b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:29.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.305+0000 7fe0b75ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0b00d1be0 con 0x7fe0b00d2130 2023-06-22T10:54:29.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.305+0000 7fe0b75ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0b00d17f0 con 0x7fe0b00b59a0 2023-06-22T10:54:29.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.305+0000 7fe0b75ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b00d1360 con 0x7fe0b00b45d0 2023-06-22T10:54:29.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.305+0000 7fe0b5b9c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe0b00b59a0 0x7fe0b00b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:29.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.305+0000 7fe0b5b9c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe0b00b59a0 0x7fe0b00b5e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39266/0 (socket says 172.21.15.40:39266) 2023-06-22T10:54:29.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.305+0000 7fe0b5b9c700 1 -- 172.21.15.40:0/4073151204 learned_addr learned my addr 172.21.15.40:0/4073151204 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:29.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.305+0000 7fe0b539b700 1 --2- 172.21.15.40:0/4073151204 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe0b00b45d0 0x7fe0b00b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:29.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.305+0000 7fe0b5b9c700 1 -- 172.21.15.40:0/4073151204 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe0b00b45d0 msgr2=0x7fe0b00b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:29.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.305+0000 7fe0b5b9c700 1 --2- 172.21.15.40:0/4073151204 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe0b00b45d0 0x7fe0b00b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:29.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.305+0000 7fe0b5b9c700 1 -- 172.21.15.40:0/4073151204 >> v1:172.21.15.45:6789/0 conn(0x7fe0b00d2130 legacy=0x7fe0b00cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:29.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.305+0000 7fe0b5b9c700 1 -- 172.21.15.40:0/4073151204 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b00b4ee0 con 0x7fe0b00b59a0 2023-06-22T10:54:29.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.306+0000 7fe0b5b9c700 1 --2- 172.21.15.40:0/4073151204 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0b00b59a0 0x7fe0b00b5e40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8009e50 tx=0x7fe0a800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37354de7bc46f8fe server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:29.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.306+0000 7fe0a7fff700 1 -- 172.21.15.40:0/4073151204 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a800e070 con 0x7fe0b00b59a0 2023-06-22T10:54:29.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.306+0000 7fe0a7fff700 1 -- 172.21.15.40:0/4073151204 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0a800b910 con 0x7fe0b00b59a0 2023-06-22T10:54:29.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.306+0000 7fe0a7fff700 1 -- 172.21.15.40:0/4073151204 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a800bcc0 con 0x7fe0b00b59a0 2023-06-22T10:54:29.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.306+0000 7fe0b75ff700 1 -- 172.21.15.40:0/4073151204 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0b00b59a0 msgr2=0x7fe0b00b5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:29.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.306+0000 7fe0b75ff700 1 --2- 172.21.15.40:0/4073151204 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0b00b59a0 0x7fe0b00b5e40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8009e50 tx=0x7fe0a800b330 comp rx=0 tx=0).stop 2023-06-22T10:54:29.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.306+0000 7fe0b75ff700 1 -- 172.21.15.40:0/4073151204 shutdown_connections 2023-06-22T10:54:29.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.306+0000 7fe0b75ff700 1 --2- 172.21.15.40:0/4073151204 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0b00b59a0 0x7fe0b00b5e40 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:29.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.306+0000 7fe0b75ff700 1 --2- 172.21.15.40:0/4073151204 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe0b00b45d0 0x7fe0b00b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:29.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.306+0000 7fe0b75ff700 1 -- 172.21.15.40:0/4073151204 >> 172.21.15.40:0/4073151204 conn(0x7fe0b00cf5d0 msgr2=0x7fe0b00cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:29.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.307+0000 7fe0b75ff700 1 -- 172.21.15.40:0/4073151204 shutdown_connections 2023-06-22T10:54:29.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.307+0000 7fe0b75ff700 1 -- 172.21.15.40:0/4073151204 wait complete. 2023-06-22T10:54:29.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.308+0000 7fe0b75ff700 1 Processor -- start 2023-06-22T10:54:29.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.308+0000 7fe0b75ff700 1 -- start start 2023-06-22T10:54:29.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.309+0000 7fe0b75ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe0b00b45d0 0x7fe0b00a9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:29.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.309+0000 7fe0b75ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0b00b59a0 0x7fe0b0158d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:29.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.309+0000 7fe0b75ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0b00d2130 0x7fe0b00a9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:29.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.309+0000 7fe0b75ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b0158940 con 0x7fe0b00d2130 2023-06-22T10:54:29.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.309+0000 7fe0b75ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b00a9a60 con 0x7fe0b00b59a0 2023-06-22T10:54:29.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.309+0000 7fe0b75ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b01592a0 con 0x7fe0b00b45d0 2023-06-22T10:54:29.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.310+0000 7fe0b5b9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0b00d2130 0x7fe0b00a9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:29.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.310+0000 7fe0b5b9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0b00d2130 0x7fe0b00a9d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39272/0 (socket says 172.21.15.40:39272) 2023-06-22T10:54:29.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.310+0000 7fe0b5b9c700 1 -- 172.21.15.40:0/3117279611 learned_addr learned my addr 172.21.15.40:0/3117279611 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:29.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.310+0000 7fe0b4b9a700 1 --2- 172.21.15.40:0/3117279611 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0b00b59a0 0x7fe0b0158d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:29.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.310+0000 7fe0b5b9c700 1 -- 172.21.15.40:0/3117279611 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe0b00b45d0 msgr2=0x7fe0b00a9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:29.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.310+0000 7fe0b539b700 1 --2- 172.21.15.40:0/3117279611 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe0b00b45d0 0x7fe0b00a9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:29.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.310+0000 7fe0b5b9c700 1 --2- 172.21.15.40:0/3117279611 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe0b00b45d0 0x7fe0b00a9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:29.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.310+0000 7fe0b5b9c700 1 -- 172.21.15.40:0/3117279611 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0b00b59a0 msgr2=0x7fe0b0158d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:29.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.310+0000 7fe0b5b9c700 1 --2- 172.21.15.40:0/3117279611 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0b00b59a0 0x7fe0b0158d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:29.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.310+0000 7fe0b5b9c700 1 -- 172.21.15.40:0/3117279611 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a8009b30 con 0x7fe0b00d2130 2023-06-22T10:54:29.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.310+0000 7fe0b4b9a700 1 --2- 172.21.15.40:0/3117279611 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0b00b59a0 0x7fe0b0158d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-22T10:54:29.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.310+0000 7fe0b539b700 1 --2- 172.21.15.40:0/3117279611 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe0b00b45d0 0x7fe0b00a9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-22T10:54:29.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.310+0000 7fe0b5b9c700 1 --2- 172.21.15.40:0/3117279611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0b00d2130 0x7fe0b00a9d80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe0b006a0c0 tx=0x7fe0a8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:29.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.310+0000 7fe0a5ffb700 1 -- 172.21.15.40:0/3117279611 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a8004920 con 0x7fe0b00d2130 2023-06-22T10:54:29.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.311+0000 7fe0a5ffb700 1 -- 172.21.15.40:0/3117279611 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0a80092e0 con 0x7fe0b00d2130 2023-06-22T10:54:29.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.311+0000 7fe0b75ff700 1 -- 172.21.15.40:0/3117279611 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0b0157cc0 con 0x7fe0b00d2130 2023-06-22T10:54:29.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.311+0000 7fe0a5ffb700 1 -- 172.21.15.40:0/3117279611 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a801c660 con 0x7fe0b00d2130 2023-06-22T10:54:29.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.311+0000 7fe0b75ff700 1 -- 172.21.15.40:0/3117279611 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0b0158280 con 0x7fe0b00d2130 2023-06-22T10:54:29.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.312+0000 7fe0b75ff700 1 -- 172.21.15.40:0/3117279611 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0b0158a80 con 0x7fe0b00d2130 2023-06-22T10:54:29.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.313+0000 7fe0a5ffb700 1 -- 172.21.15.40:0/3117279611 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe0a801c7c0 con 0x7fe0b00d2130 2023-06-22T10:54:29.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.314+0000 7fe0a5ffb700 1 --2- 172.21.15.40:0/3117279611 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe09406ace0 0x7fe09406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:29.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.314+0000 7fe0a5ffb700 1 -- 172.21.15.40:0/3117279611 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe0a808b4c0 con 0x7fe0b00d2130 2023-06-22T10:54:29.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.314+0000 7fe0b539b700 1 --2- 172.21.15.40:0/3117279611 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe09406ace0 0x7fe09406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:29.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.315+0000 7fe0b539b700 1 --2- 172.21.15.40:0/3117279611 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe09406ace0 0x7fe09406d190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac009ac0 tx=0x7fe0ac008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:29.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.319+0000 7fe0a5ffb700 1 -- 172.21.15.40:0/3117279611 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe0b0158a80 con 0x7fe0b00d2130 2023-06-22T10:54:29.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.524+0000 7fe0b75ff700 1 -- 172.21.15.40:0/3117279611 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe0b0158a80 con 0x7fe0b00d2130 2023-06-22T10:54:29.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.524+0000 7fe0a5ffb700 1 -- 172.21.15.40:0/3117279611 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe0b0158a80 con 0x7fe0b00d2130 2023-06-22T10:54:29.528 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-06-22T10:54:29.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.526+0000 7fe0b75ff700 1 -- 172.21.15.40:0/3117279611 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe09406ace0 msgr2=0x7fe09406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:29.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.526+0000 7fe0b75ff700 1 --2- 172.21.15.40:0/3117279611 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe09406ace0 0x7fe09406d190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac009ac0 tx=0x7fe0ac008040 comp rx=0 tx=0).stop 2023-06-22T10:54:29.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.526+0000 7fe0b75ff700 1 -- 172.21.15.40:0/3117279611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0b00d2130 msgr2=0x7fe0b00a9d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:29.530 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.526+0000 7fe0b75ff700 1 --2- 172.21.15.40:0/3117279611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0b00d2130 0x7fe0b00a9d80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe0b006a0c0 tx=0x7fe0a8004ad0 comp rx=0 tx=0).stop 2023-06-22T10:54:29.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.527+0000 7fe0b75ff700 1 -- 172.21.15.40:0/3117279611 shutdown_connections 2023-06-22T10:54:29.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.527+0000 7fe0b75ff700 1 --2- 172.21.15.40:0/3117279611 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe09406ace0 0x7fe09406d190 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:29.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.527+0000 7fe0b75ff700 1 --2- 172.21.15.40:0/3117279611 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe0b00b45d0 0x7fe0b00a9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:29.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.527+0000 7fe0b75ff700 1 --2- 172.21.15.40:0/3117279611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0b00d2130 0x7fe0b00a9d80 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:29.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.527+0000 7fe0b75ff700 1 --2- 172.21.15.40:0/3117279611 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0b00b59a0 0x7fe0b0158d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:29.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.527+0000 7fe0b75ff700 1 -- 172.21.15.40:0/3117279611 >> 172.21.15.40:0/3117279611 conn(0x7fe0b00cf5d0 msgr2=0x7fe0b00b38c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:29.531 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.527+0000 7fe0b75ff700 1 -- 172.21.15.40:0/3117279611 shutdown_connections 2023-06-22T10:54:29.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.527+0000 7fe0b75ff700 1 -- 172.21.15.40:0/3117279611 wait complete. 2023-06-22T10:54:29.548 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-22T10:54:29.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.749+0000 7fe9961ff700 1 Processor -- start 2023-06-22T10:54:29.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.749+0000 7fe9961ff700 1 -- start start 2023-06-22T10:54:29.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.750+0000 7fe9961ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe9900b59a0 0x7fe9900b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:29.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.750+0000 7fe9961ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9900d1be0 con 0x7fe9900d2130 2023-06-22T10:54:29.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.750+0000 7fe9961ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9900d1360 con 0x7fe9900b45d0 2023-06-22T10:54:29.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.750+0000 7fe9961ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9900d17f0 con 0x7fe9900b59a0 2023-06-22T10:54:29.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.750+0000 7fe98effd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe9900d2130 0x7fe9900cd1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51956/0 (socket says 172.21.15.40:51956) 2023-06-22T10:54:29.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.750+0000 7fe98effd700 1 -- 172.21.15.40:0/3352982437 learned_addr learned my addr 172.21.15.40:0/3352982437 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:29.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.751+0000 7fe98ffff700 1 --2- 172.21.15.40:0/3352982437 >> v2:172.21.15.40:3300/0 conn(0x7fe9900b59a0 0x7fe9900b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:29.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.751+0000 7fe98e7fc700 1 -- 172.21.15.40:0/3352982437 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3714802355 0 0) 0x7fe9900d1be0 con 0x7fe9900d2130 2023-06-22T10:54:29.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.751+0000 7fe98e7fc700 1 -- 172.21.15.40:0/3352982437 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9780035b0 con 0x7fe9900d2130 2023-06-22T10:54:29.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.751+0000 7fe98ffff700 1 -- 172.21.15.40:0/3352982437 >> v1:172.21.15.45:6789/0 conn(0x7fe9900b45d0 legacy=0x7fe9900b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:29.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.751+0000 7fe98ffff700 1 -- 172.21.15.40:0/3352982437 >> v1:172.21.15.40:6789/0 conn(0x7fe9900d2130 legacy=0x7fe9900cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:29.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.751+0000 7fe98ffff700 1 -- 172.21.15.40:0/3352982437 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9900cef40 con 0x7fe9900b59a0 2023-06-22T10:54:29.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.751+0000 7fe98ffff700 1 --2- 172.21.15.40:0/3352982437 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9900b59a0 0x7fe9900b5e40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe988009d90 tx=0x7fe98800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1399b80753d1bbf server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:29.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.752+0000 7fe98e7fc700 1 -- 172.21.15.40:0/3352982437 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe98800e070 con 0x7fe9900b59a0 2023-06-22T10:54:29.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.752+0000 7fe98e7fc700 1 -- 172.21.15.40:0/3352982437 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe98800bb20 con 0x7fe9900b59a0 2023-06-22T10:54:29.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.752+0000 7fe98e7fc700 1 -- 172.21.15.40:0/3352982437 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe988012430 con 0x7fe9900b59a0 2023-06-22T10:54:29.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.752+0000 7fe9961ff700 1 -- 172.21.15.40:0/3352982437 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9900b59a0 msgr2=0x7fe9900b5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:29.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.752+0000 7fe9961ff700 1 --2- 172.21.15.40:0/3352982437 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9900b59a0 0x7fe9900b5e40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe988009d90 tx=0x7fe98800b330 comp rx=0 tx=0).stop 2023-06-22T10:54:29.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.752+0000 7fe9961ff700 1 -- 172.21.15.40:0/3352982437 shutdown_connections 2023-06-22T10:54:29.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.752+0000 7fe9961ff700 1 --2- 172.21.15.40:0/3352982437 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9900b59a0 0x7fe9900b5e40 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:29.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.752+0000 7fe9961ff700 1 -- 172.21.15.40:0/3352982437 >> 172.21.15.40:0/3352982437 conn(0x7fe9900cf5d0 msgr2=0x7fe9900cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:29.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.752+0000 7fe9961ff700 1 -- 172.21.15.40:0/3352982437 shutdown_connections 2023-06-22T10:54:29.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.752+0000 7fe9961ff700 1 -- 172.21.15.40:0/3352982437 wait complete. 2023-06-22T10:54:29.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.754+0000 7fe9961ff700 1 Processor -- start 2023-06-22T10:54:29.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.754+0000 7fe9961ff700 1 -- start start 2023-06-22T10:54:29.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.755+0000 7fe9961ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe9900b45d0 0x7fe99006b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:29.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.755+0000 7fe9961ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9900b59a0 0x7fe990158990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:29.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.755+0000 7fe9961ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9900d2130 0x7fe990158ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:29.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.755+0000 7fe9961ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe99015d6c0 con 0x7fe9900d2130 2023-06-22T10:54:29.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.755+0000 7fe9961ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe99015cab0 con 0x7fe9900b59a0 2023-06-22T10:54:29.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.755+0000 7fe9961ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe99015cd90 con 0x7fe9900b45d0 2023-06-22T10:54:29.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.755+0000 7fe98ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9900d2130 0x7fe990158ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:29.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.755+0000 7fe98ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9900d2130 0x7fe990158ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39288/0 (socket says 172.21.15.40:39288) 2023-06-22T10:54:29.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.755+0000 7fe98ffff700 1 -- 172.21.15.40:0/2769379598 learned_addr learned my addr 172.21.15.40:0/2769379598 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:29.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.756+0000 7fe98f7fe700 1 --2- 172.21.15.40:0/2769379598 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe9900b45d0 0x7fe99006b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:29.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.756+0000 7fe98effd700 1 --2- 172.21.15.40:0/2769379598 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9900b59a0 0x7fe990158990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:29.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.756+0000 7fe98ffff700 1 -- 172.21.15.40:0/2769379598 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe9900b45d0 msgr2=0x7fe99006b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:29.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.756+0000 7fe98ffff700 1 --2- 172.21.15.40:0/2769379598 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe9900b45d0 0x7fe99006b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:29.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.756+0000 7fe98ffff700 1 -- 172.21.15.40:0/2769379598 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9900b59a0 msgr2=0x7fe990158990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:29.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.756+0000 7fe98ffff700 1 --2- 172.21.15.40:0/2769379598 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9900b59a0 0x7fe990158990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:29.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.756+0000 7fe98ffff700 1 -- 172.21.15.40:0/2769379598 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe988009a70 con 0x7fe9900d2130 2023-06-22T10:54:29.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.756+0000 7fe98ffff700 1 --2- 172.21.15.40:0/2769379598 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9900d2130 0x7fe990158ed0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe99006a0c0 tx=0x7fe988004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:29.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.756+0000 7fe977fff700 1 -- 172.21.15.40:0/2769379598 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe988012430 con 0x7fe9900d2130 2023-06-22T10:54:29.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.756+0000 7fe977fff700 1 -- 172.21.15.40:0/2769379598 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe988020070 con 0x7fe9900d2130 2023-06-22T10:54:29.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.756+0000 7fe977fff700 1 -- 172.21.15.40:0/2769379598 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe988004280 con 0x7fe9900d2130 2023-06-22T10:54:29.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.756+0000 7fe9961ff700 1 -- 172.21.15.40:0/2769379598 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe99015d070 con 0x7fe9900d2130 2023-06-22T10:54:29.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.757+0000 7fe9961ff700 1 -- 172.21.15.40:0/2769379598 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe99006bb10 con 0x7fe9900d2130 2023-06-22T10:54:29.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.758+0000 7fe9961ff700 1 -- 172.21.15.40:0/2769379598 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe99015d870 con 0x7fe9900d2130 2023-06-22T10:54:29.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.758+0000 7fe977fff700 1 -- 172.21.15.40:0/2769379598 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe9880043e0 con 0x7fe9900d2130 2023-06-22T10:54:29.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.759+0000 7fe977fff700 1 --2- 172.21.15.40:0/2769379598 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe97c06ace0 0x7fe97c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:29.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.759+0000 7fe977fff700 1 -- 172.21.15.40:0/2769379598 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe988022070 con 0x7fe9900d2130 2023-06-22T10:54:29.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.759+0000 7fe98f7fe700 1 --2- 172.21.15.40:0/2769379598 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe97c06ace0 0x7fe97c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:29.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.760+0000 7fe98f7fe700 1 --2- 172.21.15.40:0/2769379598 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe97c06ace0 0x7fe97c06d190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe980000f60 tx=0x7fe980009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:29.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.764+0000 7fe977fff700 1 -- 172.21.15.40:0/2769379598 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe99015d870 con 0x7fe9900d2130 2023-06-22T10:54:29.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.975+0000 7fe9961ff700 1 -- 172.21.15.40:0/2769379598 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe99015d870 con 0x7fe9900d2130 2023-06-22T10:54:29.980 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.975+0000 7fe977fff700 1 -- 172.21.15.40:0/2769379598 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe99015d870 con 0x7fe9900d2130 2023-06-22T10:54:29.981 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 8 2023-06-22T10:54:29.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.977+0000 7fe9961ff700 1 -- 172.21.15.40:0/2769379598 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe97c06ace0 msgr2=0x7fe97c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:29.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.977+0000 7fe9961ff700 1 --2- 172.21.15.40:0/2769379598 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe97c06ace0 0x7fe97c06d190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe980000f60 tx=0x7fe980009040 comp rx=0 tx=0).stop 2023-06-22T10:54:29.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.978+0000 7fe9961ff700 1 -- 172.21.15.40:0/2769379598 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9900d2130 msgr2=0x7fe990158ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:29.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.978+0000 7fe9961ff700 1 --2- 172.21.15.40:0/2769379598 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9900d2130 0x7fe990158ed0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe99006a0c0 tx=0x7fe988004ad0 comp rx=0 tx=0).stop 2023-06-22T10:54:29.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.978+0000 7fe9961ff700 1 -- 172.21.15.40:0/2769379598 shutdown_connections 2023-06-22T10:54:29.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.978+0000 7fe9961ff700 1 --2- 172.21.15.40:0/2769379598 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe97c06ace0 0x7fe97c06d190 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:29.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.978+0000 7fe9961ff700 1 --2- 172.21.15.40:0/2769379598 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe9900b45d0 0x7fe99006b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:29.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.978+0000 7fe9961ff700 1 --2- 172.21.15.40:0/2769379598 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9900d2130 0x7fe990158ed0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:29.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.978+0000 7fe9961ff700 1 --2- 172.21.15.40:0/2769379598 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9900b59a0 0x7fe990158990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:29.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.978+0000 7fe9961ff700 1 -- 172.21.15.40:0/2769379598 >> 172.21.15.40:0/2769379598 conn(0x7fe9900cf5d0 msgr2=0x7fe9900b2c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:29.983 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.978+0000 7fe9961ff700 1 -- 172.21.15.40:0/2769379598 shutdown_connections 2023-06-22T10:54:29.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:29.978+0000 7fe9961ff700 1 -- 172.21.15.40:0/2769379598 wait complete. 2023-06-22T10:54:30.001 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-22T10:54:30.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.202+0000 7fa8dc3ff700 1 Processor -- start 2023-06-22T10:54:30.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.203+0000 7fa8dc3ff700 1 -- start start 2023-06-22T10:54:30.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.204+0000 7fa8dc3ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa8d40d2130 0x7fa8d40cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:30.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.204+0000 7fa8dc3ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa8d40cd6e0 0x7fa8d40b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:30.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.204+0000 7fa8dc3ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8d40d1be0 con 0x7fa8d40b45d0 2023-06-22T10:54:30.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.204+0000 7fa8dc3ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8d40d17f0 con 0x7fa8d40d2130 2023-06-22T10:54:30.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.204+0000 7fa8dc3ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d40d1360 con 0x7fa8d40cd6e0 2023-06-22T10:54:30.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.204+0000 7fa8d999a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa8d40d2130 0x7fa8d40cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:30.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.204+0000 7fa8d999a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa8d40d2130 0x7fa8d40cd1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39292/0 (socket says 172.21.15.40:39292) 2023-06-22T10:54:30.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.204+0000 7fa8d999a700 1 -- 172.21.15.40:0/3911552413 learned_addr learned my addr 172.21.15.40:0/3911552413 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:30.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.204+0000 7fa8da99c700 1 --2- 172.21.15.40:0/3911552413 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa8d40cd6e0 0x7fa8d40b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:30.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.205+0000 7fa8d999a700 1 -- 172.21.15.40:0/3911552413 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa8d40cd6e0 msgr2=0x7fa8d40b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:30.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.205+0000 7fa8d999a700 1 --2- 172.21.15.40:0/3911552413 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa8d40cd6e0 0x7fa8d40b59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:30.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.205+0000 7fa8d999a700 1 -- 172.21.15.40:0/3911552413 >> v1:172.21.15.45:6789/0 conn(0x7fa8d40b45d0 legacy=0x7fa8d40b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:30.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.205+0000 7fa8d999a700 1 -- 172.21.15.40:0/3911552413 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d40cef40 con 0x7fa8d40d2130 2023-06-22T10:54:30.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.205+0000 7fa8d999a700 1 --2- 172.21.15.40:0/3911552413 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8d40d2130 0x7fa8d40cd1a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa8c40098f0 tx=0x7fa8c4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2739260594fa799f server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:30.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.205+0000 7fa8d9199700 1 -- 172.21.15.40:0/3911552413 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c4011830 con 0x7fa8d40d2130 2023-06-22T10:54:30.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.205+0000 7fa8d9199700 1 -- 172.21.15.40:0/3911552413 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c4011990 con 0x7fa8d40d2130 2023-06-22T10:54:30.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.205+0000 7fa8d9199700 1 -- 172.21.15.40:0/3911552413 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c4011d20 con 0x7fa8d40d2130 2023-06-22T10:54:30.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.206+0000 7fa8dc3ff700 1 -- 172.21.15.40:0/3911552413 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8d40d2130 msgr2=0x7fa8d40cd1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:30.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.206+0000 7fa8dc3ff700 1 --2- 172.21.15.40:0/3911552413 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8d40d2130 0x7fa8d40cd1a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa8c40098f0 tx=0x7fa8c4009c00 comp rx=0 tx=0).stop 2023-06-22T10:54:30.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.206+0000 7fa8dc3ff700 1 -- 172.21.15.40:0/3911552413 shutdown_connections 2023-06-22T10:54:30.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.206+0000 7fa8dc3ff700 1 --2- 172.21.15.40:0/3911552413 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa8d40cd6e0 0x7fa8d40b59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:30.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.206+0000 7fa8dc3ff700 1 --2- 172.21.15.40:0/3911552413 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8d40d2130 0x7fa8d40cd1a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:30.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.206+0000 7fa8dc3ff700 1 -- 172.21.15.40:0/3911552413 >> 172.21.15.40:0/3911552413 conn(0x7fa8d40cf5d0 msgr2=0x7fa8d40cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:30.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.206+0000 7fa8dc3ff700 1 -- 172.21.15.40:0/3911552413 shutdown_connections 2023-06-22T10:54:30.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.206+0000 7fa8dc3ff700 1 -- 172.21.15.40:0/3911552413 wait complete. 2023-06-22T10:54:30.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.208+0000 7fa8dc3ff700 1 Processor -- start 2023-06-22T10:54:30.213 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.208+0000 7fa8dc3ff700 1 -- start start 2023-06-22T10:54:30.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.209+0000 7fa8dc3ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8d40b45d0 0x7fa8d4158940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:30.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.209+0000 7fa8dc3ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8d40cd6e0 0x7fa8d415d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:30.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.209+0000 7fa8dc3ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa8d40d2130 0x7fa8d4159900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:30.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.209+0000 7fa8dc3ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d415df10 con 0x7fa8d40cd6e0 2023-06-22T10:54:30.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.209+0000 7fa8dc3ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d415e1f0 con 0x7fa8d40b45d0 2023-06-22T10:54:30.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.209+0000 7fa8dc3ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d415e4d0 con 0x7fa8d40d2130 2023-06-22T10:54:30.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.209+0000 7fa8d999a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8d40cd6e0 0x7fa8d415d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:30.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.209+0000 7fa8d999a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8d40cd6e0 0x7fa8d415d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39302/0 (socket says 172.21.15.40:39302) 2023-06-22T10:54:30.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.209+0000 7fa8d999a700 1 -- 172.21.15.40:0/2235119699 learned_addr learned my addr 172.21.15.40:0/2235119699 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:30.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.209+0000 7fa8d999a700 1 -- 172.21.15.40:0/2235119699 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa8d40d2130 msgr2=0x7fa8d4159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:30.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.209+0000 7fa8d999a700 1 --2- 172.21.15.40:0/2235119699 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa8d40d2130 0x7fa8d4159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:30.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.209+0000 7fa8d999a700 1 -- 172.21.15.40:0/2235119699 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8d40b45d0 msgr2=0x7fa8d4158940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:30.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.209+0000 7fa8da19b700 1 --2- 172.21.15.40:0/2235119699 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8d40b45d0 0x7fa8d4158940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:30.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.209+0000 7fa8d999a700 1 --2- 172.21.15.40:0/2235119699 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8d40b45d0 0x7fa8d4158940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:30.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.209+0000 7fa8d999a700 1 -- 172.21.15.40:0/2235119699 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c4009550 con 0x7fa8d40cd6e0 2023-06-22T10:54:30.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.209+0000 7fa8da19b700 1 --2- 172.21.15.40:0/2235119699 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8d40b45d0 0x7fa8d4158940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-22T10:54:30.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.210+0000 7fa8d999a700 1 --2- 172.21.15.40:0/2235119699 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8d40cd6e0 0x7fa8d415d450 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4014040 tx=0x7fa8c4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:30.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.210+0000 7fa8caffd700 1 -- 172.21.15.40:0/2235119699 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c4004570 con 0x7fa8d40cd6e0 2023-06-22T10:54:30.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.210+0000 7fa8caffd700 1 -- 172.21.15.40:0/2235119699 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c401f070 con 0x7fa8d40cd6e0 2023-06-22T10:54:30.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.210+0000 7fa8caffd700 1 -- 172.21.15.40:0/2235119699 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c40038e0 con 0x7fa8d40cd6e0 2023-06-22T10:54:30.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.210+0000 7fa8dc3ff700 1 -- 172.21.15.40:0/2235119699 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8d415e7b0 con 0x7fa8d40cd6e0 2023-06-22T10:54:30.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.210+0000 7fa8dc3ff700 1 -- 172.21.15.40:0/2235119699 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8d415d990 con 0x7fa8d40cd6e0 2023-06-22T10:54:30.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.211+0000 7fa8dc3ff700 1 -- 172.21.15.40:0/2235119699 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8d415e610 con 0x7fa8d40cd6e0 2023-06-22T10:54:30.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.212+0000 7fa8caffd700 1 -- 172.21.15.40:0/2235119699 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa8c4021030 con 0x7fa8d40cd6e0 2023-06-22T10:54:30.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.214+0000 7fa8caffd700 1 --2- 172.21.15.40:0/2235119699 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fa8b806ace0 0x7fa8b806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:30.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.214+0000 7fa8caffd700 1 -- 172.21.15.40:0/2235119699 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa8c408abb0 con 0x7fa8d40cd6e0 2023-06-22T10:54:30.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.214+0000 7fa8da19b700 1 --2- 172.21.15.40:0/2235119699 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fa8b806ace0 0x7fa8b806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:30.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.215+0000 7fa8da19b700 1 --2- 172.21.15.40:0/2235119699 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fa8b806ace0 0x7fa8b806d190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa8d41f5410 tx=0x7fa8d0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:30.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.218+0000 7fa8caffd700 1 -- 172.21.15.40:0/2235119699 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa8d415e610 con 0x7fa8d40cd6e0 2023-06-22T10:54:30.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.424+0000 7fa8dc3ff700 1 -- 172.21.15.40:0/2235119699 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa8d415ecd0 con 0x7fa8d40cd6e0 2023-06-22T10:54:30.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.424+0000 7fa8caffd700 1 -- 172.21.15.40:0/2235119699 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa8d415ecd0 con 0x7fa8d40cd6e0 2023-06-22T10:54:30.428 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-06-22T10:54:30.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.427+0000 7fa8dc3ff700 1 -- 172.21.15.40:0/2235119699 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fa8b806ace0 msgr2=0x7fa8b806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:30.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.427+0000 7fa8dc3ff700 1 --2- 172.21.15.40:0/2235119699 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fa8b806ace0 0x7fa8b806d190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa8d41f5410 tx=0x7fa8d0009040 comp rx=0 tx=0).stop 2023-06-22T10:54:30.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.427+0000 7fa8dc3ff700 1 -- 172.21.15.40:0/2235119699 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8d40cd6e0 msgr2=0x7fa8d415d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:30.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.427+0000 7fa8dc3ff700 1 --2- 172.21.15.40:0/2235119699 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8d40cd6e0 0x7fa8d415d450 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4014040 tx=0x7fa8c4004750 comp rx=0 tx=0).stop 2023-06-22T10:54:30.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.427+0000 7fa8dc3ff700 1 -- 172.21.15.40:0/2235119699 shutdown_connections 2023-06-22T10:54:30.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.427+0000 7fa8dc3ff700 1 --2- 172.21.15.40:0/2235119699 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fa8b806ace0 0x7fa8b806d190 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:30.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.427+0000 7fa8dc3ff700 1 --2- 172.21.15.40:0/2235119699 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa8d40d2130 0x7fa8d4159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:30.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.427+0000 7fa8dc3ff700 1 --2- 172.21.15.40:0/2235119699 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8d40b45d0 0x7fa8d4158940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:30.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.427+0000 7fa8dc3ff700 1 --2- 172.21.15.40:0/2235119699 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa8d40cd6e0 0x7fa8d415d450 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:30.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.427+0000 7fa8dc3ff700 1 -- 172.21.15.40:0/2235119699 >> 172.21.15.40:0/2235119699 conn(0x7fa8d40cf5d0 msgr2=0x7fa8d415b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:30.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.427+0000 7fa8dc3ff700 1 -- 172.21.15.40:0/2235119699 shutdown_connections 2023-06-22T10:54:30.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.427+0000 7fa8dc3ff700 1 -- 172.21.15.40:0/2235119699 wait complete. 2023-06-22T10:54:30.448 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-22T10:54:30.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.648+0000 7fbc1cfff700 1 Processor -- start 2023-06-22T10:54:30.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.648+0000 7fbc1cfff700 1 -- start start 2023-06-22T10:54:30.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.650+0000 7fbc1cfff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fbc180b59a0 0x7fbc180b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:30.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.650+0000 7fbc1cfff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc180d1be0 con 0x7fbc180d2130 2023-06-22T10:54:30.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.650+0000 7fbc1cfff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc180d1360 con 0x7fbc180b45d0 2023-06-22T10:54:30.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.650+0000 7fbc1cfff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc180d17f0 con 0x7fbc180b59a0 2023-06-22T10:54:30.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.650+0000 7fbc0ffff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fbc180d2130 0x7fbc180cd1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51970/0 (socket says 172.21.15.40:51970) 2023-06-22T10:54:30.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.650+0000 7fbc0ffff700 1 -- 172.21.15.40:0/3304504370 learned_addr learned my addr 172.21.15.40:0/3304504370 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:30.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.650+0000 7fbc16d9d700 1 --2- 172.21.15.40:0/3304504370 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fbc180b59a0 0x7fbc180b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:30.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.650+0000 7fbc15d9b700 1 -- 172.21.15.40:0/3304504370 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 109223046 0 0) 0x7fbc180d1be0 con 0x7fbc180d2130 2023-06-22T10:54:30.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.650+0000 7fbc15d9b700 1 -- 172.21.15.40:0/3304504370 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc040035b0 con 0x7fbc180d2130 2023-06-22T10:54:30.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.650+0000 7fbc15d9b700 1 -- 172.21.15.40:0/3304504370 <== mon.1 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3361430079 0 0) 0x7fbc180d1360 con 0x7fbc180b45d0 2023-06-22T10:54:30.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.651+0000 7fbc15d9b700 1 -- 172.21.15.40:0/3304504370 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc180d1be0 con 0x7fbc180b45d0 2023-06-22T10:54:30.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.651+0000 7fbc16d9d700 1 -- 172.21.15.40:0/3304504370 >> v1:172.21.15.45:6789/0 conn(0x7fbc180b45d0 legacy=0x7fbc180b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:30.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.651+0000 7fbc16d9d700 1 -- 172.21.15.40:0/3304504370 >> v1:172.21.15.40:6789/0 conn(0x7fbc180d2130 legacy=0x7fbc180cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:30.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.651+0000 7fbc16d9d700 1 -- 172.21.15.40:0/3304504370 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc180cef40 con 0x7fbc180b59a0 2023-06-22T10:54:30.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.651+0000 7fbc16d9d700 1 --2- 172.21.15.40:0/3304504370 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fbc180b59a0 0x7fbc180b5e40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbc10009dc0 tx=0x7fbc1000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aabb7ddf4ba0cc5 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:30.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.651+0000 7fbc15d9b700 1 -- 172.21.15.40:0/3304504370 <== mon.2 v2:172.21.15.45:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1000e070 con 0x7fbc180b59a0 2023-06-22T10:54:30.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.651+0000 7fbc15d9b700 1 -- 172.21.15.40:0/3304504370 <== mon.2 v2:172.21.15.45:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc1000bb20 con 0x7fbc180b59a0 2023-06-22T10:54:30.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.651+0000 7fbc15d9b700 1 -- 172.21.15.40:0/3304504370 <== mon.2 v2:172.21.15.45:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc10012430 con 0x7fbc180b59a0 2023-06-22T10:54:30.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.652+0000 7fbc1cfff700 1 -- 172.21.15.40:0/3304504370 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fbc180b59a0 msgr2=0x7fbc180b5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:30.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.652+0000 7fbc1cfff700 1 --2- 172.21.15.40:0/3304504370 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fbc180b59a0 0x7fbc180b5e40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbc10009dc0 tx=0x7fbc1000b330 comp rx=0 tx=0).stop 2023-06-22T10:54:30.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.652+0000 7fbc1cfff700 1 -- 172.21.15.40:0/3304504370 shutdown_connections 2023-06-22T10:54:30.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.652+0000 7fbc1cfff700 1 --2- 172.21.15.40:0/3304504370 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fbc180b59a0 0x7fbc180b5e40 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:30.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.652+0000 7fbc1cfff700 1 -- 172.21.15.40:0/3304504370 >> 172.21.15.40:0/3304504370 conn(0x7fbc180cf5d0 msgr2=0x7fbc180cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:30.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.652+0000 7fbc1cfff700 1 -- 172.21.15.40:0/3304504370 shutdown_connections 2023-06-22T10:54:30.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.652+0000 7fbc1cfff700 1 -- 172.21.15.40:0/3304504370 wait complete. 2023-06-22T10:54:30.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.654+0000 7fbc1cfff700 1 Processor -- start 2023-06-22T10:54:30.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.654+0000 7fbc1cfff700 1 -- start start 2023-06-22T10:54:30.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.655+0000 7fbc1cfff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fbc180b45d0 0x7fbc18153550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:30.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.655+0000 7fbc1cfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc180b59a0 0x7fbc18158c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:30.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.655+0000 7fbc1cfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc180d2130 0x7fbc180b33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:30.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.655+0000 7fbc1cfff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc18157260 con 0x7fbc180b59a0 2023-06-22T10:54:30.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.655+0000 7fbc1cfff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc18153340 con 0x7fbc180d2130 2023-06-22T10:54:30.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.655+0000 7fbc1cfff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc18159bb0 con 0x7fbc180b45d0 2023-06-22T10:54:30.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.655+0000 7fbc0ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc180b59a0 0x7fbc18158c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:30.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.655+0000 7fbc0ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc180b59a0 0x7fbc18158c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39316/0 (socket says 172.21.15.40:39316) 2023-06-22T10:54:30.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.655+0000 7fbc0ffff700 1 -- 172.21.15.40:0/309028730 learned_addr learned my addr 172.21.15.40:0/309028730 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:30.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.655+0000 7fbc1659c700 1 --2- 172.21.15.40:0/309028730 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fbc180b45d0 0x7fbc18153550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:30.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.655+0000 7fbc16d9d700 1 --2- 172.21.15.40:0/309028730 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc180d2130 0x7fbc180b33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:30.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.655+0000 7fbc0ffff700 1 -- 172.21.15.40:0/309028730 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fbc180b45d0 msgr2=0x7fbc18153550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:30.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.655+0000 7fbc0ffff700 1 --2- 172.21.15.40:0/309028730 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fbc180b45d0 0x7fbc18153550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:30.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.655+0000 7fbc0ffff700 1 -- 172.21.15.40:0/309028730 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc180d2130 msgr2=0x7fbc180b33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:30.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.655+0000 7fbc0ffff700 1 --2- 172.21.15.40:0/309028730 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc180d2130 0x7fbc180b33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:30.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.655+0000 7fbc0ffff700 1 -- 172.21.15.40:0/309028730 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc10009a70 con 0x7fbc180b59a0 2023-06-22T10:54:30.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.655+0000 7fbc16d9d700 1 --2- 172.21.15.40:0/309028730 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc180d2130 0x7fbc180b33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:54:30.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.656+0000 7fbc0ffff700 1 --2- 172.21.15.40:0/309028730 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc180b59a0 0x7fbc18158c10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fbc00001eb0 tx=0x7fbc0000c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:30.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.656+0000 7fbc0effd700 1 -- 172.21.15.40:0/309028730 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc00005d70 con 0x7fbc180b59a0 2023-06-22T10:54:30.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.656+0000 7fbc0effd700 1 -- 172.21.15.40:0/309028730 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc000070d0 con 0x7fbc180b59a0 2023-06-22T10:54:30.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.656+0000 7fbc1cfff700 1 -- 172.21.15.40:0/309028730 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc18159310 con 0x7fbc180b59a0 2023-06-22T10:54:30.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.656+0000 7fbc0effd700 1 -- 172.21.15.40:0/309028730 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc00007480 con 0x7fbc180b59a0 2023-06-22T10:54:30.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.656+0000 7fbc1cfff700 1 -- 172.21.15.40:0/309028730 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc181598d0 con 0x7fbc180b59a0 2023-06-22T10:54:30.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.657+0000 7fbc1cfff700 1 -- 172.21.15.40:0/309028730 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc181573a0 con 0x7fbc180b59a0 2023-06-22T10:54:30.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.658+0000 7fbc0effd700 1 -- 172.21.15.40:0/309028730 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbc000075e0 con 0x7fbc180b59a0 2023-06-22T10:54:30.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.659+0000 7fbc0effd700 1 --2- 172.21.15.40:0/309028730 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fbbf806ace0 0x7fbbf806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:30.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.659+0000 7fbc0effd700 1 -- 172.21.15.40:0/309028730 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fbc00088d20 con 0x7fbc180b59a0 2023-06-22T10:54:30.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.659+0000 7fbc1659c700 1 --2- 172.21.15.40:0/309028730 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fbbf806ace0 0x7fbbf806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:30.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.660+0000 7fbc1659c700 1 --2- 172.21.15.40:0/309028730 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fbbf806ace0 0x7fbbf806d190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbc08001120 tx=0x7fbc08009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:30.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.663+0000 7fbc0effd700 1 -- 172.21.15.40:0/309028730 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbc181573a0 con 0x7fbc180b59a0 2023-06-22T10:54:30.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.871+0000 7fbc1cfff700 1 -- 172.21.15.40:0/309028730 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbc181573a0 con 0x7fbc180b59a0 2023-06-22T10:54:30.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.871+0000 7fbc0effd700 1 -- 172.21.15.40:0/309028730 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbc181573a0 con 0x7fbc180b59a0 2023-06-22T10:54:30.875 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-06-22T10:54:30.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.874+0000 7fbc1cfff700 1 -- 172.21.15.40:0/309028730 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fbbf806ace0 msgr2=0x7fbbf806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:30.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.874+0000 7fbc1cfff700 1 --2- 172.21.15.40:0/309028730 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fbbf806ace0 0x7fbbf806d190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbc08001120 tx=0x7fbc08009040 comp rx=0 tx=0).stop 2023-06-22T10:54:30.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.874+0000 7fbc1cfff700 1 -- 172.21.15.40:0/309028730 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc180b59a0 msgr2=0x7fbc18158c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:30.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.874+0000 7fbc1cfff700 1 --2- 172.21.15.40:0/309028730 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc180b59a0 0x7fbc18158c10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fbc00001eb0 tx=0x7fbc0000c7b0 comp rx=0 tx=0).stop 2023-06-22T10:54:30.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.874+0000 7fbc1cfff700 1 -- 172.21.15.40:0/309028730 shutdown_connections 2023-06-22T10:54:30.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.874+0000 7fbc1cfff700 1 --2- 172.21.15.40:0/309028730 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fbbf806ace0 0x7fbbf806d190 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:30.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.874+0000 7fbc1cfff700 1 --2- 172.21.15.40:0/309028730 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fbc180b45d0 0x7fbc18153550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:30.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.874+0000 7fbc1cfff700 1 --2- 172.21.15.40:0/309028730 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc180d2130 0x7fbc180b33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:30.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.874+0000 7fbc1cfff700 1 --2- 172.21.15.40:0/309028730 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc180b59a0 0x7fbc18158c10 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:30.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.874+0000 7fbc1cfff700 1 -- 172.21.15.40:0/309028730 >> 172.21.15.40:0/309028730 conn(0x7fbc180cf5d0 msgr2=0x7fbc180cce70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:30.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.874+0000 7fbc1cfff700 1 -- 172.21.15.40:0/309028730 shutdown_connections 2023-06-22T10:54:30.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:30.874+0000 7fbc1cfff700 1 -- 172.21.15.40:0/309028730 wait complete. 2023-06-22T10:54:30.895 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-22T10:54:31.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.095+0000 7f0f647ff700 1 Processor -- start 2023-06-22T10:54:31.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.095+0000 7f0f647ff700 1 -- start start 2023-06-22T10:54:31.099 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.096+0000 7f0f647ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0f5c0cea60 0x7f0f5c06d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:31.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.096+0000 7f0f647ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f5c0ccc60 con 0x7f0f5c071310 2023-06-22T10:54:31.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.096+0000 7f0f647ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f5c0ccf40 con 0x7f0f5c15c5e0 2023-06-22T10:54:31.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.096+0000 7f0f647ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f5c0c96e0 con 0x7f0f5c0cea60 2023-06-22T10:54:31.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.096+0000 7f0f61d9a700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f0f5c071310 0x7f0f5c1602d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51978/0 (socket says 172.21.15.40:51978) 2023-06-22T10:54:31.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.096+0000 7f0f61d9a700 1 -- 172.21.15.40:0/1618086918 learned_addr learned my addr 172.21.15.40:0/1618086918 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:31.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.097+0000 7f0f62d9c700 1 --2- 172.21.15.40:0/1618086918 >> v2:172.21.15.45:3300/0 conn(0x7f0f5c0cea60 0x7f0f5c06d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:31.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.097+0000 7f0f61599700 1 -- 172.21.15.40:0/1618086918 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2396689233 0 0) 0x7f0f5c0ccc60 con 0x7f0f5c071310 2023-06-22T10:54:31.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.097+0000 7f0f61599700 1 -- 172.21.15.40:0/1618086918 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f480035b0 con 0x7f0f5c071310 2023-06-22T10:54:31.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.097+0000 7f0f61599700 1 -- 172.21.15.40:0/1618086918 <== mon.1 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3175330317 0 0) 0x7f0f5c0ccf40 con 0x7f0f5c15c5e0 2023-06-22T10:54:31.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.097+0000 7f0f61599700 1 -- 172.21.15.40:0/1618086918 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f5c0ccc60 con 0x7f0f5c15c5e0 2023-06-22T10:54:31.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.097+0000 7f0f62d9c700 1 -- 172.21.15.40:0/1618086918 >> v1:172.21.15.45:6789/0 conn(0x7f0f5c15c5e0 legacy=0x7f0f5c070c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:31.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.097+0000 7f0f62d9c700 1 -- 172.21.15.40:0/1618086918 >> v1:172.21.15.40:6789/0 conn(0x7f0f5c071310 legacy=0x7f0f5c1602d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:31.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.097+0000 7f0f62d9c700 1 -- 172.21.15.40:0/1618086918 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f5c071bc0 con 0x7f0f5c0cea60 2023-06-22T10:54:31.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.097+0000 7f0f62d9c700 1 --2- 172.21.15.40:0/1618086918 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f5c0cea60 0x7f0f5c06d630 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0f54009d90 tx=0x7f0f5400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cac047270000e6bc server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:31.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.098+0000 7f0f61599700 1 -- 172.21.15.40:0/1618086918 <== mon.1 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5400e070 con 0x7f0f5c0cea60 2023-06-22T10:54:31.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.098+0000 7f0f61599700 1 -- 172.21.15.40:0/1618086918 <== mon.1 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f5400bb20 con 0x7f0f5c0cea60 2023-06-22T10:54:31.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.098+0000 7f0f61599700 1 -- 172.21.15.40:0/1618086918 <== mon.1 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f54012430 con 0x7f0f5c0cea60 2023-06-22T10:54:31.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.098+0000 7f0f647ff700 1 -- 172.21.15.40:0/1618086918 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f5c0cea60 msgr2=0x7f0f5c06d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:31.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.098+0000 7f0f647ff700 1 --2- 172.21.15.40:0/1618086918 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f5c0cea60 0x7f0f5c06d630 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0f54009d90 tx=0x7f0f5400b330 comp rx=0 tx=0).stop 2023-06-22T10:54:31.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.098+0000 7f0f647ff700 1 -- 172.21.15.40:0/1618086918 shutdown_connections 2023-06-22T10:54:31.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.098+0000 7f0f647ff700 1 --2- 172.21.15.40:0/1618086918 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f5c0cea60 0x7f0f5c06d630 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:31.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.098+0000 7f0f647ff700 1 -- 172.21.15.40:0/1618086918 >> 172.21.15.40:0/1618086918 conn(0x7f0f5c0cc7a0 msgr2=0x7f0f5c0cf090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:31.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.099+0000 7f0f647ff700 1 -- 172.21.15.40:0/1618086918 shutdown_connections 2023-06-22T10:54:31.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.099+0000 7f0f647ff700 1 -- 172.21.15.40:0/1618086918 wait complete. 2023-06-22T10:54:31.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.100+0000 7f0f647ff700 1 Processor -- start 2023-06-22T10:54:31.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.100+0000 7f0f647ff700 1 -- start start 2023-06-22T10:54:31.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.101+0000 7f0f647ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f5c071310 0x7f0f5c0ae980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:31.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.101+0000 7f0f647ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f5c0cea60 0x7f0f5c0c8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:31.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.101+0000 7f0f647ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f0f5c15c5e0 0x7f0f5c0b38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:31.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.102+0000 7f0f647ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5c0c7a60 con 0x7f0f5c0cea60 2023-06-22T10:54:31.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.102+0000 7f0f647ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5c0c7d40 con 0x7f0f5c071310 2023-06-22T10:54:31.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.102+0000 7f0f647ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5c0c8020 con 0x7f0f5c15c5e0 2023-06-22T10:54:31.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.102+0000 7f0f61d9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f5c0cea60 0x7f0f5c0c8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:31.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.102+0000 7f0f61d9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f5c0cea60 0x7f0f5c0c8ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39324/0 (socket says 172.21.15.40:39324) 2023-06-22T10:54:31.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.102+0000 7f0f61d9a700 1 -- 172.21.15.40:0/1033640532 learned_addr learned my addr 172.21.15.40:0/1033640532 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:31.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.102+0000 7f0f6259b700 1 --2- 172.21.15.40:0/1033640532 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f5c071310 0x7f0f5c0ae980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:31.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.102+0000 7f0f62d9c700 1 --2- 172.21.15.40:0/1033640532 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f0f5c15c5e0 0x7f0f5c0b38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:31.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.102+0000 7f0f61d9a700 1 -- 172.21.15.40:0/1033640532 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f0f5c15c5e0 msgr2=0x7f0f5c0b38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:31.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.102+0000 7f0f61d9a700 1 --2- 172.21.15.40:0/1033640532 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f0f5c15c5e0 0x7f0f5c0b38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:31.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.102+0000 7f0f61d9a700 1 -- 172.21.15.40:0/1033640532 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f5c071310 msgr2=0x7f0f5c0ae980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:31.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.102+0000 7f0f61d9a700 1 --2- 172.21.15.40:0/1033640532 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f5c071310 0x7f0f5c0ae980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:31.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.102+0000 7f0f61d9a700 1 -- 172.21.15.40:0/1033640532 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f54009a70 con 0x7f0f5c0cea60 2023-06-22T10:54:31.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.102+0000 7f0f62d9c700 1 --2- 172.21.15.40:0/1033640532 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f0f5c15c5e0 0x7f0f5c0b38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:54:31.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.102+0000 7f0f61d9a700 1 --2- 172.21.15.40:0/1033640532 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f5c0cea60 0x7f0f5c0c8ae0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c00c4f0 tx=0x7f0f4c00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:31.109 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.103+0000 7f0f52ffd700 1 -- 172.21.15.40:0/1033640532 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c005d70 con 0x7f0f5c0cea60 2023-06-22T10:54:31.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.103+0000 7f0f52ffd700 1 -- 172.21.15.40:0/1033640532 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f4c0070d0 con 0x7f0f5c0cea60 2023-06-22T10:54:31.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.103+0000 7f0f52ffd700 1 -- 172.21.15.40:0/1033640532 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c007440 con 0x7f0f5c0cea60 2023-06-22T10:54:31.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.103+0000 7f0f647ff700 1 -- 172.21.15.40:0/1033640532 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f5c0c8300 con 0x7f0f5c0cea60 2023-06-22T10:54:31.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.103+0000 7f0f647ff700 1 -- 172.21.15.40:0/1033640532 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f5c0c9020 con 0x7f0f5c0cea60 2023-06-22T10:54:31.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.104+0000 7f0f647ff700 1 -- 172.21.15.40:0/1033640532 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f5c067580 con 0x7f0f5c0cea60 2023-06-22T10:54:31.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.105+0000 7f0f52ffd700 1 -- 172.21.15.40:0/1033640532 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0f4c0075a0 con 0x7f0f5c0cea60 2023-06-22T10:54:31.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.106+0000 7f0f52ffd700 1 --2- 172.21.15.40:0/1033640532 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f0f4006ace0 0x7f0f4006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:31.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.106+0000 7f0f52ffd700 1 -- 172.21.15.40:0/1033640532 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0f4c088bd0 con 0x7f0f5c0cea60 2023-06-22T10:54:31.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.106+0000 7f0f6259b700 1 --2- 172.21.15.40:0/1033640532 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f0f4006ace0 0x7f0f4006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:31.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.107+0000 7f0f6259b700 1 --2- 172.21.15.40:0/1033640532 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f0f4006ace0 0x7f0f4006d190 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0f580011e0 tx=0x7f0f58009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:31.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.110+0000 7f0f52ffd700 1 -- 172.21.15.40:0/1033640532 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0f4c053960 con 0x7f0f5c0cea60 2023-06-22T10:54:31.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.316+0000 7f0f647ff700 1 -- 172.21.15.40:0/1033640532 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f0f5c0b5010 con 0x7f0f5c0cea60 2023-06-22T10:54:31.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.317+0000 7f0f52ffd700 1 -- 172.21.15.40:0/1033640532 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0f4c056f80 con 0x7f0f5c0cea60 2023-06-22T10:54:31.320 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-06-22T10:54:31.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.319+0000 7f0f647ff700 1 -- 172.21.15.40:0/1033640532 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f0f4006ace0 msgr2=0x7f0f4006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:31.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.319+0000 7f0f647ff700 1 --2- 172.21.15.40:0/1033640532 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f0f4006ace0 0x7f0f4006d190 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0f580011e0 tx=0x7f0f58009040 comp rx=0 tx=0).stop 2023-06-22T10:54:31.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.319+0000 7f0f647ff700 1 -- 172.21.15.40:0/1033640532 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f5c0cea60 msgr2=0x7f0f5c0c8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:31.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.319+0000 7f0f647ff700 1 --2- 172.21.15.40:0/1033640532 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f5c0cea60 0x7f0f5c0c8ae0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c00c4f0 tx=0x7f0f4c00c800 comp rx=0 tx=0).stop 2023-06-22T10:54:31.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.319+0000 7f0f647ff700 1 -- 172.21.15.40:0/1033640532 shutdown_connections 2023-06-22T10:54:31.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.319+0000 7f0f647ff700 1 --2- 172.21.15.40:0/1033640532 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f0f4006ace0 0x7f0f4006d190 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:31.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.319+0000 7f0f647ff700 1 --2- 172.21.15.40:0/1033640532 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f0f5c15c5e0 0x7f0f5c0b38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:31.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.319+0000 7f0f647ff700 1 --2- 172.21.15.40:0/1033640532 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f5c071310 0x7f0f5c0ae980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:31.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.319+0000 7f0f647ff700 1 --2- 172.21.15.40:0/1033640532 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f5c0cea60 0x7f0f5c0c8ae0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:31.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.319+0000 7f0f647ff700 1 -- 172.21.15.40:0/1033640532 >> 172.21.15.40:0/1033640532 conn(0x7f0f5c0cc7a0 msgr2=0x7f0f5c069f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:31.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.320+0000 7f0f647ff700 1 -- 172.21.15.40:0/1033640532 shutdown_connections 2023-06-22T10:54:31.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.320+0000 7f0f647ff700 1 -- 172.21.15.40:0/1033640532 wait complete. 2023-06-22T10:54:31.341 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-22T10:54:31.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.537+0000 7fd245fff700 1 Processor -- start 2023-06-22T10:54:31.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.538+0000 7fd245fff700 1 -- start start 2023-06-22T10:54:31.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.539+0000 7fd245fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd2400d2830 0x7fd2400b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:31.542 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.539+0000 7fd245fff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd2400b4c60 0x7fd2400d0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:31.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.539+0000 7fd245fff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2400b2130 con 0x7fd24015c720 2023-06-22T10:54:31.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.539+0000 7fd245fff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd240160d60 con 0x7fd2400d2830 2023-06-22T10:54:31.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.539+0000 7fd245fff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2400b50e0 con 0x7fd2400b4c60 2023-06-22T10:54:31.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.539+0000 7fd23f7fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd24015c720 0x7fd2400b1870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51986/0 (socket says 172.21.15.40:51986) 2023-06-22T10:54:31.543 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.539+0000 7fd23f7fe700 1 -- 172.21.15.40:0/19949738 learned_addr learned my addr 172.21.15.40:0/19949738 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:31.545 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.539+0000 7fd23ffff700 1 --2- 172.21.15.40:0/19949738 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd2400b4c60 0x7fd2400d0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:31.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.540+0000 7fd23effd700 1 --2- 172.21.15.40:0/19949738 >> v2:172.21.15.45:3300/0 conn(0x7fd2400d2830 0x7fd2400b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:31.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.540+0000 7fd23e7fc700 1 -- 172.21.15.40:0/19949738 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3682034524 0 0) 0x7fd2400b2130 con 0x7fd24015c720 2023-06-22T10:54:31.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.540+0000 7fd23e7fc700 1 -- 172.21.15.40:0/19949738 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2280035b0 con 0x7fd24015c720 2023-06-22T10:54:31.546 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.540+0000 7fd23e7fc700 1 -- 172.21.15.40:0/19949738 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2132604907 0 0) 0x7fd2280035b0 con 0x7fd24015c720 2023-06-22T10:54:31.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.540+0000 7fd23e7fc700 1 -- 172.21.15.40:0/19949738 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd2400b4c60 msgr2=0x7fd2400d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:31.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.540+0000 7fd23e7fc700 1 --2- 172.21.15.40:0/19949738 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd2400b4c60 0x7fd2400d0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:31.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.540+0000 7fd23e7fc700 1 -- 172.21.15.40:0/19949738 >> v2:172.21.15.45:3300/0 conn(0x7fd2400d2830 msgr2=0x7fd2400b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:31.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.540+0000 7fd23e7fc700 1 --2- 172.21.15.40:0/19949738 >> v2:172.21.15.45:3300/0 conn(0x7fd2400d2830 0x7fd2400b4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:31.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.540+0000 7fd23e7fc700 1 -- 172.21.15.40:0/19949738 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd240161180 con 0x7fd24015c720 2023-06-22T10:54:31.547 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.540+0000 7fd23e7fc700 1 -- 172.21.15.40:0/19949738 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1490606486 0 0) 0x7fd230001670 con 0x7fd24015c720 2023-06-22T10:54:31.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.540+0000 7fd23effd700 1 --2- 172.21.15.40:0/19949738 >> v2:172.21.15.45:3300/0 conn(0x7fd2400d2830 0x7fd2400b4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-22T10:54:31.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.540+0000 7fd23e7fc700 1 -- 172.21.15.40:0/19949738 >> v1:172.21.15.40:6789/0 conn(0x7fd24015c720 legacy=0x7fd2400b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:31.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.540+0000 7fd23e7fc700 1 --2- 172.21.15.40:0/19949738 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd2400b4c60 0x7fd228003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:31.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.540+0000 7fd23e7fc700 1 --2- 172.21.15.40:0/19949738 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd228003f80 0x7fd228004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:31.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.540+0000 7fd23e7fc700 1 --2- 172.21.15.40:0/19949738 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd228004d90 0x7fd228005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:31.548 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.540+0000 7fd23e7fc700 1 -- 172.21.15.40:0/19949738 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd240160d60 con 0x7fd228003f80 2023-06-22T10:54:31.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.540+0000 7fd23e7fc700 1 -- 172.21.15.40:0/19949738 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2400b50e0 con 0x7fd228004d90 2023-06-22T10:54:31.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.540+0000 7fd23e7fc700 1 -- 172.21.15.40:0/19949738 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd22800baf0 con 0x7fd2400b4c60 2023-06-22T10:54:31.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.540+0000 7fd23effd700 1 --2- 172.21.15.40:0/19949738 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd228003f80 0x7fd228004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:31.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.541+0000 7fd23f7fe700 1 --2- 172.21.15.40:0/19949738 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd2400b4c60 0x7fd228003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:31.549 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.541+0000 7fd23ffff700 1 --2- 172.21.15.40:0/19949738 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd228004d90 0x7fd228005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:31.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.541+0000 7fd23effd700 1 -- 172.21.15.40:0/19949738 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd2400b4c60 msgr2=0x7fd228003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:31.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.541+0000 7fd23effd700 1 --2- 172.21.15.40:0/19949738 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd2400b4c60 0x7fd228003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:31.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.541+0000 7fd23effd700 1 -- 172.21.15.40:0/19949738 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd228004d90 msgr2=0x7fd228005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:31.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.541+0000 7fd23effd700 1 --2- 172.21.15.40:0/19949738 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd228004d90 0x7fd228005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:31.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.541+0000 7fd23effd700 1 -- 172.21.15.40:0/19949738 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2280035b0 con 0x7fd228003f80 2023-06-22T10:54:31.550 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.541+0000 7fd23ffff700 1 --2- 172.21.15.40:0/19949738 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd228004d90 0x7fd228005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:54:31.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.541+0000 7fd23effd700 1 --2- 172.21.15.40:0/19949738 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd228003f80 0x7fd228004850 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd2400d2c70 tx=0x7fd228005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94cf7e8731bc4ddb server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:31.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.541+0000 7fd23e7fc700 1 -- 172.21.15.40:0/19949738 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23400e720 con 0x7fd228003f80 2023-06-22T10:54:31.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.541+0000 7fd23e7fc700 1 -- 172.21.15.40:0/19949738 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd23400e880 con 0x7fd228003f80 2023-06-22T10:54:31.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.541+0000 7fd23e7fc700 1 -- 172.21.15.40:0/19949738 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23400ec30 con 0x7fd228003f80 2023-06-22T10:54:31.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.542+0000 7fd245fff700 1 -- 172.21.15.40:0/19949738 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd228003f80 msgr2=0x7fd228004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:31.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.542+0000 7fd245fff700 1 --2- 172.21.15.40:0/19949738 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd228003f80 0x7fd228004850 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd2400d2c70 tx=0x7fd228005880 comp rx=0 tx=0).stop 2023-06-22T10:54:31.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.542+0000 7fd23ffff700 1 -- 172.21.15.40:0/19949738 reap_dead start 2023-06-22T10:54:31.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.542+0000 7fd245fff700 1 -- 172.21.15.40:0/19949738 shutdown_connections 2023-06-22T10:54:31.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.542+0000 7fd245fff700 1 -- 172.21.15.40:0/19949738 >> 172.21.15.40:0/19949738 conn(0x7fd2400cf720 msgr2=0x7fd2400cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:31.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.542+0000 7fd245fff700 1 -- 172.21.15.40:0/19949738 shutdown_connections 2023-06-22T10:54:31.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.542+0000 7fd245fff700 1 -- 172.21.15.40:0/19949738 wait complete. 2023-06-22T10:54:31.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.544+0000 7fd245fff700 1 Processor -- start 2023-06-22T10:54:31.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.544+0000 7fd245fff700 1 -- start start 2023-06-22T10:54:31.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.545+0000 7fd245fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd228003f80 0x7fd24014e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:31.554 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.545+0000 7fd245fff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd2400cb8b0 0x7fd2400cbd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:31.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.545+0000 7fd245fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd24015cb60 0x7fd24015cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:31.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.545+0000 7fd245fff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2400cc260 con 0x7fd24015cb60 2023-06-22T10:54:31.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.545+0000 7fd245fff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24015e430 con 0x7fd228003f80 2023-06-22T10:54:31.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.545+0000 7fd245fff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd24015d8b0 con 0x7fd2400cb8b0 2023-06-22T10:54:31.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.545+0000 7fd23ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd24015cb60 0x7fd24015cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:31.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.545+0000 7fd23ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd24015cb60 0x7fd24015cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39340/0 (socket says 172.21.15.40:39340) 2023-06-22T10:54:31.555 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.545+0000 7fd23ffff700 1 -- 172.21.15.40:0/735760657 learned_addr learned my addr 172.21.15.40:0/735760657 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:31.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.546+0000 7fd23f7fe700 1 --2- 172.21.15.40:0/735760657 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd228003f80 0x7fd24014e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:31.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.546+0000 7fd23effd700 1 --2- 172.21.15.40:0/735760657 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd2400cb8b0 0x7fd2400cbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:31.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.546+0000 7fd23ffff700 1 -- 172.21.15.40:0/735760657 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd2400cb8b0 msgr2=0x7fd2400cbd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:31.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.546+0000 7fd23ffff700 1 --2- 172.21.15.40:0/735760657 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd2400cb8b0 0x7fd2400cbd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:31.556 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.546+0000 7fd23ffff700 1 -- 172.21.15.40:0/735760657 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd228003f80 msgr2=0x7fd24014e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:31.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.546+0000 7fd23ffff700 1 --2- 172.21.15.40:0/735760657 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd228003f80 0x7fd24014e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:31.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.546+0000 7fd23ffff700 1 -- 172.21.15.40:0/735760657 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd24015db90 con 0x7fd24015cb60 2023-06-22T10:54:31.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.546+0000 7fd23ffff700 1 --2- 172.21.15.40:0/735760657 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd24015cb60 0x7fd24015cfd0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd2400b5570 tx=0x7fd2380104a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:31.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.546+0000 7fd227fff700 1 -- 172.21.15.40:0/735760657 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23801b070 con 0x7fd24015cb60 2023-06-22T10:54:31.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.546+0000 7fd227fff700 1 -- 172.21.15.40:0/735760657 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd23800f040 con 0x7fd24015cb60 2023-06-22T10:54:31.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.546+0000 7fd227fff700 1 -- 172.21.15.40:0/735760657 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23800e050 con 0x7fd24015cb60 2023-06-22T10:54:31.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.546+0000 7fd245fff700 1 -- 172.21.15.40:0/735760657 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd24015de70 con 0x7fd24015cb60 2023-06-22T10:54:31.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.547+0000 7fd245fff700 1 -- 172.21.15.40:0/735760657 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd24015d510 con 0x7fd24015cb60 2023-06-22T10:54:31.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.548+0000 7fd245fff700 1 -- 172.21.15.40:0/735760657 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd240067580 con 0x7fd24015cb60 2023-06-22T10:54:31.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.549+0000 7fd227fff700 1 -- 172.21.15.40:0/735760657 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd238010d00 con 0x7fd24015cb60 2023-06-22T10:54:31.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.550+0000 7fd227fff700 1 --2- 172.21.15.40:0/735760657 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fd22c06ace0 0x7fd22c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:31.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.550+0000 7fd227fff700 1 -- 172.21.15.40:0/735760657 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd2380896d0 con 0x7fd24015cb60 2023-06-22T10:54:31.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.550+0000 7fd23f7fe700 1 --2- 172.21.15.40:0/735760657 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fd22c06ace0 0x7fd22c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:31.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.551+0000 7fd23f7fe700 1 --2- 172.21.15.40:0/735760657 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fd22c06ace0 0x7fd22c06d190 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd230000c00 tx=0x7fd230000f80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:31.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.555+0000 7fd227fff700 1 -- 172.21.15.40:0/735760657 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd2380543b0 con 0x7fd24015cb60 2023-06-22T10:54:31.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.763+0000 7fd245fff700 1 -- 172.21.15.40:0/735760657 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd2400ce020 con 0x7fd24015cb60 2023-06-22T10:54:31.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.764+0000 7fd227fff700 1 -- 172.21.15.40:0/735760657 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20132 (secure 0 0 0) 0x7fd238007ea0 con 0x7fd24015cb60 2023-06-22T10:54:31.768 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:54:31.768 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":30,"fsid":"475560bc-1a7c-4a75-b3b6-6fc6b20bdc52","created":"2023-06-22T10:53:03.784568+0000","modified":"2023-06-22T10:54:12.717204+0000","last_up_change":"2023-06-22T10:53:17.830348+0000","last_in_change":"2023-06-22T10:53:07.329974+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-22T10:53:17.182228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-22T10:53:23.874432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-22T10:53:29.812963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-22T10:53:30.404021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-22T10:53:33.982289+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"918db6b4-053a-46ba-976d-6e1a0104017f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6809","nonce":2400162888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6811","nonce":2400162888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6815","nonce":2400162888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6813","nonce":2400162888}]},"public_addr":"172.21.15.40:6809/2400162888","cluster_addr":"172.21.15.40:6811/2400162888","heartbeat_back_addr":"172.21.15.40:6815/2400162888","heartbeat_front_addr":"172.21.15.40:6813/2400162888","state":["exists","up"]},{"osd":1,"uuid":"0c146e2b-1725-4dae-9b5c-38795943b9d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6801","nonce":230885800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6803","nonce":230885800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6807","nonce":230885800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6805","nonce":230885800}]},"public_addr":"172.21.15.40:6801/230885800","cluster_addr":"172.21.15.40:6803/230885800","heartbeat_back_addr":"172.21.15.40:6807/230885800","heartbeat_front_addr":"172.21.15.40:6805/230885800","state":["exists","up"]},{"osd":2,"uuid":"0b3727fd-f281-46d5-a675-86c8c5ab269e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6817","nonce":2681404929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6819","nonce":2681404929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6823","nonce":2681404929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6821","nonce":2681404929}]},"public_addr":"172.21.15.40:6817/2681404929","cluster_addr":"172.21.15.40:6819/2681404929","heartbeat_back_addr":"172.21.15.40:6823/2681404929","heartbeat_front_addr":"172.21.15.40:6821/2681404929","state":["exists","up"]},{"osd":3,"uuid":"2969c698-7039-4bbb-beda-f756f7a368a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6825","nonce":111110981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6827","nonce":111110981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6831","nonce":111110981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6829","nonce":111110981}]},"public_addr":"172.21.15.40:6825/111110981","cluster_addr":"172.21.15.40:6827/111110981","heartbeat_back_addr":"172.21.15.40:6831/111110981","heartbeat_front_addr":"172.21.15.40:6829/111110981","state":["exists","up"]},{"osd":4,"uuid":"3bb1d9c8-8e42-4a6b-998d-04834f34be5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6801","nonce":3625455711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6803","nonce":3625455711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6807","nonce":3625455711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6805","nonce":3625455711}]},"public_addr":"172.21.15.45:6801/3625455711","cluster_addr":"172.21.15.45:6803/3625455711","heartbeat_back_addr":"172.21.15.45:6807/3625455711","heartbeat_front_addr":"172.21.15.45:6805/3625455711","state":["exists","up"]},{"osd":5,"uuid":"f9854ee4-302c-41be-977b-bedda090a3d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6817","nonce":3354411217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6819","nonce":3354411217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6823","nonce":3354411217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6821","nonce":3354411217}]},"public_addr":"172.21.15.45:6817/3354411217","cluster_addr":"172.21.15.45:6819/3354411217","heartbeat_back_addr":"172.21.15.45:6823/3354411217","heartbeat_front_addr":"172.21.15.45:6821/3354411217","state":["exists","up"]},{"osd":6,"uuid":"bbdb1989-f6ac-4954-9b85-b8b540d683c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6809","nonce":320111074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6811","nonce":320111074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6815","nonce":320111074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6813","nonce":320111074}]},"public_addr":"172.21.15.45:6809/320111074","cluster_addr":"172.21.15.45:6811/320111074","heartbeat_back_addr":"172.21.15.45:6815/320111074","heartbeat_front_addr":"172.21.15.45:6813/320111074","state":["exists","up"]},{"osd":7,"uuid":"823d44e3-58f1-4d1d-8263-a4e4a69d4327","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6825","nonce":643617680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6827","nonce":643617680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6831","nonce":643617680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6829","nonce":643617680}]},"public_addr":"172.21.15.45:6825/643617680","cluster_addr":"172.21.15.45:6827/643617680","heartbeat_back_addr":"172.21.15.45:6831/643617680","heartbeat_front_addr":"172.21.15.45:6829/643617680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.731262+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.873226+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.898936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.666578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.645990+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.953699+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.642823+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.693395+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1b","mappings":[{"from":3,"to":2}]},{"pgid":"4.2a","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-22T10:54:31.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.766+0000 7fd245fff700 1 -- 172.21.15.40:0/735760657 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fd22c06ace0 msgr2=0x7fd22c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:31.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.766+0000 7fd245fff700 1 --2- 172.21.15.40:0/735760657 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fd22c06ace0 0x7fd22c06d190 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd230000c00 tx=0x7fd230000f80 comp rx=0 tx=0).stop 2023-06-22T10:54:31.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.766+0000 7fd245fff700 1 -- 172.21.15.40:0/735760657 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd24015cb60 msgr2=0x7fd24015cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:31.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.766+0000 7fd245fff700 1 --2- 172.21.15.40:0/735760657 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd24015cb60 0x7fd24015cfd0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd2400b5570 tx=0x7fd2380104a0 comp rx=0 tx=0).stop 2023-06-22T10:54:31.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.766+0000 7fd245fff700 1 -- 172.21.15.40:0/735760657 shutdown_connections 2023-06-22T10:54:31.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.767+0000 7fd245fff700 1 --2- 172.21.15.40:0/735760657 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fd22c06ace0 0x7fd22c06d190 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:31.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.767+0000 7fd245fff700 1 --2- 172.21.15.40:0/735760657 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd24015cb60 0x7fd24015cfd0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:31.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.767+0000 7fd245fff700 1 --2- 172.21.15.40:0/735760657 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd228003f80 0x7fd24014e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:31.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.767+0000 7fd245fff700 1 --2- 172.21.15.40:0/735760657 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd2400cb8b0 0x7fd2400cbd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:31.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.767+0000 7fd245fff700 1 -- 172.21.15.40:0/735760657 >> 172.21.15.40:0/735760657 conn(0x7fd2400cf720 msgr2=0x7fd2400b26d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:31.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.767+0000 7fd245fff700 1 -- 172.21.15.40:0/735760657 shutdown_connections 2023-06-22T10:54:31.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.767+0000 7fd245fff700 1 -- 172.21.15.40:0/735760657 wait complete. 2023-06-22T10:54:31.788 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-22T10:53:17.182228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-22T10:53:23.874432+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-22T10:53:29.812963+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-22T10:53:30.404021+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-22T10:53:33.982289+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-22T10:54:31.789 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-22T10:54:31.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.993+0000 7fda4d7ff700 1 Processor -- start 2023-06-22T10:54:31.996 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.993+0000 7fda4d7ff700 1 -- start start 2023-06-22T10:54:31.997 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.994+0000 7fda4d7ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fda48069f30 0x7fda4806a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:31.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.994+0000 7fda4d7ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fda48158a40 0x7fda480ad8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:31.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.994+0000 7fda4d7ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda480ae260 con 0x7fda480ade00 2023-06-22T10:54:31.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.994+0000 7fda4d7ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda480cd500 con 0x7fda48069f30 2023-06-22T10:54:31.998 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.994+0000 7fda4d7ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda480af8f0 con 0x7fda48158a40 2023-06-22T10:54:32.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.995+0000 7fda467fc700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fda48158a40 0x7fda480ad8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:32.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.995+0000 7fda46ffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fda48069f30 0x7fda4806a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:32.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.995+0000 7fda467fc700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fda48158a40 0x7fda480ad8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3301/0 says I am v2:172.21.15.40:53804/0 (socket says 172.21.15.40:53804) 2023-06-22T10:54:32.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.995+0000 7fda467fc700 1 -- 172.21.15.40:0/3714790636 learned_addr learned my addr 172.21.15.40:0/3714790636 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:32.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.995+0000 7fda467fc700 1 -- 172.21.15.40:0/3714790636 >> v2:172.21.15.45:3300/0 conn(0x7fda48069f30 msgr2=0x7fda4806a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:32.000 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.995+0000 7fda467fc700 1 --2- 172.21.15.40:0/3714790636 >> v2:172.21.15.45:3300/0 conn(0x7fda48069f30 0x7fda4806a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:32.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.995+0000 7fda467fc700 1 -- 172.21.15.40:0/3714790636 >> v1:172.21.15.45:6789/0 conn(0x7fda480ade00 legacy=0x7fda480703b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:32.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.995+0000 7fda467fc700 1 -- 172.21.15.40:0/3714790636 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda480c38c0 con 0x7fda48158a40 2023-06-22T10:54:32.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.995+0000 7fda46ffd700 1 --2- 172.21.15.40:0/3714790636 >> v2:172.21.15.45:3300/0 conn(0x7fda48069f30 0x7fda4806a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-22T10:54:32.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.995+0000 7fda467fc700 1 --2- 172.21.15.40:0/3714790636 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fda48158a40 0x7fda480ad8c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fda3c0098f0 tx=0x7fda3c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19be78346891f8bc server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:32.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.996+0000 7fda45ffb700 1 -- 172.21.15.40:0/3714790636 <== mon.2 v2:172.21.15.45:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3c011830 con 0x7fda48158a40 2023-06-22T10:54:32.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.996+0000 7fda45ffb700 1 -- 172.21.15.40:0/3714790636 <== mon.2 v2:172.21.15.45:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda3c011990 con 0x7fda48158a40 2023-06-22T10:54:32.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.996+0000 7fda45ffb700 1 -- 172.21.15.40:0/3714790636 <== mon.2 v2:172.21.15.45:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3c011d20 con 0x7fda48158a40 2023-06-22T10:54:32.001 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.996+0000 7fda4d7ff700 1 -- 172.21.15.40:0/3714790636 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fda48158a40 msgr2=0x7fda480ad8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:32.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.996+0000 7fda4d7ff700 1 --2- 172.21.15.40:0/3714790636 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fda48158a40 0x7fda480ad8c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fda3c0098f0 tx=0x7fda3c009c00 comp rx=0 tx=0).stop 2023-06-22T10:54:32.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.996+0000 7fda4d7ff700 1 -- 172.21.15.40:0/3714790636 shutdown_connections 2023-06-22T10:54:32.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.996+0000 7fda4d7ff700 1 --2- 172.21.15.40:0/3714790636 >> v2:172.21.15.45:3300/0 conn(0x7fda48069f30 0x7fda4806a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:32.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.996+0000 7fda4d7ff700 1 --2- 172.21.15.40:0/3714790636 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fda48158a40 0x7fda480ad8c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:32.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.996+0000 7fda4d7ff700 1 -- 172.21.15.40:0/3714790636 >> 172.21.15.40:0/3714790636 conn(0x7fda480b1030 msgr2=0x7fda480ce7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:32.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.996+0000 7fda4d7ff700 1 -- 172.21.15.40:0/3714790636 shutdown_connections 2023-06-22T10:54:32.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.996+0000 7fda4d7ff700 1 -- 172.21.15.40:0/3714790636 wait complete. 2023-06-22T10:54:32.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.998+0000 7fda4d7ff700 1 Processor -- start 2023-06-22T10:54:32.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.998+0000 7fda4d7ff700 1 -- start start 2023-06-22T10:54:32.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.999+0000 7fda4d7ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda48069f30 0x7fda480b2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:32.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.999+0000 7fda4d7ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda480ade00 0x7fda480aeb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:32.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.999+0000 7fda4d7ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fda480b22a0 0x7fda48142e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:32.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.999+0000 7fda4d7ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda480b3490 con 0x7fda48069f30 2023-06-22T10:54:32.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.999+0000 7fda4d7ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda480b3770 con 0x7fda480ade00 2023-06-22T10:54:32.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.999+0000 7fda4d7ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda480b3a50 con 0x7fda480b22a0 2023-06-22T10:54:32.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.999+0000 7fda46ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda48069f30 0x7fda480b2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:32.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.999+0000 7fda46ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda48069f30 0x7fda480b2c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39348/0 (socket says 172.21.15.40:39348) 2023-06-22T10:54:32.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:31.999+0000 7fda46ffd700 1 -- 172.21.15.40:0/1768233501 learned_addr learned my addr 172.21.15.40:0/1768233501 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:32.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.000+0000 7fda467fc700 1 --2- 172.21.15.40:0/1768233501 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda480ade00 0x7fda480aeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:32.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.000+0000 7fda46ffd700 1 -- 172.21.15.40:0/1768233501 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fda480b22a0 msgr2=0x7fda48142e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:32.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.000+0000 7fda477fe700 1 --2- 172.21.15.40:0/1768233501 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fda480b22a0 0x7fda48142e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:32.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.000+0000 7fda46ffd700 1 --2- 172.21.15.40:0/1768233501 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fda480b22a0 0x7fda48142e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:32.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.000+0000 7fda46ffd700 1 -- 172.21.15.40:0/1768233501 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda480ade00 msgr2=0x7fda480aeb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:32.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.000+0000 7fda46ffd700 1 --2- 172.21.15.40:0/1768233501 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda480ade00 0x7fda480aeb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:32.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.000+0000 7fda46ffd700 1 -- 172.21.15.40:0/1768233501 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda380094a0 con 0x7fda48069f30 2023-06-22T10:54:32.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.000+0000 7fda467fc700 1 --2- 172.21.15.40:0/1768233501 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda480ade00 0x7fda480aeb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-22T10:54:32.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.000+0000 7fda477fe700 1 --2- 172.21.15.40:0/1768233501 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fda480b22a0 0x7fda48142e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-22T10:54:32.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.000+0000 7fda46ffd700 1 --2- 172.21.15.40:0/1768233501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda48069f30 0x7fda480b2c40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fda3800ebe0 tx=0x7fda38009e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:32.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.000+0000 7fda2f7fe700 1 -- 172.21.15.40:0/1768233501 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3800c8b0 con 0x7fda48069f30 2023-06-22T10:54:32.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.000+0000 7fda2f7fe700 1 -- 172.21.15.40:0/1768233501 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda3800ca10 con 0x7fda48069f30 2023-06-22T10:54:32.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.000+0000 7fda2f7fe700 1 -- 172.21.15.40:0/1768233501 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3800cda0 con 0x7fda48069f30 2023-06-22T10:54:32.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.000+0000 7fda4d7ff700 1 -- 172.21.15.40:0/1768233501 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda3c009550 con 0x7fda48069f30 2023-06-22T10:54:32.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.001+0000 7fda4d7ff700 1 -- 172.21.15.40:0/1768233501 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda480b4010 con 0x7fda48069f30 2023-06-22T10:54:32.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.002+0000 7fda4d7ff700 1 -- 172.21.15.40:0/1768233501 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda48067580 con 0x7fda48069f30 2023-06-22T10:54:32.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.003+0000 7fda2f7fe700 1 -- 172.21.15.40:0/1768233501 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fda38013470 con 0x7fda48069f30 2023-06-22T10:54:32.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.003+0000 7fda2f7fe700 1 --2- 172.21.15.40:0/1768233501 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fda3406ace0 0x7fda3406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:32.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.004+0000 7fda2f7fe700 1 -- 172.21.15.40:0/1768233501 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fda38089910 con 0x7fda48069f30 2023-06-22T10:54:32.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.004+0000 7fda467fc700 1 --2- 172.21.15.40:0/1768233501 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fda3406ace0 0x7fda3406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:32.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.004+0000 7fda467fc700 1 --2- 172.21.15.40:0/1768233501 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fda3406ace0 0x7fda3406d190 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fda480ad810 tx=0x7fda3c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:32.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.008+0000 7fda2f7fe700 1 -- 172.21.15.40:0/1768233501 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fda38054680 con 0x7fda48069f30 2023-06-22T10:54:32.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.212+0000 7fda4d7ff700 1 -- 172.21.15.40:0/1768233501 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fda4806d4d0 con 0x7fda48069f30 2023-06-22T10:54:32.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.213+0000 7fda2f7fe700 1 -- 172.21.15.40:0/1768233501 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7fda38057ca0 con 0x7fda48069f30 2023-06-22T10:54:32.217 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-06-22T10:54:32.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.215+0000 7fda4d7ff700 1 -- 172.21.15.40:0/1768233501 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fda3406ace0 msgr2=0x7fda3406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:32.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.215+0000 7fda4d7ff700 1 --2- 172.21.15.40:0/1768233501 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fda3406ace0 0x7fda3406d190 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fda480ad810 tx=0x7fda3c008030 comp rx=0 tx=0).stop 2023-06-22T10:54:32.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.215+0000 7fda4d7ff700 1 -- 172.21.15.40:0/1768233501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda48069f30 msgr2=0x7fda480b2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:32.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.215+0000 7fda4d7ff700 1 --2- 172.21.15.40:0/1768233501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda48069f30 0x7fda480b2c40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fda3800ebe0 tx=0x7fda38009e20 comp rx=0 tx=0).stop 2023-06-22T10:54:32.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.215+0000 7fda4d7ff700 1 -- 172.21.15.40:0/1768233501 shutdown_connections 2023-06-22T10:54:32.219 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.215+0000 7fda4d7ff700 1 --2- 172.21.15.40:0/1768233501 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fda3406ace0 0x7fda3406d190 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:32.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.215+0000 7fda4d7ff700 1 --2- 172.21.15.40:0/1768233501 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fda480b22a0 0x7fda48142e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:32.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.215+0000 7fda4d7ff700 1 --2- 172.21.15.40:0/1768233501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fda48069f30 0x7fda480b2c40 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:32.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.215+0000 7fda4d7ff700 1 --2- 172.21.15.40:0/1768233501 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda480ade00 0x7fda480aeb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:32.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.215+0000 7fda4d7ff700 1 -- 172.21.15.40:0/1768233501 >> 172.21.15.40:0/1768233501 conn(0x7fda480b1030 msgr2=0x7fda480afc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:32.220 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.215+0000 7fda4d7ff700 1 -- 172.21.15.40:0/1768233501 shutdown_connections 2023-06-22T10:54:32.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.215+0000 7fda4d7ff700 1 -- 172.21.15.40:0/1768233501 wait complete. 2023-06-22T10:54:32.237 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-22T10:54:32.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.437+0000 7f7258fff700 1 Processor -- start 2023-06-22T10:54:32.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.437+0000 7f7258fff700 1 -- start start 2023-06-22T10:54:32.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.438+0000 7f7258fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f72540b45d0 0x7f72540b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:32.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.438+0000 7f7258fff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f72540d2130 0x7f72540cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:32.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.438+0000 7f7258fff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72540d1be0 con 0x7f72540cd6e0 2023-06-22T10:54:32.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.438+0000 7f7258fff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72540d17f0 con 0x7f72540b45d0 2023-06-22T10:54:32.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.438+0000 7f7258fff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72540d1360 con 0x7f72540d2130 2023-06-22T10:54:32.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.438+0000 7f725259c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f72540b45d0 0x7f72540b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:32.446 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.438+0000 7f725259c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f72540b45d0 0x7f72540b49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39356/0 (socket says 172.21.15.40:39356) 2023-06-22T10:54:32.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.438+0000 7f725259c700 1 -- 172.21.15.40:0/671221863 learned_addr learned my addr 172.21.15.40:0/671221863 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:32.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.439+0000 7f7251d9b700 1 --2- 172.21.15.40:0/671221863 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f72540d2130 0x7f72540cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:32.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.439+0000 7f725259c700 1 -- 172.21.15.40:0/671221863 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f72540d2130 msgr2=0x7f72540cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:32.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.439+0000 7f725259c700 1 --2- 172.21.15.40:0/671221863 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f72540d2130 0x7f72540cd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:32.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.439+0000 7f725259c700 1 -- 172.21.15.40:0/671221863 >> v1:172.21.15.45:6789/0 conn(0x7f72540cd6e0 legacy=0x7f72540b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:32.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.439+0000 7f725259c700 1 -- 172.21.15.40:0/671221863 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72540b4ee0 con 0x7f72540b45d0 2023-06-22T10:54:32.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.439+0000 7f7251d9b700 1 --2- 172.21.15.40:0/671221863 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f72540d2130 0x7f72540cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-22T10:54:32.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.439+0000 7f725259c700 1 --2- 172.21.15.40:0/671221863 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72540b45d0 0x7f72540b49a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f72440098f0 tx=0x7f7244009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86ec317fdd9ce34b server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:32.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.439+0000 7f725159a700 1 -- 172.21.15.40:0/671221863 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7244004230 con 0x7f72540b45d0 2023-06-22T10:54:32.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.439+0000 7f725159a700 1 -- 172.21.15.40:0/671221863 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7244004390 con 0x7f72540b45d0 2023-06-22T10:54:32.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.439+0000 7f725159a700 1 -- 172.21.15.40:0/671221863 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72440036a0 con 0x7f72540b45d0 2023-06-22T10:54:32.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.440+0000 7f7258fff700 1 -- 172.21.15.40:0/671221863 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72540b45d0 msgr2=0x7f72540b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:32.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.440+0000 7f7258fff700 1 --2- 172.21.15.40:0/671221863 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72540b45d0 0x7f72540b49a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f72440098f0 tx=0x7f7244009c00 comp rx=0 tx=0).stop 2023-06-22T10:54:32.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.440+0000 7f7258fff700 1 -- 172.21.15.40:0/671221863 shutdown_connections 2023-06-22T10:54:32.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.440+0000 7f7258fff700 1 --2- 172.21.15.40:0/671221863 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72540b45d0 0x7f72540b49a0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:32.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.440+0000 7f7258fff700 1 --2- 172.21.15.40:0/671221863 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f72540d2130 0x7f72540cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:32.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.440+0000 7f7258fff700 1 -- 172.21.15.40:0/671221863 >> 172.21.15.40:0/671221863 conn(0x7f72540cf5d0 msgr2=0x7f72540cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:32.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.440+0000 7f7258fff700 1 -- 172.21.15.40:0/671221863 shutdown_connections 2023-06-22T10:54:32.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.440+0000 7f7258fff700 1 -- 172.21.15.40:0/671221863 wait complete. 2023-06-22T10:54:32.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.442+0000 7f7258fff700 1 Processor -- start 2023-06-22T10:54:32.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.442+0000 7f7258fff700 1 -- start start 2023-06-22T10:54:32.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.443+0000 7f7258fff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f72540b45d0 0x7f72541f2590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:32.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.443+0000 7f7258fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72540cd6e0 0x7f725415dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:32.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.443+0000 7f7258fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72540d2130 0x7f7254148660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:32.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.443+0000 7f7258fff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72540cd2c0 con 0x7f72540d2130 2023-06-22T10:54:32.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.443+0000 7f7258fff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72540cc220 con 0x7f72540cd6e0 2023-06-22T10:54:32.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.443+0000 7f7258fff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72540cc500 con 0x7f72540b45d0 2023-06-22T10:54:32.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.443+0000 7f7252d9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72540d2130 0x7f7254148660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:32.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.443+0000 7f7252d9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72540d2130 0x7f7254148660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39366/0 (socket says 172.21.15.40:39366) 2023-06-22T10:54:32.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.443+0000 7f7252d9d700 1 -- 172.21.15.40:0/2539223763 learned_addr learned my addr 172.21.15.40:0/2539223763 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:32.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.444+0000 7f7251d9b700 1 --2- 172.21.15.40:0/2539223763 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72540cd6e0 0x7f725415dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:32.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.444+0000 7f725259c700 1 --2- 172.21.15.40:0/2539223763 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f72540b45d0 0x7f72541f2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:32.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.444+0000 7f7252d9d700 1 -- 172.21.15.40:0/2539223763 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f72540b45d0 msgr2=0x7f72541f2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:32.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.444+0000 7f7252d9d700 1 --2- 172.21.15.40:0/2539223763 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f72540b45d0 0x7f72541f2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:32.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.444+0000 7f7252d9d700 1 -- 172.21.15.40:0/2539223763 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72540cd6e0 msgr2=0x7f725415dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:32.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.444+0000 7f7252d9d700 1 --2- 172.21.15.40:0/2539223763 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72540cd6e0 0x7f725415dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:32.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.444+0000 7f7252d9d700 1 -- 172.21.15.40:0/2539223763 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7244009550 con 0x7f72540d2130 2023-06-22T10:54:32.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.444+0000 7f7252d9d700 1 --2- 172.21.15.40:0/2539223763 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72540d2130 0x7f7254148660 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f724c00cc10 tx=0x7f724c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:32.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.444+0000 7f7242ffd700 1 -- 172.21.15.40:0/2539223763 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724c00abb0 con 0x7f72540d2130 2023-06-22T10:54:32.454 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.444+0000 7f7242ffd700 1 -- 172.21.15.40:0/2539223763 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f724c00ad10 con 0x7f72540d2130 2023-06-22T10:54:32.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.444+0000 7f7258fff700 1 -- 172.21.15.40:0/2539223763 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72540cc7e0 con 0x7f72540d2130 2023-06-22T10:54:32.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.444+0000 7f7242ffd700 1 -- 172.21.15.40:0/2539223763 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724c012660 con 0x7f72540d2130 2023-06-22T10:54:32.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.445+0000 7f7258fff700 1 -- 172.21.15.40:0/2539223763 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72540ccda0 con 0x7f72540d2130 2023-06-22T10:54:32.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.445+0000 7f7258fff700 1 -- 172.21.15.40:0/2539223763 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7254067580 con 0x7f72540d2130 2023-06-22T10:54:32.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.446+0000 7f7242ffd700 1 -- 172.21.15.40:0/2539223763 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f724c0127c0 con 0x7f72540d2130 2023-06-22T10:54:32.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.448+0000 7f7242ffd700 1 --2- 172.21.15.40:0/2539223763 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f723406ace0 0x7f723406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:32.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.448+0000 7f7242ffd700 1 -- 172.21.15.40:0/2539223763 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f724c089f70 con 0x7f72540d2130 2023-06-22T10:54:32.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.448+0000 7f725259c700 1 --2- 172.21.15.40:0/2539223763 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f723406ace0 0x7f723406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:32.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.449+0000 7f725259c700 1 --2- 172.21.15.40:0/2539223763 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f723406ace0 0x7f723406d190 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7244009130 tx=0x7f7244008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:32.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.452+0000 7f7242ffd700 1 -- 172.21.15.40:0/2539223763 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f724c054ce0 con 0x7f72540d2130 2023-06-22T10:54:32.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.657+0000 7f7258fff700 1 -- 172.21.15.40:0/2539223763 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f72540cd4c0 con 0x7f72540d2130 2023-06-22T10:54:32.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.657+0000 7f7242ffd700 1 -- 172.21.15.40:0/2539223763 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7f724c016020 con 0x7f72540d2130 2023-06-22T10:54:32.661 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 8 2023-06-22T10:54:32.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.659+0000 7f7258fff700 1 -- 172.21.15.40:0/2539223763 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f723406ace0 msgr2=0x7f723406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:32.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.659+0000 7f7258fff700 1 --2- 172.21.15.40:0/2539223763 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f723406ace0 0x7f723406d190 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7244009130 tx=0x7f7244008030 comp rx=0 tx=0).stop 2023-06-22T10:54:32.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.659+0000 7f7258fff700 1 -- 172.21.15.40:0/2539223763 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72540d2130 msgr2=0x7f7254148660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:32.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.659+0000 7f7258fff700 1 --2- 172.21.15.40:0/2539223763 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72540d2130 0x7f7254148660 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f724c00cc10 tx=0x7f724c00a060 comp rx=0 tx=0).stop 2023-06-22T10:54:32.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.660+0000 7f7258fff700 1 -- 172.21.15.40:0/2539223763 shutdown_connections 2023-06-22T10:54:32.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.660+0000 7f7258fff700 1 --2- 172.21.15.40:0/2539223763 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f723406ace0 0x7f723406d190 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:32.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.660+0000 7f7258fff700 1 --2- 172.21.15.40:0/2539223763 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f72540b45d0 0x7f72541f2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:32.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.660+0000 7f7258fff700 1 --2- 172.21.15.40:0/2539223763 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72540d2130 0x7f7254148660 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:32.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.660+0000 7f7258fff700 1 --2- 172.21.15.40:0/2539223763 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72540cd6e0 0x7f725415dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:32.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.660+0000 7f7258fff700 1 -- 172.21.15.40:0/2539223763 >> 172.21.15.40:0/2539223763 conn(0x7f72540cf5d0 msgr2=0x7f72540b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:32.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.660+0000 7f7258fff700 1 -- 172.21.15.40:0/2539223763 shutdown_connections 2023-06-22T10:54:32.665 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.660+0000 7f7258fff700 1 -- 172.21.15.40:0/2539223763 wait complete. 2023-06-22T10:54:32.681 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-22T10:54:32.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.886+0000 7ff3917ff700 1 Processor -- start 2023-06-22T10:54:32.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.887+0000 7ff3917ff700 1 -- start start 2023-06-22T10:54:32.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.888+0000 7ff3917ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff38c0d2130 0x7ff38c0cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:32.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.888+0000 7ff3917ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff38c0d1be0 con 0x7ff38c0cd6e0 2023-06-22T10:54:32.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.888+0000 7ff3917ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff38c0d1360 con 0x7ff38c0b45d0 2023-06-22T10:54:32.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.888+0000 7ff3917ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff38c0d17f0 con 0x7ff38c0d2130 2023-06-22T10:54:32.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.888+0000 7ff38b7fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff38c0cd6e0 0x7ff38c0b59a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51996/0 (socket says 172.21.15.40:51996) 2023-06-22T10:54:32.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.888+0000 7ff38b7fe700 1 -- 172.21.15.40:0/2489660421 learned_addr learned my addr 172.21.15.40:0/2489660421 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:32.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.888+0000 7ff383fff700 1 --2- 172.21.15.40:0/2489660421 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff38c0d2130 0x7ff38c0cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:32.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.889+0000 7ff38a7fc700 1 -- 172.21.15.40:0/2489660421 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2435556653 0 0) 0x7ff38c0d1be0 con 0x7ff38c0cd6e0 2023-06-22T10:54:32.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.889+0000 7ff38a7fc700 1 -- 172.21.15.40:0/2489660421 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3780035b0 con 0x7ff38c0cd6e0 2023-06-22T10:54:32.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.889+0000 7ff38a7fc700 1 -- 172.21.15.40:0/2489660421 <== mon.1 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1134806175 0 0) 0x7ff38c0d1360 con 0x7ff38c0b45d0 2023-06-22T10:54:32.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.889+0000 7ff38a7fc700 1 -- 172.21.15.40:0/2489660421 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff38c0d1be0 con 0x7ff38c0b45d0 2023-06-22T10:54:32.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.889+0000 7ff383fff700 1 -- 172.21.15.40:0/2489660421 >> v1:172.21.15.45:6789/0 conn(0x7ff38c0b45d0 legacy=0x7ff38c0b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:32.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.889+0000 7ff383fff700 1 -- 172.21.15.40:0/2489660421 >> v1:172.21.15.40:6789/0 conn(0x7ff38c0cd6e0 legacy=0x7ff38c0b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:32.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.889+0000 7ff383fff700 1 -- 172.21.15.40:0/2489660421 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff38c0cef40 con 0x7ff38c0d2130 2023-06-22T10:54:32.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.889+0000 7ff383fff700 1 --2- 172.21.15.40:0/2489660421 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff38c0d2130 0x7ff38c0cd1a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff374009870 tx=0x7ff374009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5ed818f9ff6a9c8 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:32.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.889+0000 7ff38a7fc700 1 -- 172.21.15.40:0/2489660421 <== mon.2 v2:172.21.15.45:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff374011830 con 0x7ff38c0d2130 2023-06-22T10:54:32.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.889+0000 7ff38a7fc700 1 -- 172.21.15.40:0/2489660421 <== mon.2 v2:172.21.15.45:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff374011990 con 0x7ff38c0d2130 2023-06-22T10:54:32.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.889+0000 7ff38a7fc700 1 -- 172.21.15.40:0/2489660421 <== mon.2 v2:172.21.15.45:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff374011d20 con 0x7ff38c0d2130 2023-06-22T10:54:32.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.890+0000 7ff3917ff700 1 -- 172.21.15.40:0/2489660421 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff38c0d2130 msgr2=0x7ff38c0cd1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:32.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.890+0000 7ff3917ff700 1 --2- 172.21.15.40:0/2489660421 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff38c0d2130 0x7ff38c0cd1a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff374009870 tx=0x7ff374009b80 comp rx=0 tx=0).stop 2023-06-22T10:54:32.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.890+0000 7ff3917ff700 1 -- 172.21.15.40:0/2489660421 shutdown_connections 2023-06-22T10:54:32.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.890+0000 7ff3917ff700 1 --2- 172.21.15.40:0/2489660421 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff38c0d2130 0x7ff38c0cd1a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:32.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.890+0000 7ff3917ff700 1 -- 172.21.15.40:0/2489660421 >> 172.21.15.40:0/2489660421 conn(0x7ff38c0cf5d0 msgr2=0x7ff38c0cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:32.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.890+0000 7ff3917ff700 1 -- 172.21.15.40:0/2489660421 shutdown_connections 2023-06-22T10:54:32.898 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.890+0000 7ff3917ff700 1 -- 172.21.15.40:0/2489660421 wait complete. 2023-06-22T10:54:32.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.892+0000 7ff3917ff700 1 Processor -- start 2023-06-22T10:54:32.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.892+0000 7ff3917ff700 1 -- start start 2023-06-22T10:54:32.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.893+0000 7ff3917ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff38c0b45d0 0x7ff38c147300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:32.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.893+0000 7ff3917ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff38c0cd6e0 0x7ff38c147840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:32.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.893+0000 7ff3917ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff38c0d2130 0x7ff38c1f4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:32.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.893+0000 7ff3917ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff38c145410 con 0x7ff38c0cd6e0 2023-06-22T10:54:32.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.893+0000 7ff3917ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff38c1456f0 con 0x7ff38c0b45d0 2023-06-22T10:54:32.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.893+0000 7ff3917ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff38c1459d0 con 0x7ff38c0d2130 2023-06-22T10:54:32.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.893+0000 7ff383fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff38c0cd6e0 0x7ff38c147840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:32.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.893+0000 7ff383fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff38c0cd6e0 0x7ff38c147840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39374/0 (socket says 172.21.15.40:39374) 2023-06-22T10:54:32.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.893+0000 7ff383fff700 1 -- 172.21.15.40:0/2216836936 learned_addr learned my addr 172.21.15.40:0/2216836936 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:32.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.894+0000 7ff38affd700 1 --2- 172.21.15.40:0/2216836936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff38c0b45d0 0x7ff38c147300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:32.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.894+0000 7ff38b7fe700 1 --2- 172.21.15.40:0/2216836936 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff38c0d2130 0x7ff38c1f4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:32.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.894+0000 7ff383fff700 1 -- 172.21.15.40:0/2216836936 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff38c0d2130 msgr2=0x7ff38c1f4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:32.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.894+0000 7ff383fff700 1 --2- 172.21.15.40:0/2216836936 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff38c0d2130 0x7ff38c1f4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:32.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.894+0000 7ff383fff700 1 -- 172.21.15.40:0/2216836936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff38c0b45d0 msgr2=0x7ff38c147300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:32.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.894+0000 7ff383fff700 1 --2- 172.21.15.40:0/2216836936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff38c0b45d0 0x7ff38c147300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:32.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.894+0000 7ff383fff700 1 -- 172.21.15.40:0/2216836936 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3740094a0 con 0x7ff38c0cd6e0 2023-06-22T10:54:32.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.894+0000 7ff38affd700 1 --2- 172.21.15.40:0/2216836936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff38c0b45d0 0x7ff38c147300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:54:32.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.894+0000 7ff383fff700 1 --2- 172.21.15.40:0/2216836936 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff38c0cd6e0 0x7ff38c147840 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff3740090b0 tx=0x7ff374004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:32.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.894+0000 7ff3837fe700 1 -- 172.21.15.40:0/2216836936 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff37401a860 con 0x7ff38c0cd6e0 2023-06-22T10:54:32.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.894+0000 7ff3837fe700 1 -- 172.21.15.40:0/2216836936 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff37401a9c0 con 0x7ff38c0cd6e0 2023-06-22T10:54:32.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.894+0000 7ff3837fe700 1 -- 172.21.15.40:0/2216836936 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff37401ad30 con 0x7ff38c0cd6e0 2023-06-22T10:54:32.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.894+0000 7ff3917ff700 1 -- 172.21.15.40:0/2216836936 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff38c145cb0 con 0x7ff38c0cd6e0 2023-06-22T10:54:32.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.895+0000 7ff3917ff700 1 -- 172.21.15.40:0/2216836936 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff38c148940 con 0x7ff38c0cd6e0 2023-06-22T10:54:32.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.896+0000 7ff3917ff700 1 -- 172.21.15.40:0/2216836936 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff38c145550 con 0x7ff38c0cd6e0 2023-06-22T10:54:32.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.896+0000 7ff3837fe700 1 -- 172.21.15.40:0/2216836936 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff374022070 con 0x7ff38c0cd6e0 2023-06-22T10:54:32.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.897+0000 7ff3837fe700 1 --2- 172.21.15.40:0/2216836936 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7ff36c06ace0 0x7ff36c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:32.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.897+0000 7ff3837fe700 1 -- 172.21.15.40:0/2216836936 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff37408a410 con 0x7ff38c0cd6e0 2023-06-22T10:54:32.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.898+0000 7ff38affd700 1 --2- 172.21.15.40:0/2216836936 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7ff36c06ace0 0x7ff36c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:32.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.898+0000 7ff38affd700 1 --2- 172.21.15.40:0/2216836936 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7ff36c06ace0 0x7ff36c06d190 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff37c0011e0 tx=0x7ff37c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:32.906 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:32.902+0000 7ff3837fe700 1 -- 172.21.15.40:0/2216836936 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff38c145550 con 0x7ff38c0cd6e0 2023-06-22T10:54:33.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.106+0000 7ff3917ff700 1 -- 172.21.15.40:0/2216836936 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff38c145550 con 0x7ff38c0cd6e0 2023-06-22T10:54:33.110 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.106+0000 7ff3837fe700 1 -- 172.21.15.40:0/2216836936 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff38c145550 con 0x7ff38c0cd6e0 2023-06-22T10:54:33.111 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-06-22T10:54:33.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.109+0000 7ff3917ff700 1 -- 172.21.15.40:0/2216836936 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7ff36c06ace0 msgr2=0x7ff36c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:33.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.109+0000 7ff3917ff700 1 --2- 172.21.15.40:0/2216836936 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7ff36c06ace0 0x7ff36c06d190 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff37c0011e0 tx=0x7ff37c009040 comp rx=0 tx=0).stop 2023-06-22T10:54:33.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.109+0000 7ff3917ff700 1 -- 172.21.15.40:0/2216836936 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff38c0cd6e0 msgr2=0x7ff38c147840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:33.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.109+0000 7ff3917ff700 1 --2- 172.21.15.40:0/2216836936 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff38c0cd6e0 0x7ff38c147840 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff3740090b0 tx=0x7ff374004750 comp rx=0 tx=0).stop 2023-06-22T10:54:33.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.109+0000 7ff3917ff700 1 -- 172.21.15.40:0/2216836936 shutdown_connections 2023-06-22T10:54:33.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.109+0000 7ff3917ff700 1 --2- 172.21.15.40:0/2216836936 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7ff36c06ace0 0x7ff36c06d190 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:33.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.109+0000 7ff3917ff700 1 --2- 172.21.15.40:0/2216836936 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff38c0d2130 0x7ff38c1f4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:33.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.109+0000 7ff3917ff700 1 --2- 172.21.15.40:0/2216836936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff38c0b45d0 0x7ff38c147300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:33.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.109+0000 7ff3917ff700 1 --2- 172.21.15.40:0/2216836936 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff38c0cd6e0 0x7ff38c147840 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:33.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.109+0000 7ff3917ff700 1 -- 172.21.15.40:0/2216836936 >> 172.21.15.40:0/2216836936 conn(0x7ff38c0cf5d0 msgr2=0x7ff38c159900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:33.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.109+0000 7ff3917ff700 1 -- 172.21.15.40:0/2216836936 shutdown_connections 2023-06-22T10:54:33.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.109+0000 7ff3917ff700 1 -- 172.21.15.40:0/2216836936 wait complete. 2023-06-22T10:54:33.130 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-22T10:54:33.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.332+0000 7ff35ffff700 1 Processor -- start 2023-06-22T10:54:33.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.332+0000 7ff35ffff700 1 -- start start 2023-06-22T10:54:33.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.333+0000 7ff35ffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff3580b45d0 0x7ff3580b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:33.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.334+0000 7ff35ffff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff3580b59a0 0x7ff3580b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:33.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.334+0000 7ff35ffff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3580d1be0 con 0x7ff3580d2130 2023-06-22T10:54:33.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.334+0000 7ff35ffff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3580d17f0 con 0x7ff3580b45d0 2023-06-22T10:54:33.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.334+0000 7ff35ffff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3580d1360 con 0x7ff3580b59a0 2023-06-22T10:54:33.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.334+0000 7ff35d59a700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff3580d2130 0x7ff3580cd1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52010/0 (socket says 172.21.15.40:52010) 2023-06-22T10:54:33.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.334+0000 7ff35dd9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff3580b45d0 0x7ff3580b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:33.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.334+0000 7ff35d59a700 1 -- 172.21.15.40:0/932615814 learned_addr learned my addr 172.21.15.40:0/932615814 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:33.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.334+0000 7ff35e59c700 1 --2- 172.21.15.40:0/932615814 >> v2:172.21.15.45:3300/0 conn(0x7ff3580b59a0 0x7ff3580b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:33.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.334+0000 7ff35dd9b700 1 -- 172.21.15.40:0/932615814 >> v2:172.21.15.45:3300/0 conn(0x7ff3580b59a0 msgr2=0x7ff3580b5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:33.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.334+0000 7ff35dd9b700 1 --2- 172.21.15.40:0/932615814 >> v2:172.21.15.45:3300/0 conn(0x7ff3580b59a0 0x7ff3580b5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:33.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.334+0000 7ff35dd9b700 1 -- 172.21.15.40:0/932615814 >> v1:172.21.15.40:6789/0 conn(0x7ff3580d2130 legacy=0x7ff3580cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:33.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.334+0000 7ff35dd9b700 1 -- 172.21.15.40:0/932615814 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3580b4ee0 con 0x7ff3580b45d0 2023-06-22T10:54:33.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.334+0000 7ff35cd99700 1 -- 172.21.15.40:0/932615814 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3592037062 0 0) 0x7ff3580d1be0 con 0x7ff3580d2130 2023-06-22T10:54:33.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.335+0000 7ff35dd9b700 1 --2- 172.21.15.40:0/932615814 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3580b45d0 0x7ff3580b49a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff3580b1aa0 tx=0x7ff354009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a0811e1a77e3adf server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:33.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.335+0000 7ff35cd99700 1 -- 172.21.15.40:0/932615814 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff354011830 con 0x7ff3580b45d0 2023-06-22T10:54:33.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.335+0000 7ff35cd99700 1 -- 172.21.15.40:0/932615814 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff354011990 con 0x7ff3580b45d0 2023-06-22T10:54:33.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.335+0000 7ff35cd99700 1 -- 172.21.15.40:0/932615814 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff354011d20 con 0x7ff3580b45d0 2023-06-22T10:54:33.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.335+0000 7ff35ffff700 1 -- 172.21.15.40:0/932615814 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3580b45d0 msgr2=0x7ff3580b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:33.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.335+0000 7ff35ffff700 1 --2- 172.21.15.40:0/932615814 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3580b45d0 0x7ff3580b49a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff3580b1aa0 tx=0x7ff354009b20 comp rx=0 tx=0).stop 2023-06-22T10:54:33.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.336+0000 7ff35ffff700 1 -- 172.21.15.40:0/932615814 shutdown_connections 2023-06-22T10:54:33.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.336+0000 7ff35ffff700 1 --2- 172.21.15.40:0/932615814 >> v2:172.21.15.45:3300/0 conn(0x7ff3580b59a0 0x7ff3580b5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:33.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.336+0000 7ff35ffff700 1 --2- 172.21.15.40:0/932615814 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3580b45d0 0x7ff3580b49a0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:33.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.336+0000 7ff35ffff700 1 -- 172.21.15.40:0/932615814 >> 172.21.15.40:0/932615814 conn(0x7ff3580cf5d0 msgr2=0x7ff3580cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:33.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.336+0000 7ff35ffff700 1 -- 172.21.15.40:0/932615814 shutdown_connections 2023-06-22T10:54:33.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.336+0000 7ff35ffff700 1 -- 172.21.15.40:0/932615814 wait complete. 2023-06-22T10:54:33.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.338+0000 7ff35ffff700 1 Processor -- start 2023-06-22T10:54:33.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.338+0000 7ff35ffff700 1 -- start start 2023-06-22T10:54:33.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.339+0000 7ff35ffff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff3580b45d0 0x7ff3581f5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:33.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.339+0000 7ff35ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3580b59a0 0x7ff3580b6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:33.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.340+0000 7ff35ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3580d2130 0x7ff3580b6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:33.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.340+0000 7ff35ffff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3580cc020 con 0x7ff3580b59a0 2023-06-22T10:54:33.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.340+0000 7ff35ffff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff35815e680 con 0x7ff3580d2130 2023-06-22T10:54:33.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.340+0000 7ff35ffff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff35815e960 con 0x7ff3580b45d0 2023-06-22T10:54:33.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.340+0000 7ff35d59a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3580b59a0 0x7ff3580b6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:33.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.340+0000 7ff35d59a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3580b59a0 0x7ff3580b6a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39392/0 (socket says 172.21.15.40:39392) 2023-06-22T10:54:33.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.340+0000 7ff35d59a700 1 -- 172.21.15.40:0/830144061 learned_addr learned my addr 172.21.15.40:0/830144061 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:33.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.340+0000 7ff35e59c700 1 --2- 172.21.15.40:0/830144061 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3580d2130 0x7ff3580b6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:33.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.340+0000 7ff35dd9b700 1 --2- 172.21.15.40:0/830144061 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff3580b45d0 0x7ff3581f5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:33.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.340+0000 7ff35d59a700 1 -- 172.21.15.40:0/830144061 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff3580b45d0 msgr2=0x7ff3581f5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:33.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.340+0000 7ff35d59a700 1 --2- 172.21.15.40:0/830144061 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff3580b45d0 0x7ff3581f5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:33.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.340+0000 7ff35d59a700 1 -- 172.21.15.40:0/830144061 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3580d2130 msgr2=0x7ff3580b6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:33.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.340+0000 7ff35d59a700 1 --2- 172.21.15.40:0/830144061 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3580d2130 0x7ff3580b6fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:33.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.340+0000 7ff35d59a700 1 -- 172.21.15.40:0/830144061 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3540094a0 con 0x7ff3580b59a0 2023-06-22T10:54:33.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.340+0000 7ff35d59a700 1 --2- 172.21.15.40:0/830144061 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3580b59a0 0x7ff3580b6a60 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff3480011e0 tx=0x7ff34800ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:33.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.341+0000 7ff34e7fc700 1 -- 172.21.15.40:0/830144061 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff348004c80 con 0x7ff3580b59a0 2023-06-22T10:54:33.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.341+0000 7ff34e7fc700 1 -- 172.21.15.40:0/830144061 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff348004e00 con 0x7ff3580b59a0 2023-06-22T10:54:33.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.341+0000 7ff34e7fc700 1 -- 172.21.15.40:0/830144061 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff348007310 con 0x7ff3580b59a0 2023-06-22T10:54:33.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.341+0000 7ff35ffff700 1 -- 172.21.15.40:0/830144061 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff35815ec40 con 0x7ff3580b59a0 2023-06-22T10:54:33.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.341+0000 7ff35ffff700 1 -- 172.21.15.40:0/830144061 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff35815f440 con 0x7ff3580b59a0 2023-06-22T10:54:33.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.342+0000 7ff35ffff700 1 -- 172.21.15.40:0/830144061 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff35815f160 con 0x7ff3580b59a0 2023-06-22T10:54:33.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.343+0000 7ff34e7fc700 1 -- 172.21.15.40:0/830144061 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff348007470 con 0x7ff3580b59a0 2023-06-22T10:54:33.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.344+0000 7ff34e7fc700 1 --2- 172.21.15.40:0/830144061 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7ff33c06ace0 0x7ff33c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:33.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.344+0000 7ff34e7fc700 1 -- 172.21.15.40:0/830144061 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff3480893c0 con 0x7ff3580b59a0 2023-06-22T10:54:33.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.344+0000 7ff35dd9b700 1 --2- 172.21.15.40:0/830144061 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7ff33c06ace0 0x7ff33c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:33.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.345+0000 7ff35dd9b700 1 --2- 172.21.15.40:0/830144061 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7ff33c06ace0 0x7ff33c06d190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff3540090b0 tx=0x7ff35401c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:33.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.348+0000 7ff34e7fc700 1 -- 172.21.15.40:0/830144061 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff35815f160 con 0x7ff3580b59a0 2023-06-22T10:54:33.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.559+0000 7ff35ffff700 1 -- 172.21.15.40:0/830144061 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff35815f160 con 0x7ff3580b59a0 2023-06-22T10:54:33.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.559+0000 7ff34e7fc700 1 -- 172.21.15.40:0/830144061 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff35815f160 con 0x7ff3580b59a0 2023-06-22T10:54:33.563 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-06-22T10:54:33.565 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.562+0000 7ff35ffff700 1 -- 172.21.15.40:0/830144061 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7ff33c06ace0 msgr2=0x7ff33c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:33.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.562+0000 7ff35ffff700 1 --2- 172.21.15.40:0/830144061 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7ff33c06ace0 0x7ff33c06d190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff3540090b0 tx=0x7ff35401c040 comp rx=0 tx=0).stop 2023-06-22T10:54:33.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.562+0000 7ff35ffff700 1 -- 172.21.15.40:0/830144061 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3580b59a0 msgr2=0x7ff3580b6a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:33.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.562+0000 7ff35ffff700 1 --2- 172.21.15.40:0/830144061 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3580b59a0 0x7ff3580b6a60 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff3480011e0 tx=0x7ff34800ca30 comp rx=0 tx=0).stop 2023-06-22T10:54:33.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.562+0000 7ff35ffff700 1 -- 172.21.15.40:0/830144061 shutdown_connections 2023-06-22T10:54:33.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.562+0000 7ff35ffff700 1 --2- 172.21.15.40:0/830144061 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7ff33c06ace0 0x7ff33c06d190 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:33.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.562+0000 7ff35ffff700 1 --2- 172.21.15.40:0/830144061 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff3580b45d0 0x7ff3581f5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:33.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.562+0000 7ff35ffff700 1 --2- 172.21.15.40:0/830144061 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3580d2130 0x7ff3580b6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:33.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.562+0000 7ff35ffff700 1 --2- 172.21.15.40:0/830144061 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3580b59a0 0x7ff3580b6a60 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:33.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.562+0000 7ff35ffff700 1 -- 172.21.15.40:0/830144061 >> 172.21.15.40:0/830144061 conn(0x7ff3580cf5d0 msgr2=0x7ff35815b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:33.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.562+0000 7ff35ffff700 1 -- 172.21.15.40:0/830144061 shutdown_connections 2023-06-22T10:54:33.567 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.562+0000 7ff35ffff700 1 -- 172.21.15.40:0/830144061 wait complete. 2023-06-22T10:54:33.583 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-22T10:54:33.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.785+0000 7fe95bfff700 1 Processor -- start 2023-06-22T10:54:33.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.785+0000 7fe95bfff700 1 -- start start 2023-06-22T10:54:33.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.786+0000 7fe95bfff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe9540b59a0 0x7fe9540b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:33.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.786+0000 7fe95bfff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9540d1be0 con 0x7fe9540b45d0 2023-06-22T10:54:33.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.786+0000 7fe95bfff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9540d1360 con 0x7fe9540d2130 2023-06-22T10:54:33.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.786+0000 7fe95bfff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9540d17f0 con 0x7fe9540b59a0 2023-06-22T10:54:33.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.787+0000 7fe959d9b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe9540b45d0 0x7fe9540b49a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52020/0 (socket says 172.21.15.40:52020) 2023-06-22T10:54:33.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.787+0000 7fe959d9b700 1 -- 172.21.15.40:0/3705995660 learned_addr learned my addr 172.21.15.40:0/3705995660 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:33.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.787+0000 7fe95a59c700 1 --2- 172.21.15.40:0/3705995660 >> v2:172.21.15.45:3300/0 conn(0x7fe9540b59a0 0x7fe9540b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:33.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.787+0000 7fe95a59c700 1 -- 172.21.15.40:0/3705995660 >> v1:172.21.15.45:6789/0 conn(0x7fe9540d2130 legacy=0x7fe9540cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:33.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.787+0000 7fe95a59c700 1 -- 172.21.15.40:0/3705995660 >> v1:172.21.15.40:6789/0 conn(0x7fe9540b45d0 legacy=0x7fe9540b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:33.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.787+0000 7fe95a59c700 1 -- 172.21.15.40:0/3705995660 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9540cef40 con 0x7fe9540b59a0 2023-06-22T10:54:33.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.788+0000 7fe95a59c700 1 --2- 172.21.15.40:0/3705995660 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9540b59a0 0x7fe9540b5e40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe94c009d90 tx=0x7fe94c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4591cb59b734e254 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:33.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.788+0000 7fe958d99700 1 -- 172.21.15.40:0/3705995660 <== mon.1 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94c00e070 con 0x7fe9540b59a0 2023-06-22T10:54:33.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.788+0000 7fe958d99700 1 -- 172.21.15.40:0/3705995660 <== mon.1 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe94c00bbd0 con 0x7fe9540b59a0 2023-06-22T10:54:33.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.788+0000 7fe958d99700 1 -- 172.21.15.40:0/3705995660 <== mon.1 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94c012430 con 0x7fe9540b59a0 2023-06-22T10:54:33.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.788+0000 7fe95bfff700 1 -- 172.21.15.40:0/3705995660 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9540b59a0 msgr2=0x7fe9540b5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:33.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.788+0000 7fe95bfff700 1 --2- 172.21.15.40:0/3705995660 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9540b59a0 0x7fe9540b5e40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe94c009d90 tx=0x7fe94c00b330 comp rx=0 tx=0).stop 2023-06-22T10:54:33.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.789+0000 7fe95bfff700 1 -- 172.21.15.40:0/3705995660 shutdown_connections 2023-06-22T10:54:33.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.789+0000 7fe95bfff700 1 --2- 172.21.15.40:0/3705995660 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9540b59a0 0x7fe9540b5e40 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:33.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.789+0000 7fe95bfff700 1 -- 172.21.15.40:0/3705995660 >> 172.21.15.40:0/3705995660 conn(0x7fe9540cf5d0 msgr2=0x7fe9540cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:33.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.789+0000 7fe95bfff700 1 -- 172.21.15.40:0/3705995660 shutdown_connections 2023-06-22T10:54:33.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.789+0000 7fe95bfff700 1 -- 172.21.15.40:0/3705995660 wait complete. 2023-06-22T10:54:33.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.791+0000 7fe95bfff700 1 Processor -- start 2023-06-22T10:54:33.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.791+0000 7fe95bfff700 1 -- start start 2023-06-22T10:54:33.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.793+0000 7fe95bfff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe9540b45d0 0x7fe9541f5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:33.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.793+0000 7fe95bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9540b59a0 0x7fe9540b74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:33.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.793+0000 7fe95bfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9540d2130 0x7fe9540b7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:33.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.793+0000 7fe95bfff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9541f5870 con 0x7fe9540d2130 2023-06-22T10:54:33.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.793+0000 7fe95bfff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9541f61d0 con 0x7fe9540b59a0 2023-06-22T10:54:33.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.793+0000 7fe95bfff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9541f5240 con 0x7fe9540b45d0 2023-06-22T10:54:33.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.793+0000 7fe95a59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9540d2130 0x7fe9540b7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:33.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.793+0000 7fe95a59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9540d2130 0x7fe9540b7a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39402/0 (socket says 172.21.15.40:39402) 2023-06-22T10:54:33.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.793+0000 7fe95a59c700 1 -- 172.21.15.40:0/989729792 learned_addr learned my addr 172.21.15.40:0/989729792 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:33.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.793+0000 7fe959d9b700 1 --2- 172.21.15.40:0/989729792 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe9540b45d0 0x7fe9541f5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:33.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.793+0000 7fe95959a700 1 --2- 172.21.15.40:0/989729792 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9540b59a0 0x7fe9540b74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:33.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.793+0000 7fe95a59c700 1 -- 172.21.15.40:0/989729792 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe9540b45d0 msgr2=0x7fe9541f5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:33.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.793+0000 7fe95a59c700 1 --2- 172.21.15.40:0/989729792 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe9540b45d0 0x7fe9541f5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:33.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.793+0000 7fe95a59c700 1 -- 172.21.15.40:0/989729792 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9540b59a0 msgr2=0x7fe9540b74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:33.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.793+0000 7fe95a59c700 1 --2- 172.21.15.40:0/989729792 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9540b59a0 0x7fe9540b74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:33.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.793+0000 7fe95a59c700 1 -- 172.21.15.40:0/989729792 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe94c009a70 con 0x7fe9540d2130 2023-06-22T10:54:33.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.793+0000 7fe959d9b700 1 --2- 172.21.15.40:0/989729792 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe9540b45d0 0x7fe9541f5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:54:33.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.794+0000 7fe95959a700 1 --2- 172.21.15.40:0/989729792 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9540b59a0 0x7fe9540b74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:54:33.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.794+0000 7fe95a59c700 1 --2- 172.21.15.40:0/989729792 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9540d2130 0x7fe9540b7a30 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe94c014040 tx=0x7fe94c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:33.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.794+0000 7fe94a7fc700 1 -- 172.21.15.40:0/989729792 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94c012430 con 0x7fe9540d2130 2023-06-22T10:54:33.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.794+0000 7fe94a7fc700 1 -- 172.21.15.40:0/989729792 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe94c020070 con 0x7fe9540d2130 2023-06-22T10:54:33.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.794+0000 7fe94a7fc700 1 -- 172.21.15.40:0/989729792 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94c004280 con 0x7fe9540d2130 2023-06-22T10:54:33.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.794+0000 7fe95bfff700 1 -- 172.21.15.40:0/989729792 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9540cc620 con 0x7fe9540d2130 2023-06-22T10:54:33.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.794+0000 7fe95bfff700 1 -- 172.21.15.40:0/989729792 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9541f5490 con 0x7fe9540d2130 2023-06-22T10:54:33.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.795+0000 7fe95bfff700 1 -- 172.21.15.40:0/989729792 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9541f59b0 con 0x7fe9540d2130 2023-06-22T10:54:33.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.796+0000 7fe94a7fc700 1 -- 172.21.15.40:0/989729792 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe94c0043e0 con 0x7fe9540d2130 2023-06-22T10:54:33.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.797+0000 7fe94a7fc700 1 --2- 172.21.15.40:0/989729792 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe93806ace0 0x7fe93806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:33.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.797+0000 7fe94a7fc700 1 -- 172.21.15.40:0/989729792 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe94c022070 con 0x7fe9540d2130 2023-06-22T10:54:33.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.797+0000 7fe959d9b700 1 --2- 172.21.15.40:0/989729792 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe93806ace0 0x7fe93806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:33.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.798+0000 7fe959d9b700 1 --2- 172.21.15.40:0/989729792 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe93806ace0 0x7fe93806d190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe950007fd0 tx=0x7fe950009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:33.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:33.802+0000 7fe94a7fc700 1 -- 172.21.15.40:0/989729792 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe9541f59b0 con 0x7fe9540d2130 2023-06-22T10:54:34.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.009+0000 7fe95bfff700 1 -- 172.21.15.40:0/989729792 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe9541f59b0 con 0x7fe9540d2130 2023-06-22T10:54:34.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.009+0000 7fe94a7fc700 1 -- 172.21.15.40:0/989729792 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe9541f59b0 con 0x7fe9540d2130 2023-06-22T10:54:34.013 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-06-22T10:54:34.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.012+0000 7fe95bfff700 1 -- 172.21.15.40:0/989729792 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe93806ace0 msgr2=0x7fe93806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:34.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.012+0000 7fe95bfff700 1 --2- 172.21.15.40:0/989729792 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe93806ace0 0x7fe93806d190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe950007fd0 tx=0x7fe950009040 comp rx=0 tx=0).stop 2023-06-22T10:54:34.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.012+0000 7fe95bfff700 1 -- 172.21.15.40:0/989729792 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9540d2130 msgr2=0x7fe9540b7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:34.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.012+0000 7fe95bfff700 1 --2- 172.21.15.40:0/989729792 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9540d2130 0x7fe9540b7a30 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe94c014040 tx=0x7fe94c004ad0 comp rx=0 tx=0).stop 2023-06-22T10:54:34.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.012+0000 7fe95bfff700 1 -- 172.21.15.40:0/989729792 shutdown_connections 2023-06-22T10:54:34.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.012+0000 7fe95bfff700 1 --2- 172.21.15.40:0/989729792 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe93806ace0 0x7fe93806d190 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:34.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.012+0000 7fe95bfff700 1 --2- 172.21.15.40:0/989729792 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe9540b45d0 0x7fe9541f5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:34.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.012+0000 7fe95bfff700 1 --2- 172.21.15.40:0/989729792 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9540d2130 0x7fe9540b7a30 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:34.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.012+0000 7fe95bfff700 1 --2- 172.21.15.40:0/989729792 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9540b59a0 0x7fe9540b74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:34.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.012+0000 7fe95bfff700 1 -- 172.21.15.40:0/989729792 >> 172.21.15.40:0/989729792 conn(0x7fe9540cf5d0 msgr2=0x7fe9540d03e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:34.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.012+0000 7fe95bfff700 1 -- 172.21.15.40:0/989729792 shutdown_connections 2023-06-22T10:54:34.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.012+0000 7fe95bfff700 1 -- 172.21.15.40:0/989729792 wait complete. 2023-06-22T10:54:34.033 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-22T10:54:34.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.232+0000 7ff9b2dff700 1 Processor -- start 2023-06-22T10:54:34.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.232+0000 7ff9b2dff700 1 -- start start 2023-06-22T10:54:34.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.234+0000 7ff9b2dff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff9ac15c720 0x7ff9ac0b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:34.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.234+0000 7ff9b2dff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff9ac0d2830 0x7ff9ac0b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:34.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.234+0000 7ff9b2dff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff9ac0b4c60 0x7ff9ac06b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:34.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.234+0000 7ff9b2dff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9ac160d60 con 0x7ff9ac15c720 2023-06-22T10:54:34.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.234+0000 7ff9b2dff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9ac0b50e0 con 0x7ff9ac0d2830 2023-06-22T10:54:34.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.234+0000 7ff9b2dff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac0b2130 con 0x7ff9ac0b4c60 2023-06-22T10:54:34.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.234+0000 7ff9b0b9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff9ac15c720 0x7ff9ac0b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:34.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.234+0000 7ff9b0b9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff9ac15c720 0x7ff9ac0b1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39414/0 (socket says 172.21.15.40:39414) 2023-06-22T10:54:34.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.234+0000 7ff9b0b9b700 1 -- 172.21.15.40:0/1599431810 learned_addr learned my addr 172.21.15.40:0/1599431810 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:34.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.234+0000 7ff9abfff700 1 --2- 172.21.15.40:0/1599431810 >> v2:172.21.15.45:3300/0 conn(0x7ff9ac0d2830 0x7ff9ac0b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:34.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.234+0000 7ff9b139c700 1 --2- 172.21.15.40:0/1599431810 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff9ac0b4c60 0x7ff9ac06b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:34.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.234+0000 7ff9b0b9b700 1 -- 172.21.15.40:0/1599431810 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff9ac0b4c60 msgr2=0x7ff9ac06b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:34.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.234+0000 7ff9b0b9b700 1 --2- 172.21.15.40:0/1599431810 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff9ac0b4c60 0x7ff9ac06b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:34.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.234+0000 7ff9b0b9b700 1 -- 172.21.15.40:0/1599431810 >> v2:172.21.15.45:3300/0 conn(0x7ff9ac0d2830 msgr2=0x7ff9ac0b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:34.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.234+0000 7ff9b0b9b700 1 --2- 172.21.15.40:0/1599431810 >> v2:172.21.15.45:3300/0 conn(0x7ff9ac0d2830 0x7ff9ac0b4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:34.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.234+0000 7ff9b0b9b700 1 -- 172.21.15.40:0/1599431810 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9ac161180 con 0x7ff9ac15c720 2023-06-22T10:54:34.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.234+0000 7ff9abfff700 1 --2- 172.21.15.40:0/1599431810 >> v2:172.21.15.45:3300/0 conn(0x7ff9ac0d2830 0x7ff9ac0b4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:54:34.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.235+0000 7ff9b0b9b700 1 --2- 172.21.15.40:0/1599431810 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff9ac15c720 0x7ff9ac0b1870 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff9a00098f0 tx=0x7ff9a0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8752228ca56e3876 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:34.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.235+0000 7ff9ab7fe700 1 -- 172.21.15.40:0/1599431810 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a000b860 con 0x7ff9ac15c720 2023-06-22T10:54:34.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.235+0000 7ff9ab7fe700 1 -- 172.21.15.40:0/1599431810 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9a000b9c0 con 0x7ff9ac15c720 2023-06-22T10:54:34.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.235+0000 7ff9ab7fe700 1 -- 172.21.15.40:0/1599431810 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a000bd50 con 0x7ff9ac15c720 2023-06-22T10:54:34.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.236+0000 7ff9b2dff700 1 -- 172.21.15.40:0/1599431810 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff9ac15c720 msgr2=0x7ff9ac0b1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:34.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.236+0000 7ff9b2dff700 1 --2- 172.21.15.40:0/1599431810 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff9ac15c720 0x7ff9ac0b1870 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff9a00098f0 tx=0x7ff9a0009c00 comp rx=0 tx=0).stop 2023-06-22T10:54:34.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.236+0000 7ff9b2dff700 1 -- 172.21.15.40:0/1599431810 shutdown_connections 2023-06-22T10:54:34.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.236+0000 7ff9b2dff700 1 --2- 172.21.15.40:0/1599431810 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff9ac0b4c60 0x7ff9ac06b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:34.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.236+0000 7ff9b2dff700 1 --2- 172.21.15.40:0/1599431810 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff9ac15c720 0x7ff9ac0b1870 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:34.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.236+0000 7ff9b2dff700 1 --2- 172.21.15.40:0/1599431810 >> v2:172.21.15.45:3300/0 conn(0x7ff9ac0d2830 0x7ff9ac0b4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:34.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.236+0000 7ff9b2dff700 1 -- 172.21.15.40:0/1599431810 >> 172.21.15.40:0/1599431810 conn(0x7ff9ac0cf720 msgr2=0x7ff9ac0cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:34.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.236+0000 7ff9b2dff700 1 -- 172.21.15.40:0/1599431810 shutdown_connections 2023-06-22T10:54:34.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.236+0000 7ff9b2dff700 1 -- 172.21.15.40:0/1599431810 wait complete. 2023-06-22T10:54:34.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.238+0000 7ff9b2dff700 1 Processor -- start 2023-06-22T10:54:34.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.238+0000 7ff9b2dff700 1 -- start start 2023-06-22T10:54:34.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.240+0000 7ff9b2dff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9ac0b4c60 0x7ff9ac15d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:34.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.240+0000 7ff9b2dff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff9ac0d2830 0x7ff9ac1f5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:34.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.240+0000 7ff9b2dff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff9ac15c720 0x7ff9ac0c8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:34.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.240+0000 7ff9b2dff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac1f61f0 con 0x7ff9ac0d2830 2023-06-22T10:54:34.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.240+0000 7ff9b2dff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac1f26f0 con 0x7ff9ac0b4c60 2023-06-22T10:54:34.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.240+0000 7ff9b2dff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac0c9200 con 0x7ff9ac15c720 2023-06-22T10:54:34.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.240+0000 7ff9abfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff9ac0d2830 0x7ff9ac1f5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:34.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.240+0000 7ff9abfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff9ac0d2830 0x7ff9ac1f5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39428/0 (socket says 172.21.15.40:39428) 2023-06-22T10:54:34.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.240+0000 7ff9abfff700 1 -- 172.21.15.40:0/1267881304 learned_addr learned my addr 172.21.15.40:0/1267881304 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:34.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.240+0000 7ff9b0b9b700 1 --2- 172.21.15.40:0/1267881304 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9ac0b4c60 0x7ff9ac15d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:34.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.240+0000 7ff9b139c700 1 --2- 172.21.15.40:0/1267881304 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff9ac15c720 0x7ff9ac0c8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:34.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.240+0000 7ff9abfff700 1 -- 172.21.15.40:0/1267881304 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff9ac15c720 msgr2=0x7ff9ac0c8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:34.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.240+0000 7ff9abfff700 1 --2- 172.21.15.40:0/1267881304 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff9ac15c720 0x7ff9ac0c8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:34.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.240+0000 7ff9abfff700 1 -- 172.21.15.40:0/1267881304 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9ac0b4c60 msgr2=0x7ff9ac15d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:34.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.240+0000 7ff9abfff700 1 --2- 172.21.15.40:0/1267881304 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9ac0b4c60 0x7ff9ac15d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:34.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.240+0000 7ff9abfff700 1 -- 172.21.15.40:0/1267881304 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a0009550 con 0x7ff9ac0d2830 2023-06-22T10:54:34.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.241+0000 7ff9abfff700 1 --2- 172.21.15.40:0/1267881304 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff9ac0d2830 0x7ff9ac1f5cb0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff99800e7e0 tx=0x7ff99800eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:34.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.241+0000 7ff9a97fa700 1 -- 172.21.15.40:0/1267881304 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff998004230 con 0x7ff9ac0d2830 2023-06-22T10:54:34.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.241+0000 7ff9a97fa700 1 -- 172.21.15.40:0/1267881304 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff998004390 con 0x7ff9ac0d2830 2023-06-22T10:54:34.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.241+0000 7ff9a97fa700 1 -- 172.21.15.40:0/1267881304 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9980036a0 con 0x7ff9ac0d2830 2023-06-22T10:54:34.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.241+0000 7ff9b2dff700 1 -- 172.21.15.40:0/1267881304 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9ac1f1dc0 con 0x7ff9ac0d2830 2023-06-22T10:54:34.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.241+0000 7ff9b2dff700 1 -- 172.21.15.40:0/1267881304 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9ac1f2380 con 0x7ff9ac0d2830 2023-06-22T10:54:34.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.242+0000 7ff9b2dff700 1 -- 172.21.15.40:0/1267881304 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9ac1f2860 con 0x7ff9ac0d2830 2023-06-22T10:54:34.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.243+0000 7ff9a97fa700 1 -- 172.21.15.40:0/1267881304 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff998003800 con 0x7ff9ac0d2830 2023-06-22T10:54:34.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.244+0000 7ff9a97fa700 1 --2- 172.21.15.40:0/1267881304 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7ff99006ace0 0x7ff99006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:34.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.244+0000 7ff9a97fa700 1 -- 172.21.15.40:0/1267881304 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff998089190 con 0x7ff9ac0d2830 2023-06-22T10:54:34.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.245+0000 7ff9b0b9b700 1 --2- 172.21.15.40:0/1267881304 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7ff99006ace0 0x7ff99006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:34.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.245+0000 7ff9b0b9b700 1 --2- 172.21.15.40:0/1267881304 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7ff99006ace0 0x7ff99006d190 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff9a0009c40 tx=0x7ff9a0008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:34.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.248+0000 7ff9a97fa700 1 -- 172.21.15.40:0/1267881304 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff998057a30 con 0x7ff9ac0d2830 2023-06-22T10:54:34.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.453+0000 7ff9b2dff700 1 -- 172.21.15.40:0/1267881304 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9ac067580 con 0x7ff9ac0d2830 2023-06-22T10:54:34.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.455+0000 7ff9a97fa700 1 -- 172.21.15.40:0/1267881304 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20132 (secure 0 0 0) 0x7ff9980575c0 con 0x7ff9ac0d2830 2023-06-22T10:54:34.458 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:54:34.459 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":30,"fsid":"475560bc-1a7c-4a75-b3b6-6fc6b20bdc52","created":"2023-06-22T10:53:03.784568+0000","modified":"2023-06-22T10:54:12.717204+0000","last_up_change":"2023-06-22T10:53:17.830348+0000","last_in_change":"2023-06-22T10:53:07.329974+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-22T10:53:17.182228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-22T10:53:23.874432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-22T10:53:29.812963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-22T10:53:30.404021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-22T10:53:33.982289+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"918db6b4-053a-46ba-976d-6e1a0104017f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6809","nonce":2400162888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6811","nonce":2400162888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6815","nonce":2400162888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6813","nonce":2400162888}]},"public_addr":"172.21.15.40:6809/2400162888","cluster_addr":"172.21.15.40:6811/2400162888","heartbeat_back_addr":"172.21.15.40:6815/2400162888","heartbeat_front_addr":"172.21.15.40:6813/2400162888","state":["exists","up"]},{"osd":1,"uuid":"0c146e2b-1725-4dae-9b5c-38795943b9d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6801","nonce":230885800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6803","nonce":230885800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6807","nonce":230885800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6805","nonce":230885800}]},"public_addr":"172.21.15.40:6801/230885800","cluster_addr":"172.21.15.40:6803/230885800","heartbeat_back_addr":"172.21.15.40:6807/230885800","heartbeat_front_addr":"172.21.15.40:6805/230885800","state":["exists","up"]},{"osd":2,"uuid":"0b3727fd-f281-46d5-a675-86c8c5ab269e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6817","nonce":2681404929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6819","nonce":2681404929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6823","nonce":2681404929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6821","nonce":2681404929}]},"public_addr":"172.21.15.40:6817/2681404929","cluster_addr":"172.21.15.40:6819/2681404929","heartbeat_back_addr":"172.21.15.40:6823/2681404929","heartbeat_front_addr":"172.21.15.40:6821/2681404929","state":["exists","up"]},{"osd":3,"uuid":"2969c698-7039-4bbb-beda-f756f7a368a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6825","nonce":111110981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6827","nonce":111110981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6831","nonce":111110981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6829","nonce":111110981}]},"public_addr":"172.21.15.40:6825/111110981","cluster_addr":"172.21.15.40:6827/111110981","heartbeat_back_addr":"172.21.15.40:6831/111110981","heartbeat_front_addr":"172.21.15.40:6829/111110981","state":["exists","up"]},{"osd":4,"uuid":"3bb1d9c8-8e42-4a6b-998d-04834f34be5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6801","nonce":3625455711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6803","nonce":3625455711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6807","nonce":3625455711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6805","nonce":3625455711}]},"public_addr":"172.21.15.45:6801/3625455711","cluster_addr":"172.21.15.45:6803/3625455711","heartbeat_back_addr":"172.21.15.45:6807/3625455711","heartbeat_front_addr":"172.21.15.45:6805/3625455711","state":["exists","up"]},{"osd":5,"uuid":"f9854ee4-302c-41be-977b-bedda090a3d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6817","nonce":3354411217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6819","nonce":3354411217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6823","nonce":3354411217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6821","nonce":3354411217}]},"public_addr":"172.21.15.45:6817/3354411217","cluster_addr":"172.21.15.45:6819/3354411217","heartbeat_back_addr":"172.21.15.45:6823/3354411217","heartbeat_front_addr":"172.21.15.45:6821/3354411217","state":["exists","up"]},{"osd":6,"uuid":"bbdb1989-f6ac-4954-9b85-b8b540d683c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6809","nonce":320111074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6811","nonce":320111074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6815","nonce":320111074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6813","nonce":320111074}]},"public_addr":"172.21.15.45:6809/320111074","cluster_addr":"172.21.15.45:6811/320111074","heartbeat_back_addr":"172.21.15.45:6815/320111074","heartbeat_front_addr":"172.21.15.45:6813/320111074","state":["exists","up"]},{"osd":7,"uuid":"823d44e3-58f1-4d1d-8263-a4e4a69d4327","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6825","nonce":643617680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6827","nonce":643617680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6831","nonce":643617680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6829","nonce":643617680}]},"public_addr":"172.21.15.45:6825/643617680","cluster_addr":"172.21.15.45:6827/643617680","heartbeat_back_addr":"172.21.15.45:6831/643617680","heartbeat_front_addr":"172.21.15.45:6829/643617680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.731262+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.873226+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.898936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.666578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.645990+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.953699+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.642823+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.693395+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1b","mappings":[{"from":3,"to":2}]},{"pgid":"4.2a","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-22T10:54:34.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.457+0000 7ff9b2dff700 1 -- 172.21.15.40:0/1267881304 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7ff99006ace0 msgr2=0x7ff99006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:34.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.457+0000 7ff9b2dff700 1 --2- 172.21.15.40:0/1267881304 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7ff99006ace0 0x7ff99006d190 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff9a0009c40 tx=0x7ff9a0008030 comp rx=0 tx=0).stop 2023-06-22T10:54:34.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.457+0000 7ff9b2dff700 1 -- 172.21.15.40:0/1267881304 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff9ac0d2830 msgr2=0x7ff9ac1f5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:34.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.457+0000 7ff9b2dff700 1 --2- 172.21.15.40:0/1267881304 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff9ac0d2830 0x7ff9ac1f5cb0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff99800e7e0 tx=0x7ff99800eaf0 comp rx=0 tx=0).stop 2023-06-22T10:54:34.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.457+0000 7ff9b2dff700 1 -- 172.21.15.40:0/1267881304 shutdown_connections 2023-06-22T10:54:34.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.457+0000 7ff9b2dff700 1 --2- 172.21.15.40:0/1267881304 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7ff99006ace0 0x7ff99006d190 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:34.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.457+0000 7ff9b2dff700 1 --2- 172.21.15.40:0/1267881304 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff9ac15c720 0x7ff9ac0c8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:34.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.457+0000 7ff9b2dff700 1 --2- 172.21.15.40:0/1267881304 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9ac0b4c60 0x7ff9ac15d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:34.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.457+0000 7ff9b2dff700 1 --2- 172.21.15.40:0/1267881304 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff9ac0d2830 0x7ff9ac1f5cb0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:34.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.457+0000 7ff9b2dff700 1 -- 172.21.15.40:0/1267881304 >> 172.21.15.40:0/1267881304 conn(0x7ff9ac0cf720 msgr2=0x7ff9ac0b5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:34.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.457+0000 7ff9b2dff700 1 -- 172.21.15.40:0/1267881304 shutdown_connections 2023-06-22T10:54:34.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.457+0000 7ff9b2dff700 1 -- 172.21.15.40:0/1267881304 wait complete. 2023-06-22T10:54:34.479 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-22T10:53:17.182228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-22T10:53:23.874432+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-22T10:53:29.812963+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-22T10:53:30.404021+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-22T10:53:33.982289+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-22T10:54:34.481 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-22T10:54:34.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.683+0000 7fe1fb9ff700 1 Processor -- start 2023-06-22T10:54:34.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.683+0000 7fe1fb9ff700 1 -- start start 2023-06-22T10:54:34.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.684+0000 7fe1fb9ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe1f40d2130 0x7fe1f40cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:34.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.684+0000 7fe1fb9ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe1f40cd6e0 0x7fe1f40b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:34.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.684+0000 7fe1fb9ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1f40d1be0 con 0x7fe1f40b45d0 2023-06-22T10:54:34.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.684+0000 7fe1fb9ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1f40d17f0 con 0x7fe1f40cd6e0 2023-06-22T10:54:34.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.684+0000 7fe1fb9ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1f40d1360 con 0x7fe1f40d2130 2023-06-22T10:54:34.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.685+0000 7fe1f9f9c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe1f40cd6e0 0x7fe1f40b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:34.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.685+0000 7fe1f979b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe1f40b45d0 0x7fe1f40b49a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52030/0 (socket says 172.21.15.40:52030) 2023-06-22T10:54:34.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.685+0000 7fe1f979b700 1 -- 172.21.15.40:0/3378379350 learned_addr learned my addr 172.21.15.40:0/3378379350 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:34.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.685+0000 7fe1f8f9a700 1 --2- 172.21.15.40:0/3378379350 >> v2:172.21.15.45:3300/0 conn(0x7fe1f40d2130 0x7fe1f40cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:34.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.685+0000 7fe1ebfff700 1 -- 172.21.15.40:0/3378379350 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4204165938 0 0) 0x7fe1f40d1be0 con 0x7fe1f40b45d0 2023-06-22T10:54:34.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.685+0000 7fe1ebfff700 1 -- 172.21.15.40:0/3378379350 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1e00035b0 con 0x7fe1f40b45d0 2023-06-22T10:54:34.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.685+0000 7fe1f9f9c700 1 -- 172.21.15.40:0/3378379350 >> v2:172.21.15.45:3300/0 conn(0x7fe1f40d2130 msgr2=0x7fe1f40cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:34.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.685+0000 7fe1f9f9c700 1 --2- 172.21.15.40:0/3378379350 >> v2:172.21.15.45:3300/0 conn(0x7fe1f40d2130 0x7fe1f40cd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:34.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.685+0000 7fe1f9f9c700 1 -- 172.21.15.40:0/3378379350 >> v1:172.21.15.40:6789/0 conn(0x7fe1f40b45d0 legacy=0x7fe1f40b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:34.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.685+0000 7fe1f9f9c700 1 -- 172.21.15.40:0/3378379350 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f40cef40 con 0x7fe1f40cd6e0 2023-06-22T10:54:34.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.685+0000 7fe1f8f9a700 1 --2- 172.21.15.40:0/3378379350 >> v2:172.21.15.45:3300/0 conn(0x7fe1f40d2130 0x7fe1f40cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-22T10:54:34.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.685+0000 7fe1f9f9c700 1 --2- 172.21.15.40:0/3378379350 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1f40cd6e0 0x7fe1f40b59a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe1f40668c0 tx=0x7fe1ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40a8aa10ffc924d6 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:34.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.686+0000 7fe1ebfff700 1 -- 172.21.15.40:0/3378379350 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ec00e070 con 0x7fe1f40cd6e0 2023-06-22T10:54:34.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.686+0000 7fe1ebfff700 1 -- 172.21.15.40:0/3378379350 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1ec00bb20 con 0x7fe1f40cd6e0 2023-06-22T10:54:34.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.686+0000 7fe1ebfff700 1 -- 172.21.15.40:0/3378379350 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ec012430 con 0x7fe1f40cd6e0 2023-06-22T10:54:34.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.686+0000 7fe1fb9ff700 1 -- 172.21.15.40:0/3378379350 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1f40cd6e0 msgr2=0x7fe1f40b59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:34.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.686+0000 7fe1fb9ff700 1 --2- 172.21.15.40:0/3378379350 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1f40cd6e0 0x7fe1f40b59a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe1f40668c0 tx=0x7fe1ec00b330 comp rx=0 tx=0).stop 2023-06-22T10:54:34.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.686+0000 7fe1fb9ff700 1 -- 172.21.15.40:0/3378379350 shutdown_connections 2023-06-22T10:54:34.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.686+0000 7fe1fb9ff700 1 --2- 172.21.15.40:0/3378379350 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1f40cd6e0 0x7fe1f40b59a0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:34.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.686+0000 7fe1fb9ff700 1 --2- 172.21.15.40:0/3378379350 >> v2:172.21.15.45:3300/0 conn(0x7fe1f40d2130 0x7fe1f40cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:34.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.686+0000 7fe1fb9ff700 1 -- 172.21.15.40:0/3378379350 >> 172.21.15.40:0/3378379350 conn(0x7fe1f40cf5d0 msgr2=0x7fe1f40cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:34.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.686+0000 7fe1fb9ff700 1 -- 172.21.15.40:0/3378379350 shutdown_connections 2023-06-22T10:54:34.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.686+0000 7fe1fb9ff700 1 -- 172.21.15.40:0/3378379350 wait complete. 2023-06-22T10:54:34.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.688+0000 7fe1fb9ff700 1 Processor -- start 2023-06-22T10:54:34.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.688+0000 7fe1fb9ff700 1 -- start start 2023-06-22T10:54:34.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.689+0000 7fe1fb9ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1f40b45d0 0x7fe1f40a9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:34.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.689+0000 7fe1fb9ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1f40cd6e0 0x7fe1f40b5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:34.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.689+0000 7fe1fb9ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe1f40d2130 0x7fe1f40b5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:34.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.689+0000 7fe1fb9ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f414c7d0 con 0x7fe1f40b45d0 2023-06-22T10:54:34.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.689+0000 7fe1fb9ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f4149770 con 0x7fe1f40cd6e0 2023-06-22T10:54:34.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.689+0000 7fe1fb9ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f4149a50 con 0x7fe1f40d2130 2023-06-22T10:54:34.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.689+0000 7fe1f979b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1f40b45d0 0x7fe1f40a9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:34.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.689+0000 7fe1f979b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1f40b45d0 0x7fe1f40a9520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39448/0 (socket says 172.21.15.40:39448) 2023-06-22T10:54:34.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.689+0000 7fe1f979b700 1 -- 172.21.15.40:0/1024884294 learned_addr learned my addr 172.21.15.40:0/1024884294 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:34.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.689+0000 7fe1f8f9a700 1 --2- 172.21.15.40:0/1024884294 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1f40cd6e0 0x7fe1f40b5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:34.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.690+0000 7fe1f9f9c700 1 --2- 172.21.15.40:0/1024884294 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe1f40d2130 0x7fe1f40b5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:34.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.690+0000 7fe1f979b700 1 -- 172.21.15.40:0/1024884294 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe1f40d2130 msgr2=0x7fe1f40b5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:34.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.690+0000 7fe1f979b700 1 --2- 172.21.15.40:0/1024884294 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe1f40d2130 0x7fe1f40b5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:34.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.690+0000 7fe1f979b700 1 -- 172.21.15.40:0/1024884294 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1f40cd6e0 msgr2=0x7fe1f40b5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:34.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.690+0000 7fe1f979b700 1 --2- 172.21.15.40:0/1024884294 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1f40cd6e0 0x7fe1f40b5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:34.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.690+0000 7fe1f979b700 1 -- 172.21.15.40:0/1024884294 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e40094a0 con 0x7fe1f40b45d0 2023-06-22T10:54:34.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.690+0000 7fe1f9f9c700 1 --2- 172.21.15.40:0/1024884294 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe1f40d2130 0x7fe1f40b5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:54:34.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.690+0000 7fe1f979b700 1 --2- 172.21.15.40:0/1024884294 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1f40b45d0 0x7fe1f40a9520 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe1f000c700 tx=0x7fe1f000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:34.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.690+0000 7fe1e9ffb700 1 -- 172.21.15.40:0/1024884294 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f0005d70 con 0x7fe1f40b45d0 2023-06-22T10:54:34.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.690+0000 7fe1e9ffb700 1 -- 172.21.15.40:0/1024884294 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1f00070d0 con 0x7fe1f40b45d0 2023-06-22T10:54:34.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.690+0000 7fe1fb9ff700 1 -- 172.21.15.40:0/1024884294 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1ec009a70 con 0x7fe1f40b45d0 2023-06-22T10:54:34.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.690+0000 7fe1e9ffb700 1 -- 172.21.15.40:0/1024884294 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f0007460 con 0x7fe1f40b45d0 2023-06-22T10:54:34.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.691+0000 7fe1fb9ff700 1 -- 172.21.15.40:0/1024884294 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1f40b6a50 con 0x7fe1f40b45d0 2023-06-22T10:54:34.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.692+0000 7fe1fb9ff700 1 -- 172.21.15.40:0/1024884294 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1f40b5380 con 0x7fe1f40b45d0 2023-06-22T10:54:34.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.692+0000 7fe1e9ffb700 1 -- 172.21.15.40:0/1024884294 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe1f00075c0 con 0x7fe1f40b45d0 2023-06-22T10:54:34.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.693+0000 7fe1e9ffb700 1 --2- 172.21.15.40:0/1024884294 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe1d806ace0 0x7fe1d806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:34.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.694+0000 7fe1e9ffb700 1 -- 172.21.15.40:0/1024884294 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe1f0088e00 con 0x7fe1f40b45d0 2023-06-22T10:54:34.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.694+0000 7fe1f8f9a700 1 --2- 172.21.15.40:0/1024884294 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe1d806ace0 0x7fe1d806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:34.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.694+0000 7fe1f8f9a700 1 --2- 172.21.15.40:0/1024884294 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe1d806ace0 0x7fe1d806d190 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe1f4159840 tx=0x7fe1e4009210 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:34.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.698+0000 7fe1e9ffb700 1 -- 172.21.15.40:0/1024884294 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe1f0053af0 con 0x7fe1f40b45d0 2023-06-22T10:54:34.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.908+0000 7fe1fb9ff700 1 -- 172.21.15.40:0/1024884294 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe1f4067580 con 0x7fe1f40b45d0 2023-06-22T10:54:34.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.908+0000 7fe1e9ffb700 1 -- 172.21.15.40:0/1024884294 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe1f0057110 con 0x7fe1f40b45d0 2023-06-22T10:54:34.912 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-06-22T10:54:34.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.910+0000 7fe1fb9ff700 1 -- 172.21.15.40:0/1024884294 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe1d806ace0 msgr2=0x7fe1d806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:34.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.910+0000 7fe1fb9ff700 1 --2- 172.21.15.40:0/1024884294 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe1d806ace0 0x7fe1d806d190 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe1f4159840 tx=0x7fe1e4009210 comp rx=0 tx=0).stop 2023-06-22T10:54:34.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.910+0000 7fe1fb9ff700 1 -- 172.21.15.40:0/1024884294 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1f40b45d0 msgr2=0x7fe1f40a9520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:34.914 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.910+0000 7fe1fb9ff700 1 --2- 172.21.15.40:0/1024884294 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1f40b45d0 0x7fe1f40a9520 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe1f000c700 tx=0x7fe1f000ca10 comp rx=0 tx=0).stop 2023-06-22T10:54:34.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.911+0000 7fe1fb9ff700 1 -- 172.21.15.40:0/1024884294 shutdown_connections 2023-06-22T10:54:34.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.911+0000 7fe1fb9ff700 1 --2- 172.21.15.40:0/1024884294 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe1d806ace0 0x7fe1d806d190 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:34.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.911+0000 7fe1fb9ff700 1 --2- 172.21.15.40:0/1024884294 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe1f40d2130 0x7fe1f40b5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:34.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.911+0000 7fe1fb9ff700 1 --2- 172.21.15.40:0/1024884294 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1f40b45d0 0x7fe1f40a9520 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:34.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.911+0000 7fe1fb9ff700 1 --2- 172.21.15.40:0/1024884294 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1f40cd6e0 0x7fe1f40b5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:34.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.911+0000 7fe1fb9ff700 1 -- 172.21.15.40:0/1024884294 >> 172.21.15.40:0/1024884294 conn(0x7fe1f40cf5d0 msgr2=0x7fe1f40b3ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:34.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.911+0000 7fe1fb9ff700 1 -- 172.21.15.40:0/1024884294 shutdown_connections 2023-06-22T10:54:34.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:34.911+0000 7fe1fb9ff700 1 -- 172.21.15.40:0/1024884294 wait complete. 2023-06-22T10:54:34.932 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-22T10:54:35.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.134+0000 7f8aaf9ff700 1 Processor -- start 2023-06-22T10:54:35.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.134+0000 7f8aaf9ff700 1 -- start start 2023-06-22T10:54:35.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.135+0000 7f8aaf9ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8aa80d2130 0x7f8aa80cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:35.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.135+0000 7f8aaf9ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8aa80cd6e0 0x7f8aa80b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:35.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.135+0000 7f8aaf9ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aa80d1be0 con 0x7f8aa80b45d0 2023-06-22T10:54:35.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.135+0000 7f8aaf9ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8aa80d17f0 con 0x7f8aa80d2130 2023-06-22T10:54:35.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.135+0000 7f8aaf9ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa80d1360 con 0x7f8aa80cd6e0 2023-06-22T10:54:35.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.136+0000 7f8aad79b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f8aa80b45d0 0x7f8aa80b49a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52036/0 (socket says 172.21.15.40:52036) 2023-06-22T10:54:35.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.136+0000 7f8aad79b700 1 -- 172.21.15.40:0/4106724075 learned_addr learned my addr 172.21.15.40:0/4106724075 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:35.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.136+0000 7f8aadf9c700 1 --2- 172.21.15.40:0/4106724075 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8aa80cd6e0 0x7f8aa80b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:35.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.136+0000 7f8aacf9a700 1 --2- 172.21.15.40:0/4106724075 >> v2:172.21.15.45:3300/0 conn(0x7f8aa80d2130 0x7f8aa80cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:35.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.136+0000 7f8a9ffff700 1 -- 172.21.15.40:0/4106724075 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4242633189 0 0) 0x7f8aa80d1be0 con 0x7f8aa80b45d0 2023-06-22T10:54:35.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.136+0000 7f8a9ffff700 1 -- 172.21.15.40:0/4106724075 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a940035b0 con 0x7f8aa80b45d0 2023-06-22T10:54:35.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.136+0000 7f8a9ffff700 1 -- 172.21.15.40:0/4106724075 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 253606315 0 0) 0x7f8a940035b0 con 0x7f8aa80b45d0 2023-06-22T10:54:35.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.136+0000 7f8a9ffff700 1 -- 172.21.15.40:0/4106724075 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8aa80cd6e0 msgr2=0x7f8aa80b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:35.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.136+0000 7f8a9ffff700 1 --2- 172.21.15.40:0/4106724075 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8aa80cd6e0 0x7f8aa80b59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:35.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.136+0000 7f8a9ffff700 1 -- 172.21.15.40:0/4106724075 >> v2:172.21.15.45:3300/0 conn(0x7f8aa80d2130 msgr2=0x7f8aa80cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:35.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.136+0000 7f8a9ffff700 1 --2- 172.21.15.40:0/4106724075 >> v2:172.21.15.45:3300/0 conn(0x7f8aa80d2130 0x7f8aa80cd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:35.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.136+0000 7f8a9ffff700 1 -- 172.21.15.40:0/4106724075 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa80cef40 con 0x7f8aa80b45d0 2023-06-22T10:54:35.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.136+0000 7f8a9ffff700 1 -- 172.21.15.40:0/4106724075 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1490606486 0 0) 0x7f8aa4001670 con 0x7f8aa80b45d0 2023-06-22T10:54:35.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.136+0000 7f8a9ffff700 1 -- 172.21.15.40:0/4106724075 >> v1:172.21.15.40:6789/0 conn(0x7f8aa80b45d0 legacy=0x7f8aa80b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:35.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.136+0000 7f8a9ffff700 1 --2- 172.21.15.40:0/4106724075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a94003a00 0x7f8a94003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:35.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.137+0000 7f8a9ffff700 1 --2- 172.21.15.40:0/4106724075 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8a94004430 0x7f8a940048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:35.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.137+0000 7f8a9ffff700 1 --2- 172.21.15.40:0/4106724075 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a94004f10 0x7f8a9400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:35.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.137+0000 7f8a9ffff700 1 -- 172.21.15.40:0/4106724075 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa80d17f0 con 0x7f8a94004f10 2023-06-22T10:54:35.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.137+0000 7f8a9ffff700 1 -- 172.21.15.40:0/4106724075 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa80d1360 con 0x7f8a94003a00 2023-06-22T10:54:35.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.137+0000 7f8a9ffff700 1 -- 172.21.15.40:0/4106724075 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9400bf50 con 0x7f8a94004430 2023-06-22T10:54:35.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.137+0000 7f8aacf9a700 1 --2- 172.21.15.40:0/4106724075 >> v2:172.21.15.45:3300/0 conn(0x7f8aa80d2130 0x7f8aa80cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-22T10:54:35.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.137+0000 7f8aadf9c700 1 --2- 172.21.15.40:0/4106724075 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8aa80cd6e0 0x7f8aa80b59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-22T10:54:35.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.137+0000 7f8aad79b700 1 --2- 172.21.15.40:0/4106724075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a94003a00 0x7f8a94003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:35.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.137+0000 7f8aadf9c700 1 --2- 172.21.15.40:0/4106724075 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a94004f10 0x7f8a9400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:35.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.137+0000 7f8aacf9a700 1 --2- 172.21.15.40:0/4106724075 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8a94004430 0x7f8a940048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:35.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.137+0000 7f8aadf9c700 1 -- 172.21.15.40:0/4106724075 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8a94004430 msgr2=0x7f8a940048f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:35.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.137+0000 7f8aadf9c700 1 --2- 172.21.15.40:0/4106724075 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8a94004430 0x7f8a940048f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:35.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.137+0000 7f8aadf9c700 1 -- 172.21.15.40:0/4106724075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a94003a00 msgr2=0x7f8a94003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:35.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.137+0000 7f8aadf9c700 1 --2- 172.21.15.40:0/4106724075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a94003a00 0x7f8a94003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:35.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.137+0000 7f8aadf9c700 1 -- 172.21.15.40:0/4106724075 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a940035b0 con 0x7f8a94004f10 2023-06-22T10:54:35.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.137+0000 7f8aadf9c700 1 --2- 172.21.15.40:0/4106724075 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a94004f10 0x7f8a9400ba10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8aa80cdab0 tx=0x7f8a94005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f401bbbeeb96cea3 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:35.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.138+0000 7f8a9ffff700 1 -- 172.21.15.40:0/4106724075 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa0003c20 con 0x7f8a94004f10 2023-06-22T10:54:35.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.138+0000 7f8a9ffff700 1 -- 172.21.15.40:0/4106724075 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa000f040 con 0x7f8a94004f10 2023-06-22T10:54:35.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.138+0000 7f8a9ffff700 1 -- 172.21.15.40:0/4106724075 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa000ea60 con 0x7f8a94004f10 2023-06-22T10:54:35.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.138+0000 7f8aaf9ff700 1 -- 172.21.15.40:0/4106724075 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a94004f10 msgr2=0x7f8a9400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:35.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.138+0000 7f8aaf9ff700 1 --2- 172.21.15.40:0/4106724075 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a94004f10 0x7f8a9400ba10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8aa80cdab0 tx=0x7f8a94005880 comp rx=0 tx=0).stop 2023-06-22T10:54:35.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.138+0000 7f8aadf9c700 1 -- 172.21.15.40:0/4106724075 reap_dead start 2023-06-22T10:54:35.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.138+0000 7f8aaf9ff700 1 -- 172.21.15.40:0/4106724075 shutdown_connections 2023-06-22T10:54:35.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.138+0000 7f8aaf9ff700 1 -- 172.21.15.40:0/4106724075 >> 172.21.15.40:0/4106724075 conn(0x7f8aa80cf5d0 msgr2=0x7f8aa80cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:35.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.138+0000 7f8aaf9ff700 1 -- 172.21.15.40:0/4106724075 shutdown_connections 2023-06-22T10:54:35.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.138+0000 7f8aaf9ff700 1 -- 172.21.15.40:0/4106724075 wait complete. 2023-06-22T10:54:35.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.141+0000 7f8aaf9ff700 1 Processor -- start 2023-06-22T10:54:35.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.141+0000 7f8aaf9ff700 1 -- start start 2023-06-22T10:54:35.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.142+0000 7f8aaf9ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a94004f10 0x7f8aa81f4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:35.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.142+0000 7f8aaf9ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8aa80c9c20 0x7f8aa80ca090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:35.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.142+0000 7f8aaf9ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8aa80c8400 0x7f8aa80c88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:35.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.142+0000 7f8aaf9ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa8143c70 con 0x7f8aa80c8400 2023-06-22T10:54:35.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.142+0000 7f8aaf9ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa81f5bd0 con 0x7f8a94004f10 2023-06-22T10:54:35.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.142+0000 7f8aaf9ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa80ca5d0 con 0x7f8aa80c9c20 2023-06-22T10:54:35.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.143+0000 7f8aadf9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8aa80c8400 0x7f8aa80c88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:35.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.143+0000 7f8aadf9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8aa80c8400 0x7f8aa80c88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39456/0 (socket says 172.21.15.40:39456) 2023-06-22T10:54:35.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.143+0000 7f8aadf9c700 1 -- 172.21.15.40:0/3890450574 learned_addr learned my addr 172.21.15.40:0/3890450574 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:35.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.143+0000 7f8aad79b700 1 --2- 172.21.15.40:0/3890450574 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a94004f10 0x7f8aa81f4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:35.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.143+0000 7f8aacf9a700 1 --2- 172.21.15.40:0/3890450574 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8aa80c9c20 0x7f8aa80ca090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:35.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.143+0000 7f8aadf9c700 1 -- 172.21.15.40:0/3890450574 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8aa80c9c20 msgr2=0x7f8aa80ca090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:35.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.143+0000 7f8aadf9c700 1 --2- 172.21.15.40:0/3890450574 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8aa80c9c20 0x7f8aa80ca090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:35.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.143+0000 7f8aadf9c700 1 -- 172.21.15.40:0/3890450574 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a94004f10 msgr2=0x7f8aa81f4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:35.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.143+0000 7f8aadf9c700 1 --2- 172.21.15.40:0/3890450574 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a94004f10 0x7f8aa81f4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:35.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.143+0000 7f8aadf9c700 1 -- 172.21.15.40:0/3890450574 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa80c8de0 con 0x7f8aa80c8400 2023-06-22T10:54:35.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.143+0000 7f8aacf9a700 1 --2- 172.21.15.40:0/3890450574 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8aa80c9c20 0x7f8aa80ca090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:54:35.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.143+0000 7f8aad79b700 1 --2- 172.21.15.40:0/3890450574 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a94004f10 0x7f8aa81f4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:54:35.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.143+0000 7f8aadf9c700 1 --2- 172.21.15.40:0/3890450574 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8aa80c8400 0x7f8aa80c88a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0015000 tx=0x7f8aa0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:35.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.144+0000 7f8a9dffb700 1 -- 172.21.15.40:0/3890450574 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa0004230 con 0x7f8aa80c8400 2023-06-22T10:54:35.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.144+0000 7f8a9dffb700 1 -- 172.21.15.40:0/3890450574 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa0023070 con 0x7f8aa80c8400 2023-06-22T10:54:35.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.144+0000 7f8a9dffb700 1 -- 172.21.15.40:0/3890450574 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa00045f0 con 0x7f8aa80c8400 2023-06-22T10:54:35.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.144+0000 7f8aaf9ff700 1 -- 172.21.15.40:0/3890450574 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aa80ca830 con 0x7f8aa80c8400 2023-06-22T10:54:35.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.144+0000 7f8aaf9ff700 1 -- 172.21.15.40:0/3890450574 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aa80cadf0 con 0x7f8aa80c8400 2023-06-22T10:54:35.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.145+0000 7f8aaf9ff700 1 -- 172.21.15.40:0/3890450574 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8aa80b5390 con 0x7f8aa80c8400 2023-06-22T10:54:35.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.146+0000 7f8a9dffb700 1 -- 172.21.15.40:0/3890450574 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8aa0025030 con 0x7f8aa80c8400 2023-06-22T10:54:35.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.147+0000 7f8a9dffb700 1 --2- 172.21.15.40:0/3890450574 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f8a8c06ace0 0x7f8a8c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:35.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.147+0000 7f8a9dffb700 1 -- 172.21.15.40:0/3890450574 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8aa008b0e0 con 0x7f8aa80c8400 2023-06-22T10:54:35.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.147+0000 7f8aad79b700 1 --2- 172.21.15.40:0/3890450574 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f8a8c06ace0 0x7f8a8c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:35.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.147+0000 7f8aad79b700 1 --2- 172.21.15.40:0/3890450574 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f8a8c06ace0 0x7f8a8c06d190 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4000c00 tx=0x7f8aa4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:35.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.151+0000 7f8a9dffb700 1 -- 172.21.15.40:0/3890450574 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8aa0055e50 con 0x7f8aa80c8400 2023-06-22T10:54:35.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.355+0000 7f8aaf9ff700 1 -- 172.21.15.40:0/3890450574 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8aa8067580 con 0x7f8aa80c8400 2023-06-22T10:54:35.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.355+0000 7f8a9dffb700 1 -- 172.21.15.40:0/3890450574 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8aa0059470 con 0x7f8aa80c8400 2023-06-22T10:54:35.359 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 8 2023-06-22T10:54:35.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.358+0000 7f8aaf9ff700 1 -- 172.21.15.40:0/3890450574 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f8a8c06ace0 msgr2=0x7f8a8c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:35.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.358+0000 7f8aaf9ff700 1 --2- 172.21.15.40:0/3890450574 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f8a8c06ace0 0x7f8a8c06d190 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4000c00 tx=0x7f8aa4009040 comp rx=0 tx=0).stop 2023-06-22T10:54:35.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.358+0000 7f8aaf9ff700 1 -- 172.21.15.40:0/3890450574 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8aa80c8400 msgr2=0x7f8aa80c88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:35.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.358+0000 7f8aaf9ff700 1 --2- 172.21.15.40:0/3890450574 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8aa80c8400 0x7f8aa80c88a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0015000 tx=0x7f8aa0009750 comp rx=0 tx=0).stop 2023-06-22T10:54:35.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.358+0000 7f8aaf9ff700 1 -- 172.21.15.40:0/3890450574 shutdown_connections 2023-06-22T10:54:35.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.358+0000 7f8aaf9ff700 1 --2- 172.21.15.40:0/3890450574 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f8a8c06ace0 0x7f8a8c06d190 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:35.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.358+0000 7f8aaf9ff700 1 --2- 172.21.15.40:0/3890450574 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8aa80c8400 0x7f8aa80c88a0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:35.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.358+0000 7f8aaf9ff700 1 --2- 172.21.15.40:0/3890450574 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a94004f10 0x7f8aa81f4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:35.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.358+0000 7f8aaf9ff700 1 --2- 172.21.15.40:0/3890450574 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8aa80c9c20 0x7f8aa80ca090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:35.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.358+0000 7f8aaf9ff700 1 -- 172.21.15.40:0/3890450574 >> 172.21.15.40:0/3890450574 conn(0x7f8aa80cf5d0 msgr2=0x7f8aa80b7990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:35.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.358+0000 7f8aaf9ff700 1 -- 172.21.15.40:0/3890450574 shutdown_connections 2023-06-22T10:54:35.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.358+0000 7f8aaf9ff700 1 -- 172.21.15.40:0/3890450574 wait complete. 2023-06-22T10:54:35.379 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-22T10:54:35.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.580+0000 7f770bfff700 1 Processor -- start 2023-06-22T10:54:35.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.580+0000 7f770bfff700 1 -- start start 2023-06-22T10:54:35.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.581+0000 7f770bfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f77040d2130 0x7f77040cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:35.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.581+0000 7f770bfff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f77040cd6e0 0x7f77040b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:35.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.581+0000 7f770bfff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77040d1be0 con 0x7f77040b45d0 2023-06-22T10:54:35.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.581+0000 7f770bfff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77040d17f0 con 0x7f77040d2130 2023-06-22T10:54:35.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.581+0000 7f770bfff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77040d1360 con 0x7f77040cd6e0 2023-06-22T10:54:35.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.582+0000 7f770959a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f77040d2130 0x7f77040cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:35.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.582+0000 7f7709d9b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f77040b45d0 0x7f77040b49a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52052/0 (socket says 172.21.15.40:52052) 2023-06-22T10:54:35.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.582+0000 7f7709d9b700 1 -- 172.21.15.40:0/4237954615 learned_addr learned my addr 172.21.15.40:0/4237954615 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:35.587 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.582+0000 7f770a59c700 1 --2- 172.21.15.40:0/4237954615 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f77040cd6e0 0x7f77040b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:35.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.582+0000 7f7708d99700 1 -- 172.21.15.40:0/4237954615 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3228855443 0 0) 0x7f77040d1be0 con 0x7f77040b45d0 2023-06-22T10:54:35.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.582+0000 7f7708d99700 1 -- 172.21.15.40:0/4237954615 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76f00035b0 con 0x7f77040b45d0 2023-06-22T10:54:35.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.582+0000 7f770959a700 1 -- 172.21.15.40:0/4237954615 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f77040cd6e0 msgr2=0x7f77040b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:35.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.582+0000 7f770959a700 1 --2- 172.21.15.40:0/4237954615 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f77040cd6e0 0x7f77040b59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:35.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.582+0000 7f770959a700 1 -- 172.21.15.40:0/4237954615 >> v1:172.21.15.40:6789/0 conn(0x7f77040b45d0 legacy=0x7f77040b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:35.588 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.582+0000 7f770959a700 1 -- 172.21.15.40:0/4237954615 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77040cef40 con 0x7f77040d2130 2023-06-22T10:54:35.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.582+0000 7f770959a700 1 --2- 172.21.15.40:0/4237954615 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77040d2130 0x7f77040cd1a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f76f4009840 tx=0x7f76f4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17c31a16b4bfa9ad server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:35.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.583+0000 7f7708d99700 1 -- 172.21.15.40:0/4237954615 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f4011830 con 0x7f77040d2130 2023-06-22T10:54:35.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.583+0000 7f7708d99700 1 -- 172.21.15.40:0/4237954615 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f4011990 con 0x7f77040d2130 2023-06-22T10:54:35.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.583+0000 7f7708d99700 1 -- 172.21.15.40:0/4237954615 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f4011d20 con 0x7f77040d2130 2023-06-22T10:54:35.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.583+0000 7f770bfff700 1 -- 172.21.15.40:0/4237954615 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77040d2130 msgr2=0x7f77040cd1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:35.589 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.583+0000 7f770bfff700 1 --2- 172.21.15.40:0/4237954615 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77040d2130 0x7f77040cd1a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f76f4009840 tx=0x7f76f4009b50 comp rx=0 tx=0).stop 2023-06-22T10:54:35.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.583+0000 7f770bfff700 1 -- 172.21.15.40:0/4237954615 shutdown_connections 2023-06-22T10:54:35.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.583+0000 7f770bfff700 1 --2- 172.21.15.40:0/4237954615 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f77040cd6e0 0x7f77040b59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:35.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.583+0000 7f770bfff700 1 --2- 172.21.15.40:0/4237954615 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77040d2130 0x7f77040cd1a0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:35.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.583+0000 7f770bfff700 1 -- 172.21.15.40:0/4237954615 >> 172.21.15.40:0/4237954615 conn(0x7f77040cf5d0 msgr2=0x7f77040cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:35.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.583+0000 7f770bfff700 1 -- 172.21.15.40:0/4237954615 shutdown_connections 2023-06-22T10:54:35.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.583+0000 7f770bfff700 1 -- 172.21.15.40:0/4237954615 wait complete. 2023-06-22T10:54:35.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.585+0000 7f770bfff700 1 Processor -- start 2023-06-22T10:54:35.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.585+0000 7f770bfff700 1 -- start start 2023-06-22T10:54:35.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.586+0000 7f770bfff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f77040b45d0 0x7f77040ccba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:35.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.586+0000 7f770bfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77040cd6e0 0x7f77041f0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:35.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.586+0000 7f770bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77040d2130 0x7f77041f13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:35.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.586+0000 7f770bfff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77041f1900 con 0x7f77040cd6e0 2023-06-22T10:54:35.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.586+0000 7f770bfff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f770415e610 con 0x7f77040d2130 2023-06-22T10:54:35.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.586+0000 7f770bfff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f770415e8f0 con 0x7f77040b45d0 2023-06-22T10:54:35.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.586+0000 7f770959a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77040cd6e0 0x7f77041f0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:35.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.587+0000 7f770959a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77040cd6e0 0x7f77041f0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39480/0 (socket says 172.21.15.40:39480) 2023-06-22T10:54:35.595 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.587+0000 7f770959a700 1 -- 172.21.15.40:0/2631350031 learned_addr learned my addr 172.21.15.40:0/2631350031 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:35.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.587+0000 7f7709d9b700 1 --2- 172.21.15.40:0/2631350031 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f77040b45d0 0x7f77040ccba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:35.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.587+0000 7f770a59c700 1 --2- 172.21.15.40:0/2631350031 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77040d2130 0x7f77041f13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:35.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.587+0000 7f770959a700 1 -- 172.21.15.40:0/2631350031 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f77040b45d0 msgr2=0x7f77040ccba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:35.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.587+0000 7f770959a700 1 --2- 172.21.15.40:0/2631350031 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f77040b45d0 0x7f77040ccba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:35.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.587+0000 7f770959a700 1 -- 172.21.15.40:0/2631350031 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77040d2130 msgr2=0x7f77041f13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:35.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.587+0000 7f770959a700 1 --2- 172.21.15.40:0/2631350031 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77040d2130 0x7f77041f13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:35.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.587+0000 7f770959a700 1 -- 172.21.15.40:0/2631350031 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f40094a0 con 0x7f77040cd6e0 2023-06-22T10:54:35.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.587+0000 7f770959a700 1 --2- 172.21.15.40:0/2631350031 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77040cd6e0 0x7f77041f0e80 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f76f4000c00 tx=0x7f76f4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:35.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.587+0000 7f76fa7fc700 1 -- 172.21.15.40:0/2631350031 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f40036a0 con 0x7f77040cd6e0 2023-06-22T10:54:35.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.587+0000 7f76fa7fc700 1 -- 172.21.15.40:0/2631350031 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f401f070 con 0x7f77040cd6e0 2023-06-22T10:54:35.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.587+0000 7f76fa7fc700 1 -- 172.21.15.40:0/2631350031 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f4003a20 con 0x7f77040cd6e0 2023-06-22T10:54:35.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.587+0000 7f770bfff700 1 -- 172.21.15.40:0/2631350031 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f770415ebd0 con 0x7f77040cd6e0 2023-06-22T10:54:35.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.588+0000 7f770bfff700 1 -- 172.21.15.40:0/2631350031 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7704148f70 con 0x7f77040cd6e0 2023-06-22T10:54:35.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.589+0000 7f770bfff700 1 -- 172.21.15.40:0/2631350031 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7704149160 con 0x7f77040cd6e0 2023-06-22T10:54:35.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.589+0000 7f76fa7fc700 1 -- 172.21.15.40:0/2631350031 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f76f4003b80 con 0x7f77040cd6e0 2023-06-22T10:54:35.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.590+0000 7f76fa7fc700 1 --2- 172.21.15.40:0/2631350031 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f76e806ace0 0x7f76e806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:35.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.591+0000 7f76fa7fc700 1 -- 172.21.15.40:0/2631350031 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f76f4021070 con 0x7f77040cd6e0 2023-06-22T10:54:35.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.591+0000 7f7709d9b700 1 --2- 172.21.15.40:0/2631350031 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f76e806ace0 0x7f76e806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:35.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.591+0000 7f7709d9b700 1 --2- 172.21.15.40:0/2631350031 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f76e806ace0 0x7f76e806d190 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f77000011e0 tx=0x7f7700009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:35.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.595+0000 7f76fa7fc700 1 -- 172.21.15.40:0/2631350031 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f76f4055db0 con 0x7f77040cd6e0 2023-06-22T10:54:35.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.802+0000 7f770bfff700 1 -- 172.21.15.40:0/2631350031 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7704067580 con 0x7f77040cd6e0 2023-06-22T10:54:35.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.802+0000 7f76fa7fc700 1 -- 172.21.15.40:0/2631350031 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7f76f4015020 con 0x7f77040cd6e0 2023-06-22T10:54:35.807 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-06-22T10:54:35.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.805+0000 7f770bfff700 1 -- 172.21.15.40:0/2631350031 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f76e806ace0 msgr2=0x7f76e806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:35.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.805+0000 7f770bfff700 1 --2- 172.21.15.40:0/2631350031 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f76e806ace0 0x7f76e806d190 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f77000011e0 tx=0x7f7700009040 comp rx=0 tx=0).stop 2023-06-22T10:54:35.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.805+0000 7f770bfff700 1 -- 172.21.15.40:0/2631350031 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77040cd6e0 msgr2=0x7f77041f0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:35.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.805+0000 7f770bfff700 1 --2- 172.21.15.40:0/2631350031 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77040cd6e0 0x7f77041f0e80 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f76f4000c00 tx=0x7f76f4004750 comp rx=0 tx=0).stop 2023-06-22T10:54:35.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.805+0000 7f770bfff700 1 -- 172.21.15.40:0/2631350031 shutdown_connections 2023-06-22T10:54:35.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.805+0000 7f770bfff700 1 --2- 172.21.15.40:0/2631350031 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f76e806ace0 0x7f76e806d190 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:35.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.805+0000 7f770bfff700 1 --2- 172.21.15.40:0/2631350031 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f77040b45d0 0x7f77040ccba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:35.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.805+0000 7f770bfff700 1 --2- 172.21.15.40:0/2631350031 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77040d2130 0x7f77041f13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:35.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.805+0000 7f770bfff700 1 --2- 172.21.15.40:0/2631350031 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77040cd6e0 0x7f77041f0e80 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:35.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.805+0000 7f770bfff700 1 -- 172.21.15.40:0/2631350031 >> 172.21.15.40:0/2631350031 conn(0x7f77040cf5d0 msgr2=0x7f77040b3c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:35.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.805+0000 7f770bfff700 1 -- 172.21.15.40:0/2631350031 shutdown_connections 2023-06-22T10:54:35.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:35.805+0000 7f770bfff700 1 -- 172.21.15.40:0/2631350031 wait complete. 2023-06-22T10:54:35.827 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-22T10:54:36.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.031+0000 7fa493dff700 1 Processor -- start 2023-06-22T10:54:36.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.031+0000 7fa493dff700 1 -- start start 2023-06-22T10:54:36.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.032+0000 7fa493dff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa48c0b45d0 0x7fa48c0b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:36.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.032+0000 7fa493dff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa48c0b59a0 0x7fa48c0b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:36.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.032+0000 7fa493dff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa48c0d1be0 con 0x7fa48c0d2130 2023-06-22T10:54:36.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.032+0000 7fa493dff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa48c0d17f0 con 0x7fa48c0b45d0 2023-06-22T10:54:36.036 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.032+0000 7fa493dff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa48c0d1360 con 0x7fa48c0b59a0 2023-06-22T10:54:36.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.033+0000 7fa491b9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa48c0b45d0 0x7fa48c0b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:36.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.033+0000 7fa49139a700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa48c0d2130 0x7fa48c0cd1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52054/0 (socket says 172.21.15.40:52054) 2023-06-22T10:54:36.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.033+0000 7fa49139a700 1 -- 172.21.15.40:0/2687923117 learned_addr learned my addr 172.21.15.40:0/2687923117 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:36.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.033+0000 7fa49239c700 1 --2- 172.21.15.40:0/2687923117 >> v2:172.21.15.45:3300/0 conn(0x7fa48c0b59a0 0x7fa48c0b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:36.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.033+0000 7fa491b9b700 1 -- 172.21.15.40:0/2687923117 >> v2:172.21.15.45:3300/0 conn(0x7fa48c0b59a0 msgr2=0x7fa48c0b5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:36.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.033+0000 7fa491b9b700 1 --2- 172.21.15.40:0/2687923117 >> v2:172.21.15.45:3300/0 conn(0x7fa48c0b59a0 0x7fa48c0b5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:36.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.033+0000 7fa491b9b700 1 -- 172.21.15.40:0/2687923117 >> v1:172.21.15.40:6789/0 conn(0x7fa48c0d2130 legacy=0x7fa48c0cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:36.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.033+0000 7fa491b9b700 1 -- 172.21.15.40:0/2687923117 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa48c0b4ee0 con 0x7fa48c0b45d0 2023-06-22T10:54:36.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.033+0000 7fa49239c700 1 --2- 172.21.15.40:0/2687923117 >> v2:172.21.15.45:3300/0 conn(0x7fa48c0b59a0 0x7fa48c0b5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-22T10:54:36.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.033+0000 7fa491b9b700 1 --2- 172.21.15.40:0/2687923117 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa48c0b45d0 0x7fa48c0b49a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa48c0b1aa0 tx=0x7fa488009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9c79d99f95cbbfb server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:36.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.034+0000 7fa490b99700 1 -- 172.21.15.40:0/2687923117 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa488011830 con 0x7fa48c0b45d0 2023-06-22T10:54:36.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.034+0000 7fa490b99700 1 -- 172.21.15.40:0/2687923117 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa488011990 con 0x7fa48c0b45d0 2023-06-22T10:54:36.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.034+0000 7fa490b99700 1 -- 172.21.15.40:0/2687923117 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa488011d20 con 0x7fa48c0b45d0 2023-06-22T10:54:36.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.034+0000 7fa493dff700 1 -- 172.21.15.40:0/2687923117 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa48c0b45d0 msgr2=0x7fa48c0b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:36.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.034+0000 7fa493dff700 1 --2- 172.21.15.40:0/2687923117 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa48c0b45d0 0x7fa48c0b49a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa48c0b1aa0 tx=0x7fa488009b20 comp rx=0 tx=0).stop 2023-06-22T10:54:36.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.034+0000 7fa493dff700 1 -- 172.21.15.40:0/2687923117 shutdown_connections 2023-06-22T10:54:36.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.034+0000 7fa493dff700 1 --2- 172.21.15.40:0/2687923117 >> v2:172.21.15.45:3300/0 conn(0x7fa48c0b59a0 0x7fa48c0b5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:36.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.034+0000 7fa493dff700 1 --2- 172.21.15.40:0/2687923117 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa48c0b45d0 0x7fa48c0b49a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:36.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.034+0000 7fa493dff700 1 -- 172.21.15.40:0/2687923117 >> 172.21.15.40:0/2687923117 conn(0x7fa48c0cf5d0 msgr2=0x7fa48c0cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:36.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.034+0000 7fa493dff700 1 -- 172.21.15.40:0/2687923117 shutdown_connections 2023-06-22T10:54:36.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.034+0000 7fa493dff700 1 -- 172.21.15.40:0/2687923117 wait complete. 2023-06-22T10:54:36.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.036+0000 7fa493dff700 1 Processor -- start 2023-06-22T10:54:36.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.036+0000 7fa493dff700 1 -- start start 2023-06-22T10:54:36.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.037+0000 7fa493dff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa48c0b45d0 0x7fa48c14db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:36.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.037+0000 7fa493dff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa48c0b59a0 0x7fa48c1f2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:36.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.037+0000 7fa493dff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa48c0d2130 0x7fa48c15d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:36.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.037+0000 7fa493dff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48c0c9c20 con 0x7fa48c0b45d0 2023-06-22T10:54:36.043 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.037+0000 7fa493dff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48c0c9e70 con 0x7fa48c0b59a0 2023-06-22T10:54:36.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.037+0000 7fa493dff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa48c0ca150 con 0x7fa48c0d2130 2023-06-22T10:54:36.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.037+0000 7fa491b9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa48c0b45d0 0x7fa48c14db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:36.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.037+0000 7fa491b9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa48c0b45d0 0x7fa48c14db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39492/0 (socket says 172.21.15.40:39492) 2023-06-22T10:54:36.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.037+0000 7fa491b9b700 1 -- 172.21.15.40:0/3268863452 learned_addr learned my addr 172.21.15.40:0/3268863452 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:36.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.038+0000 7fa49139a700 1 --2- 172.21.15.40:0/3268863452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa48c0b59a0 0x7fa48c1f2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:36.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.038+0000 7fa49239c700 1 --2- 172.21.15.40:0/3268863452 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa48c0d2130 0x7fa48c15d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:36.044 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.038+0000 7fa491b9b700 1 -- 172.21.15.40:0/3268863452 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa48c0d2130 msgr2=0x7fa48c15d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:36.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.038+0000 7fa491b9b700 1 --2- 172.21.15.40:0/3268863452 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa48c0d2130 0x7fa48c15d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:36.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.038+0000 7fa491b9b700 1 -- 172.21.15.40:0/3268863452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa48c0b59a0 msgr2=0x7fa48c1f2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:36.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.038+0000 7fa491b9b700 1 --2- 172.21.15.40:0/3268863452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa48c0b59a0 0x7fa48c1f2e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:36.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.038+0000 7fa491b9b700 1 -- 172.21.15.40:0/3268863452 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4880094a0 con 0x7fa48c0b45d0 2023-06-22T10:54:36.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.038+0000 7fa491b9b700 1 --2- 172.21.15.40:0/3268863452 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa48c0b45d0 0x7fa48c14db50 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa4880090b0 tx=0x7fa488004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:36.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.038+0000 7fa4827fc700 1 -- 172.21.15.40:0/3268863452 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4880038a0 con 0x7fa48c0b45d0 2023-06-22T10:54:36.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.038+0000 7fa4827fc700 1 -- 172.21.15.40:0/3268863452 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa48801e070 con 0x7fa48c0b45d0 2023-06-22T10:54:36.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.038+0000 7fa4827fc700 1 -- 172.21.15.40:0/3268863452 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa488003c40 con 0x7fa48c0b45d0 2023-06-22T10:54:36.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.038+0000 7fa493dff700 1 -- 172.21.15.40:0/3268863452 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa48c0ca430 con 0x7fa48c0b45d0 2023-06-22T10:54:36.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.038+0000 7fa493dff700 1 -- 172.21.15.40:0/3268863452 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa48c15ddd0 con 0x7fa48c0b45d0 2023-06-22T10:54:36.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.039+0000 7fa493dff700 1 -- 172.21.15.40:0/3268863452 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa48c0ca950 con 0x7fa48c0b45d0 2023-06-22T10:54:36.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.040+0000 7fa4827fc700 1 -- 172.21.15.40:0/3268863452 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa48802d450 con 0x7fa48c0b45d0 2023-06-22T10:54:36.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.041+0000 7fa4827fc700 1 --2- 172.21.15.40:0/3268863452 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fa47006ace0 0x7fa47006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:36.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.041+0000 7fa4827fc700 1 -- 172.21.15.40:0/3268863452 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa48808a960 con 0x7fa48c0b45d0 2023-06-22T10:54:36.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.042+0000 7fa49139a700 1 --2- 172.21.15.40:0/3268863452 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fa47006ace0 0x7fa47006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:36.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.042+0000 7fa49139a700 1 --2- 172.21.15.40:0/3268863452 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fa47006ace0 0x7fa47006d190 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa47c005910 tx=0x7fa47c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:36.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.045+0000 7fa4827fc700 1 -- 172.21.15.40:0/3268863452 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa48c0ca950 con 0x7fa48c0b45d0 2023-06-22T10:54:36.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.250+0000 7fa493dff700 1 -- 172.21.15.40:0/3268863452 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa48c0ca950 con 0x7fa48c0b45d0 2023-06-22T10:54:36.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.251+0000 7fa4827fc700 1 -- 172.21.15.40:0/3268863452 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa48c0ca950 con 0x7fa48c0b45d0 2023-06-22T10:54:36.254 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-06-22T10:54:36.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.253+0000 7fa493dff700 1 -- 172.21.15.40:0/3268863452 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fa47006ace0 msgr2=0x7fa47006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:36.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.253+0000 7fa493dff700 1 --2- 172.21.15.40:0/3268863452 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fa47006ace0 0x7fa47006d190 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa47c005910 tx=0x7fa47c009040 comp rx=0 tx=0).stop 2023-06-22T10:54:36.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.253+0000 7fa493dff700 1 -- 172.21.15.40:0/3268863452 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa48c0b45d0 msgr2=0x7fa48c14db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:36.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.253+0000 7fa493dff700 1 --2- 172.21.15.40:0/3268863452 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa48c0b45d0 0x7fa48c14db50 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa4880090b0 tx=0x7fa488004750 comp rx=0 tx=0).stop 2023-06-22T10:54:36.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.253+0000 7fa493dff700 1 -- 172.21.15.40:0/3268863452 shutdown_connections 2023-06-22T10:54:36.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.253+0000 7fa493dff700 1 --2- 172.21.15.40:0/3268863452 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fa47006ace0 0x7fa47006d190 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:36.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.253+0000 7fa493dff700 1 --2- 172.21.15.40:0/3268863452 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa48c0d2130 0x7fa48c15d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:36.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.253+0000 7fa493dff700 1 --2- 172.21.15.40:0/3268863452 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa48c0b45d0 0x7fa48c14db50 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:36.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.253+0000 7fa493dff700 1 --2- 172.21.15.40:0/3268863452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa48c0b59a0 0x7fa48c1f2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:36.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.253+0000 7fa493dff700 1 -- 172.21.15.40:0/3268863452 >> 172.21.15.40:0/3268863452 conn(0x7fa48c0cf5d0 msgr2=0x7fa48c15b910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:36.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.253+0000 7fa493dff700 1 -- 172.21.15.40:0/3268863452 shutdown_connections 2023-06-22T10:54:36.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.253+0000 7fa493dff700 1 -- 172.21.15.40:0/3268863452 wait complete. 2023-06-22T10:54:36.274 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-22T10:54:36.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.475+0000 7f7e841ff700 1 Processor -- start 2023-06-22T10:54:36.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.476+0000 7f7e841ff700 1 -- start start 2023-06-22T10:54:36.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.477+0000 7f7e841ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f7e7c0d2130 0x7f7e7c0cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:36.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.477+0000 7f7e841ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e7c0d1be0 con 0x7f7e7c0cd6e0 2023-06-22T10:54:36.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.477+0000 7f7e841ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e7c0d1360 con 0x7f7e7c0b45d0 2023-06-22T10:54:36.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.477+0000 7f7e841ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7c0d17f0 con 0x7f7e7c0d2130 2023-06-22T10:54:36.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.477+0000 7f7e8279c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f7e7c0cd6e0 0x7f7e7c0b59a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52062/0 (socket says 172.21.15.40:52062) 2023-06-22T10:54:36.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.477+0000 7f7e8279c700 1 -- 172.21.15.40:0/121502228 learned_addr learned my addr 172.21.15.40:0/121502228 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:36.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.477+0000 7f7e8179a700 1 --2- 172.21.15.40:0/121502228 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f7e7c0d2130 0x7f7e7c0cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:36.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.478+0000 7f7e80f99700 1 -- 172.21.15.40:0/121502228 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1816924149 0 0) 0x7f7e7c0d1be0 con 0x7f7e7c0cd6e0 2023-06-22T10:54:36.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.478+0000 7f7e80f99700 1 -- 172.21.15.40:0/121502228 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e680035b0 con 0x7f7e7c0cd6e0 2023-06-22T10:54:36.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.478+0000 7f7e80f99700 1 -- 172.21.15.40:0/121502228 <== mon.1 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 515860869 0 0) 0x7f7e7c0d1360 con 0x7f7e7c0b45d0 2023-06-22T10:54:36.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.478+0000 7f7e80f99700 1 -- 172.21.15.40:0/121502228 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e7c0d1be0 con 0x7f7e7c0b45d0 2023-06-22T10:54:36.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.478+0000 7f7e8179a700 1 -- 172.21.15.40:0/121502228 >> v1:172.21.15.45:6789/0 conn(0x7f7e7c0b45d0 legacy=0x7f7e7c0b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:36.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.478+0000 7f7e8179a700 1 -- 172.21.15.40:0/121502228 >> v1:172.21.15.40:6789/0 conn(0x7f7e7c0cd6e0 legacy=0x7f7e7c0b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:36.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.478+0000 7f7e8179a700 1 -- 172.21.15.40:0/121502228 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e7c0cef40 con 0x7f7e7c0d2130 2023-06-22T10:54:36.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.478+0000 7f7e8179a700 1 --2- 172.21.15.40:0/121502228 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f7e7c0d2130 0x7f7e7c0cd1a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c009870 tx=0x7f7e6c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=694eacbdb3249b8a server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:36.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.479+0000 7f7e80f99700 1 -- 172.21.15.40:0/121502228 <== mon.2 v2:172.21.15.45:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c011830 con 0x7f7e7c0d2130 2023-06-22T10:54:36.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.479+0000 7f7e80f99700 1 -- 172.21.15.40:0/121502228 <== mon.2 v2:172.21.15.45:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e6c011990 con 0x7f7e7c0d2130 2023-06-22T10:54:36.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.479+0000 7f7e80f99700 1 -- 172.21.15.40:0/121502228 <== mon.2 v2:172.21.15.45:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c011d20 con 0x7f7e7c0d2130 2023-06-22T10:54:36.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.479+0000 7f7e841ff700 1 -- 172.21.15.40:0/121502228 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f7e7c0d2130 msgr2=0x7f7e7c0cd1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:36.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.479+0000 7f7e841ff700 1 --2- 172.21.15.40:0/121502228 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f7e7c0d2130 0x7f7e7c0cd1a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c009870 tx=0x7f7e6c009b80 comp rx=0 tx=0).stop 2023-06-22T10:54:36.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.479+0000 7f7e841ff700 1 -- 172.21.15.40:0/121502228 shutdown_connections 2023-06-22T10:54:36.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.479+0000 7f7e841ff700 1 --2- 172.21.15.40:0/121502228 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f7e7c0d2130 0x7f7e7c0cd1a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:36.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.479+0000 7f7e841ff700 1 -- 172.21.15.40:0/121502228 >> 172.21.15.40:0/121502228 conn(0x7f7e7c0cf5d0 msgr2=0x7f7e7c0cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:36.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.479+0000 7f7e841ff700 1 -- 172.21.15.40:0/121502228 shutdown_connections 2023-06-22T10:54:36.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.479+0000 7f7e841ff700 1 -- 172.21.15.40:0/121502228 wait complete. 2023-06-22T10:54:36.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.482+0000 7f7e841ff700 1 Processor -- start 2023-06-22T10:54:36.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.482+0000 7f7e841ff700 1 -- start start 2023-06-22T10:54:36.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.483+0000 7f7e841ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e7c0b45d0 0x7f7e7c147300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:36.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.483+0000 7f7e841ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f7e7c0cd6e0 0x7f7e7c147840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:36.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.483+0000 7f7e841ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e7c0d2130 0x7f7e7c1f4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:36.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.483+0000 7f7e841ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7c145410 con 0x7f7e7c0b45d0 2023-06-22T10:54:36.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.483+0000 7f7e841ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7c1456f0 con 0x7f7e7c0d2130 2023-06-22T10:54:36.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.483+0000 7f7e841ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7c1459d0 con 0x7f7e7c0cd6e0 2023-06-22T10:54:36.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.483+0000 7f7e81f9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e7c0b45d0 0x7f7e7c147300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:36.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.484+0000 7f7e81f9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e7c0b45d0 0x7f7e7c147300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39508/0 (socket says 172.21.15.40:39508) 2023-06-22T10:54:36.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.484+0000 7f7e81f9b700 1 -- 172.21.15.40:0/1340338488 learned_addr learned my addr 172.21.15.40:0/1340338488 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:36.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.484+0000 7f7e8279c700 1 --2- 172.21.15.40:0/1340338488 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e7c0d2130 0x7f7e7c1f4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:36.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.484+0000 7f7e8179a700 1 --2- 172.21.15.40:0/1340338488 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f7e7c0cd6e0 0x7f7e7c147840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:36.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.484+0000 7f7e81f9b700 1 -- 172.21.15.40:0/1340338488 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f7e7c0cd6e0 msgr2=0x7f7e7c147840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:36.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.484+0000 7f7e81f9b700 1 --2- 172.21.15.40:0/1340338488 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f7e7c0cd6e0 0x7f7e7c147840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:36.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.484+0000 7f7e81f9b700 1 -- 172.21.15.40:0/1340338488 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e7c0d2130 msgr2=0x7f7e7c1f4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:36.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.484+0000 7f7e81f9b700 1 --2- 172.21.15.40:0/1340338488 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e7c0d2130 0x7f7e7c1f4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:36.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.484+0000 7f7e81f9b700 1 -- 172.21.15.40:0/1340338488 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e6c0094a0 con 0x7f7e7c0b45d0 2023-06-22T10:54:36.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.484+0000 7f7e8279c700 1 --2- 172.21.15.40:0/1340338488 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e7c0d2130 0x7f7e7c1f4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:54:36.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.484+0000 7f7e81f9b700 1 --2- 172.21.15.40:0/1340338488 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e7c0b45d0 0x7f7e7c147300 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7e7800c520 tx=0x7f7e7800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:36.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.484+0000 7f7e727fc700 1 -- 172.21.15.40:0/1340338488 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e780052d0 con 0x7f7e7c0b45d0 2023-06-22T10:54:36.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.484+0000 7f7e727fc700 1 -- 172.21.15.40:0/1340338488 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e78005430 con 0x7f7e7c0b45d0 2023-06-22T10:54:36.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.484+0000 7f7e841ff700 1 -- 172.21.15.40:0/1340338488 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e7c145cb0 con 0x7f7e7c0b45d0 2023-06-22T10:54:36.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.484+0000 7f7e727fc700 1 -- 172.21.15.40:0/1340338488 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e780038c0 con 0x7f7e7c0b45d0 2023-06-22T10:54:36.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.485+0000 7f7e841ff700 1 -- 172.21.15.40:0/1340338488 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e7c148940 con 0x7f7e7c0b45d0 2023-06-22T10:54:36.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.486+0000 7f7e841ff700 1 -- 172.21.15.40:0/1340338488 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e7c145550 con 0x7f7e7c0b45d0 2023-06-22T10:54:36.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.487+0000 7f7e727fc700 1 -- 172.21.15.40:0/1340338488 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7e78003a20 con 0x7f7e7c0b45d0 2023-06-22T10:54:36.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.488+0000 7f7e727fc700 1 --2- 172.21.15.40:0/1340338488 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f7e6006ace0 0x7f7e6006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:36.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.488+0000 7f7e727fc700 1 -- 172.21.15.40:0/1340338488 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7e78088e60 con 0x7f7e7c0b45d0 2023-06-22T10:54:36.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.488+0000 7f7e8179a700 1 --2- 172.21.15.40:0/1340338488 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f7e6006ace0 0x7f7e6006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:36.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.488+0000 7f7e8179a700 1 --2- 172.21.15.40:0/1340338488 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f7e6006ace0 0x7f7e6006d190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c0097c0 tx=0x7f7e6c01c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:36.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.492+0000 7f7e727fc700 1 -- 172.21.15.40:0/1340338488 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7e7c145550 con 0x7f7e7c0b45d0 2023-06-22T10:54:36.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.697+0000 7f7e841ff700 1 -- 172.21.15.40:0/1340338488 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f7e7c145550 con 0x7f7e7c0b45d0 2023-06-22T10:54:36.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.697+0000 7f7e727fc700 1 -- 172.21.15.40:0/1340338488 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7e78017020 con 0x7f7e7c0b45d0 2023-06-22T10:54:36.701 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-06-22T10:54:36.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.700+0000 7f7e841ff700 1 -- 172.21.15.40:0/1340338488 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f7e6006ace0 msgr2=0x7f7e6006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:36.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.700+0000 7f7e841ff700 1 --2- 172.21.15.40:0/1340338488 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f7e6006ace0 0x7f7e6006d190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c0097c0 tx=0x7f7e6c01c040 comp rx=0 tx=0).stop 2023-06-22T10:54:36.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.700+0000 7f7e841ff700 1 -- 172.21.15.40:0/1340338488 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e7c0b45d0 msgr2=0x7f7e7c147300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:36.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.700+0000 7f7e841ff700 1 --2- 172.21.15.40:0/1340338488 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e7c0b45d0 0x7f7e7c147300 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7e7800c520 tx=0x7f7e7800c8e0 comp rx=0 tx=0).stop 2023-06-22T10:54:36.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.700+0000 7f7e841ff700 1 -- 172.21.15.40:0/1340338488 shutdown_connections 2023-06-22T10:54:36.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.700+0000 7f7e841ff700 1 --2- 172.21.15.40:0/1340338488 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f7e6006ace0 0x7f7e6006d190 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:36.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.700+0000 7f7e841ff700 1 --2- 172.21.15.40:0/1340338488 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e7c0d2130 0x7f7e7c1f4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:36.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.700+0000 7f7e841ff700 1 --2- 172.21.15.40:0/1340338488 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e7c0b45d0 0x7f7e7c147300 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:36.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.700+0000 7f7e841ff700 1 --2- 172.21.15.40:0/1340338488 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f7e7c0cd6e0 0x7f7e7c147840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:36.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.700+0000 7f7e841ff700 1 -- 172.21.15.40:0/1340338488 >> 172.21.15.40:0/1340338488 conn(0x7f7e7c0cf5d0 msgr2=0x7f7e7c159900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:36.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.700+0000 7f7e841ff700 1 -- 172.21.15.40:0/1340338488 shutdown_connections 2023-06-22T10:54:36.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.700+0000 7f7e841ff700 1 -- 172.21.15.40:0/1340338488 wait complete. 2023-06-22T10:54:36.722 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-22T10:54:36.922 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.919+0000 7f580d9ff700 1 Processor -- start 2023-06-22T10:54:36.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.919+0000 7f580d9ff700 1 -- start start 2023-06-22T10:54:36.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.920+0000 7f580d9ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f580815c720 0x7f58080b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:36.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.920+0000 7f580d9ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f58080d2830 0x7f58080b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:36.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.921+0000 7f580d9ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58080b50a0 con 0x7f58080b4c60 2023-06-22T10:54:36.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.921+0000 7f580d9ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5808160d60 con 0x7f58080d2830 2023-06-22T10:54:36.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.921+0000 7f580d9ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58080b2130 con 0x7f580815c720 2023-06-22T10:54:36.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.921+0000 7f58067fc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f58080d2830 0x7f58080b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:36.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.921+0000 7f58077fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f58080b4c60 0x7f580806b4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52068/0 (socket says 172.21.15.40:52068) 2023-06-22T10:54:36.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.921+0000 7f58077fe700 1 -- 172.21.15.40:0/1893318633 learned_addr learned my addr 172.21.15.40:0/1893318633 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:36.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.921+0000 7f5806ffd700 1 --2- 172.21.15.40:0/1893318633 >> v2:172.21.15.45:3300/0 conn(0x7f580815c720 0x7f58080b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:36.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.921+0000 7f5805ffb700 1 -- 172.21.15.40:0/1893318633 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 386649782 0 0) 0x7f58080b50a0 con 0x7f58080b4c60 2023-06-22T10:54:36.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.921+0000 7f5805ffb700 1 -- 172.21.15.40:0/1893318633 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57f00035b0 con 0x7f58080b4c60 2023-06-22T10:54:36.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.921+0000 7f58067fc700 1 -- 172.21.15.40:0/1893318633 >> v2:172.21.15.45:3300/0 conn(0x7f580815c720 msgr2=0x7f58080b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:36.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.921+0000 7f58067fc700 1 --2- 172.21.15.40:0/1893318633 >> v2:172.21.15.45:3300/0 conn(0x7f580815c720 0x7f58080b1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:36.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.921+0000 7f58067fc700 1 -- 172.21.15.40:0/1893318633 >> v1:172.21.15.40:6789/0 conn(0x7f58080b4c60 legacy=0x7f580806b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:36.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.921+0000 7f58067fc700 1 -- 172.21.15.40:0/1893318633 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5808161180 con 0x7f58080d2830 2023-06-22T10:54:36.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.921+0000 7f5806ffd700 1 --2- 172.21.15.40:0/1893318633 >> v2:172.21.15.45:3300/0 conn(0x7f580815c720 0x7f58080b1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:54:36.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.922+0000 7f58067fc700 1 --2- 172.21.15.40:0/1893318633 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58080d2830 0x7f58080b4720 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f57fc009840 tx=0x7f57fc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87aa6873eab7e43c server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:36.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.922+0000 7f5805ffb700 1 -- 172.21.15.40:0/1893318633 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57fc011830 con 0x7f58080d2830 2023-06-22T10:54:36.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.922+0000 7f5805ffb700 1 -- 172.21.15.40:0/1893318633 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57fc011990 con 0x7f58080d2830 2023-06-22T10:54:36.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.922+0000 7f5805ffb700 1 -- 172.21.15.40:0/1893318633 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57fc011d20 con 0x7f58080d2830 2023-06-22T10:54:36.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.922+0000 7f580d9ff700 1 -- 172.21.15.40:0/1893318633 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58080d2830 msgr2=0x7f58080b4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:36.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.922+0000 7f580d9ff700 1 --2- 172.21.15.40:0/1893318633 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58080d2830 0x7f58080b4720 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f57fc009840 tx=0x7f57fc009b50 comp rx=0 tx=0).stop 2023-06-22T10:54:36.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.922+0000 7f580d9ff700 1 -- 172.21.15.40:0/1893318633 shutdown_connections 2023-06-22T10:54:36.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.922+0000 7f580d9ff700 1 --2- 172.21.15.40:0/1893318633 >> v2:172.21.15.45:3300/0 conn(0x7f580815c720 0x7f58080b1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:36.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.922+0000 7f580d9ff700 1 --2- 172.21.15.40:0/1893318633 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58080d2830 0x7f58080b4720 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:36.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.922+0000 7f580d9ff700 1 -- 172.21.15.40:0/1893318633 >> 172.21.15.40:0/1893318633 conn(0x7f58080cf720 msgr2=0x7f58080cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:36.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.923+0000 7f580d9ff700 1 -- 172.21.15.40:0/1893318633 shutdown_connections 2023-06-22T10:54:36.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.923+0000 7f580d9ff700 1 -- 172.21.15.40:0/1893318633 wait complete. 2023-06-22T10:54:36.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.924+0000 7f580d9ff700 1 Processor -- start 2023-06-22T10:54:36.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.924+0000 7f580d9ff700 1 -- start start 2023-06-22T10:54:36.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.925+0000 7f580d9ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58080b4c60 0x7f580815caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:36.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.925+0000 7f580d9ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58080d2830 0x7f58081f1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:36.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.925+0000 7f580d9ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f580815c720 0x7f58080cc170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:36.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.925+0000 7f580d9ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58080cb960 con 0x7f58080d2830 2023-06-22T10:54:36.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.925+0000 7f580d9ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f580815d030 con 0x7f58080b4c60 2023-06-22T10:54:36.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.925+0000 7f580d9ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58080b1390 con 0x7f580815c720 2023-06-22T10:54:36.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.926+0000 7f58067fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58080d2830 0x7f58081f1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:36.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.926+0000 7f58067fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58080d2830 0x7f58081f1d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39524/0 (socket says 172.21.15.40:39524) 2023-06-22T10:54:36.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.926+0000 7f58067fc700 1 -- 172.21.15.40:0/417930878 learned_addr learned my addr 172.21.15.40:0/417930878 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:36.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.926+0000 7f5806ffd700 1 --2- 172.21.15.40:0/417930878 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58080b4c60 0x7f580815caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:36.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.926+0000 7f58077fe700 1 --2- 172.21.15.40:0/417930878 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f580815c720 0x7f58080cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:36.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.926+0000 7f58067fc700 1 -- 172.21.15.40:0/417930878 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f580815c720 msgr2=0x7f58080cc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:36.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.926+0000 7f58067fc700 1 --2- 172.21.15.40:0/417930878 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f580815c720 0x7f58080cc170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:36.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.926+0000 7f58067fc700 1 -- 172.21.15.40:0/417930878 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58080b4c60 msgr2=0x7f580815caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:36.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.926+0000 7f58067fc700 1 --2- 172.21.15.40:0/417930878 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58080b4c60 0x7f580815caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:36.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.926+0000 7f58067fc700 1 -- 172.21.15.40:0/417930878 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57fc0094a0 con 0x7f58080d2830 2023-06-22T10:54:36.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.926+0000 7f5806ffd700 1 --2- 172.21.15.40:0/417930878 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58080b4c60 0x7f580815caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:54:36.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.926+0000 7f58067fc700 1 --2- 172.21.15.40:0/417930878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58080d2830 0x7f58081f1d70 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f57fc0090b0 tx=0x7f57fc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:36.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.926+0000 7f57effff700 1 -- 172.21.15.40:0/417930878 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57fc0036a0 con 0x7f58080d2830 2023-06-22T10:54:36.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.927+0000 7f57effff700 1 -- 172.21.15.40:0/417930878 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57fc01e070 con 0x7f58080d2830 2023-06-22T10:54:36.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.927+0000 7f580d9ff700 1 -- 172.21.15.40:0/417930878 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58080cbbb0 con 0x7f58080d2830 2023-06-22T10:54:36.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.927+0000 7f57effff700 1 -- 172.21.15.40:0/417930878 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57fc003a60 con 0x7f58080d2830 2023-06-22T10:54:36.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.927+0000 7f580d9ff700 1 -- 172.21.15.40:0/417930878 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58081f28f0 con 0x7f58080d2830 2023-06-22T10:54:36.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.928+0000 7f580d9ff700 1 -- 172.21.15.40:0/417930878 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5808067580 con 0x7f58080d2830 2023-06-22T10:54:36.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.929+0000 7f57effff700 1 -- 172.21.15.40:0/417930878 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f57fc003bc0 con 0x7f58080d2830 2023-06-22T10:54:36.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.930+0000 7f57effff700 1 --2- 172.21.15.40:0/417930878 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f57f406ace0 0x7f57f406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:36.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.930+0000 7f57effff700 1 -- 172.21.15.40:0/417930878 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f57fc08a710 con 0x7f58080d2830 2023-06-22T10:54:36.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.930+0000 7f5806ffd700 1 --2- 172.21.15.40:0/417930878 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f57f406ace0 0x7f57f406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:36.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.931+0000 7f5806ffd700 1 --2- 172.21.15.40:0/417930878 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f57f406ace0 0x7f57f406d190 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f58080b2010 tx=0x7f57f8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:36.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:36.934+0000 7f57effff700 1 -- 172.21.15.40:0/417930878 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f57fc055480 con 0x7f58080d2830 2023-06-22T10:54:37.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.144+0000 7f580d9ff700 1 -- 172.21.15.40:0/417930878 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f58080d2100 con 0x7f58080d2830 2023-06-22T10:54:37.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.145+0000 7f57effff700 1 -- 172.21.15.40:0/417930878 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20132 (secure 0 0 0) 0x7f57fc058aa0 con 0x7f58080d2830 2023-06-22T10:54:37.149 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:54:37.149 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":30,"fsid":"475560bc-1a7c-4a75-b3b6-6fc6b20bdc52","created":"2023-06-22T10:53:03.784568+0000","modified":"2023-06-22T10:54:12.717204+0000","last_up_change":"2023-06-22T10:53:17.830348+0000","last_in_change":"2023-06-22T10:53:07.329974+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-22T10:53:17.182228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-22T10:53:23.874432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-22T10:53:29.812963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-22T10:53:30.404021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-22T10:53:33.982289+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"918db6b4-053a-46ba-976d-6e1a0104017f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6809","nonce":2400162888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6811","nonce":2400162888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6815","nonce":2400162888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6813","nonce":2400162888}]},"public_addr":"172.21.15.40:6809/2400162888","cluster_addr":"172.21.15.40:6811/2400162888","heartbeat_back_addr":"172.21.15.40:6815/2400162888","heartbeat_front_addr":"172.21.15.40:6813/2400162888","state":["exists","up"]},{"osd":1,"uuid":"0c146e2b-1725-4dae-9b5c-38795943b9d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6801","nonce":230885800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6803","nonce":230885800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6807","nonce":230885800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6805","nonce":230885800}]},"public_addr":"172.21.15.40:6801/230885800","cluster_addr":"172.21.15.40:6803/230885800","heartbeat_back_addr":"172.21.15.40:6807/230885800","heartbeat_front_addr":"172.21.15.40:6805/230885800","state":["exists","up"]},{"osd":2,"uuid":"0b3727fd-f281-46d5-a675-86c8c5ab269e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6817","nonce":2681404929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6819","nonce":2681404929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6823","nonce":2681404929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6821","nonce":2681404929}]},"public_addr":"172.21.15.40:6817/2681404929","cluster_addr":"172.21.15.40:6819/2681404929","heartbeat_back_addr":"172.21.15.40:6823/2681404929","heartbeat_front_addr":"172.21.15.40:6821/2681404929","state":["exists","up"]},{"osd":3,"uuid":"2969c698-7039-4bbb-beda-f756f7a368a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6825","nonce":111110981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6827","nonce":111110981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6831","nonce":111110981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6829","nonce":111110981}]},"public_addr":"172.21.15.40:6825/111110981","cluster_addr":"172.21.15.40:6827/111110981","heartbeat_back_addr":"172.21.15.40:6831/111110981","heartbeat_front_addr":"172.21.15.40:6829/111110981","state":["exists","up"]},{"osd":4,"uuid":"3bb1d9c8-8e42-4a6b-998d-04834f34be5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6801","nonce":3625455711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6803","nonce":3625455711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6807","nonce":3625455711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6805","nonce":3625455711}]},"public_addr":"172.21.15.45:6801/3625455711","cluster_addr":"172.21.15.45:6803/3625455711","heartbeat_back_addr":"172.21.15.45:6807/3625455711","heartbeat_front_addr":"172.21.15.45:6805/3625455711","state":["exists","up"]},{"osd":5,"uuid":"f9854ee4-302c-41be-977b-bedda090a3d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6817","nonce":3354411217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6819","nonce":3354411217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6823","nonce":3354411217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6821","nonce":3354411217}]},"public_addr":"172.21.15.45:6817/3354411217","cluster_addr":"172.21.15.45:6819/3354411217","heartbeat_back_addr":"172.21.15.45:6823/3354411217","heartbeat_front_addr":"172.21.15.45:6821/3354411217","state":["exists","up"]},{"osd":6,"uuid":"bbdb1989-f6ac-4954-9b85-b8b540d683c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6809","nonce":320111074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6811","nonce":320111074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6815","nonce":320111074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6813","nonce":320111074}]},"public_addr":"172.21.15.45:6809/320111074","cluster_addr":"172.21.15.45:6811/320111074","heartbeat_back_addr":"172.21.15.45:6815/320111074","heartbeat_front_addr":"172.21.15.45:6813/320111074","state":["exists","up"]},{"osd":7,"uuid":"823d44e3-58f1-4d1d-8263-a4e4a69d4327","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6825","nonce":643617680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6827","nonce":643617680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6831","nonce":643617680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6829","nonce":643617680}]},"public_addr":"172.21.15.45:6825/643617680","cluster_addr":"172.21.15.45:6827/643617680","heartbeat_back_addr":"172.21.15.45:6831/643617680","heartbeat_front_addr":"172.21.15.45:6829/643617680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.731262+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.873226+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.898936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.666578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.645990+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.953699+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.642823+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.693395+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1b","mappings":[{"from":3,"to":2}]},{"pgid":"4.2a","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-22T10:54:37.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.148+0000 7f580d9ff700 1 -- 172.21.15.40:0/417930878 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f57f406ace0 msgr2=0x7f57f406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:37.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.148+0000 7f580d9ff700 1 --2- 172.21.15.40:0/417930878 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f57f406ace0 0x7f57f406d190 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f58080b2010 tx=0x7f57f8008040 comp rx=0 tx=0).stop 2023-06-22T10:54:37.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.148+0000 7f580d9ff700 1 -- 172.21.15.40:0/417930878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58080d2830 msgr2=0x7f58081f1d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:37.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.148+0000 7f580d9ff700 1 --2- 172.21.15.40:0/417930878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58080d2830 0x7f58081f1d70 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f57fc0090b0 tx=0x7f57fc004750 comp rx=0 tx=0).stop 2023-06-22T10:54:37.152 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.148+0000 7f580d9ff700 1 -- 172.21.15.40:0/417930878 shutdown_connections 2023-06-22T10:54:37.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.148+0000 7f580d9ff700 1 --2- 172.21.15.40:0/417930878 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f57f406ace0 0x7f57f406d190 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:37.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.148+0000 7f580d9ff700 1 --2- 172.21.15.40:0/417930878 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f580815c720 0x7f58080cc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:37.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.148+0000 7f580d9ff700 1 --2- 172.21.15.40:0/417930878 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58080b4c60 0x7f580815caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:37.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.148+0000 7f580d9ff700 1 --2- 172.21.15.40:0/417930878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58080d2830 0x7f58081f1d70 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:37.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.148+0000 7f580d9ff700 1 -- 172.21.15.40:0/417930878 >> 172.21.15.40:0/417930878 conn(0x7f58080cf720 msgr2=0x7f58080b40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:37.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.148+0000 7f580d9ff700 1 -- 172.21.15.40:0/417930878 shutdown_connections 2023-06-22T10:54:37.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.148+0000 7f580d9ff700 1 -- 172.21.15.40:0/417930878 wait complete. 2023-06-22T10:54:37.170 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-22T10:53:17.182228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-22T10:53:23.874432+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-22T10:53:29.812963+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-22T10:53:30.404021+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-22T10:53:33.982289+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-22T10:54:37.171 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-22T10:54:37.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.371+0000 7fdd487ff700 1 Processor -- start 2023-06-22T10:54:37.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.371+0000 7fdd487ff700 1 -- start start 2023-06-22T10:54:37.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.372+0000 7fdd487ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdd400b45d0 0x7fdd400b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:37.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.372+0000 7fdd487ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdd400d2130 0x7fdd400cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:37.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.372+0000 7fdd487ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fdd400cd6e0 0x7fdd400b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:37.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.372+0000 7fdd487ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd400d17f0 con 0x7fdd400d2130 2023-06-22T10:54:37.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.372+0000 7fdd487ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd400d1be0 con 0x7fdd400b45d0 2023-06-22T10:54:37.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.372+0000 7fdd487ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd400d1360 con 0x7fdd400cd6e0 2023-06-22T10:54:37.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.372+0000 7fdd45d9a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdd400d2130 0x7fdd400cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:37.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.372+0000 7fdd4659b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdd400b45d0 0x7fdd400b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:37.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.372+0000 7fdd4659b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdd400b45d0 0x7fdd400b49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.40:36352/0 (socket says 172.21.15.40:36352) 2023-06-22T10:54:37.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.372+0000 7fdd45d9a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdd400d2130 0x7fdd400cd1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39530/0 (socket says 172.21.15.40:39530) 2023-06-22T10:54:37.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.372+0000 7fdd4659b700 1 -- 172.21.15.40:0/3037487389 learned_addr learned my addr 172.21.15.40:0/3037487389 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:37.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.372+0000 7fdd46d9c700 1 --2- 172.21.15.40:0/3037487389 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fdd400cd6e0 0x7fdd400b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:37.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.373+0000 7fdd45d9a700 1 -- 172.21.15.40:0/3037487389 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fdd400cd6e0 msgr2=0x7fdd400b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:37.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.373+0000 7fdd45d9a700 1 --2- 172.21.15.40:0/3037487389 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fdd400cd6e0 0x7fdd400b59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:37.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.373+0000 7fdd45d9a700 1 -- 172.21.15.40:0/3037487389 >> v2:172.21.15.45:3300/0 conn(0x7fdd400b45d0 msgr2=0x7fdd400b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:37.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.373+0000 7fdd45d9a700 1 --2- 172.21.15.40:0/3037487389 >> v2:172.21.15.45:3300/0 conn(0x7fdd400b45d0 0x7fdd400b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:37.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.373+0000 7fdd45d9a700 1 -- 172.21.15.40:0/3037487389 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd400b4ee0 con 0x7fdd400d2130 2023-06-22T10:54:37.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.373+0000 7fdd45d9a700 1 --2- 172.21.15.40:0/3037487389 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd400d2130 0x7fdd400cd1a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fdd400668f0 tx=0x7fdd30009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5dc24dc1882f982 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:37.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.373+0000 7fdd45599700 1 -- 172.21.15.40:0/3037487389 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd30011830 con 0x7fdd400d2130 2023-06-22T10:54:37.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.373+0000 7fdd45599700 1 -- 172.21.15.40:0/3037487389 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd30011990 con 0x7fdd400d2130 2023-06-22T10:54:37.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.373+0000 7fdd45599700 1 -- 172.21.15.40:0/3037487389 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd30011d20 con 0x7fdd400d2130 2023-06-22T10:54:37.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.374+0000 7fdd487ff700 1 -- 172.21.15.40:0/3037487389 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd400d2130 msgr2=0x7fdd400cd1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:37.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.374+0000 7fdd487ff700 1 --2- 172.21.15.40:0/3037487389 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd400d2130 0x7fdd400cd1a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fdd400668f0 tx=0x7fdd30009b20 comp rx=0 tx=0).stop 2023-06-22T10:54:37.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.374+0000 7fdd487ff700 1 -- 172.21.15.40:0/3037487389 shutdown_connections 2023-06-22T10:54:37.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.374+0000 7fdd487ff700 1 --2- 172.21.15.40:0/3037487389 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fdd400cd6e0 0x7fdd400b59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:37.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.374+0000 7fdd487ff700 1 --2- 172.21.15.40:0/3037487389 >> v2:172.21.15.45:3300/0 conn(0x7fdd400b45d0 0x7fdd400b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:37.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.374+0000 7fdd487ff700 1 --2- 172.21.15.40:0/3037487389 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd400d2130 0x7fdd400cd1a0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:37.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.374+0000 7fdd487ff700 1 -- 172.21.15.40:0/3037487389 >> 172.21.15.40:0/3037487389 conn(0x7fdd400cf5d0 msgr2=0x7fdd400cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:37.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.374+0000 7fdd487ff700 1 -- 172.21.15.40:0/3037487389 shutdown_connections 2023-06-22T10:54:37.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.374+0000 7fdd487ff700 1 -- 172.21.15.40:0/3037487389 wait complete. 2023-06-22T10:54:37.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.376+0000 7fdd487ff700 1 Processor -- start 2023-06-22T10:54:37.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.376+0000 7fdd487ff700 1 -- start start 2023-06-22T10:54:37.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.377+0000 7fdd487ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd400b45d0 0x7fdd400b5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:37.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.377+0000 7fdd487ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fdd400cd6e0 0x7fdd4015ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:37.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.377+0000 7fdd487ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd400d2130 0x7fdd400b0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:37.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.377+0000 7fdd487ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd400b5ec0 con 0x7fdd400d2130 2023-06-22T10:54:37.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.377+0000 7fdd487ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd400b60f0 con 0x7fdd400b45d0 2023-06-22T10:54:37.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.377+0000 7fdd487ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd400b63d0 con 0x7fdd400cd6e0 2023-06-22T10:54:37.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.377+0000 7fdd46d9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd400d2130 0x7fdd400b0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:37.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.377+0000 7fdd46d9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd400d2130 0x7fdd400b0590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39532/0 (socket says 172.21.15.40:39532) 2023-06-22T10:54:37.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.377+0000 7fdd46d9c700 1 -- 172.21.15.40:0/1396338355 learned_addr learned my addr 172.21.15.40:0/1396338355 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:37.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.378+0000 7fdd4659b700 1 --2- 172.21.15.40:0/1396338355 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd400b45d0 0x7fdd400b5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:37.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.378+0000 7fdd45d9a700 1 --2- 172.21.15.40:0/1396338355 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fdd400cd6e0 0x7fdd4015ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:37.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.378+0000 7fdd46d9c700 1 -- 172.21.15.40:0/1396338355 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fdd400cd6e0 msgr2=0x7fdd4015ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:37.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.378+0000 7fdd46d9c700 1 --2- 172.21.15.40:0/1396338355 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fdd400cd6e0 0x7fdd4015ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:37.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.378+0000 7fdd46d9c700 1 -- 172.21.15.40:0/1396338355 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd400b45d0 msgr2=0x7fdd400b5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:37.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.378+0000 7fdd46d9c700 1 --2- 172.21.15.40:0/1396338355 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd400b45d0 0x7fdd400b5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:37.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.378+0000 7fdd46d9c700 1 -- 172.21.15.40:0/1396338355 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd300094a0 con 0x7fdd400d2130 2023-06-22T10:54:37.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.378+0000 7fdd45d9a700 1 --2- 172.21.15.40:0/1396338355 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fdd400cd6e0 0x7fdd4015ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:54:37.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.378+0000 7fdd46d9c700 1 --2- 172.21.15.40:0/1396338355 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd400d2130 0x7fdd400b0590 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fdd3800efc0 tx=0x7fdd3800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:37.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.378+0000 7fdd36ffd700 1 -- 172.21.15.40:0/1396338355 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd38009ea0 con 0x7fdd400d2130 2023-06-22T10:54:37.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.378+0000 7fdd36ffd700 1 -- 172.21.15.40:0/1396338355 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd3800f040 con 0x7fdd400d2130 2023-06-22T10:54:37.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.378+0000 7fdd36ffd700 1 -- 172.21.15.40:0/1396338355 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd38014480 con 0x7fdd400d2130 2023-06-22T10:54:37.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.378+0000 7fdd487ff700 1 -- 172.21.15.40:0/1396338355 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd400b66b0 con 0x7fdd400d2130 2023-06-22T10:54:37.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.379+0000 7fdd487ff700 1 -- 172.21.15.40:0/1396338355 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd400b6c70 con 0x7fdd400d2130 2023-06-22T10:54:37.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.379+0000 7fdd487ff700 1 -- 172.21.15.40:0/1396338355 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd400b6e90 con 0x7fdd400d2130 2023-06-22T10:54:37.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.380+0000 7fdd36ffd700 1 -- 172.21.15.40:0/1396338355 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdd380145e0 con 0x7fdd400d2130 2023-06-22T10:54:37.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.381+0000 7fdd36ffd700 1 --2- 172.21.15.40:0/1396338355 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fdd2406ace0 0x7fdd2406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:37.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.381+0000 7fdd36ffd700 1 -- 172.21.15.40:0/1396338355 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fdd3808a390 con 0x7fdd400d2130 2023-06-22T10:54:37.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.382+0000 7fdd4659b700 1 --2- 172.21.15.40:0/1396338355 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fdd2406ace0 0x7fdd2406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:37.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.382+0000 7fdd4659b700 1 --2- 172.21.15.40:0/1396338355 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fdd2406ace0 0x7fdd2406d190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdd40158960 tx=0x7fdd3c0092c0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:37.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.386+0000 7fdd36ffd700 1 -- 172.21.15.40:0/1396338355 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdd38055070 con 0x7fdd400d2130 2023-06-22T10:54:37.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.592+0000 7fdd487ff700 1 -- 172.21.15.40:0/1396338355 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdd40067580 con 0x7fdd400d2130 2023-06-22T10:54:37.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.593+0000 7fdd36ffd700 1 -- 172.21.15.40:0/1396338355 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdd38058690 con 0x7fdd400d2130 2023-06-22T10:54:37.596 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-06-22T10:54:37.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.595+0000 7fdd487ff700 1 -- 172.21.15.40:0/1396338355 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fdd2406ace0 msgr2=0x7fdd2406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:37.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.595+0000 7fdd487ff700 1 --2- 172.21.15.40:0/1396338355 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fdd2406ace0 0x7fdd2406d190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdd40158960 tx=0x7fdd3c0092c0 comp rx=0 tx=0).stop 2023-06-22T10:54:37.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.595+0000 7fdd487ff700 1 -- 172.21.15.40:0/1396338355 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd400d2130 msgr2=0x7fdd400b0590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:37.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.595+0000 7fdd487ff700 1 --2- 172.21.15.40:0/1396338355 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd400d2130 0x7fdd400b0590 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fdd3800efc0 tx=0x7fdd3800c3a0 comp rx=0 tx=0).stop 2023-06-22T10:54:37.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.595+0000 7fdd487ff700 1 -- 172.21.15.40:0/1396338355 shutdown_connections 2023-06-22T10:54:37.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.595+0000 7fdd487ff700 1 --2- 172.21.15.40:0/1396338355 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fdd2406ace0 0x7fdd2406d190 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:37.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.595+0000 7fdd487ff700 1 --2- 172.21.15.40:0/1396338355 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd400d2130 0x7fdd400b0590 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:37.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.595+0000 7fdd487ff700 1 --2- 172.21.15.40:0/1396338355 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd400b45d0 0x7fdd400b5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:37.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.595+0000 7fdd487ff700 1 --2- 172.21.15.40:0/1396338355 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fdd400cd6e0 0x7fdd4015ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:37.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.595+0000 7fdd487ff700 1 -- 172.21.15.40:0/1396338355 >> 172.21.15.40:0/1396338355 conn(0x7fdd400cf5d0 msgr2=0x7fdd4015aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:37.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.595+0000 7fdd487ff700 1 -- 172.21.15.40:0/1396338355 shutdown_connections 2023-06-22T10:54:37.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.595+0000 7fdd487ff700 1 -- 172.21.15.40:0/1396338355 wait complete. 2023-06-22T10:54:37.617 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-22T10:54:37.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.820+0000 7f82a07ff700 1 Processor -- start 2023-06-22T10:54:37.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.820+0000 7f82a07ff700 1 -- start start 2023-06-22T10:54:37.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.821+0000 7f82a07ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f82980b45d0 0x7f82980b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:37.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.821+0000 7f82a07ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f82980d2130 0x7f82980cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:37.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.821+0000 7f82a07ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f82980cd6e0 0x7f82980b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:37.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.821+0000 7f82a07ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82980d17f0 con 0x7f82980cd6e0 2023-06-22T10:54:37.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.821+0000 7f82a07ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82980d1be0 con 0x7f82980b45d0 2023-06-22T10:54:37.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.821+0000 7f82a07ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82980d1360 con 0x7f82980d2130 2023-06-22T10:54:37.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.822+0000 7f829ed9c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f82980cd6e0 0x7f82980b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:37.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.822+0000 7f829ed9c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f82980cd6e0 0x7f82980b59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39542/0 (socket says 172.21.15.40:39542) 2023-06-22T10:54:37.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.822+0000 7f829ed9c700 1 -- 172.21.15.40:0/2988773945 learned_addr learned my addr 172.21.15.40:0/2988773945 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:37.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.822+0000 7f829e59b700 1 --2- 172.21.15.40:0/2988773945 >> v2:172.21.15.45:3300/0 conn(0x7f82980b45d0 0x7f82980b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:37.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.822+0000 7f829dd9a700 1 --2- 172.21.15.40:0/2988773945 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f82980d2130 0x7f82980cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:37.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.822+0000 7f829ed9c700 1 -- 172.21.15.40:0/2988773945 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f82980d2130 msgr2=0x7f82980cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:37.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.822+0000 7f829ed9c700 1 --2- 172.21.15.40:0/2988773945 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f82980d2130 0x7f82980cd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:37.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.822+0000 7f829ed9c700 1 -- 172.21.15.40:0/2988773945 >> v2:172.21.15.45:3300/0 conn(0x7f82980b45d0 msgr2=0x7f82980b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:37.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.822+0000 7f829ed9c700 1 --2- 172.21.15.40:0/2988773945 >> v2:172.21.15.45:3300/0 conn(0x7f82980b45d0 0x7f82980b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:37.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.822+0000 7f829ed9c700 1 -- 172.21.15.40:0/2988773945 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82980b4ee0 con 0x7f82980cd6e0 2023-06-22T10:54:37.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.822+0000 7f829ed9c700 1 --2- 172.21.15.40:0/2988773945 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82980cd6e0 0x7f82980b59a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f82980668f0 tx=0x7f829000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=464eeb3bb530c06a server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:37.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.823+0000 7f829d599700 1 -- 172.21.15.40:0/2988773945 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829000e070 con 0x7f82980cd6e0 2023-06-22T10:54:37.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.823+0000 7f829d599700 1 -- 172.21.15.40:0/2988773945 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f829000b910 con 0x7f82980cd6e0 2023-06-22T10:54:37.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.823+0000 7f829d599700 1 -- 172.21.15.40:0/2988773945 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829000bcc0 con 0x7f82980cd6e0 2023-06-22T10:54:37.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.823+0000 7f82a07ff700 1 -- 172.21.15.40:0/2988773945 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82980cd6e0 msgr2=0x7f82980b59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:37.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.823+0000 7f82a07ff700 1 --2- 172.21.15.40:0/2988773945 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82980cd6e0 0x7f82980b59a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f82980668f0 tx=0x7f829000b330 comp rx=0 tx=0).stop 2023-06-22T10:54:37.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.823+0000 7f82a07ff700 1 -- 172.21.15.40:0/2988773945 shutdown_connections 2023-06-22T10:54:37.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.823+0000 7f82a07ff700 1 --2- 172.21.15.40:0/2988773945 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82980cd6e0 0x7f82980b59a0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:37.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.823+0000 7f82a07ff700 1 --2- 172.21.15.40:0/2988773945 >> v2:172.21.15.45:3300/0 conn(0x7f82980b45d0 0x7f82980b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:37.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.823+0000 7f82a07ff700 1 --2- 172.21.15.40:0/2988773945 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f82980d2130 0x7f82980cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:37.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.823+0000 7f82a07ff700 1 -- 172.21.15.40:0/2988773945 >> 172.21.15.40:0/2988773945 conn(0x7f82980cf5d0 msgr2=0x7f82980cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:37.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.823+0000 7f82a07ff700 1 -- 172.21.15.40:0/2988773945 shutdown_connections 2023-06-22T10:54:37.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.823+0000 7f82a07ff700 1 -- 172.21.15.40:0/2988773945 wait complete. 2023-06-22T10:54:37.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.826+0000 7f82a07ff700 1 Processor -- start 2023-06-22T10:54:37.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.826+0000 7f82a07ff700 1 -- start start 2023-06-22T10:54:37.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.827+0000 7f82a07ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82980b45d0 0x7f82981e80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:37.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.827+0000 7f82a07ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f82980cd6e0 0x7f8298157c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:37.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.827+0000 7f82a07ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82980d2130 0x7f82981f1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:37.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.827+0000 7f82a07ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82980cb000 con 0x7f82980b45d0 2023-06-22T10:54:37.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.827+0000 7f82a07ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82980cb2e0 con 0x7f82980d2130 2023-06-22T10:54:37.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.827+0000 7f82a07ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82980cb5c0 con 0x7f82980cd6e0 2023-06-22T10:54:37.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.827+0000 7f829e59b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82980b45d0 0x7f82981e80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:37.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.828+0000 7f829e59b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82980b45d0 0x7f82981e80c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39544/0 (socket says 172.21.15.40:39544) 2023-06-22T10:54:37.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.828+0000 7f829e59b700 1 -- 172.21.15.40:0/3462992729 learned_addr learned my addr 172.21.15.40:0/3462992729 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:37.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.828+0000 7f829dd9a700 1 --2- 172.21.15.40:0/3462992729 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f82980cd6e0 0x7f8298157c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:37.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.828+0000 7f829ed9c700 1 --2- 172.21.15.40:0/3462992729 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82980d2130 0x7f82981f1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:37.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.828+0000 7f829e59b700 1 -- 172.21.15.40:0/3462992729 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f82980cd6e0 msgr2=0x7f8298157c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:37.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.828+0000 7f829e59b700 1 --2- 172.21.15.40:0/3462992729 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f82980cd6e0 0x7f8298157c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:37.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.828+0000 7f829e59b700 1 -- 172.21.15.40:0/3462992729 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82980d2130 msgr2=0x7f82981f1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:37.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.828+0000 7f829e59b700 1 --2- 172.21.15.40:0/3462992729 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82980d2130 0x7f82981f1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:37.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.828+0000 7f829e59b700 1 -- 172.21.15.40:0/3462992729 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8290009b30 con 0x7f82980b45d0 2023-06-22T10:54:37.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.828+0000 7f829dd9a700 1 --2- 172.21.15.40:0/3462992729 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f82980cd6e0 0x7f8298157c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-22T10:54:37.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.828+0000 7f829ed9c700 1 --2- 172.21.15.40:0/3462992729 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82980d2130 0x7f82981f1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-22T10:54:37.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.828+0000 7f829e59b700 1 --2- 172.21.15.40:0/3462992729 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82980b45d0 0x7f82981e80c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f829400e870 tx=0x7f829400ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:37.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.828+0000 7f828effd700 1 -- 172.21.15.40:0/3462992729 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829400c640 con 0x7f82980b45d0 2023-06-22T10:54:37.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.828+0000 7f828effd700 1 -- 172.21.15.40:0/3462992729 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f829400c7a0 con 0x7f82980b45d0 2023-06-22T10:54:37.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.828+0000 7f82a07ff700 1 -- 172.21.15.40:0/3462992729 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82980cb8a0 con 0x7f82980b45d0 2023-06-22T10:54:37.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.828+0000 7f828effd700 1 -- 172.21.15.40:0/3462992729 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829400cb30 con 0x7f82980b45d0 2023-06-22T10:54:37.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.829+0000 7f82a07ff700 1 -- 172.21.15.40:0/3462992729 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82981e8600 con 0x7f82980b45d0 2023-06-22T10:54:37.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.830+0000 7f82a07ff700 1 -- 172.21.15.40:0/3462992729 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82980cbef0 con 0x7f82980b45d0 2023-06-22T10:54:37.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.831+0000 7f828effd700 1 -- 172.21.15.40:0/3462992729 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f829400cc90 con 0x7f82980b45d0 2023-06-22T10:54:37.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.832+0000 7f828effd700 1 --2- 172.21.15.40:0/3462992729 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f827c06ace0 0x7f827c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:37.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.832+0000 7f828effd700 1 -- 172.21.15.40:0/3462992729 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8294089650 con 0x7f82980b45d0 2023-06-22T10:54:37.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.832+0000 7f829dd9a700 1 --2- 172.21.15.40:0/3462992729 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f827c06ace0 0x7f827c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:37.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.833+0000 7f829dd9a700 1 --2- 172.21.15.40:0/3462992729 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f827c06ace0 0x7f827c06d190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f82980c9760 tx=0x7f8288008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:37.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:37.837+0000 7f828effd700 1 -- 172.21.15.40:0/3462992729 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8294054460 con 0x7f82980b45d0 2023-06-22T10:54:38.045 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.042+0000 7f82a07ff700 1 -- 172.21.15.40:0/3462992729 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8298067580 con 0x7f82980b45d0 2023-06-22T10:54:38.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.042+0000 7f828effd700 1 -- 172.21.15.40:0/3462992729 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8294057a80 con 0x7f82980b45d0 2023-06-22T10:54:38.046 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 8 2023-06-22T10:54:38.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.045+0000 7f82a07ff700 1 -- 172.21.15.40:0/3462992729 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f827c06ace0 msgr2=0x7f827c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:38.048 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.045+0000 7f82a07ff700 1 --2- 172.21.15.40:0/3462992729 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f827c06ace0 0x7f827c06d190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f82980c9760 tx=0x7f8288008040 comp rx=0 tx=0).stop 2023-06-22T10:54:38.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.045+0000 7f82a07ff700 1 -- 172.21.15.40:0/3462992729 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82980b45d0 msgr2=0x7f82981e80c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:38.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.045+0000 7f82a07ff700 1 --2- 172.21.15.40:0/3462992729 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82980b45d0 0x7f82981e80c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f829400e870 tx=0x7f829400ec30 comp rx=0 tx=0).stop 2023-06-22T10:54:38.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.045+0000 7f82a07ff700 1 -- 172.21.15.40:0/3462992729 shutdown_connections 2023-06-22T10:54:38.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.045+0000 7f82a07ff700 1 --2- 172.21.15.40:0/3462992729 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f827c06ace0 0x7f827c06d190 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:38.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.045+0000 7f82a07ff700 1 --2- 172.21.15.40:0/3462992729 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82980d2130 0x7f82981f1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:38.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.045+0000 7f82a07ff700 1 --2- 172.21.15.40:0/3462992729 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82980b45d0 0x7f82981e80c0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:38.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.045+0000 7f82a07ff700 1 --2- 172.21.15.40:0/3462992729 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f82980cd6e0 0x7f8298157c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:38.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.045+0000 7f82a07ff700 1 -- 172.21.15.40:0/3462992729 >> 172.21.15.40:0/3462992729 conn(0x7f82980cf5d0 msgr2=0x7f82980b24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:38.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.045+0000 7f82a07ff700 1 -- 172.21.15.40:0/3462992729 shutdown_connections 2023-06-22T10:54:38.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.045+0000 7f82a07ff700 1 -- 172.21.15.40:0/3462992729 wait complete. 2023-06-22T10:54:38.066 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-22T10:54:38.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.267+0000 7fb8cadff700 1 Processor -- start 2023-06-22T10:54:38.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.267+0000 7fb8cadff700 1 -- start start 2023-06-22T10:54:38.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.268+0000 7fb8cadff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb8c41609b0 0x7fb8c415d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:38.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.268+0000 7fb8cadff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb8c415dcf0 0x7fb8c415e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:38.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.268+0000 7fb8cadff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8c415d940 con 0x7fb8c40cd350 2023-06-22T10:54:38.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.268+0000 7fb8cadff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8c415c7e0 con 0x7fb8c415dcf0 2023-06-22T10:54:38.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.268+0000 7fb8cadff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8c415fef0 con 0x7fb8c41609b0 2023-06-22T10:54:38.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.269+0000 7fb8c939c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb8c415dcf0 0x7fb8c415e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:38.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.269+0000 7fb8c939c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb8c415dcf0 0x7fb8c415e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39546/0 (socket says 172.21.15.40:39546) 2023-06-22T10:54:38.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.269+0000 7fb8c939c700 1 -- 172.21.15.40:0/981297911 learned_addr learned my addr 172.21.15.40:0/981297911 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:38.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.269+0000 7fb8c3fff700 1 --2- 172.21.15.40:0/981297911 >> v2:172.21.15.45:3300/0 conn(0x7fb8c41609b0 0x7fb8c415d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:38.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.269+0000 7fb8c939c700 1 -- 172.21.15.40:0/981297911 >> v2:172.21.15.45:3300/0 conn(0x7fb8c41609b0 msgr2=0x7fb8c415d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:38.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.269+0000 7fb8c939c700 1 --2- 172.21.15.40:0/981297911 >> v2:172.21.15.45:3300/0 conn(0x7fb8c41609b0 0x7fb8c415d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:38.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.269+0000 7fb8c939c700 1 -- 172.21.15.40:0/981297911 >> v1:172.21.15.45:6789/0 conn(0x7fb8c40cd350 legacy=0x7fb8c40cd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:38.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.269+0000 7fb8c939c700 1 -- 172.21.15.40:0/981297911 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c4160e20 con 0x7fb8c415dcf0 2023-06-22T10:54:38.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.269+0000 7fb8c939c700 1 --2- 172.21.15.40:0/981297911 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8c415dcf0 0x7fb8c415e170 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4066950 tx=0x7fb8bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=156e6ddc3423eee0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:38.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.270+0000 7fb8c37fe700 1 -- 172.21.15.40:0/981297911 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8bc00e070 con 0x7fb8c415dcf0 2023-06-22T10:54:38.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.270+0000 7fb8c37fe700 1 -- 172.21.15.40:0/981297911 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8bc00b9c0 con 0x7fb8c415dcf0 2023-06-22T10:54:38.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.270+0000 7fb8c37fe700 1 -- 172.21.15.40:0/981297911 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8bc00bd70 con 0x7fb8c415dcf0 2023-06-22T10:54:38.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.270+0000 7fb8cadff700 1 -- 172.21.15.40:0/981297911 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8c415dcf0 msgr2=0x7fb8c415e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:38.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.270+0000 7fb8cadff700 1 --2- 172.21.15.40:0/981297911 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8c415dcf0 0x7fb8c415e170 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4066950 tx=0x7fb8bc00b330 comp rx=0 tx=0).stop 2023-06-22T10:54:38.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.270+0000 7fb8cadff700 1 -- 172.21.15.40:0/981297911 shutdown_connections 2023-06-22T10:54:38.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.270+0000 7fb8cadff700 1 --2- 172.21.15.40:0/981297911 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8c415dcf0 0x7fb8c415e170 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:38.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.270+0000 7fb8cadff700 1 --2- 172.21.15.40:0/981297911 >> v2:172.21.15.45:3300/0 conn(0x7fb8c41609b0 0x7fb8c415d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:38.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.270+0000 7fb8cadff700 1 -- 172.21.15.40:0/981297911 >> 172.21.15.40:0/981297911 conn(0x7fb8c4069f30 msgr2=0x7fb8c406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:38.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.270+0000 7fb8cadff700 1 -- 172.21.15.40:0/981297911 shutdown_connections 2023-06-22T10:54:38.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.270+0000 7fb8cadff700 1 -- 172.21.15.40:0/981297911 wait complete. 2023-06-22T10:54:38.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.272+0000 7fb8cadff700 1 Processor -- start 2023-06-22T10:54:38.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.272+0000 7fb8cadff700 1 -- start start 2023-06-22T10:54:38.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.273+0000 7fb8cadff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fb8c40cd350 0x7fb8c40b4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:38.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.273+0000 7fb8cadff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8c415dcf0 0x7fb8c40ca020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:38.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.273+0000 7fb8cadff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8c41609b0 0x7fb8c4156f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:38.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.273+0000 7fb8cadff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c40b3a70 con 0x7fb8c41609b0 2023-06-22T10:54:38.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.273+0000 7fb8cadff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c40b3d50 con 0x7fb8c415dcf0 2023-06-22T10:54:38.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.273+0000 7fb8cadff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c40b4030 con 0x7fb8c40cd350 2023-06-22T10:54:38.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.274+0000 7fb8c939c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8c41609b0 0x7fb8c4156f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:38.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.274+0000 7fb8c939c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8c41609b0 0x7fb8c4156f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39556/0 (socket says 172.21.15.40:39556) 2023-06-22T10:54:38.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.274+0000 7fb8c939c700 1 -- 172.21.15.40:0/1357195776 learned_addr learned my addr 172.21.15.40:0/1357195776 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:38.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.274+0000 7fb8c3fff700 1 --2- 172.21.15.40:0/1357195776 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8c415dcf0 0x7fb8c40ca020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:38.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.274+0000 7fb8c8b9b700 1 --2- 172.21.15.40:0/1357195776 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fb8c40cd350 0x7fb8c40b4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:38.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.274+0000 7fb8c939c700 1 -- 172.21.15.40:0/1357195776 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fb8c40cd350 msgr2=0x7fb8c40b4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:38.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.274+0000 7fb8c939c700 1 --2- 172.21.15.40:0/1357195776 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fb8c40cd350 0x7fb8c40b4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:38.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.274+0000 7fb8c939c700 1 -- 172.21.15.40:0/1357195776 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8c415dcf0 msgr2=0x7fb8c40ca020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:38.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.274+0000 7fb8c939c700 1 --2- 172.21.15.40:0/1357195776 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8c415dcf0 0x7fb8c40ca020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:38.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.274+0000 7fb8c939c700 1 -- 172.21.15.40:0/1357195776 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8bc009b30 con 0x7fb8c41609b0 2023-06-22T10:54:38.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.274+0000 7fb8c939c700 1 --2- 172.21.15.40:0/1357195776 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8c41609b0 0x7fb8c4156f10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc00b370 tx=0x7fb8bc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:38.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.274+0000 7fb8c17fa700 1 -- 172.21.15.40:0/1357195776 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8bc0099b0 con 0x7fb8c41609b0 2023-06-22T10:54:38.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.275+0000 7fb8c17fa700 1 -- 172.21.15.40:0/1357195776 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8bc0092e0 con 0x7fb8c41609b0 2023-06-22T10:54:38.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.275+0000 7fb8c17fa700 1 -- 172.21.15.40:0/1357195776 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8bc01c660 con 0x7fb8c41609b0 2023-06-22T10:54:38.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.275+0000 7fb8cadff700 1 -- 172.21.15.40:0/1357195776 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8c40b4310 con 0x7fb8c41609b0 2023-06-22T10:54:38.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.275+0000 7fb8cadff700 1 -- 172.21.15.40:0/1357195776 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8c40c8fc0 con 0x7fb8c41609b0 2023-06-22T10:54:38.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.276+0000 7fb8cadff700 1 -- 172.21.15.40:0/1357195776 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8c40c9180 con 0x7fb8c41609b0 2023-06-22T10:54:38.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.276+0000 7fb8c17fa700 1 -- 172.21.15.40:0/1357195776 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb8bc01c7c0 con 0x7fb8c41609b0 2023-06-22T10:54:38.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.278+0000 7fb8c17fa700 1 --2- 172.21.15.40:0/1357195776 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fb8a806ace0 0x7fb8a806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:38.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.279+0000 7fb8c17fa700 1 -- 172.21.15.40:0/1357195776 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb8bc08b580 con 0x7fb8c41609b0 2023-06-22T10:54:38.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.279+0000 7fb8c8b9b700 1 --2- 172.21.15.40:0/1357195776 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fb8a806ace0 0x7fb8a806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:38.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.279+0000 7fb8c8b9b700 1 --2- 172.21.15.40:0/1357195776 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fb8a806ace0 0x7fb8a806d190 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8000f60 tx=0x7fb8b8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:38.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.283+0000 7fb8c17fa700 1 -- 172.21.15.40:0/1357195776 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb8bc0562f0 con 0x7fb8c41609b0 2023-06-22T10:54:38.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.489+0000 7fb8cadff700 1 -- 172.21.15.40:0/1357195776 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb8c40b47d0 con 0x7fb8c41609b0 2023-06-22T10:54:38.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.489+0000 7fb8c17fa700 1 -- 172.21.15.40:0/1357195776 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb8bc059910 con 0x7fb8c41609b0 2023-06-22T10:54:38.493 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-06-22T10:54:38.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.491+0000 7fb8cadff700 1 -- 172.21.15.40:0/1357195776 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fb8a806ace0 msgr2=0x7fb8a806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:38.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.491+0000 7fb8cadff700 1 --2- 172.21.15.40:0/1357195776 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fb8a806ace0 0x7fb8a806d190 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb8b8000f60 tx=0x7fb8b8009040 comp rx=0 tx=0).stop 2023-06-22T10:54:38.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.491+0000 7fb8cadff700 1 -- 172.21.15.40:0/1357195776 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8c41609b0 msgr2=0x7fb8c4156f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:38.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.491+0000 7fb8cadff700 1 --2- 172.21.15.40:0/1357195776 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8c41609b0 0x7fb8c4156f10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc00b370 tx=0x7fb8bc004ad0 comp rx=0 tx=0).stop 2023-06-22T10:54:38.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.491+0000 7fb8cadff700 1 -- 172.21.15.40:0/1357195776 shutdown_connections 2023-06-22T10:54:38.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.491+0000 7fb8cadff700 1 --2- 172.21.15.40:0/1357195776 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fb8a806ace0 0x7fb8a806d190 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:38.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.491+0000 7fb8cadff700 1 --2- 172.21.15.40:0/1357195776 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fb8c40cd350 0x7fb8c40b4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:38.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.491+0000 7fb8cadff700 1 --2- 172.21.15.40:0/1357195776 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8c41609b0 0x7fb8c4156f10 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:38.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.491+0000 7fb8cadff700 1 --2- 172.21.15.40:0/1357195776 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8c415dcf0 0x7fb8c40ca020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:38.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.491+0000 7fb8cadff700 1 -- 172.21.15.40:0/1357195776 >> 172.21.15.40:0/1357195776 conn(0x7fb8c4069f30 msgr2=0x7fb8c415d160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:38.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.492+0000 7fb8cadff700 1 -- 172.21.15.40:0/1357195776 shutdown_connections 2023-06-22T10:54:38.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.492+0000 7fb8cadff700 1 -- 172.21.15.40:0/1357195776 wait complete. 2023-06-22T10:54:38.513 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-22T10:54:38.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.713+0000 7f09293ff700 1 Processor -- start 2023-06-22T10:54:38.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.713+0000 7f09293ff700 1 -- start start 2023-06-22T10:54:38.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.714+0000 7f09293ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f09240b45d0 0x7f09240b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:38.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.714+0000 7f09293ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f09240b59a0 0x7f09240b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:38.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.714+0000 7f09293ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09240d1be0 con 0x7f09240d2130 2023-06-22T10:54:38.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.714+0000 7f09293ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09240d17f0 con 0x7f09240b45d0 2023-06-22T10:54:38.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.714+0000 7f09293ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09240d1360 con 0x7f09240b59a0 2023-06-22T10:54:38.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.714+0000 7f0922ffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f09240b45d0 0x7f09240b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:38.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.714+0000 7f091bfff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f09240d2130 0x7f09240cd1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51556/0 (socket says 172.21.15.40:51556) 2023-06-22T10:54:38.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.714+0000 7f091bfff700 1 -- 172.21.15.40:0/1257964689 learned_addr learned my addr 172.21.15.40:0/1257964689 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:38.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.715+0000 7f09237fe700 1 --2- 172.21.15.40:0/1257964689 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f09240b59a0 0x7f09240b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:38.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.715+0000 7f0922ffd700 1 -- 172.21.15.40:0/1257964689 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f09240b59a0 msgr2=0x7f09240b5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:38.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.715+0000 7f0922ffd700 1 --2- 172.21.15.40:0/1257964689 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f09240b59a0 0x7f09240b5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:38.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.715+0000 7f0922ffd700 1 -- 172.21.15.40:0/1257964689 >> v1:172.21.15.40:6789/0 conn(0x7f09240d2130 legacy=0x7f09240cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:38.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.715+0000 7f0922ffd700 1 -- 172.21.15.40:0/1257964689 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09240b4ee0 con 0x7f09240b45d0 2023-06-22T10:54:38.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.715+0000 7f09227fc700 1 -- 172.21.15.40:0/1257964689 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4181896272 0 0) 0x7f09240d1be0 con 0x7f09240d2130 2023-06-22T10:54:38.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.715+0000 7f0922ffd700 1 --2- 172.21.15.40:0/1257964689 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09240b45d0 0x7f09240b49a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0914009840 tx=0x7f0914009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c44cde7e14162444 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:38.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.715+0000 7f09227fc700 1 -- 172.21.15.40:0/1257964689 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0914011830 con 0x7f09240b45d0 2023-06-22T10:54:38.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.716+0000 7f09227fc700 1 -- 172.21.15.40:0/1257964689 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0914011990 con 0x7f09240b45d0 2023-06-22T10:54:38.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.716+0000 7f09227fc700 1 -- 172.21.15.40:0/1257964689 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0914011d20 con 0x7f09240b45d0 2023-06-22T10:54:38.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.716+0000 7f09293ff700 1 -- 172.21.15.40:0/1257964689 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09240b45d0 msgr2=0x7f09240b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:38.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.716+0000 7f09293ff700 1 --2- 172.21.15.40:0/1257964689 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09240b45d0 0x7f09240b49a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0914009840 tx=0x7f0914009b50 comp rx=0 tx=0).stop 2023-06-22T10:54:38.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.716+0000 7f09293ff700 1 -- 172.21.15.40:0/1257964689 shutdown_connections 2023-06-22T10:54:38.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.716+0000 7f09293ff700 1 --2- 172.21.15.40:0/1257964689 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f09240b59a0 0x7f09240b5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:38.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.716+0000 7f09293ff700 1 --2- 172.21.15.40:0/1257964689 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09240b45d0 0x7f09240b49a0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:38.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.716+0000 7f09293ff700 1 -- 172.21.15.40:0/1257964689 >> 172.21.15.40:0/1257964689 conn(0x7f09240cf5d0 msgr2=0x7f09240cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:38.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.716+0000 7f09293ff700 1 -- 172.21.15.40:0/1257964689 shutdown_connections 2023-06-22T10:54:38.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.716+0000 7f09293ff700 1 -- 172.21.15.40:0/1257964689 wait complete. 2023-06-22T10:54:38.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.718+0000 7f09293ff700 1 Processor -- start 2023-06-22T10:54:38.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.718+0000 7f09293ff700 1 -- start start 2023-06-22T10:54:38.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.719+0000 7f09293ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09240b45d0 0x7f09240b12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:38.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.719+0000 7f09293ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f09240b59a0 0x7f09240a9f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:38.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.719+0000 7f09293ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09240d2130 0x7f0924149c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:38.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.719+0000 7f09293ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f092414a190 con 0x7f09240d2130 2023-06-22T10:54:38.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.719+0000 7f09293ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f092414a410 con 0x7f09240b45d0 2023-06-22T10:54:38.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.719+0000 7f09293ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f092414a6f0 con 0x7f09240b59a0 2023-06-22T10:54:38.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.719+0000 7f09237fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09240d2130 0x7f0924149c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:38.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.719+0000 7f09237fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09240d2130 0x7f0924149c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56546/0 (socket says 172.21.15.40:56546) 2023-06-22T10:54:38.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.719+0000 7f09237fe700 1 -- 172.21.15.40:0/3882091959 learned_addr learned my addr 172.21.15.40:0/3882091959 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:38.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.719+0000 7f091bfff700 1 --2- 172.21.15.40:0/3882091959 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f09240b59a0 0x7f09240a9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:38.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.719+0000 7f0922ffd700 1 --2- 172.21.15.40:0/3882091959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09240b45d0 0x7f09240b12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:38.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.720+0000 7f09237fe700 1 -- 172.21.15.40:0/3882091959 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f09240b59a0 msgr2=0x7f09240a9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:38.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.720+0000 7f09237fe700 1 --2- 172.21.15.40:0/3882091959 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f09240b59a0 0x7f09240a9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:38.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.720+0000 7f09237fe700 1 -- 172.21.15.40:0/3882091959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09240b45d0 msgr2=0x7f09240b12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:38.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.720+0000 7f09237fe700 1 --2- 172.21.15.40:0/3882091959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09240b45d0 0x7f09240b12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:38.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.720+0000 7f09237fe700 1 -- 172.21.15.40:0/3882091959 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09140094a0 con 0x7f09240d2130 2023-06-22T10:54:38.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.720+0000 7f09237fe700 1 --2- 172.21.15.40:0/3882091959 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09240d2130 0x7f0924149c50 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f091c00efc0 tx=0x7f091c00c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:38.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.720+0000 7f091b7fe700 1 -- 172.21.15.40:0/3882091959 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091c00cad0 con 0x7f09240d2130 2023-06-22T10:54:38.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.720+0000 7f091b7fe700 1 -- 172.21.15.40:0/3882091959 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f091c00f040 con 0x7f09240d2130 2023-06-22T10:54:38.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.720+0000 7f091b7fe700 1 -- 172.21.15.40:0/3882091959 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091c00ce70 con 0x7f09240d2130 2023-06-22T10:54:38.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.720+0000 7f09293ff700 1 -- 172.21.15.40:0/3882091959 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f092414a9d0 con 0x7f09240d2130 2023-06-22T10:54:38.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.721+0000 7f09293ff700 1 -- 172.21.15.40:0/3882091959 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f092414af90 con 0x7f09240d2130 2023-06-22T10:54:38.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.721+0000 7f09293ff700 1 -- 172.21.15.40:0/3882091959 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f092414b1b0 con 0x7f09240d2130 2023-06-22T10:54:38.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.722+0000 7f091b7fe700 1 -- 172.21.15.40:0/3882091959 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f091c014480 con 0x7f09240d2130 2023-06-22T10:54:38.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.723+0000 7f091b7fe700 1 --2- 172.21.15.40:0/3882091959 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f090406ace0 0x7f090406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:38.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.723+0000 7f091b7fe700 1 -- 172.21.15.40:0/3882091959 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f091c089f50 con 0x7f09240d2130 2023-06-22T10:54:38.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.724+0000 7f0922ffd700 1 --2- 172.21.15.40:0/3882091959 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f090406ace0 0x7f090406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:38.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.724+0000 7f0922ffd700 1 --2- 172.21.15.40:0/3882091959 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f090406ace0 0x7f090406d190 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f09140090b0 tx=0x7f091401c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:38.731 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.728+0000 7f091b7fe700 1 -- 172.21.15.40:0/3882091959 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f091c054d70 con 0x7f09240d2130 2023-06-22T10:54:38.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.932+0000 7f09293ff700 1 -- 172.21.15.40:0/3882091959 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f09240d3970 con 0x7f09240d2130 2023-06-22T10:54:38.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.932+0000 7f091b7fe700 1 -- 172.21.15.40:0/3882091959 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7f091c018020 con 0x7f09240d2130 2023-06-22T10:54:38.936 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-06-22T10:54:38.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.934+0000 7f09293ff700 1 -- 172.21.15.40:0/3882091959 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f090406ace0 msgr2=0x7f090406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:38.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.934+0000 7f09293ff700 1 --2- 172.21.15.40:0/3882091959 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f090406ace0 0x7f090406d190 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f09140090b0 tx=0x7f091401c040 comp rx=0 tx=0).stop 2023-06-22T10:54:38.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.934+0000 7f09293ff700 1 -- 172.21.15.40:0/3882091959 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09240d2130 msgr2=0x7f0924149c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:38.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.934+0000 7f09293ff700 1 --2- 172.21.15.40:0/3882091959 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09240d2130 0x7f0924149c50 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f091c00efc0 tx=0x7f091c00c0c0 comp rx=0 tx=0).stop 2023-06-22T10:54:38.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.934+0000 7f09293ff700 1 -- 172.21.15.40:0/3882091959 shutdown_connections 2023-06-22T10:54:38.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.934+0000 7f09293ff700 1 --2- 172.21.15.40:0/3882091959 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f090406ace0 0x7f090406d190 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:38.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.934+0000 7f09293ff700 1 --2- 172.21.15.40:0/3882091959 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09240d2130 0x7f0924149c50 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:38.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.934+0000 7f09293ff700 1 --2- 172.21.15.40:0/3882091959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09240b45d0 0x7f09240b12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:38.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.934+0000 7f09293ff700 1 --2- 172.21.15.40:0/3882091959 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f09240b59a0 0x7f09240a9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:38.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.934+0000 7f09293ff700 1 -- 172.21.15.40:0/3882091959 >> 172.21.15.40:0/3882091959 conn(0x7f09240cf5d0 msgr2=0x7f09240b2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:38.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.935+0000 7f09293ff700 1 -- 172.21.15.40:0/3882091959 shutdown_connections 2023-06-22T10:54:38.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:38.935+0000 7f09293ff700 1 -- 172.21.15.40:0/3882091959 wait complete. 2023-06-22T10:54:38.956 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-22T10:54:39.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.157+0000 7fde6bfff700 1 Processor -- start 2023-06-22T10:54:39.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.157+0000 7fde6bfff700 1 -- start start 2023-06-22T10:54:39.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.159+0000 7fde6bfff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fde640d2130 0x7fde640cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:39.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.159+0000 7fde6bfff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fde640cd6e0 0x7fde640b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:39.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.159+0000 7fde6bfff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde640d1be0 con 0x7fde640b45d0 2023-06-22T10:54:39.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.159+0000 7fde6bfff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde640d17f0 con 0x7fde640d2130 2023-06-22T10:54:39.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.159+0000 7fde6bfff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde640d1360 con 0x7fde640cd6e0 2023-06-22T10:54:39.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.159+0000 7fde69d9b700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fde640b45d0 0x7fde640b49a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.40:57766/0 (socket says 172.21.15.40:57766) 2023-06-22T10:54:39.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.159+0000 7fde69d9b700 1 -- 172.21.15.40:0/1941147792 learned_addr learned my addr 172.21.15.40:0/1941147792 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:39.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.159+0000 7fde6959a700 1 --2- 172.21.15.40:0/1941147792 >> v2:172.21.15.45:3300/0 conn(0x7fde640d2130 0x7fde640cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:39.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.159+0000 7fde6a59c700 1 --2- 172.21.15.40:0/1941147792 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fde640cd6e0 0x7fde640b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:39.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.160+0000 7fde68d99700 1 -- 172.21.15.40:0/1941147792 <== mon.1 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2052958446 0 0) 0x7fde640d1be0 con 0x7fde640b45d0 2023-06-22T10:54:39.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.160+0000 7fde6959a700 1 -- 172.21.15.40:0/1941147792 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fde640cd6e0 msgr2=0x7fde640b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:39.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.160+0000 7fde6959a700 1 --2- 172.21.15.40:0/1941147792 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fde640cd6e0 0x7fde640b59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:39.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.160+0000 7fde6959a700 1 -- 172.21.15.40:0/1941147792 >> v1:172.21.15.45:6789/0 conn(0x7fde640b45d0 legacy=0x7fde640b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:39.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.160+0000 7fde6959a700 1 -- 172.21.15.40:0/1941147792 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde640cef40 con 0x7fde640d2130 2023-06-22T10:54:39.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.160+0000 7fde6a59c700 1 --2- 172.21.15.40:0/1941147792 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fde640cd6e0 0x7fde640b59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-22T10:54:39.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.160+0000 7fde6959a700 1 --2- 172.21.15.40:0/1941147792 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde640d2130 0x7fde640cd1a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fde54009840 tx=0x7fde54009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbfcbfdb2d409c90 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:39.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.160+0000 7fde68d99700 1 -- 172.21.15.40:0/1941147792 <== mon.1 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde54011830 con 0x7fde640d2130 2023-06-22T10:54:39.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.160+0000 7fde68d99700 1 -- 172.21.15.40:0/1941147792 <== mon.1 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde54011990 con 0x7fde640d2130 2023-06-22T10:54:39.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.160+0000 7fde68d99700 1 -- 172.21.15.40:0/1941147792 <== mon.1 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde54011d20 con 0x7fde640d2130 2023-06-22T10:54:39.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.161+0000 7fde6bfff700 1 -- 172.21.15.40:0/1941147792 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde640d2130 msgr2=0x7fde640cd1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:39.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.161+0000 7fde6bfff700 1 --2- 172.21.15.40:0/1941147792 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde640d2130 0x7fde640cd1a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fde54009840 tx=0x7fde54009b50 comp rx=0 tx=0).stop 2023-06-22T10:54:39.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.161+0000 7fde6bfff700 1 -- 172.21.15.40:0/1941147792 shutdown_connections 2023-06-22T10:54:39.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.161+0000 7fde6bfff700 1 --2- 172.21.15.40:0/1941147792 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fde640cd6e0 0x7fde640b59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:39.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.161+0000 7fde6bfff700 1 --2- 172.21.15.40:0/1941147792 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde640d2130 0x7fde640cd1a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:39.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.161+0000 7fde6bfff700 1 -- 172.21.15.40:0/1941147792 >> 172.21.15.40:0/1941147792 conn(0x7fde640cf5d0 msgr2=0x7fde640cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:39.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.161+0000 7fde6bfff700 1 -- 172.21.15.40:0/1941147792 shutdown_connections 2023-06-22T10:54:39.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.161+0000 7fde6bfff700 1 -- 172.21.15.40:0/1941147792 wait complete. 2023-06-22T10:54:39.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.162+0000 7fde6bfff700 1 Processor -- start 2023-06-22T10:54:39.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.163+0000 7fde6bfff700 1 -- start start 2023-06-22T10:54:39.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.164+0000 7fde6bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde640b45d0 0x7fde641f5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:39.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.164+0000 7fde6bfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde640cd6e0 0x7fde641577a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:39.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.164+0000 7fde6bfff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fde640d2130 0x7fde640c8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:39.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.164+0000 7fde6bfff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde64154460 con 0x7fde640cd6e0 2023-06-22T10:54:39.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.164+0000 7fde6bfff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde640c9de0 con 0x7fde640b45d0 2023-06-22T10:54:39.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.164+0000 7fde6bfff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde641f6740 con 0x7fde640d2130 2023-06-22T10:54:39.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.164+0000 7fde6959a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde640cd6e0 0x7fde641577a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:39.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.164+0000 7fde69d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde640b45d0 0x7fde641f5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:39.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.164+0000 7fde6a59c700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fde640d2130 0x7fde640c8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:39.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.164+0000 7fde69d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde640b45d0 0x7fde641f5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.40:60846/0 (socket says 172.21.15.40:60846) 2023-06-22T10:54:39.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.164+0000 7fde69d9b700 1 -- 172.21.15.40:0/4196763661 learned_addr learned my addr 172.21.15.40:0/4196763661 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:39.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.164+0000 7fde6959a700 1 -- 172.21.15.40:0/4196763661 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fde640d2130 msgr2=0x7fde640c8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:39.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.164+0000 7fde6959a700 1 --2- 172.21.15.40:0/4196763661 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fde640d2130 0x7fde640c8950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:39.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.164+0000 7fde6959a700 1 -- 172.21.15.40:0/4196763661 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde640b45d0 msgr2=0x7fde641f5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:39.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.164+0000 7fde6959a700 1 --2- 172.21.15.40:0/4196763661 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde640b45d0 0x7fde641f5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:39.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.164+0000 7fde6959a700 1 -- 172.21.15.40:0/4196763661 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde5c009a70 con 0x7fde640cd6e0 2023-06-22T10:54:39.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.164+0000 7fde69d9b700 1 --2- 172.21.15.40:0/4196763661 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde640b45d0 0x7fde641f5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-22T10:54:39.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.165+0000 7fde6959a700 1 --2- 172.21.15.40:0/4196763661 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde640cd6e0 0x7fde641577a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fde54016000 tx=0x7fde54004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:39.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.165+0000 7fde5a7fc700 1 -- 172.21.15.40:0/4196763661 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde540045d0 con 0x7fde640cd6e0 2023-06-22T10:54:39.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.165+0000 7fde5a7fc700 1 -- 172.21.15.40:0/4196763661 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde5401f070 con 0x7fde640cd6e0 2023-06-22T10:54:39.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.165+0000 7fde6bfff700 1 -- 172.21.15.40:0/4196763661 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde540094a0 con 0x7fde640cd6e0 2023-06-22T10:54:39.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.165+0000 7fde5a7fc700 1 -- 172.21.15.40:0/4196763661 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde540038c0 con 0x7fde640cd6e0 2023-06-22T10:54:39.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.165+0000 7fde6bfff700 1 -- 172.21.15.40:0/4196763661 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde641f5ea0 con 0x7fde640cd6e0 2023-06-22T10:54:39.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.166+0000 7fde6bfff700 1 -- 172.21.15.40:0/4196763661 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde640c9f50 con 0x7fde640cd6e0 2023-06-22T10:54:39.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.167+0000 7fde5a7fc700 1 -- 172.21.15.40:0/4196763661 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fde54003a20 con 0x7fde640cd6e0 2023-06-22T10:54:39.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.168+0000 7fde5a7fc700 1 --2- 172.21.15.40:0/4196763661 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fde4806ace0 0x7fde4806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:39.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.168+0000 7fde5a7fc700 1 -- 172.21.15.40:0/4196763661 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fde54021070 con 0x7fde640cd6e0 2023-06-22T10:54:39.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.168+0000 7fde69d9b700 1 --2- 172.21.15.40:0/4196763661 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fde4806ace0 0x7fde4806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:39.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.169+0000 7fde69d9b700 1 --2- 172.21.15.40:0/4196763661 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fde4806ace0 0x7fde4806d190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fde60000f60 tx=0x7fde60007ea0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:39.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.172+0000 7fde5a7fc700 1 -- 172.21.15.40:0/4196763661 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fde54055b80 con 0x7fde640cd6e0 2023-06-22T10:54:39.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.377+0000 7fde6bfff700 1 -- 172.21.15.40:0/4196763661 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fde64067580 con 0x7fde640cd6e0 2023-06-22T10:54:39.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.378+0000 7fde5a7fc700 1 -- 172.21.15.40:0/4196763661 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7fde5402b020 con 0x7fde640cd6e0 2023-06-22T10:54:39.381 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-06-22T10:54:39.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.380+0000 7fde6bfff700 1 -- 172.21.15.40:0/4196763661 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fde4806ace0 msgr2=0x7fde4806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:39.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.380+0000 7fde6bfff700 1 --2- 172.21.15.40:0/4196763661 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fde4806ace0 0x7fde4806d190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fde60000f60 tx=0x7fde60007ea0 comp rx=0 tx=0).stop 2023-06-22T10:54:39.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.380+0000 7fde6bfff700 1 -- 172.21.15.40:0/4196763661 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde640cd6e0 msgr2=0x7fde641577a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:39.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.380+0000 7fde6bfff700 1 --2- 172.21.15.40:0/4196763661 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde640cd6e0 0x7fde641577a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fde54016000 tx=0x7fde54004750 comp rx=0 tx=0).stop 2023-06-22T10:54:39.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.381+0000 7fde6bfff700 1 -- 172.21.15.40:0/4196763661 shutdown_connections 2023-06-22T10:54:39.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.381+0000 7fde6bfff700 1 --2- 172.21.15.40:0/4196763661 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fde4806ace0 0x7fde4806d190 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:39.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.381+0000 7fde6bfff700 1 --2- 172.21.15.40:0/4196763661 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fde640d2130 0x7fde640c8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:39.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.381+0000 7fde6bfff700 1 --2- 172.21.15.40:0/4196763661 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde640b45d0 0x7fde641f5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:39.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.381+0000 7fde6bfff700 1 --2- 172.21.15.40:0/4196763661 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde640cd6e0 0x7fde641577a0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:39.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.381+0000 7fde6bfff700 1 -- 172.21.15.40:0/4196763661 >> 172.21.15.40:0/4196763661 conn(0x7fde640cf5d0 msgr2=0x7fde640b7990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:39.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.381+0000 7fde6bfff700 1 -- 172.21.15.40:0/4196763661 shutdown_connections 2023-06-22T10:54:39.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.381+0000 7fde6bfff700 1 -- 172.21.15.40:0/4196763661 wait complete. 2023-06-22T10:54:39.420 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-06-22T10:54:39.507 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-06-22T10:54:39.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.706+0000 7f32eefff700 1 Processor -- start 2023-06-22T10:54:39.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.706+0000 7f32eefff700 1 -- start start 2023-06-22T10:54:39.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.708+0000 7f32eefff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f32e80d2830 0x7f32e80b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:39.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.708+0000 7f32eefff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32e80b2130 con 0x7f32e80b4c60 2023-06-22T10:54:39.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.708+0000 7f32eefff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32e8161180 con 0x7f32e815c720 2023-06-22T10:54:39.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.708+0000 7f32eefff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32e8160d60 con 0x7f32e80d2830 2023-06-22T10:54:39.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.708+0000 7f32ed59c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f32e80b4c60 0x7f32e80d0d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51566/0 (socket says 172.21.15.40:51566) 2023-06-22T10:54:39.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.708+0000 7f32ed59c700 1 -- 172.21.15.40:0/1490555369 learned_addr learned my addr 172.21.15.40:0/1490555369 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:39.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.708+0000 7f32e7fff700 1 --2- 172.21.15.40:0/1490555369 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f32e80d2830 0x7f32e80b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:39.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.708+0000 7f32e77fe700 1 -- 172.21.15.40:0/1490555369 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2460186441 0 0) 0x7f32e80b2130 con 0x7f32e80b4c60 2023-06-22T10:54:39.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.709+0000 7f32e77fe700 1 -- 172.21.15.40:0/1490555369 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32d80035b0 con 0x7f32e80b4c60 2023-06-22T10:54:39.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.709+0000 7f32e77fe700 1 -- 172.21.15.40:0/1490555369 <== mon.1 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2809746361 0 0) 0x7f32e8161180 con 0x7f32e815c720 2023-06-22T10:54:39.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.709+0000 7f32e77fe700 1 -- 172.21.15.40:0/1490555369 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32e80b2130 con 0x7f32e815c720 2023-06-22T10:54:39.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.709+0000 7f32e7fff700 1 -- 172.21.15.40:0/1490555369 >> v1:172.21.15.45:6789/0 conn(0x7f32e815c720 legacy=0x7f32e80b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:39.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.709+0000 7f32e7fff700 1 -- 172.21.15.40:0/1490555369 >> v1:172.21.15.40:6789/0 conn(0x7f32e80b4c60 legacy=0x7f32e80d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:39.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.709+0000 7f32e7fff700 1 -- 172.21.15.40:0/1490555369 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32e81603c0 con 0x7f32e80d2830 2023-06-22T10:54:39.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.709+0000 7f32e7fff700 1 --2- 172.21.15.40:0/1490555369 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f32e80d2830 0x7f32e80b4720 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f32d4009870 tx=0x7f32d4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44476d9949bc45dc server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:39.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.709+0000 7f32e77fe700 1 -- 172.21.15.40:0/1490555369 <== mon.2 v2:172.21.15.45:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d4011830 con 0x7f32e80d2830 2023-06-22T10:54:39.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.709+0000 7f32e77fe700 1 -- 172.21.15.40:0/1490555369 <== mon.2 v2:172.21.15.45:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32d4011990 con 0x7f32e80d2830 2023-06-22T10:54:39.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.709+0000 7f32e77fe700 1 -- 172.21.15.40:0/1490555369 <== mon.2 v2:172.21.15.45:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d4011d20 con 0x7f32e80d2830 2023-06-22T10:54:39.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.710+0000 7f32eefff700 1 -- 172.21.15.40:0/1490555369 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f32e80d2830 msgr2=0x7f32e80b4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:39.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.710+0000 7f32eefff700 1 --2- 172.21.15.40:0/1490555369 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f32e80d2830 0x7f32e80b4720 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f32d4009870 tx=0x7f32d4009b80 comp rx=0 tx=0).stop 2023-06-22T10:54:39.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.710+0000 7f32eefff700 1 -- 172.21.15.40:0/1490555369 shutdown_connections 2023-06-22T10:54:39.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.710+0000 7f32eefff700 1 --2- 172.21.15.40:0/1490555369 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f32e80d2830 0x7f32e80b4720 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:39.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.710+0000 7f32eefff700 1 -- 172.21.15.40:0/1490555369 >> 172.21.15.40:0/1490555369 conn(0x7f32e80cf720 msgr2=0x7f32e80cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:39.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.710+0000 7f32eefff700 1 -- 172.21.15.40:0/1490555369 shutdown_connections 2023-06-22T10:54:39.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.710+0000 7f32eefff700 1 -- 172.21.15.40:0/1490555369 wait complete. 2023-06-22T10:54:39.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.712+0000 7f32eefff700 1 Processor -- start 2023-06-22T10:54:39.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.712+0000 7f32eefff700 1 -- start start 2023-06-22T10:54:39.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.713+0000 7f32eefff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32e80b4c60 0x7f32e80cb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:39.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.713+0000 7f32eefff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f32e80d2830 0x7f32e815f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:39.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.713+0000 7f32eefff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32e815c720 0x7f32e80c9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:39.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.713+0000 7f32eefff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e80a95e0 con 0x7f32e80b4c60 2023-06-22T10:54:39.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.713+0000 7f32eefff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e815d720 con 0x7f32e815c720 2023-06-22T10:54:39.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.713+0000 7f32eefff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32e815ce30 con 0x7f32e80d2830 2023-06-22T10:54:39.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.713+0000 7f32ecd9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32e80b4c60 0x7f32e80cb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:39.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.713+0000 7f32ecd9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32e80b4c60 0x7f32e80cb9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56572/0 (socket says 172.21.15.40:56572) 2023-06-22T10:54:39.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.713+0000 7f32ecd9b700 1 -- 172.21.15.40:0/1092428821 learned_addr learned my addr 172.21.15.40:0/1092428821 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:39.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.713+0000 7f32ed59c700 1 --2- 172.21.15.40:0/1092428821 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32e815c720 0x7f32e80c9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:39.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.713+0000 7f32e7fff700 1 --2- 172.21.15.40:0/1092428821 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f32e80d2830 0x7f32e815f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:39.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.713+0000 7f32ecd9b700 1 -- 172.21.15.40:0/1092428821 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f32e80d2830 msgr2=0x7f32e815f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:39.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.713+0000 7f32ecd9b700 1 --2- 172.21.15.40:0/1092428821 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f32e80d2830 0x7f32e815f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:39.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.713+0000 7f32ecd9b700 1 -- 172.21.15.40:0/1092428821 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32e815c720 msgr2=0x7f32e80c9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:39.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.713+0000 7f32ecd9b700 1 --2- 172.21.15.40:0/1092428821 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32e815c720 0x7f32e80c9d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:39.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.713+0000 7f32ecd9b700 1 -- 172.21.15.40:0/1092428821 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32d40094a0 con 0x7f32e80b4c60 2023-06-22T10:54:39.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.714+0000 7f32ecd9b700 1 --2- 172.21.15.40:0/1092428821 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32e80b4c60 0x7f32e80cb9b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f32dc00c520 tx=0x7f32dc00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:39.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.714+0000 7f32e57fa700 1 -- 172.21.15.40:0/1092428821 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32dc0052d0 con 0x7f32e80b4c60 2023-06-22T10:54:39.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.714+0000 7f32e57fa700 1 -- 172.21.15.40:0/1092428821 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32dc005430 con 0x7f32e80b4c60 2023-06-22T10:54:39.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.714+0000 7f32e57fa700 1 -- 172.21.15.40:0/1092428821 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32dc0038c0 con 0x7f32e80b4c60 2023-06-22T10:54:39.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.714+0000 7f32eefff700 1 -- 172.21.15.40:0/1092428821 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32e81f1d20 con 0x7f32e80b4c60 2023-06-22T10:54:39.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.714+0000 7f32eefff700 1 -- 172.21.15.40:0/1092428821 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32e815d3b0 con 0x7f32e80b4c60 2023-06-22T10:54:39.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.715+0000 7f32eefff700 1 -- 172.21.15.40:0/1092428821 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32e8067580 con 0x7f32e80b4c60 2023-06-22T10:54:39.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.716+0000 7f32e57fa700 1 -- 172.21.15.40:0/1092428821 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f32dc003a20 con 0x7f32e80b4c60 2023-06-22T10:54:39.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.717+0000 7f32e57fa700 1 --2- 172.21.15.40:0/1092428821 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f32cc06ace0 0x7f32cc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:39.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.717+0000 7f32e57fa700 1 -- 172.21.15.40:0/1092428821 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f32dc088c30 con 0x7f32e80b4c60 2023-06-22T10:54:39.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.718+0000 7f32e7fff700 1 --2- 172.21.15.40:0/1092428821 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f32cc06ace0 0x7f32cc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:39.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.718+0000 7f32e7fff700 1 --2- 172.21.15.40:0/1092428821 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f32cc06ace0 0x7f32cc06d190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f32d40097c0 tx=0x7f32d401c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:39.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:39.722+0000 7f32e57fa700 1 -- 172.21.15.40:0/1092428821 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f32dc0539b0 con 0x7f32e80b4c60 2023-06-22T10:54:40.021 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:40.018+0000 7f32eefff700 1 -- 172.21.15.40:0/1092428821 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7f32e80cd140 con 0x7f32e80b4c60 2023-06-22T10:54:40.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:40.817+0000 7f32e57fa700 1 -- 172.21.15.40:0/1092428821 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v85) v1 ==== 147+0+0 (secure 0 0 0) 0x7f32dc056fd0 con 0x7f32e80b4c60 2023-06-22T10:54:40.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:40.820+0000 7f32eefff700 1 -- 172.21.15.40:0/1092428821 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f32cc06ace0 msgr2=0x7f32cc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:40.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:40.820+0000 7f32eefff700 1 --2- 172.21.15.40:0/1092428821 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f32cc06ace0 0x7f32cc06d190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f32d40097c0 tx=0x7f32d401c040 comp rx=0 tx=0).stop 2023-06-22T10:54:40.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:40.820+0000 7f32eefff700 1 -- 172.21.15.40:0/1092428821 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32e80b4c60 msgr2=0x7f32e80cb9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:40.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:40.820+0000 7f32eefff700 1 --2- 172.21.15.40:0/1092428821 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32e80b4c60 0x7f32e80cb9b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f32dc00c520 tx=0x7f32dc00c830 comp rx=0 tx=0).stop 2023-06-22T10:54:40.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:40.820+0000 7f32eefff700 1 -- 172.21.15.40:0/1092428821 shutdown_connections 2023-06-22T10:54:40.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:40.820+0000 7f32eefff700 1 --2- 172.21.15.40:0/1092428821 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f32cc06ace0 0x7f32cc06d190 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:40.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:40.820+0000 7f32eefff700 1 --2- 172.21.15.40:0/1092428821 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32e815c720 0x7f32e80c9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:40.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:40.820+0000 7f32eefff700 1 --2- 172.21.15.40:0/1092428821 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32e80b4c60 0x7f32e80cb9b0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:40.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:40.820+0000 7f32eefff700 1 --2- 172.21.15.40:0/1092428821 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f32e80d2830 0x7f32e815f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:40.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:40.820+0000 7f32eefff700 1 -- 172.21.15.40:0/1092428821 >> 172.21.15.40:0/1092428821 conn(0x7f32e80cf720 msgr2=0x7f32e80d0ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:40.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:40.820+0000 7f32eefff700 1 -- 172.21.15.40:0/1092428821 shutdown_connections 2023-06-22T10:54:40.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:40.820+0000 7f32eefff700 1 -- 172.21.15.40:0/1092428821 wait complete. 2023-06-22T10:54:40.845 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-06-22T10:54:41.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.050+0000 7fe86afff700 1 Processor -- start 2023-06-22T10:54:41.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.050+0000 7fe86afff700 1 -- start start 2023-06-22T10:54:41.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.051+0000 7fe86afff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe8640b45d0 0x7fe8640b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:41.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.051+0000 7fe86afff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe8640d2130 0x7fe8640cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:41.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.051+0000 7fe86afff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe8640cd6e0 0x7fe8640b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:41.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.051+0000 7fe86afff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8640d17f0 con 0x7fe8640b45d0 2023-06-22T10:54:41.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.051+0000 7fe86afff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8640d1be0 con 0x7fe8640d2130 2023-06-22T10:54:41.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.051+0000 7fe86afff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8640d1360 con 0x7fe8640cd6e0 2023-06-22T10:54:41.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.051+0000 7fe868d9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe8640b45d0 0x7fe8640b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:41.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.051+0000 7fe868d9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe8640b45d0 0x7fe8640b49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56586/0 (socket says 172.21.15.40:56586) 2023-06-22T10:54:41.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.051+0000 7fe868d9b700 1 -- 172.21.15.40:0/2673600125 learned_addr learned my addr 172.21.15.40:0/2673600125 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:41.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.052+0000 7fe863fff700 1 --2- 172.21.15.40:0/2673600125 >> v2:172.21.15.45:3300/0 conn(0x7fe8640d2130 0x7fe8640cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:41.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.052+0000 7fe86959c700 1 --2- 172.21.15.40:0/2673600125 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe8640cd6e0 0x7fe8640b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:41.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.052+0000 7fe868d9b700 1 -- 172.21.15.40:0/2673600125 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe8640cd6e0 msgr2=0x7fe8640b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:41.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.052+0000 7fe868d9b700 1 --2- 172.21.15.40:0/2673600125 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe8640cd6e0 0x7fe8640b59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:41.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.052+0000 7fe868d9b700 1 -- 172.21.15.40:0/2673600125 >> v2:172.21.15.45:3300/0 conn(0x7fe8640d2130 msgr2=0x7fe8640cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:41.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.052+0000 7fe868d9b700 1 --2- 172.21.15.40:0/2673600125 >> v2:172.21.15.45:3300/0 conn(0x7fe8640d2130 0x7fe8640cd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:41.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.052+0000 7fe868d9b700 1 -- 172.21.15.40:0/2673600125 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8640b4ee0 con 0x7fe8640b45d0 2023-06-22T10:54:41.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.052+0000 7fe86959c700 1 --2- 172.21.15.40:0/2673600125 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe8640cd6e0 0x7fe8640b59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:54:41.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.052+0000 7fe863fff700 1 --2- 172.21.15.40:0/2673600125 >> v2:172.21.15.45:3300/0 conn(0x7fe8640d2130 0x7fe8640cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:54:41.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.052+0000 7fe868d9b700 1 --2- 172.21.15.40:0/2673600125 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8640b45d0 0x7fe8640b49a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe8640668c0 tx=0x7fe858009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cb7dd94a38b143f server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:41.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.052+0000 7fe8637fe700 1 -- 172.21.15.40:0/2673600125 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85800b870 con 0x7fe8640b45d0 2023-06-22T10:54:41.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.052+0000 7fe8637fe700 1 -- 172.21.15.40:0/2673600125 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe85800b9d0 con 0x7fe8640b45d0 2023-06-22T10:54:41.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.052+0000 7fe8637fe700 1 -- 172.21.15.40:0/2673600125 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85800bd60 con 0x7fe8640b45d0 2023-06-22T10:54:41.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.053+0000 7fe86afff700 1 -- 172.21.15.40:0/2673600125 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8640b45d0 msgr2=0x7fe8640b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:41.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.053+0000 7fe86afff700 1 --2- 172.21.15.40:0/2673600125 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8640b45d0 0x7fe8640b49a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe8640668c0 tx=0x7fe858009bd0 comp rx=0 tx=0).stop 2023-06-22T10:54:41.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.053+0000 7fe86afff700 1 -- 172.21.15.40:0/2673600125 shutdown_connections 2023-06-22T10:54:41.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.053+0000 7fe86afff700 1 --2- 172.21.15.40:0/2673600125 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe8640cd6e0 0x7fe8640b59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:41.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.053+0000 7fe86afff700 1 --2- 172.21.15.40:0/2673600125 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8640b45d0 0x7fe8640b49a0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:41.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.053+0000 7fe86afff700 1 --2- 172.21.15.40:0/2673600125 >> v2:172.21.15.45:3300/0 conn(0x7fe8640d2130 0x7fe8640cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:41.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.053+0000 7fe86afff700 1 -- 172.21.15.40:0/2673600125 >> 172.21.15.40:0/2673600125 conn(0x7fe8640cf5d0 msgr2=0x7fe8640cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:41.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.053+0000 7fe86afff700 1 -- 172.21.15.40:0/2673600125 shutdown_connections 2023-06-22T10:54:41.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.053+0000 7fe86afff700 1 -- 172.21.15.40:0/2673600125 wait complete. 2023-06-22T10:54:41.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.055+0000 7fe86afff700 1 Processor -- start 2023-06-22T10:54:41.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.055+0000 7fe86afff700 1 -- start start 2023-06-22T10:54:41.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.056+0000 7fe86afff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8640b45d0 0x7fe8640cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:41.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.056+0000 7fe86afff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe8640cd6e0 0x7fe864156020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:41.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.056+0000 7fe86afff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8640d2130 0x7fe86415e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:41.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.056+0000 7fe86afff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8641f1d40 con 0x7fe8640d2130 2023-06-22T10:54:41.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.056+0000 7fe86afff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8641f5820 con 0x7fe8640b45d0 2023-06-22T10:54:41.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.056+0000 7fe86afff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8641f5b00 con 0x7fe8640cd6e0 2023-06-22T10:54:41.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.056+0000 7fe86959c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8640d2130 0x7fe86415e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:41.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.056+0000 7fe86959c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8640d2130 0x7fe86415e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56596/0 (socket says 172.21.15.40:56596) 2023-06-22T10:54:41.062 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.056+0000 7fe86959c700 1 -- 172.21.15.40:0/3168710547 learned_addr learned my addr 172.21.15.40:0/3168710547 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:41.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.057+0000 7fe868d9b700 1 --2- 172.21.15.40:0/3168710547 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8640b45d0 0x7fe8640cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:41.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.057+0000 7fe863fff700 1 --2- 172.21.15.40:0/3168710547 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe8640cd6e0 0x7fe864156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:41.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.057+0000 7fe86959c700 1 -- 172.21.15.40:0/3168710547 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe8640cd6e0 msgr2=0x7fe864156020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:41.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.057+0000 7fe86959c700 1 --2- 172.21.15.40:0/3168710547 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe8640cd6e0 0x7fe864156020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:41.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.057+0000 7fe86959c700 1 -- 172.21.15.40:0/3168710547 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8640b45d0 msgr2=0x7fe8640cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:41.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.057+0000 7fe86959c700 1 --2- 172.21.15.40:0/3168710547 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8640b45d0 0x7fe8640cafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:41.063 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.057+0000 7fe86959c700 1 -- 172.21.15.40:0/3168710547 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe858009550 con 0x7fe8640d2130 2023-06-22T10:54:41.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.057+0000 7fe863fff700 1 --2- 172.21.15.40:0/3168710547 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe8640cd6e0 0x7fe864156020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-22T10:54:41.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.057+0000 7fe86959c700 1 --2- 172.21.15.40:0/3168710547 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8640d2130 0x7fe86415e060 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe85c007e10 tx=0x7fe85c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:41.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.057+0000 7fe8617fa700 1 -- 172.21.15.40:0/3168710547 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85c00de90 con 0x7fe8640d2130 2023-06-22T10:54:41.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.057+0000 7fe8617fa700 1 -- 172.21.15.40:0/3168710547 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe85c00f040 con 0x7fe8640d2130 2023-06-22T10:54:41.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.057+0000 7fe8617fa700 1 -- 172.21.15.40:0/3168710547 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85c003c60 con 0x7fe8640d2130 2023-06-22T10:54:41.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.057+0000 7fe86afff700 1 -- 172.21.15.40:0/3168710547 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8641f5de0 con 0x7fe8640d2130 2023-06-22T10:54:41.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.057+0000 7fe86afff700 1 -- 172.21.15.40:0/3168710547 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe864156560 con 0x7fe8640d2130 2023-06-22T10:54:41.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.058+0000 7fe86afff700 1 -- 172.21.15.40:0/3168710547 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe864072bf0 con 0x7fe8640d2130 2023-06-22T10:54:41.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.059+0000 7fe8617fa700 1 -- 172.21.15.40:0/3168710547 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe85c004030 con 0x7fe8640d2130 2023-06-22T10:54:41.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.060+0000 7fe8617fa700 1 --2- 172.21.15.40:0/3168710547 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe84806ace0 0x7fe84806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:41.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.061+0000 7fe8617fa700 1 -- 172.21.15.40:0/3168710547 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe85c089a50 con 0x7fe8640d2130 2023-06-22T10:54:41.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.061+0000 7fe868d9b700 1 --2- 172.21.15.40:0/3168710547 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe84806ace0 0x7fe84806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:41.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.062+0000 7fe868d9b700 1 --2- 172.21.15.40:0/3168710547 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe84806ace0 0x7fe84806d190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe858014040 tx=0x7fe858008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:41.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.065+0000 7fe8617fa700 1 -- 172.21.15.40:0/3168710547 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe85c054730 con 0x7fe8640d2130 2023-06-22T10:54:41.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.274+0000 7fe86afff700 1 -- 172.21.15.40:0/3168710547 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fe8640cdb00 con 0x7fe8640d2130 2023-06-22T10:54:41.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.278+0000 7fe8617fa700 1 -- 172.21.15.40:0/3168710547 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe85c057d50 con 0x7fe8640d2130 2023-06-22T10:54:41.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.281+0000 7fe86afff700 1 -- 172.21.15.40:0/3168710547 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe84806ace0 msgr2=0x7fe84806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:41.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.281+0000 7fe86afff700 1 --2- 172.21.15.40:0/3168710547 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe84806ace0 0x7fe84806d190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe858014040 tx=0x7fe858008030 comp rx=0 tx=0).stop 2023-06-22T10:54:41.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.281+0000 7fe86afff700 1 -- 172.21.15.40:0/3168710547 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8640d2130 msgr2=0x7fe86415e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:41.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.281+0000 7fe86afff700 1 --2- 172.21.15.40:0/3168710547 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8640d2130 0x7fe86415e060 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe85c007e10 tx=0x7fe85c00d3b0 comp rx=0 tx=0).stop 2023-06-22T10:54:41.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.281+0000 7fe86afff700 1 -- 172.21.15.40:0/3168710547 shutdown_connections 2023-06-22T10:54:41.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.281+0000 7fe86afff700 1 --2- 172.21.15.40:0/3168710547 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe84806ace0 0x7fe84806d190 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:41.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.281+0000 7fe86afff700 1 --2- 172.21.15.40:0/3168710547 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8640d2130 0x7fe86415e060 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:41.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.281+0000 7fe86afff700 1 --2- 172.21.15.40:0/3168710547 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8640b45d0 0x7fe8640cafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:41.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.281+0000 7fe86afff700 1 --2- 172.21.15.40:0/3168710547 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe8640cd6e0 0x7fe864156020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:41.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.281+0000 7fe86afff700 1 -- 172.21.15.40:0/3168710547 >> 172.21.15.40:0/3168710547 conn(0x7fe8640cf5d0 msgr2=0x7fe86415aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:41.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.281+0000 7fe86afff700 1 -- 172.21.15.40:0/3168710547 shutdown_connections 2023-06-22T10:54:41.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.281+0000 7fe86afff700 1 -- 172.21.15.40:0/3168710547 wait complete. 2023-06-22T10:54:41.302 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-06-22T10:54:41.303 DEBUG:teuthology.orchestra.run.smithi040:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-22T10:54:41.397 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-22T10:54:41.504 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-06-22T10:54:41.505 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-06-22T10:54:41.505 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-22T10:54:41.551 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-06-22T10:54:41.552 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-22T10:54:41.636 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-06-22T10:54:41.637 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-22T10:54:41.722 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-22T10:54:41.965 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.960+0000 7feb08dff700 1 Processor -- start 2023-06-22T10:54:41.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.960+0000 7feb08dff700 1 -- start start 2023-06-22T10:54:41.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.961+0000 7feb08dff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7feb040add30 0x7feb04159f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:41.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.961+0000 7feb08dff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7feb040b3910 0x7feb040b3d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:41.966 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.961+0000 7feb08dff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb040b42b0 con 0x7feb040b3120 2023-06-22T10:54:41.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.961+0000 7feb08dff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb0415d370 con 0x7feb040b3910 2023-06-22T10:54:41.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.961+0000 7feb08dff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb04153bc0 con 0x7feb040add30 2023-06-22T10:54:41.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.962+0000 7feb02d9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7feb040b3910 0x7feb040b3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:41.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.962+0000 7feb01d9b700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7feb040add30 0x7feb04159f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:41.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.962+0000 7feb0259c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7feb040b3120 0x7feb0415cc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.40:57788/0 (socket says 172.21.15.40:57788) 2023-06-22T10:54:41.967 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.962+0000 7feb0259c700 1 -- 172.21.15.40:0/1129450788 learned_addr learned my addr 172.21.15.40:0/1129450788 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:41.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.962+0000 7feb01d9b700 1 -- 172.21.15.40:0/1129450788 >> v2:172.21.15.45:3300/0 conn(0x7feb040b3910 msgr2=0x7feb040b3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:41.968 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.962+0000 7feb01d9b700 1 --2- 172.21.15.40:0/1129450788 >> v2:172.21.15.45:3300/0 conn(0x7feb040b3910 0x7feb040b3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:41.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.962+0000 7feb01d9b700 1 -- 172.21.15.40:0/1129450788 >> v1:172.21.15.45:6789/0 conn(0x7feb040b3120 legacy=0x7feb0415cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:41.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.962+0000 7feb01d9b700 1 -- 172.21.15.40:0/1129450788 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb0415d560 con 0x7feb040add30 2023-06-22T10:54:41.969 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.962+0000 7feb0159a700 1 -- 172.21.15.40:0/1129450788 <== mon.1 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 707635741 0 0) 0x7feb040b42b0 con 0x7feb040b3120 2023-06-22T10:54:41.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.963+0000 7feb01d9b700 1 --2- 172.21.15.40:0/1129450788 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7feb040add30 0x7feb04159f80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7feaf8009820 tx=0x7feaf8009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4b4ceb3a20d571e server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:41.971 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.963+0000 7feb0159a700 1 -- 172.21.15.40:0/1129450788 <== mon.2 v2:172.21.15.45:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf8005e30 con 0x7feb040add30 2023-06-22T10:54:41.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.963+0000 7feb0159a700 1 -- 172.21.15.40:0/1129450788 <== mon.2 v2:172.21.15.45:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf8006030 con 0x7feb040add30 2023-06-22T10:54:41.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.963+0000 7feb0159a700 1 -- 172.21.15.40:0/1129450788 <== mon.2 v2:172.21.15.45:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf80063c0 con 0x7feb040add30 2023-06-22T10:54:41.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.963+0000 7feb08dff700 1 -- 172.21.15.40:0/1129450788 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7feb040add30 msgr2=0x7feb04159f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:41.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.963+0000 7feb08dff700 1 --2- 172.21.15.40:0/1129450788 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7feb040add30 0x7feb04159f80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7feaf8009820 tx=0x7feaf8009b30 comp rx=0 tx=0).stop 2023-06-22T10:54:41.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.963+0000 7feb08dff700 1 -- 172.21.15.40:0/1129450788 shutdown_connections 2023-06-22T10:54:41.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.963+0000 7feb08dff700 1 --2- 172.21.15.40:0/1129450788 >> v2:172.21.15.45:3300/0 conn(0x7feb040b3910 0x7feb040b3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:41.972 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.963+0000 7feb08dff700 1 --2- 172.21.15.40:0/1129450788 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7feb040add30 0x7feb04159f80 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:41.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.964+0000 7feb08dff700 1 -- 172.21.15.40:0/1129450788 >> 172.21.15.40:0/1129450788 conn(0x7feb04069f30 msgr2=0x7feb0406a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:41.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.964+0000 7feb08dff700 1 -- 172.21.15.40:0/1129450788 shutdown_connections 2023-06-22T10:54:41.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.964+0000 7feb08dff700 1 -- 172.21.15.40:0/1129450788 wait complete. 2023-06-22T10:54:41.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.965+0000 7feb08dff700 1 Processor -- start 2023-06-22T10:54:41.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.965+0000 7feb08dff700 1 -- start start 2023-06-22T10:54:41.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.966+0000 7feb08dff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb040add30 0x7feb04151330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:41.973 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.966+0000 7feb08dff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7feb040b3120 0x7feb04152a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:41.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.966+0000 7feb08dff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb040b3910 0x7feb0413a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:41.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.966+0000 7feb08dff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb04151870 con 0x7feb040add30 2023-06-22T10:54:41.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.966+0000 7feb08dff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb04150ea0 con 0x7feb040b3910 2023-06-22T10:54:41.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.966+0000 7feb08dff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb041535a0 con 0x7feb040b3120 2023-06-22T10:54:41.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.967+0000 7feb0259c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb040add30 0x7feb04151330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:41.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.967+0000 7feb0259c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb040add30 0x7feb04151330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56610/0 (socket says 172.21.15.40:56610) 2023-06-22T10:54:41.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.967+0000 7feb0259c700 1 -- 172.21.15.40:0/4277142448 learned_addr learned my addr 172.21.15.40:0/4277142448 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:41.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.967+0000 7feb01d9b700 1 --2- 172.21.15.40:0/4277142448 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7feb040b3120 0x7feb04152a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:41.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.967+0000 7feb02d9d700 1 --2- 172.21.15.40:0/4277142448 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb040b3910 0x7feb0413a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:41.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.967+0000 7feb01d9b700 1 -- 172.21.15.40:0/4277142448 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb040b3910 msgr2=0x7feb0413a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:41.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.967+0000 7feb01d9b700 1 --2- 172.21.15.40:0/4277142448 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb040b3910 0x7feb0413a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:41.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.967+0000 7feb01d9b700 1 -- 172.21.15.40:0/4277142448 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb040add30 msgr2=0x7feb04151330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:41.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.967+0000 7feb01d9b700 1 --2- 172.21.15.40:0/4277142448 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb040add30 0x7feb04151330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:41.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.967+0000 7feb01d9b700 1 -- 172.21.15.40:0/4277142448 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf8009430 con 0x7feb040b3120 2023-06-22T10:54:41.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.967+0000 7feb0259c700 1 --2- 172.21.15.40:0/4277142448 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb040add30 0x7feb04151330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-22T10:54:41.975 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.968+0000 7feb01d9b700 1 --2- 172.21.15.40:0/4277142448 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7feb040b3120 0x7feb04152a90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7feb040b12e0 tx=0x7feaf8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:41.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.968+0000 7feaf2ffd700 1 -- 172.21.15.40:0/4277142448 <== mon.2 v2:172.21.15.45:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf80063a0 con 0x7feb040b3120 2023-06-22T10:54:41.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.968+0000 7feaf2ffd700 1 -- 172.21.15.40:0/4277142448 <== mon.2 v2:172.21.15.45:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf8006500 con 0x7feb040b3120 2023-06-22T10:54:41.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.968+0000 7feb08dff700 1 -- 172.21.15.40:0/4277142448 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb041532c0 con 0x7feb040b3120 2023-06-22T10:54:41.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.968+0000 7feaf2ffd700 1 -- 172.21.15.40:0/4277142448 <== mon.2 v2:172.21.15.45:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf80068b0 con 0x7feb040b3120 2023-06-22T10:54:41.976 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.968+0000 7feb08dff700 1 -- 172.21.15.40:0/4277142448 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb04150b30 con 0x7feb040b3120 2023-06-22T10:54:41.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.969+0000 7feb08dff700 1 -- 172.21.15.40:0/4277142448 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb04151010 con 0x7feb040b3120 2023-06-22T10:54:41.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.970+0000 7feaf2ffd700 1 -- 172.21.15.40:0/4277142448 <== mon.2 v2:172.21.15.45:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7feaf8022070 con 0x7feb040b3120 2023-06-22T10:54:41.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.971+0000 7feaf2ffd700 1 --2- 172.21.15.40:0/4277142448 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7feae406ace0 0x7feae406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:41.977 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.971+0000 7feaf2ffd700 1 -- 172.21.15.40:0/4277142448 <== mon.2 v2:172.21.15.45:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7feaf808b2f0 con 0x7feb040b3120 2023-06-22T10:54:41.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.971+0000 7feb0259c700 1 --2- 172.21.15.40:0/4277142448 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7feae406ace0 0x7feae406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:41.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.972+0000 7feb0259c700 1 --2- 172.21.15.40:0/4277142448 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7feae406ace0 0x7feae406d190 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7feaf4000f60 tx=0x7feaf4007ea0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:41.978 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:41.975+0000 7feaf2ffd700 1 -- 172.21.15.40:0/4277142448 <== mon.2 v2:172.21.15.45:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7feaf80560e0 con 0x7feb040b3120 2023-06-22T10:54:42.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.178+0000 7feb08dff700 1 -- 172.21.15.40:0/4277142448 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feb04067580 con 0x7feb040b3120 2023-06-22T10:54:42.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.180+0000 7feaf2ffd700 1 -- 172.21.15.40:0/4277142448 <== mon.2 v2:172.21.15.45:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20132 (secure 0 0 0) 0x7feaf8059700 con 0x7feb040b3120 2023-06-22T10:54:42.184 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:54:42.184 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":30,"fsid":"475560bc-1a7c-4a75-b3b6-6fc6b20bdc52","created":"2023-06-22T10:53:03.784568+0000","modified":"2023-06-22T10:54:12.717204+0000","last_up_change":"2023-06-22T10:53:17.830348+0000","last_in_change":"2023-06-22T10:53:07.329974+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-22T10:53:17.182228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-22T10:53:23.874432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-22T10:53:29.812963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-22T10:53:30.404021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-22T10:53:33.982289+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"918db6b4-053a-46ba-976d-6e1a0104017f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6809","nonce":2400162888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6811","nonce":2400162888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6815","nonce":2400162888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6813","nonce":2400162888}]},"public_addr":"172.21.15.40:6809/2400162888","cluster_addr":"172.21.15.40:6811/2400162888","heartbeat_back_addr":"172.21.15.40:6815/2400162888","heartbeat_front_addr":"172.21.15.40:6813/2400162888","state":["exists","up"]},{"osd":1,"uuid":"0c146e2b-1725-4dae-9b5c-38795943b9d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6801","nonce":230885800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6803","nonce":230885800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6807","nonce":230885800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6805","nonce":230885800}]},"public_addr":"172.21.15.40:6801/230885800","cluster_addr":"172.21.15.40:6803/230885800","heartbeat_back_addr":"172.21.15.40:6807/230885800","heartbeat_front_addr":"172.21.15.40:6805/230885800","state":["exists","up"]},{"osd":2,"uuid":"0b3727fd-f281-46d5-a675-86c8c5ab269e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6817","nonce":2681404929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6819","nonce":2681404929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6823","nonce":2681404929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6821","nonce":2681404929}]},"public_addr":"172.21.15.40:6817/2681404929","cluster_addr":"172.21.15.40:6819/2681404929","heartbeat_back_addr":"172.21.15.40:6823/2681404929","heartbeat_front_addr":"172.21.15.40:6821/2681404929","state":["exists","up"]},{"osd":3,"uuid":"2969c698-7039-4bbb-beda-f756f7a368a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6825","nonce":111110981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6827","nonce":111110981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6831","nonce":111110981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6829","nonce":111110981}]},"public_addr":"172.21.15.40:6825/111110981","cluster_addr":"172.21.15.40:6827/111110981","heartbeat_back_addr":"172.21.15.40:6831/111110981","heartbeat_front_addr":"172.21.15.40:6829/111110981","state":["exists","up"]},{"osd":4,"uuid":"3bb1d9c8-8e42-4a6b-998d-04834f34be5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6801","nonce":3625455711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6803","nonce":3625455711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6807","nonce":3625455711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6805","nonce":3625455711}]},"public_addr":"172.21.15.45:6801/3625455711","cluster_addr":"172.21.15.45:6803/3625455711","heartbeat_back_addr":"172.21.15.45:6807/3625455711","heartbeat_front_addr":"172.21.15.45:6805/3625455711","state":["exists","up"]},{"osd":5,"uuid":"f9854ee4-302c-41be-977b-bedda090a3d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6817","nonce":3354411217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6819","nonce":3354411217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6823","nonce":3354411217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6821","nonce":3354411217}]},"public_addr":"172.21.15.45:6817/3354411217","cluster_addr":"172.21.15.45:6819/3354411217","heartbeat_back_addr":"172.21.15.45:6823/3354411217","heartbeat_front_addr":"172.21.15.45:6821/3354411217","state":["exists","up"]},{"osd":6,"uuid":"bbdb1989-f6ac-4954-9b85-b8b540d683c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6809","nonce":320111074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6811","nonce":320111074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6815","nonce":320111074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6813","nonce":320111074}]},"public_addr":"172.21.15.45:6809/320111074","cluster_addr":"172.21.15.45:6811/320111074","heartbeat_back_addr":"172.21.15.45:6815/320111074","heartbeat_front_addr":"172.21.15.45:6813/320111074","state":["exists","up"]},{"osd":7,"uuid":"823d44e3-58f1-4d1d-8263-a4e4a69d4327","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6825","nonce":643617680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6827","nonce":643617680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6831","nonce":643617680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6829","nonce":643617680}]},"public_addr":"172.21.15.45:6825/643617680","cluster_addr":"172.21.15.45:6827/643617680","heartbeat_back_addr":"172.21.15.45:6831/643617680","heartbeat_front_addr":"172.21.15.45:6829/643617680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.731262+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.873226+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.898936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.666578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.645990+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.953699+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.642823+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.693395+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1b","mappings":[{"from":3,"to":2}]},{"pgid":"4.2a","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-22T10:54:42.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.182+0000 7feb08dff700 1 -- 172.21.15.40:0/4277142448 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7feae406ace0 msgr2=0x7feae406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:42.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.182+0000 7feb08dff700 1 --2- 172.21.15.40:0/4277142448 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7feae406ace0 0x7feae406d190 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7feaf4000f60 tx=0x7feaf4007ea0 comp rx=0 tx=0).stop 2023-06-22T10:54:42.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.182+0000 7feb08dff700 1 -- 172.21.15.40:0/4277142448 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7feb040b3120 msgr2=0x7feb04152a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:42.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.182+0000 7feb08dff700 1 --2- 172.21.15.40:0/4277142448 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7feb040b3120 0x7feb04152a90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7feb040b12e0 tx=0x7feaf8004750 comp rx=0 tx=0).stop 2023-06-22T10:54:42.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.183+0000 7feb08dff700 1 -- 172.21.15.40:0/4277142448 shutdown_connections 2023-06-22T10:54:42.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.183+0000 7feb08dff700 1 --2- 172.21.15.40:0/4277142448 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7feae406ace0 0x7feae406d190 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:42.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.183+0000 7feb08dff700 1 --2- 172.21.15.40:0/4277142448 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb040b3910 0x7feb0413a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:42.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.183+0000 7feb08dff700 1 --2- 172.21.15.40:0/4277142448 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb040add30 0x7feb04151330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:42.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.183+0000 7feb08dff700 1 --2- 172.21.15.40:0/4277142448 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7feb040b3120 0x7feb04152a90 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:42.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.183+0000 7feb08dff700 1 -- 172.21.15.40:0/4277142448 >> 172.21.15.40:0/4277142448 conn(0x7feb04069f30 msgr2=0x7feb040b3d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:42.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.183+0000 7feb08dff700 1 -- 172.21.15.40:0/4277142448 shutdown_connections 2023-06-22T10:54:42.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.183+0000 7feb08dff700 1 -- 172.21.15.40:0/4277142448 wait complete. 2023-06-22T10:54:42.205 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-22T10:53:17.182228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-22T10:53:23.874432+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-22T10:53:29.812963+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-22T10:53:30.404021+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-22T10:53:33.982289+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-22T10:54:42.206 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-22T10:54:42.410 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.407+0000 7f26af9ff700 1 Processor -- start 2023-06-22T10:54:42.411 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.407+0000 7f26af9ff700 1 -- start start 2023-06-22T10:54:42.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.408+0000 7f26af9ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f26a80b45d0 0x7f26a80b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:42.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.408+0000 7f26af9ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f26a80d2130 0x7f26a80cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:42.412 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.408+0000 7f26af9ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f26a80cd6e0 0x7f26a80b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:42.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.408+0000 7f26af9ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26a80d17f0 con 0x7f26a80cd6e0 2023-06-22T10:54:42.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.408+0000 7f26af9ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26a80d1be0 con 0x7f26a80b45d0 2023-06-22T10:54:42.413 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.408+0000 7f26af9ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26a80d1360 con 0x7f26a80d2130 2023-06-22T10:54:42.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.409+0000 7f26adf9c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f26a80cd6e0 0x7f26a80b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:42.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.409+0000 7f26adf9c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f26a80cd6e0 0x7f26a80b59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56612/0 (socket says 172.21.15.40:56612) 2023-06-22T10:54:42.414 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.409+0000 7f26adf9c700 1 -- 172.21.15.40:0/3103828156 learned_addr learned my addr 172.21.15.40:0/3103828156 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:42.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.409+0000 7f26acf9a700 1 --2- 172.21.15.40:0/3103828156 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f26a80d2130 0x7f26a80cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:42.415 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.409+0000 7f26ad79b700 1 --2- 172.21.15.40:0/3103828156 >> v2:172.21.15.45:3300/0 conn(0x7f26a80b45d0 0x7f26a80b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:42.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.409+0000 7f26adf9c700 1 -- 172.21.15.40:0/3103828156 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f26a80d2130 msgr2=0x7f26a80cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:42.417 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.409+0000 7f26adf9c700 1 --2- 172.21.15.40:0/3103828156 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f26a80d2130 0x7f26a80cd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:42.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.409+0000 7f26adf9c700 1 -- 172.21.15.40:0/3103828156 >> v2:172.21.15.45:3300/0 conn(0x7f26a80b45d0 msgr2=0x7f26a80b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:42.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.409+0000 7f26adf9c700 1 --2- 172.21.15.40:0/3103828156 >> v2:172.21.15.45:3300/0 conn(0x7f26a80b45d0 0x7f26a80b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:42.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.409+0000 7f26adf9c700 1 -- 172.21.15.40:0/3103828156 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26a80b4ee0 con 0x7f26a80cd6e0 2023-06-22T10:54:42.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.409+0000 7f26ad79b700 1 --2- 172.21.15.40:0/3103828156 >> v2:172.21.15.45:3300/0 conn(0x7f26a80b45d0 0x7f26a80b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:54:42.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.409+0000 7f26adf9c700 1 --2- 172.21.15.40:0/3103828156 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26a80cd6e0 0x7f26a80b59a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f26a80668f0 tx=0x7f26a000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4db3bcafef83f12d server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:42.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.410+0000 7f269ffff700 1 -- 172.21.15.40:0/3103828156 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a000e070 con 0x7f26a80cd6e0 2023-06-22T10:54:42.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.410+0000 7f269ffff700 1 -- 172.21.15.40:0/3103828156 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26a000b910 con 0x7f26a80cd6e0 2023-06-22T10:54:42.418 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.410+0000 7f269ffff700 1 -- 172.21.15.40:0/3103828156 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a000bcc0 con 0x7f26a80cd6e0 2023-06-22T10:54:42.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.410+0000 7f26af9ff700 1 -- 172.21.15.40:0/3103828156 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26a80cd6e0 msgr2=0x7f26a80b59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:42.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.410+0000 7f26af9ff700 1 --2- 172.21.15.40:0/3103828156 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26a80cd6e0 0x7f26a80b59a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f26a80668f0 tx=0x7f26a000b330 comp rx=0 tx=0).stop 2023-06-22T10:54:42.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.410+0000 7f26af9ff700 1 -- 172.21.15.40:0/3103828156 shutdown_connections 2023-06-22T10:54:42.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.410+0000 7f26af9ff700 1 --2- 172.21.15.40:0/3103828156 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26a80cd6e0 0x7f26a80b59a0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:42.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.410+0000 7f26af9ff700 1 --2- 172.21.15.40:0/3103828156 >> v2:172.21.15.45:3300/0 conn(0x7f26a80b45d0 0x7f26a80b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:42.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.410+0000 7f26af9ff700 1 --2- 172.21.15.40:0/3103828156 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f26a80d2130 0x7f26a80cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:42.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.410+0000 7f26af9ff700 1 -- 172.21.15.40:0/3103828156 >> 172.21.15.40:0/3103828156 conn(0x7f26a80cf5d0 msgr2=0x7f26a80cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:42.419 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.411+0000 7f26af9ff700 1 -- 172.21.15.40:0/3103828156 shutdown_connections 2023-06-22T10:54:42.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.411+0000 7f26af9ff700 1 -- 172.21.15.40:0/3103828156 wait complete. 2023-06-22T10:54:42.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.412+0000 7f26af9ff700 1 Processor -- start 2023-06-22T10:54:42.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.412+0000 7f26af9ff700 1 -- start start 2023-06-22T10:54:42.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.413+0000 7f26af9ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26a80b45d0 0x7f26a81f16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:42.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.413+0000 7f26af9ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f26a80cd6e0 0x7f26a80b6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:42.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.413+0000 7f26af9ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26a80d2130 0x7f26a80ca260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:42.420 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.413+0000 7f26af9ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a80b6a90 con 0x7f26a80d2130 2023-06-22T10:54:42.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.413+0000 7f26af9ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a80b6d70 con 0x7f26a80b45d0 2023-06-22T10:54:42.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.413+0000 7f26af9ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26a80b7050 con 0x7f26a80cd6e0 2023-06-22T10:54:42.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.414+0000 7f26adf9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26a80d2130 0x7f26a80ca260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:42.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.414+0000 7f26adf9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26a80d2130 0x7f26a80ca260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56620/0 (socket says 172.21.15.40:56620) 2023-06-22T10:54:42.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.414+0000 7f26adf9c700 1 -- 172.21.15.40:0/588241610 learned_addr learned my addr 172.21.15.40:0/588241610 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:42.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.414+0000 7f26ad79b700 1 --2- 172.21.15.40:0/588241610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26a80b45d0 0x7f26a81f16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:42.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.414+0000 7f26acf9a700 1 --2- 172.21.15.40:0/588241610 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f26a80cd6e0 0x7f26a80b6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:42.421 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.414+0000 7f26adf9c700 1 -- 172.21.15.40:0/588241610 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f26a80cd6e0 msgr2=0x7f26a80b6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:42.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.414+0000 7f26adf9c700 1 --2- 172.21.15.40:0/588241610 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f26a80cd6e0 0x7f26a80b6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:42.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.414+0000 7f26adf9c700 1 -- 172.21.15.40:0/588241610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26a80b45d0 msgr2=0x7f26a81f16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:42.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.414+0000 7f26adf9c700 1 --2- 172.21.15.40:0/588241610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26a80b45d0 0x7f26a81f16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:42.422 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.414+0000 7f26adf9c700 1 -- 172.21.15.40:0/588241610 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26a0009b30 con 0x7f26a80d2130 2023-06-22T10:54:42.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.415+0000 7f26adf9c700 1 --2- 172.21.15.40:0/588241610 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26a80d2130 0x7f26a80ca260 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f26a806a0c0 tx=0x7f26a0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:42.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.415+0000 7f269dffb700 1 -- 172.21.15.40:0/588241610 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a00092e0 con 0x7f26a80d2130 2023-06-22T10:54:42.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.415+0000 7f269dffb700 1 -- 172.21.15.40:0/588241610 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26a0004250 con 0x7f26a80d2130 2023-06-22T10:54:42.423 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.415+0000 7f269dffb700 1 -- 172.21.15.40:0/588241610 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a0004620 con 0x7f26a80d2130 2023-06-22T10:54:42.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.415+0000 7f26af9ff700 1 -- 172.21.15.40:0/588241610 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26a80b7330 con 0x7f26a80d2130 2023-06-22T10:54:42.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.415+0000 7f26af9ff700 1 -- 172.21.15.40:0/588241610 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26a815d430 con 0x7f26a80d2130 2023-06-22T10:54:42.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.416+0000 7f26af9ff700 1 -- 172.21.15.40:0/588241610 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26a8067580 con 0x7f26a80d2130 2023-06-22T10:54:42.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.417+0000 7f269dffb700 1 -- 172.21.15.40:0/588241610 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f26a0004780 con 0x7f26a80d2130 2023-06-22T10:54:42.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.418+0000 7f269dffb700 1 --2- 172.21.15.40:0/588241610 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f268c06ace0 0x7f268c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:42.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.418+0000 7f269dffb700 1 -- 172.21.15.40:0/588241610 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f26a008abf0 con 0x7f26a80d2130 2023-06-22T10:54:42.424 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.418+0000 7f26ad79b700 1 --2- 172.21.15.40:0/588241610 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f268c06ace0 0x7f268c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:42.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.419+0000 7f26ad79b700 1 --2- 172.21.15.40:0/588241610 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f268c06ace0 0x7f268c06d190 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f26a40045f0 tx=0x7f26a4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:42.425 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.422+0000 7f269dffb700 1 -- 172.21.15.40:0/588241610 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f26a0055960 con 0x7f26a80d2130 2023-06-22T10:54:42.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.625+0000 7f26af9ff700 1 -- 172.21.15.40:0/588241610 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f26a8072fb0 con 0x7f26a80d2130 2023-06-22T10:54:42.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.626+0000 7f269dffb700 1 -- 172.21.15.40:0/588241610 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f26a002a020 con 0x7f26a80d2130 2023-06-22T10:54:42.629 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-06-22T10:54:42.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.628+0000 7f26af9ff700 1 -- 172.21.15.40:0/588241610 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f268c06ace0 msgr2=0x7f268c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:42.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.628+0000 7f26af9ff700 1 --2- 172.21.15.40:0/588241610 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f268c06ace0 0x7f268c06d190 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f26a40045f0 tx=0x7f26a4008040 comp rx=0 tx=0).stop 2023-06-22T10:54:42.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.628+0000 7f26af9ff700 1 -- 172.21.15.40:0/588241610 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26a80d2130 msgr2=0x7f26a80ca260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:42.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.628+0000 7f26af9ff700 1 --2- 172.21.15.40:0/588241610 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26a80d2130 0x7f26a80ca260 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f26a806a0c0 tx=0x7f26a0004ad0 comp rx=0 tx=0).stop 2023-06-22T10:54:42.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.628+0000 7f26af9ff700 1 -- 172.21.15.40:0/588241610 shutdown_connections 2023-06-22T10:54:42.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.628+0000 7f26af9ff700 1 --2- 172.21.15.40:0/588241610 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f268c06ace0 0x7f268c06d190 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:42.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.628+0000 7f26af9ff700 1 --2- 172.21.15.40:0/588241610 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26a80d2130 0x7f26a80ca260 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:42.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.628+0000 7f26af9ff700 1 --2- 172.21.15.40:0/588241610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26a80b45d0 0x7f26a81f16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:42.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.628+0000 7f26af9ff700 1 --2- 172.21.15.40:0/588241610 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f26a80cd6e0 0x7f26a80b6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:42.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.628+0000 7f26af9ff700 1 -- 172.21.15.40:0/588241610 >> 172.21.15.40:0/588241610 conn(0x7f26a80cf5d0 msgr2=0x7f26a815aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:42.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.628+0000 7f26af9ff700 1 -- 172.21.15.40:0/588241610 shutdown_connections 2023-06-22T10:54:42.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.628+0000 7f26af9ff700 1 -- 172.21.15.40:0/588241610 wait complete. 2023-06-22T10:54:42.649 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-22T10:54:42.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.852+0000 7f36e95ff700 1 Processor -- start 2023-06-22T10:54:42.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.852+0000 7f36e95ff700 1 -- start start 2023-06-22T10:54:42.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.853+0000 7f36e95ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f36e40b59a0 0x7f36e40b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:42.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.853+0000 7f36e95ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36e40d1be0 con 0x7f36e40b45d0 2023-06-22T10:54:42.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.853+0000 7f36e95ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36e40d1360 con 0x7f36e40d2130 2023-06-22T10:54:42.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.853+0000 7f36e95ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36e40d17f0 con 0x7f36e40b59a0 2023-06-22T10:54:42.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.853+0000 7f36e2ffd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f36e40b45d0 0x7f36e40b49a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51578/0 (socket says 172.21.15.40:51578) 2023-06-22T10:54:42.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.853+0000 7f36e2ffd700 1 -- 172.21.15.40:0/2102610506 learned_addr learned my addr 172.21.15.40:0/2102610506 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:42.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.854+0000 7f36e37fe700 1 --2- 172.21.15.40:0/2102610506 >> v2:172.21.15.45:3300/0 conn(0x7f36e40b59a0 0x7f36e40b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:42.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.854+0000 7f36e1ffb700 1 -- 172.21.15.40:0/2102610506 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1426831683 0 0) 0x7f36e40d1be0 con 0x7f36e40b45d0 2023-06-22T10:54:42.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.854+0000 7f36e1ffb700 1 -- 172.21.15.40:0/2102610506 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36cc0035b0 con 0x7f36e40b45d0 2023-06-22T10:54:42.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.854+0000 7f36e1ffb700 1 -- 172.21.15.40:0/2102610506 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3343381278 0 0) 0x7f36cc0035b0 con 0x7f36e40b45d0 2023-06-22T10:54:42.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.854+0000 7f36e1ffb700 1 -- 172.21.15.40:0/2102610506 >> v2:172.21.15.45:3300/0 conn(0x7f36e40b59a0 msgr2=0x7f36e40b5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:42.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.854+0000 7f36e1ffb700 1 --2- 172.21.15.40:0/2102610506 >> v2:172.21.15.45:3300/0 conn(0x7f36e40b59a0 0x7f36e40b5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:42.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.854+0000 7f36e1ffb700 1 -- 172.21.15.40:0/2102610506 >> v1:172.21.15.45:6789/0 conn(0x7f36e40d2130 legacy=0x7f36e40cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:42.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.854+0000 7f36e1ffb700 1 -- 172.21.15.40:0/2102610506 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e40cef40 con 0x7f36e40b45d0 2023-06-22T10:54:42.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.854+0000 7f36e1ffb700 1 -- 172.21.15.40:0/2102610506 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1490606486 0 0) 0x7f36d4001670 con 0x7f36e40b45d0 2023-06-22T10:54:42.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.854+0000 7f36e1ffb700 1 -- 172.21.15.40:0/2102610506 >> v1:172.21.15.40:6789/0 conn(0x7f36e40b45d0 legacy=0x7f36e40b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:42.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.854+0000 7f36e1ffb700 1 --2- 172.21.15.40:0/2102610506 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36cc003a50 0x7f36cc003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:42.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.854+0000 7f36e1ffb700 1 --2- 172.21.15.40:0/2102610506 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36cc004850 0x7f36cc004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:42.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.854+0000 7f36e1ffb700 1 --2- 172.21.15.40:0/2102610506 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f36cc005250 0x7f36cc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:42.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.854+0000 7f36e1ffb700 1 -- 172.21.15.40:0/2102610506 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e40d17f0 con 0x7f36cc003a50 2023-06-22T10:54:42.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.854+0000 7f36e1ffb700 1 -- 172.21.15.40:0/2102610506 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36cc00c160 con 0x7f36cc004850 2023-06-22T10:54:42.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.854+0000 7f36e1ffb700 1 -- 172.21.15.40:0/2102610506 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36cc00c320 con 0x7f36cc005250 2023-06-22T10:54:42.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.855+0000 7f36e2ffd700 1 --2- 172.21.15.40:0/2102610506 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36cc003a50 0x7f36cc003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:42.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.855+0000 7f36e27fc700 1 --2- 172.21.15.40:0/2102610506 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36cc004850 0x7f36cc004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:42.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.855+0000 7f36e37fe700 1 --2- 172.21.15.40:0/2102610506 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f36cc005250 0x7f36cc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:42.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.855+0000 7f36e2ffd700 1 -- 172.21.15.40:0/2102610506 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f36cc005250 msgr2=0x7f36cc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:42.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.855+0000 7f36e2ffd700 1 --2- 172.21.15.40:0/2102610506 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f36cc005250 0x7f36cc00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:42.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.855+0000 7f36e2ffd700 1 -- 172.21.15.40:0/2102610506 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36cc004850 msgr2=0x7f36cc004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:42.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.855+0000 7f36e2ffd700 1 --2- 172.21.15.40:0/2102610506 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36cc004850 0x7f36cc004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:42.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.855+0000 7f36e2ffd700 1 -- 172.21.15.40:0/2102610506 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36cc0035b0 con 0x7f36cc003a50 2023-06-22T10:54:42.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.855+0000 7f36e37fe700 1 -- 172.21.15.40:0/2102610506 reap_dead start 2023-06-22T10:54:42.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.855+0000 7f36e27fc700 1 --2- 172.21.15.40:0/2102610506 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36cc004850 0x7f36cc004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-22T10:54:42.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.855+0000 7f36e2ffd700 1 --2- 172.21.15.40:0/2102610506 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36cc003a50 0x7f36cc003e60 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f36d400c190 tx=0x7f36cc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=384824092f4c0447 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:42.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.856+0000 7f36e1ffb700 1 -- 172.21.15.40:0/2102610506 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d4007b30 con 0x7f36cc003a50 2023-06-22T10:54:42.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.856+0000 7f36e1ffb700 1 -- 172.21.15.40:0/2102610506 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36d400cd10 con 0x7f36cc003a50 2023-06-22T10:54:42.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.856+0000 7f36e1ffb700 1 -- 172.21.15.40:0/2102610506 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d4005ba0 con 0x7f36cc003a50 2023-06-22T10:54:42.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.856+0000 7f36e95ff700 1 -- 172.21.15.40:0/2102610506 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36cc003a50 msgr2=0x7f36cc003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:42.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.856+0000 7f36e95ff700 1 --2- 172.21.15.40:0/2102610506 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36cc003a50 0x7f36cc003e60 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f36d400c190 tx=0x7f36cc005880 comp rx=0 tx=0).stop 2023-06-22T10:54:42.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.856+0000 7f36e95ff700 1 -- 172.21.15.40:0/2102610506 shutdown_connections 2023-06-22T10:54:42.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.856+0000 7f36e95ff700 1 --2- 172.21.15.40:0/2102610506 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36cc003a50 0x7f36cc003e60 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:42.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.856+0000 7f36e95ff700 1 -- 172.21.15.40:0/2102610506 >> 172.21.15.40:0/2102610506 conn(0x7f36e40cf5d0 msgr2=0x7f36e40cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:42.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.856+0000 7f36e95ff700 1 -- 172.21.15.40:0/2102610506 shutdown_connections 2023-06-22T10:54:42.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.856+0000 7f36e95ff700 1 -- 172.21.15.40:0/2102610506 wait complete. 2023-06-22T10:54:42.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.858+0000 7f36e95ff700 1 Processor -- start 2023-06-22T10:54:42.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.858+0000 7f36e95ff700 1 -- start start 2023-06-22T10:54:42.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.859+0000 7f36e95ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f36cc003a50 0x7f36e4159770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:42.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.859+0000 7f36e95ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36e41543b0 0x7f36e41f26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:42.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.859+0000 7f36e95ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36e415eb40 0x7f36e415efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:42.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.859+0000 7f36e95ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e41e58e0 con 0x7f36e41543b0 2023-06-22T10:54:42.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.859+0000 7f36e95ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e415e340 con 0x7f36e415eb40 2023-06-22T10:54:42.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.859+0000 7f36e95ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36e41e4fd0 con 0x7f36cc003a50 2023-06-22T10:54:42.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.859+0000 7f36e27fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36e41543b0 0x7f36e41f26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:42.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.859+0000 7f36e27fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36e41543b0 0x7f36e41f26d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56644/0 (socket says 172.21.15.40:56644) 2023-06-22T10:54:42.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.859+0000 7f36e27fc700 1 -- 172.21.15.40:0/942358425 learned_addr learned my addr 172.21.15.40:0/942358425 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:42.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.860+0000 7f36e2ffd700 1 --2- 172.21.15.40:0/942358425 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f36cc003a50 0x7f36e4159770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:42.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.860+0000 7f36e37fe700 1 --2- 172.21.15.40:0/942358425 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36e415eb40 0x7f36e415efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:42.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.860+0000 7f36e27fc700 1 -- 172.21.15.40:0/942358425 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f36cc003a50 msgr2=0x7f36e4159770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:42.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.860+0000 7f36e27fc700 1 --2- 172.21.15.40:0/942358425 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f36cc003a50 0x7f36e4159770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:42.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.860+0000 7f36e27fc700 1 -- 172.21.15.40:0/942358425 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36e415eb40 msgr2=0x7f36e415efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:42.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.860+0000 7f36e27fc700 1 --2- 172.21.15.40:0/942358425 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36e415eb40 0x7f36e415efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:42.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.860+0000 7f36e27fc700 1 -- 172.21.15.40:0/942358425 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e415d4c0 con 0x7f36e41543b0 2023-06-22T10:54:42.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.860+0000 7f36e37fe700 1 --2- 172.21.15.40:0/942358425 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36e415eb40 0x7f36e415efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-22T10:54:42.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.860+0000 7f36e27fc700 1 --2- 172.21.15.40:0/942358425 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36e41543b0 0x7f36e41f26d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f36d800f7c0 tx=0x7f36d800fb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:42.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.860+0000 7f36cb7fe700 1 -- 172.21.15.40:0/942358425 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d80052e0 con 0x7f36e41543b0 2023-06-22T10:54:42.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.860+0000 7f36cb7fe700 1 -- 172.21.15.40:0/942358425 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36d8005440 con 0x7f36e41543b0 2023-06-22T10:54:42.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.860+0000 7f36cb7fe700 1 -- 172.21.15.40:0/942358425 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d80038a0 con 0x7f36e41543b0 2023-06-22T10:54:42.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.860+0000 7f36e95ff700 1 -- 172.21.15.40:0/942358425 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36e41e5220 con 0x7f36e41543b0 2023-06-22T10:54:42.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.860+0000 7f36e95ff700 1 -- 172.21.15.40:0/942358425 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36e41f2c10 con 0x7f36e41543b0 2023-06-22T10:54:42.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.862+0000 7f36e95ff700 1 -- 172.21.15.40:0/942358425 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36e40b5390 con 0x7f36e41543b0 2023-06-22T10:54:42.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.862+0000 7f36cb7fe700 1 -- 172.21.15.40:0/942358425 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f36d8003a00 con 0x7f36e41543b0 2023-06-22T10:54:42.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.863+0000 7f36cb7fe700 1 --2- 172.21.15.40:0/942358425 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f36d006ace0 0x7f36d006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:42.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.863+0000 7f36cb7fe700 1 -- 172.21.15.40:0/942358425 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f36d8089550 con 0x7f36e41543b0 2023-06-22T10:54:42.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.863+0000 7f36e2ffd700 1 --2- 172.21.15.40:0/942358425 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f36d006ace0 0x7f36d006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:42.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.864+0000 7f36e2ffd700 1 --2- 172.21.15.40:0/942358425 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f36d006ace0 0x7f36d006d190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f36e415cf30 tx=0x7f36d4007000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:42.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:42.868+0000 7f36cb7fe700 1 -- 172.21.15.40:0/942358425 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f36d80542c0 con 0x7f36e41543b0 2023-06-22T10:54:43.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.074+0000 7f36e95ff700 1 -- 172.21.15.40:0/942358425 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f36e4067580 con 0x7f36e41543b0 2023-06-22T10:54:43.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.075+0000 7f36cb7fe700 1 -- 172.21.15.40:0/942358425 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7f36d8003cb0 con 0x7f36e41543b0 2023-06-22T10:54:43.078 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 8 2023-06-22T10:54:43.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.077+0000 7f36e95ff700 1 -- 172.21.15.40:0/942358425 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f36d006ace0 msgr2=0x7f36d006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:43.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.077+0000 7f36e95ff700 1 --2- 172.21.15.40:0/942358425 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f36d006ace0 0x7f36d006d190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f36e415cf30 tx=0x7f36d4007000 comp rx=0 tx=0).stop 2023-06-22T10:54:43.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.077+0000 7f36e95ff700 1 -- 172.21.15.40:0/942358425 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36e41543b0 msgr2=0x7f36e41f26d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:43.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.077+0000 7f36e95ff700 1 --2- 172.21.15.40:0/942358425 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36e41543b0 0x7f36e41f26d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f36d800f7c0 tx=0x7f36d800fb80 comp rx=0 tx=0).stop 2023-06-22T10:54:43.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.077+0000 7f36e95ff700 1 -- 172.21.15.40:0/942358425 shutdown_connections 2023-06-22T10:54:43.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.077+0000 7f36e95ff700 1 --2- 172.21.15.40:0/942358425 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f36d006ace0 0x7f36d006d190 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:43.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.077+0000 7f36e95ff700 1 --2- 172.21.15.40:0/942358425 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f36cc003a50 0x7f36e4159770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:43.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.077+0000 7f36e95ff700 1 --2- 172.21.15.40:0/942358425 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36e415eb40 0x7f36e415efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:43.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.077+0000 7f36e95ff700 1 --2- 172.21.15.40:0/942358425 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f36e41543b0 0x7f36e41f26d0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:43.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.077+0000 7f36e95ff700 1 -- 172.21.15.40:0/942358425 >> 172.21.15.40:0/942358425 conn(0x7f36e40cf5d0 msgr2=0x7f36e40b3d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:43.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.077+0000 7f36e95ff700 1 -- 172.21.15.40:0/942358425 shutdown_connections 2023-06-22T10:54:43.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.077+0000 7f36e95ff700 1 -- 172.21.15.40:0/942358425 wait complete. 2023-06-22T10:54:43.098 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-22T10:54:43.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.301+0000 7fac3c1ff700 1 Processor -- start 2023-06-22T10:54:43.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.301+0000 7fac3c1ff700 1 -- start start 2023-06-22T10:54:43.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.302+0000 7fac3c1ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fac340cdf70 0x7fac3415b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:43.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.302+0000 7fac3c1ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac340b01e0 con 0x7fac34069f30 2023-06-22T10:54:43.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.302+0000 7fac3c1ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac340703b0 con 0x7fac341511c0 2023-06-22T10:54:43.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.302+0000 7fac3c1ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac34151590 con 0x7fac340cdf70 2023-06-22T10:54:43.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.303+0000 7fac3a79c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fac34069f30 0x7fac340ada40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51590/0 (socket says 172.21.15.40:51590) 2023-06-22T10:54:43.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.303+0000 7fac3a79c700 1 -- 172.21.15.40:0/2676903817 learned_addr learned my addr 172.21.15.40:0/2676903817 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:43.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.303+0000 7fac3979a700 1 --2- 172.21.15.40:0/2676903817 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fac340cdf70 0x7fac3415b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:43.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.303+0000 7fac38f99700 1 -- 172.21.15.40:0/2676903817 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2423291300 0 0) 0x7fac340b01e0 con 0x7fac34069f30 2023-06-22T10:54:43.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.303+0000 7fac38f99700 1 -- 172.21.15.40:0/2676903817 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac200035b0 con 0x7fac34069f30 2023-06-22T10:54:43.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.303+0000 7fac38f99700 1 -- 172.21.15.40:0/2676903817 <== mon.1 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1972796917 0 0) 0x7fac340703b0 con 0x7fac341511c0 2023-06-22T10:54:43.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.303+0000 7fac3979a700 1 -- 172.21.15.40:0/2676903817 >> v1:172.21.15.45:6789/0 conn(0x7fac341511c0 legacy=0x7fac34070b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:43.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.303+0000 7fac3979a700 1 -- 172.21.15.40:0/2676903817 >> v1:172.21.15.40:6789/0 conn(0x7fac34069f30 legacy=0x7fac340ada40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:43.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.303+0000 7fac3979a700 1 -- 172.21.15.40:0/2676903817 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac34071280 con 0x7fac340cdf70 2023-06-22T10:54:43.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.304+0000 7fac3979a700 1 --2- 172.21.15.40:0/2676903817 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fac340cdf70 0x7fac3415b0c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fac24009870 tx=0x7fac24009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=139e8d4e4e2459f8 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:43.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.304+0000 7fac38f99700 1 -- 172.21.15.40:0/2676903817 <== mon.2 v2:172.21.15.45:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac24011830 con 0x7fac340cdf70 2023-06-22T10:54:43.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.304+0000 7fac38f99700 1 -- 172.21.15.40:0/2676903817 <== mon.2 v2:172.21.15.45:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac24011990 con 0x7fac340cdf70 2023-06-22T10:54:43.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.304+0000 7fac38f99700 1 -- 172.21.15.40:0/2676903817 <== mon.2 v2:172.21.15.45:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac24011d00 con 0x7fac340cdf70 2023-06-22T10:54:43.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.305+0000 7fac3c1ff700 1 -- 172.21.15.40:0/2676903817 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fac340cdf70 msgr2=0x7fac3415b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:43.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.305+0000 7fac3c1ff700 1 --2- 172.21.15.40:0/2676903817 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fac340cdf70 0x7fac3415b0c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fac24009870 tx=0x7fac24009b80 comp rx=0 tx=0).stop 2023-06-22T10:54:43.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.305+0000 7fac3c1ff700 1 -- 172.21.15.40:0/2676903817 shutdown_connections 2023-06-22T10:54:43.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.305+0000 7fac3c1ff700 1 --2- 172.21.15.40:0/2676903817 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fac340cdf70 0x7fac3415b0c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:43.310 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.305+0000 7fac3c1ff700 1 -- 172.21.15.40:0/2676903817 >> 172.21.15.40:0/2676903817 conn(0x7fac340b1030 msgr2=0x7fac340ce7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:43.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.305+0000 7fac3c1ff700 1 -- 172.21.15.40:0/2676903817 shutdown_connections 2023-06-22T10:54:43.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.305+0000 7fac3c1ff700 1 -- 172.21.15.40:0/2676903817 wait complete. 2023-06-22T10:54:43.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.306+0000 7fac3c1ff700 1 Processor -- start 2023-06-22T10:54:43.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.307+0000 7fac3c1ff700 1 -- start start 2023-06-22T10:54:43.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.308+0000 7fac3c1ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fac34069f30 0x7fac341e4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:43.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.308+0000 7fac3c1ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac340cdf70 0x7fac3414a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:43.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.308+0000 7fac3c1ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac341511c0 0x7fac340b2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:43.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.308+0000 7fac3c1ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac341e42e0 con 0x7fac341511c0 2023-06-22T10:54:43.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.308+0000 7fac3c1ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac3415e8d0 con 0x7fac340cdf70 2023-06-22T10:54:43.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.308+0000 7fac3c1ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac341e3c20 con 0x7fac34069f30 2023-06-22T10:54:43.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.308+0000 7fac3a79c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac341511c0 0x7fac340b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:43.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.308+0000 7fac3a79c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac341511c0 0x7fac340b2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56660/0 (socket says 172.21.15.40:56660) 2023-06-22T10:54:43.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.308+0000 7fac3a79c700 1 -- 172.21.15.40:0/2586810623 learned_addr learned my addr 172.21.15.40:0/2586810623 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:43.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.308+0000 7fac39f9b700 1 --2- 172.21.15.40:0/2586810623 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fac34069f30 0x7fac341e4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:43.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.308+0000 7fac3979a700 1 --2- 172.21.15.40:0/2586810623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac340cdf70 0x7fac3414a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:43.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.308+0000 7fac3a79c700 1 -- 172.21.15.40:0/2586810623 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fac34069f30 msgr2=0x7fac341e4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:43.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.308+0000 7fac3a79c700 1 --2- 172.21.15.40:0/2586810623 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fac34069f30 0x7fac341e4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:43.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.308+0000 7fac3a79c700 1 -- 172.21.15.40:0/2586810623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac340cdf70 msgr2=0x7fac3414a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:43.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.308+0000 7fac3a79c700 1 --2- 172.21.15.40:0/2586810623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac340cdf70 0x7fac3414a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:43.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.308+0000 7fac3a79c700 1 -- 172.21.15.40:0/2586810623 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac240094a0 con 0x7fac341511c0 2023-06-22T10:54:43.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.309+0000 7fac3a79c700 1 --2- 172.21.15.40:0/2586810623 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac341511c0 0x7fac340b2050 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fac2c00cb40 tx=0x7fac2c00ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:43.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.309+0000 7fac2a7fc700 1 -- 172.21.15.40:0/2586810623 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2c00a9e0 con 0x7fac341511c0 2023-06-22T10:54:43.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.309+0000 7fac2a7fc700 1 -- 172.21.15.40:0/2586810623 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac2c00ab40 con 0x7fac341511c0 2023-06-22T10:54:43.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.309+0000 7fac3c1ff700 1 -- 172.21.15.40:0/2586810623 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac341e3f00 con 0x7fac341511c0 2023-06-22T10:54:43.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.309+0000 7fac2a7fc700 1 -- 172.21.15.40:0/2586810623 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2c012400 con 0x7fac341511c0 2023-06-22T10:54:43.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.309+0000 7fac3c1ff700 1 -- 172.21.15.40:0/2586810623 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac340b2590 con 0x7fac341511c0 2023-06-22T10:54:43.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.310+0000 7fac3c1ff700 1 -- 172.21.15.40:0/2586810623 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac341e3a80 con 0x7fac341511c0 2023-06-22T10:54:43.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.311+0000 7fac2a7fc700 1 -- 172.21.15.40:0/2586810623 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fac2c01b3b0 con 0x7fac341511c0 2023-06-22T10:54:43.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.312+0000 7fac2a7fc700 1 --2- 172.21.15.40:0/2586810623 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fac1806ace0 0x7fac1806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:43.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.312+0000 7fac2a7fc700 1 -- 172.21.15.40:0/2586810623 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fac2c089450 con 0x7fac341511c0 2023-06-22T10:54:43.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.312+0000 7fac39f9b700 1 --2- 172.21.15.40:0/2586810623 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fac1806ace0 0x7fac1806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:43.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.313+0000 7fac39f9b700 1 --2- 172.21.15.40:0/2586810623 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fac1806ace0 0x7fac1806d190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fac30000f60 tx=0x7fac30009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:43.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.316+0000 7fac2a7fc700 1 -- 172.21.15.40:0/2586810623 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fac341e3a80 con 0x7fac341511c0 2023-06-22T10:54:43.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.525+0000 7fac3c1ff700 1 -- 172.21.15.40:0/2586810623 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fac341e3a80 con 0x7fac341511c0 2023-06-22T10:54:43.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.526+0000 7fac2a7fc700 1 -- 172.21.15.40:0/2586810623 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7fac341e3a80 con 0x7fac341511c0 2023-06-22T10:54:43.529 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-06-22T10:54:43.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.528+0000 7fac3c1ff700 1 -- 172.21.15.40:0/2586810623 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fac1806ace0 msgr2=0x7fac1806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:43.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.528+0000 7fac3c1ff700 1 --2- 172.21.15.40:0/2586810623 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fac1806ace0 0x7fac1806d190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fac30000f60 tx=0x7fac30009040 comp rx=0 tx=0).stop 2023-06-22T10:54:43.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.528+0000 7fac3c1ff700 1 -- 172.21.15.40:0/2586810623 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac341511c0 msgr2=0x7fac340b2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:43.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.528+0000 7fac3c1ff700 1 --2- 172.21.15.40:0/2586810623 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac341511c0 0x7fac340b2050 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fac2c00cb40 tx=0x7fac2c00ce50 comp rx=0 tx=0).stop 2023-06-22T10:54:43.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.528+0000 7fac3c1ff700 1 -- 172.21.15.40:0/2586810623 shutdown_connections 2023-06-22T10:54:43.532 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.528+0000 7fac3c1ff700 1 --2- 172.21.15.40:0/2586810623 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fac1806ace0 0x7fac1806d190 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:43.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.528+0000 7fac3c1ff700 1 --2- 172.21.15.40:0/2586810623 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fac34069f30 0x7fac341e4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:43.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.528+0000 7fac3c1ff700 1 --2- 172.21.15.40:0/2586810623 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac341511c0 0x7fac340b2050 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:43.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.528+0000 7fac3c1ff700 1 --2- 172.21.15.40:0/2586810623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac340cdf70 0x7fac3414a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:43.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.528+0000 7fac3c1ff700 1 -- 172.21.15.40:0/2586810623 >> 172.21.15.40:0/2586810623 conn(0x7fac340b1030 msgr2=0x7fac3406e170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:43.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.529+0000 7fac3c1ff700 1 -- 172.21.15.40:0/2586810623 shutdown_connections 2023-06-22T10:54:43.533 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.529+0000 7fac3c1ff700 1 -- 172.21.15.40:0/2586810623 wait complete. 2023-06-22T10:54:43.550 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-22T10:54:43.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.752+0000 7f16bfdff700 1 Processor -- start 2023-06-22T10:54:43.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.752+0000 7f16bfdff700 1 -- start start 2023-06-22T10:54:43.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.753+0000 7f16bfdff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f16b80d2130 0x7f16b80cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:43.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.753+0000 7f16bfdff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f16b80cd6e0 0x7f16b80b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:43.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.753+0000 7f16bfdff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16b80d1be0 con 0x7f16b80b45d0 2023-06-22T10:54:43.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.753+0000 7f16bfdff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16b80d17f0 con 0x7f16b80d2130 2023-06-22T10:54:43.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.753+0000 7f16bfdff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16b80d1360 con 0x7f16b80cd6e0 2023-06-22T10:54:43.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.754+0000 7f16bdb9b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f16b80b45d0 0x7f16b80b49a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51600/0 (socket says 172.21.15.40:51600) 2023-06-22T10:54:43.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.754+0000 7f16bd39a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f16b80d2130 0x7f16b80cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:43.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.754+0000 7f16bdb9b700 1 -- 172.21.15.40:0/923478728 learned_addr learned my addr 172.21.15.40:0/923478728 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:43.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.754+0000 7f16be39c700 1 --2- 172.21.15.40:0/923478728 >> v2:172.21.15.45:3300/0 conn(0x7f16b80cd6e0 0x7f16b80b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:43.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.754+0000 7f16bd39a700 1 -- 172.21.15.40:0/923478728 >> v2:172.21.15.45:3300/0 conn(0x7f16b80cd6e0 msgr2=0x7f16b80b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:43.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.754+0000 7f16bd39a700 1 --2- 172.21.15.40:0/923478728 >> v2:172.21.15.45:3300/0 conn(0x7f16b80cd6e0 0x7f16b80b59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:43.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.754+0000 7f16bd39a700 1 -- 172.21.15.40:0/923478728 >> v1:172.21.15.40:6789/0 conn(0x7f16b80b45d0 legacy=0x7f16b80b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:43.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.754+0000 7f16bd39a700 1 -- 172.21.15.40:0/923478728 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16b80cef40 con 0x7f16b80d2130 2023-06-22T10:54:43.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.754+0000 7f16bcb99700 1 -- 172.21.15.40:0/923478728 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3049722697 0 0) 0x7f16b80d1be0 con 0x7f16b80b45d0 2023-06-22T10:54:43.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.754+0000 7f16bd39a700 1 --2- 172.21.15.40:0/923478728 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16b80d2130 0x7f16b80cd1a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f16b80b8ca0 tx=0x7f16a8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da8f478bff0ac325 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:43.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.755+0000 7f16bcb99700 1 -- 172.21.15.40:0/923478728 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a8011830 con 0x7f16b80d2130 2023-06-22T10:54:43.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.755+0000 7f16bcb99700 1 -- 172.21.15.40:0/923478728 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16a8011990 con 0x7f16b80d2130 2023-06-22T10:54:43.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.755+0000 7f16bcb99700 1 -- 172.21.15.40:0/923478728 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a8011d20 con 0x7f16b80d2130 2023-06-22T10:54:43.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.755+0000 7f16bfdff700 1 -- 172.21.15.40:0/923478728 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16b80d2130 msgr2=0x7f16b80cd1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:43.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.755+0000 7f16bfdff700 1 --2- 172.21.15.40:0/923478728 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16b80d2130 0x7f16b80cd1a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f16b80b8ca0 tx=0x7f16a8009b20 comp rx=0 tx=0).stop 2023-06-22T10:54:43.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.755+0000 7f16bfdff700 1 -- 172.21.15.40:0/923478728 shutdown_connections 2023-06-22T10:54:43.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.755+0000 7f16bfdff700 1 --2- 172.21.15.40:0/923478728 >> v2:172.21.15.45:3300/0 conn(0x7f16b80cd6e0 0x7f16b80b59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:43.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.755+0000 7f16bfdff700 1 --2- 172.21.15.40:0/923478728 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16b80d2130 0x7f16b80cd1a0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:43.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.755+0000 7f16bfdff700 1 -- 172.21.15.40:0/923478728 >> 172.21.15.40:0/923478728 conn(0x7f16b80cf5d0 msgr2=0x7f16b80cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:43.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.756+0000 7f16bfdff700 1 -- 172.21.15.40:0/923478728 shutdown_connections 2023-06-22T10:54:43.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.756+0000 7f16bfdff700 1 -- 172.21.15.40:0/923478728 wait complete. 2023-06-22T10:54:43.763 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.757+0000 7f16bfdff700 1 Processor -- start 2023-06-22T10:54:43.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.757+0000 7f16bfdff700 1 -- start start 2023-06-22T10:54:43.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.758+0000 7f16bfdff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16b80b45d0 0x7f16b80b0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:43.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.758+0000 7f16bfdff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16b80cd6e0 0x7f16b80cb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:43.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.758+0000 7f16bfdff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f16b80d2130 0x7f16b806b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:43.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.758+0000 7f16bfdff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16b815d670 con 0x7f16b80cd6e0 2023-06-22T10:54:43.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.758+0000 7f16bfdff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16b80b13c0 con 0x7f16b80b45d0 2023-06-22T10:54:43.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.758+0000 7f16bfdff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16b80cb800 con 0x7f16b80d2130 2023-06-22T10:54:43.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.759+0000 7f16bd39a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16b80cd6e0 0x7f16b80cb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:43.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.759+0000 7f16bd39a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16b80cd6e0 0x7f16b80cb2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56680/0 (socket says 172.21.15.40:56680) 2023-06-22T10:54:43.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.759+0000 7f16bd39a700 1 -- 172.21.15.40:0/2169498700 learned_addr learned my addr 172.21.15.40:0/2169498700 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:43.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.759+0000 7f16bdb9b700 1 --2- 172.21.15.40:0/2169498700 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16b80b45d0 0x7f16b80b0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:43.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.759+0000 7f16be39c700 1 --2- 172.21.15.40:0/2169498700 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f16b80d2130 0x7f16b806b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:43.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.759+0000 7f16bd39a700 1 -- 172.21.15.40:0/2169498700 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f16b80d2130 msgr2=0x7f16b806b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:43.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.759+0000 7f16bd39a700 1 --2- 172.21.15.40:0/2169498700 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f16b80d2130 0x7f16b806b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:43.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.759+0000 7f16bd39a700 1 -- 172.21.15.40:0/2169498700 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16b80b45d0 msgr2=0x7f16b80b0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:43.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.759+0000 7f16bd39a700 1 --2- 172.21.15.40:0/2169498700 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16b80b45d0 0x7f16b80b0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:43.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.759+0000 7f16bd39a700 1 -- 172.21.15.40:0/2169498700 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a80094a0 con 0x7f16b80cd6e0 2023-06-22T10:54:43.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.759+0000 7f16bd39a700 1 --2- 172.21.15.40:0/2169498700 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16b80cd6e0 0x7f16b80cb2c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f16a8014040 tx=0x7f16a8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:43.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.760+0000 7f16ae7fc700 1 -- 172.21.15.40:0/2169498700 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a80036a0 con 0x7f16b80cd6e0 2023-06-22T10:54:43.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.760+0000 7f16ae7fc700 1 -- 172.21.15.40:0/2169498700 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16a801f070 con 0x7f16b80cd6e0 2023-06-22T10:54:43.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.760+0000 7f16ae7fc700 1 -- 172.21.15.40:0/2169498700 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a8003a60 con 0x7f16b80cd6e0 2023-06-22T10:54:43.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.760+0000 7f16bfdff700 1 -- 172.21.15.40:0/2169498700 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16b815d390 con 0x7f16b80cd6e0 2023-06-22T10:54:43.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.760+0000 7f16bfdff700 1 -- 172.21.15.40:0/2169498700 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16b80caac0 con 0x7f16b80cd6e0 2023-06-22T10:54:43.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.761+0000 7f16bfdff700 1 -- 172.21.15.40:0/2169498700 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16b80ca640 con 0x7f16b80cd6e0 2023-06-22T10:54:43.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.762+0000 7f16ae7fc700 1 -- 172.21.15.40:0/2169498700 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f16a8003bc0 con 0x7f16b80cd6e0 2023-06-22T10:54:43.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.763+0000 7f16ae7fc700 1 --2- 172.21.15.40:0/2169498700 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f169c06ace0 0x7f169c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:43.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.763+0000 7f16ae7fc700 1 -- 172.21.15.40:0/2169498700 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f16a8021070 con 0x7f16b80cd6e0 2023-06-22T10:54:43.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.763+0000 7f16bdb9b700 1 --2- 172.21.15.40:0/2169498700 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f169c06ace0 0x7f169c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:43.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.764+0000 7f16bdb9b700 1 --2- 172.21.15.40:0/2169498700 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f169c06ace0 0x7f169c06d190 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f16b4007fd0 tx=0x7f16b4007de0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:43.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.768+0000 7f16ae7fc700 1 -- 172.21.15.40:0/2169498700 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f16b80ca640 con 0x7f16b80cd6e0 2023-06-22T10:54:43.981 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.978+0000 7f16bfdff700 1 -- 172.21.15.40:0/2169498700 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f16b80ca640 con 0x7f16b80cd6e0 2023-06-22T10:54:43.982 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.978+0000 7f16ae7fc700 1 -- 172.21.15.40:0/2169498700 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7f16b80ca640 con 0x7f16b80cd6e0 2023-06-22T10:54:43.982 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-06-22T10:54:43.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.981+0000 7f16bfdff700 1 -- 172.21.15.40:0/2169498700 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f169c06ace0 msgr2=0x7f169c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:43.984 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.981+0000 7f16bfdff700 1 --2- 172.21.15.40:0/2169498700 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f169c06ace0 0x7f169c06d190 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f16b4007fd0 tx=0x7f16b4007de0 comp rx=0 tx=0).stop 2023-06-22T10:54:43.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.981+0000 7f16bfdff700 1 -- 172.21.15.40:0/2169498700 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16b80cd6e0 msgr2=0x7f16b80cb2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:43.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.981+0000 7f16bfdff700 1 --2- 172.21.15.40:0/2169498700 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16b80cd6e0 0x7f16b80cb2c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f16a8014040 tx=0x7f16a8004750 comp rx=0 tx=0).stop 2023-06-22T10:54:43.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.981+0000 7f16bfdff700 1 -- 172.21.15.40:0/2169498700 shutdown_connections 2023-06-22T10:54:43.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.981+0000 7f16bfdff700 1 --2- 172.21.15.40:0/2169498700 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f169c06ace0 0x7f169c06d190 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:43.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.981+0000 7f16bfdff700 1 --2- 172.21.15.40:0/2169498700 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f16b80d2130 0x7f16b806b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:43.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.981+0000 7f16bfdff700 1 --2- 172.21.15.40:0/2169498700 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16b80b45d0 0x7f16b80b0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:43.985 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.981+0000 7f16bfdff700 1 --2- 172.21.15.40:0/2169498700 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16b80cd6e0 0x7f16b80cb2c0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:43.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.981+0000 7f16bfdff700 1 -- 172.21.15.40:0/2169498700 >> 172.21.15.40:0/2169498700 conn(0x7f16b80cf5d0 msgr2=0x7f16b80b7990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:43.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.981+0000 7f16bfdff700 1 -- 172.21.15.40:0/2169498700 shutdown_connections 2023-06-22T10:54:43.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:43.981+0000 7f16bfdff700 1 -- 172.21.15.40:0/2169498700 wait complete. 2023-06-22T10:54:44.002 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-22T10:54:44.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.203+0000 7f9397fff700 1 Processor -- start 2023-06-22T10:54:44.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.203+0000 7f9397fff700 1 -- start start 2023-06-22T10:54:44.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.204+0000 7f9397fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f93900d2130 0x7f93900cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:44.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.204+0000 7f9397fff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f93900cd6e0 0x7f93900b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:44.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.204+0000 7f9397fff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93900d1be0 con 0x7f93900b45d0 2023-06-22T10:54:44.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.204+0000 7f9397fff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93900d17f0 con 0x7f93900d2130 2023-06-22T10:54:44.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.204+0000 7f9397fff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93900d1360 con 0x7f93900cd6e0 2023-06-22T10:54:44.209 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.205+0000 7f9395d9b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f93900b45d0 0x7f93900b49a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51604/0 (socket says 172.21.15.40:51604) 2023-06-22T10:54:44.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.205+0000 7f9395d9b700 1 -- 172.21.15.40:0/1990290130 learned_addr learned my addr 172.21.15.40:0/1990290130 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:44.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.205+0000 7f939559a700 1 --2- 172.21.15.40:0/1990290130 >> v2:172.21.15.40:3300/0 conn(0x7f93900d2130 0x7f93900cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:44.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.205+0000 7f939659c700 1 --2- 172.21.15.40:0/1990290130 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f93900cd6e0 0x7f93900b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:44.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.205+0000 7f9394d99700 1 -- 172.21.15.40:0/1990290130 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2414197699 0 0) 0x7f93900d1be0 con 0x7f93900b45d0 2023-06-22T10:54:44.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.205+0000 7f9394d99700 1 -- 172.21.15.40:0/1990290130 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f937c0035b0 con 0x7f93900b45d0 2023-06-22T10:54:44.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.205+0000 7f939559a700 1 -- 172.21.15.40:0/1990290130 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f93900cd6e0 msgr2=0x7f93900b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:44.210 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.205+0000 7f939559a700 1 --2- 172.21.15.40:0/1990290130 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f93900cd6e0 0x7f93900b59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:44.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.205+0000 7f939559a700 1 -- 172.21.15.40:0/1990290130 >> v1:172.21.15.40:6789/0 conn(0x7f93900b45d0 legacy=0x7f93900b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:44.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.205+0000 7f939559a700 1 -- 172.21.15.40:0/1990290130 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93900cef40 con 0x7f93900d2130 2023-06-22T10:54:44.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.205+0000 7f939559a700 1 --2- 172.21.15.40:0/1990290130 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93900d2130 0x7f93900cd1a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f9380009840 tx=0x7f9380009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=176d5618b8aa07e9 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:44.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.206+0000 7f9394d99700 1 -- 172.21.15.40:0/1990290130 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9380011830 con 0x7f93900d2130 2023-06-22T10:54:44.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.206+0000 7f9394d99700 1 -- 172.21.15.40:0/1990290130 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9380011990 con 0x7f93900d2130 2023-06-22T10:54:44.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.206+0000 7f9394d99700 1 -- 172.21.15.40:0/1990290130 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9380011d20 con 0x7f93900d2130 2023-06-22T10:54:44.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.206+0000 7f9397fff700 1 -- 172.21.15.40:0/1990290130 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93900d2130 msgr2=0x7f93900cd1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:44.211 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.206+0000 7f9397fff700 1 --2- 172.21.15.40:0/1990290130 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93900d2130 0x7f93900cd1a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f9380009840 tx=0x7f9380009b50 comp rx=0 tx=0).stop 2023-06-22T10:54:44.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.206+0000 7f9397fff700 1 -- 172.21.15.40:0/1990290130 shutdown_connections 2023-06-22T10:54:44.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.206+0000 7f9397fff700 1 --2- 172.21.15.40:0/1990290130 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f93900cd6e0 0x7f93900b59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:44.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.206+0000 7f9397fff700 1 --2- 172.21.15.40:0/1990290130 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93900d2130 0x7f93900cd1a0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:44.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.206+0000 7f9397fff700 1 -- 172.21.15.40:0/1990290130 >> 172.21.15.40:0/1990290130 conn(0x7f93900cf5d0 msgr2=0x7f93900cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:44.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.206+0000 7f9397fff700 1 -- 172.21.15.40:0/1990290130 shutdown_connections 2023-06-22T10:54:44.212 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.206+0000 7f9397fff700 1 -- 172.21.15.40:0/1990290130 wait complete. 2023-06-22T10:54:44.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.208+0000 7f9397fff700 1 Processor -- start 2023-06-22T10:54:44.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.208+0000 7f9397fff700 1 -- start start 2023-06-22T10:54:44.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.209+0000 7f9397fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93900b45d0 0x7f93900cb650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:44.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.209+0000 7f9397fff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f93900cd6e0 0x7f9390157350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:44.214 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.209+0000 7f9397fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93900d2130 0x7f939006b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:44.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.209+0000 7f9397fff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f939015d5e0 con 0x7f93900b45d0 2023-06-22T10:54:44.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.209+0000 7f9397fff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93900cbb90 con 0x7f93900d2130 2023-06-22T10:54:44.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.209+0000 7f9397fff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f939015c9d0 con 0x7f93900cd6e0 2023-06-22T10:54:44.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.209+0000 7f9395d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93900b45d0 0x7f93900cb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:44.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.209+0000 7f9395d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93900b45d0 0x7f93900cb650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56696/0 (socket says 172.21.15.40:56696) 2023-06-22T10:54:44.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.209+0000 7f9395d9b700 1 -- 172.21.15.40:0/2972528293 learned_addr learned my addr 172.21.15.40:0/2972528293 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:44.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.210+0000 7f939559a700 1 --2- 172.21.15.40:0/2972528293 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f93900cd6e0 0x7f9390157350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:44.215 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.210+0000 7f939659c700 1 --2- 172.21.15.40:0/2972528293 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93900d2130 0x7f939006b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:44.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.210+0000 7f9395d9b700 1 -- 172.21.15.40:0/2972528293 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f93900cd6e0 msgr2=0x7f9390157350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:44.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.210+0000 7f9395d9b700 1 --2- 172.21.15.40:0/2972528293 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f93900cd6e0 0x7f9390157350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:44.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.210+0000 7f9395d9b700 1 -- 172.21.15.40:0/2972528293 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93900d2130 msgr2=0x7f939006b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:44.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.210+0000 7f9395d9b700 1 --2- 172.21.15.40:0/2972528293 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93900d2130 0x7f939006b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:44.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.210+0000 7f9395d9b700 1 -- 172.21.15.40:0/2972528293 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93800094a0 con 0x7f93900b45d0 2023-06-22T10:54:44.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.210+0000 7f9395d9b700 1 --2- 172.21.15.40:0/2972528293 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93900b45d0 0x7f93900cb650 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f938c00c450 tx=0x7f938c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:44.216 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.210+0000 7f93867fc700 1 -- 172.21.15.40:0/2972528293 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938c005d70 con 0x7f93900b45d0 2023-06-22T10:54:44.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.210+0000 7f93867fc700 1 -- 172.21.15.40:0/2972528293 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f938c0070d0 con 0x7f93900b45d0 2023-06-22T10:54:44.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.210+0000 7f93867fc700 1 -- 172.21.15.40:0/2972528293 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938c007440 con 0x7f93900b45d0 2023-06-22T10:54:44.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.210+0000 7f9397fff700 1 -- 172.21.15.40:0/2972528293 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f939015ccb0 con 0x7f93900b45d0 2023-06-22T10:54:44.217 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.210+0000 7f9397fff700 1 -- 172.21.15.40:0/2972528293 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f939015d270 con 0x7f93900b45d0 2023-06-22T10:54:44.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.211+0000 7f9397fff700 1 -- 172.21.15.40:0/2972528293 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9390067580 con 0x7f93900b45d0 2023-06-22T10:54:44.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.212+0000 7f93867fc700 1 -- 172.21.15.40:0/2972528293 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f938c0075a0 con 0x7f93900b45d0 2023-06-22T10:54:44.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.213+0000 7f93867fc700 1 --2- 172.21.15.40:0/2972528293 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f937406ad10 0x7f937406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:44.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.213+0000 7f93867fc700 1 -- 172.21.15.40:0/2972528293 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f938c088bc0 con 0x7f93900b45d0 2023-06-22T10:54:44.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.214+0000 7f939559a700 1 --2- 172.21.15.40:0/2972528293 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f937406ad10 0x7f937406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:44.218 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.214+0000 7f939559a700 1 --2- 172.21.15.40:0/2972528293 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f937406ad10 0x7f937406d1c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9380000c00 tx=0x7f9380008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:44.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.218+0000 7f93867fc700 1 -- 172.21.15.40:0/2972528293 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f938c053950 con 0x7f93900b45d0 2023-06-22T10:54:44.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.425+0000 7f9397fff700 1 -- 172.21.15.40:0/2972528293 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f93900b8210 con 0x7f93900b45d0 2023-06-22T10:54:44.429 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.426+0000 7f93867fc700 1 -- 172.21.15.40:0/2972528293 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7f938c017020 con 0x7f93900b45d0 2023-06-22T10:54:44.429 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-06-22T10:54:44.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.428+0000 7f9397fff700 1 -- 172.21.15.40:0/2972528293 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f937406ad10 msgr2=0x7f937406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:44.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.428+0000 7f9397fff700 1 --2- 172.21.15.40:0/2972528293 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f937406ad10 0x7f937406d1c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9380000c00 tx=0x7f9380008030 comp rx=0 tx=0).stop 2023-06-22T10:54:44.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.428+0000 7f9397fff700 1 -- 172.21.15.40:0/2972528293 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93900b45d0 msgr2=0x7f93900cb650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:44.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.428+0000 7f9397fff700 1 --2- 172.21.15.40:0/2972528293 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93900b45d0 0x7f93900cb650 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f938c00c450 tx=0x7f938c00c810 comp rx=0 tx=0).stop 2023-06-22T10:54:44.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.428+0000 7f9397fff700 1 -- 172.21.15.40:0/2972528293 shutdown_connections 2023-06-22T10:54:44.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.428+0000 7f9397fff700 1 --2- 172.21.15.40:0/2972528293 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f937406ad10 0x7f937406d1c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:44.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.428+0000 7f9397fff700 1 --2- 172.21.15.40:0/2972528293 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93900d2130 0x7f939006b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:44.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.428+0000 7f9397fff700 1 --2- 172.21.15.40:0/2972528293 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93900b45d0 0x7f93900cb650 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:44.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.428+0000 7f9397fff700 1 --2- 172.21.15.40:0/2972528293 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f93900cd6e0 0x7f9390157350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:44.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.428+0000 7f9397fff700 1 -- 172.21.15.40:0/2972528293 >> 172.21.15.40:0/2972528293 conn(0x7f93900cf5d0 msgr2=0x7f93900b7990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:44.433 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.428+0000 7f9397fff700 1 -- 172.21.15.40:0/2972528293 shutdown_connections 2023-06-22T10:54:44.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.429+0000 7f9397fff700 1 -- 172.21.15.40:0/2972528293 wait complete. 2023-06-22T10:54:44.449 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-22T10:54:44.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.648+0000 7f3327dff700 1 Processor -- start 2023-06-22T10:54:44.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.648+0000 7f3327dff700 1 -- start start 2023-06-22T10:54:44.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.649+0000 7f3327dff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f33200d2830 0x7f33200b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:44.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.649+0000 7f3327dff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f33200b4c60 0x7f33200d0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:44.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.649+0000 7f3327dff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33200b50a0 con 0x7f332015c720 2023-06-22T10:54:44.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.649+0000 7f3327dff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3320160d60 con 0x7f33200b4c60 2023-06-22T10:54:44.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.649+0000 7f3327dff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33200b2130 con 0x7f33200d2830 2023-06-22T10:54:44.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.649+0000 7f3325b9b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f332015c720 0x7f33200b1870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51618/0 (socket says 172.21.15.40:51618) 2023-06-22T10:54:44.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.649+0000 7f3325b9b700 1 -- 172.21.15.40:0/4137525599 learned_addr learned my addr 172.21.15.40:0/4137525599 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:44.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.649+0000 7f332639c700 1 --2- 172.21.15.40:0/4137525599 >> v2:172.21.15.40:3300/0 conn(0x7f33200b4c60 0x7f33200d0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:44.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.650+0000 7f332539a700 1 --2- 172.21.15.40:0/4137525599 >> v2:172.21.15.45:3300/0 conn(0x7f33200d2830 0x7f33200b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:44.654 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.650+0000 7f3324b99700 1 -- 172.21.15.40:0/4137525599 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 105035606 0 0) 0x7f33200b50a0 con 0x7f332015c720 2023-06-22T10:54:44.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.650+0000 7f3324b99700 1 -- 172.21.15.40:0/4137525599 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f330c0035b0 con 0x7f332015c720 2023-06-22T10:54:44.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.650+0000 7f332639c700 1 -- 172.21.15.40:0/4137525599 >> v2:172.21.15.45:3300/0 conn(0x7f33200d2830 msgr2=0x7f33200b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:44.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.650+0000 7f332639c700 1 --2- 172.21.15.40:0/4137525599 >> v2:172.21.15.45:3300/0 conn(0x7f33200d2830 0x7f33200b4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:44.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.650+0000 7f332639c700 1 -- 172.21.15.40:0/4137525599 >> v1:172.21.15.40:6789/0 conn(0x7f332015c720 legacy=0x7f33200b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:44.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.650+0000 7f332639c700 1 -- 172.21.15.40:0/4137525599 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3320161180 con 0x7f33200b4c60 2023-06-22T10:54:44.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.650+0000 7f332639c700 1 --2- 172.21.15.40:0/4137525599 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33200b4c60 0x7f33200d0d00 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3318009d90 tx=0x7f331800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2c64d4ec6e4dc78 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:44.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.650+0000 7f3324b99700 1 -- 172.21.15.40:0/4137525599 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331800e070 con 0x7f33200b4c60 2023-06-22T10:54:44.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.650+0000 7f3324b99700 1 -- 172.21.15.40:0/4137525599 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f331800bae0 con 0x7f33200b4c60 2023-06-22T10:54:44.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.651+0000 7f3324b99700 1 -- 172.21.15.40:0/4137525599 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331800be90 con 0x7f33200b4c60 2023-06-22T10:54:44.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.651+0000 7f3327dff700 1 -- 172.21.15.40:0/4137525599 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33200b4c60 msgr2=0x7f33200d0d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:44.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.651+0000 7f3327dff700 1 --2- 172.21.15.40:0/4137525599 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33200b4c60 0x7f33200d0d00 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3318009d90 tx=0x7f331800b330 comp rx=0 tx=0).stop 2023-06-22T10:54:44.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.651+0000 7f3327dff700 1 -- 172.21.15.40:0/4137525599 shutdown_connections 2023-06-22T10:54:44.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.651+0000 7f3327dff700 1 --2- 172.21.15.40:0/4137525599 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33200b4c60 0x7f33200d0d00 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:44.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.651+0000 7f3327dff700 1 --2- 172.21.15.40:0/4137525599 >> v2:172.21.15.45:3300/0 conn(0x7f33200d2830 0x7f33200b4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:44.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.651+0000 7f3327dff700 1 -- 172.21.15.40:0/4137525599 >> 172.21.15.40:0/4137525599 conn(0x7f33200cf720 msgr2=0x7f33200cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:44.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.651+0000 7f3327dff700 1 -- 172.21.15.40:0/4137525599 shutdown_connections 2023-06-22T10:54:44.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.651+0000 7f3327dff700 1 -- 172.21.15.40:0/4137525599 wait complete. 2023-06-22T10:54:44.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.653+0000 7f3327dff700 1 Processor -- start 2023-06-22T10:54:44.658 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.653+0000 7f3327dff700 1 -- start start 2023-06-22T10:54:44.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.654+0000 7f3327dff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33200b4c60 0x7f33200cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:44.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.654+0000 7f3327dff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f33200d2830 0x7f33200cac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:44.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.654+0000 7f3327dff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f332015c720 0x7f332015abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:44.659 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.654+0000 7f3327dff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f332015b100 con 0x7f332015c720 2023-06-22T10:54:44.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.654+0000 7f3327dff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33200cb2d0 con 0x7f33200b4c60 2023-06-22T10:54:44.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.654+0000 7f3327dff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33200cb520 con 0x7f33200d2830 2023-06-22T10:54:44.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.654+0000 7f332639c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f332015c720 0x7f332015abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:44.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.654+0000 7f332639c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f332015c720 0x7f332015abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56708/0 (socket says 172.21.15.40:56708) 2023-06-22T10:54:44.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.654+0000 7f332639c700 1 -- 172.21.15.40:0/644613524 learned_addr learned my addr 172.21.15.40:0/644613524 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:44.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.654+0000 7f3325b9b700 1 --2- 172.21.15.40:0/644613524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33200b4c60 0x7f33200cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:44.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.654+0000 7f332539a700 1 --2- 172.21.15.40:0/644613524 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f33200d2830 0x7f33200cac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:44.660 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.655+0000 7f332639c700 1 -- 172.21.15.40:0/644613524 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f33200d2830 msgr2=0x7f33200cac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:44.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.655+0000 7f332639c700 1 --2- 172.21.15.40:0/644613524 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f33200d2830 0x7f33200cac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:44.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.655+0000 7f332639c700 1 -- 172.21.15.40:0/644613524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33200b4c60 msgr2=0x7f33200cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:44.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.655+0000 7f332639c700 1 --2- 172.21.15.40:0/644613524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33200b4c60 0x7f33200cc5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:44.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.655+0000 7f332639c700 1 -- 172.21.15.40:0/644613524 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3318009a70 con 0x7f332015c720 2023-06-22T10:54:44.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.655+0000 7f332639c700 1 --2- 172.21.15.40:0/644613524 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f332015c720 0x7f332015abc0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3318014040 tx=0x7f3318004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:44.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.655+0000 7f33167fc700 1 -- 172.21.15.40:0/644613524 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33180044d0 con 0x7f332015c720 2023-06-22T10:54:44.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.655+0000 7f33167fc700 1 -- 172.21.15.40:0/644613524 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3318020070 con 0x7f332015c720 2023-06-22T10:54:44.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.655+0000 7f33167fc700 1 -- 172.21.15.40:0/644613524 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3318004870 con 0x7f332015c720 2023-06-22T10:54:44.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.655+0000 7f3327dff700 1 -- 172.21.15.40:0/644613524 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33200cb800 con 0x7f332015c720 2023-06-22T10:54:44.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.655+0000 7f3327dff700 1 -- 172.21.15.40:0/644613524 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33200cbdc0 con 0x7f332015c720 2023-06-22T10:54:44.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.656+0000 7f3327dff700 1 -- 172.21.15.40:0/644613524 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3320067580 con 0x7f332015c720 2023-06-22T10:54:44.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.657+0000 7f33167fc700 1 -- 172.21.15.40:0/644613524 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3318027480 con 0x7f332015c720 2023-06-22T10:54:44.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.658+0000 7f33167fc700 1 --2- 172.21.15.40:0/644613524 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f330406ace0 0x7f330406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:44.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.659+0000 7f33167fc700 1 -- 172.21.15.40:0/644613524 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3318022070 con 0x7f332015c720 2023-06-22T10:54:44.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.659+0000 7f3325b9b700 1 --2- 172.21.15.40:0/644613524 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f330406ace0 0x7f330406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:44.663 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.659+0000 7f3325b9b700 1 --2- 172.21.15.40:0/644613524 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f330406ace0 0x7f330406d190 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f331c007fd0 tx=0x7f331c007dc0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:44.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.663+0000 7f33167fc700 1 -- 172.21.15.40:0/644613524 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f33180563c0 con 0x7f332015c720 2023-06-22T10:54:44.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.888+0000 7f3327dff700 1 -- 172.21.15.40:0/644613524 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f33200b38f0 con 0x7f332015c720 2023-06-22T10:54:44.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.888+0000 7f33167fc700 1 -- 172.21.15.40:0/644613524 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v30) v1 ==== 80+0+0 (secure 0 0 0) 0x7f33180599e0 con 0x7f332015c720 2023-06-22T10:54:44.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.890+0000 7f3327dff700 1 -- 172.21.15.40:0/644613524 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f330406ace0 msgr2=0x7f330406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:44.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.890+0000 7f3327dff700 1 --2- 172.21.15.40:0/644613524 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f330406ace0 0x7f330406d190 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f331c007fd0 tx=0x7f331c007dc0 comp rx=0 tx=0).stop 2023-06-22T10:54:44.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.890+0000 7f3327dff700 1 -- 172.21.15.40:0/644613524 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f332015c720 msgr2=0x7f332015abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:44.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.890+0000 7f3327dff700 1 --2- 172.21.15.40:0/644613524 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f332015c720 0x7f332015abc0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3318014040 tx=0x7f3318004ad0 comp rx=0 tx=0).stop 2023-06-22T10:54:44.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.891+0000 7f3327dff700 1 -- 172.21.15.40:0/644613524 shutdown_connections 2023-06-22T10:54:44.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.891+0000 7f3327dff700 1 --2- 172.21.15.40:0/644613524 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f330406ace0 0x7f330406d190 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:44.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.891+0000 7f3327dff700 1 --2- 172.21.15.40:0/644613524 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f332015c720 0x7f332015abc0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:44.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.891+0000 7f3327dff700 1 --2- 172.21.15.40:0/644613524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33200b4c60 0x7f33200cc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:44.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.891+0000 7f3327dff700 1 --2- 172.21.15.40:0/644613524 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f33200d2830 0x7f33200cac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:44.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.891+0000 7f3327dff700 1 -- 172.21.15.40:0/644613524 >> 172.21.15.40:0/644613524 conn(0x7f33200cf720 msgr2=0x7f33200b41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:44.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.891+0000 7f3327dff700 1 -- 172.21.15.40:0/644613524 shutdown_connections 2023-06-22T10:54:44.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:44.891+0000 7f3327dff700 1 -- 172.21.15.40:0/644613524 wait complete. 2023-06-22T10:54:44.896 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2023-06-22T10:54:44.912 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-06-22T10:54:44.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:44.913 DEBUG:teuthology.orchestra.run.smithi040:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-06-22T10:54:45.002 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi040.front.sepia.ceph.com 2023-06-22T10:54:45.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:45.003 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-06-22T10:54:45.050 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-06-22T10:54:45.050 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-22T10:54:45.101 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-06-22T10:54:45.102 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-22T10:54:45.150 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-06-22T10:54:45.150 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-22T10:54:45.237 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-22T10:54:45.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.436+0000 7fe6ac7ff700 1 Processor -- start 2023-06-22T10:54:45.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.436+0000 7fe6ac7ff700 1 -- start start 2023-06-22T10:54:45.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.436+0000 7fe6ac7ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe6a415c720 0x7fe6a40b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:45.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.437+0000 7fe6ac7ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe6a40b4e30 0x7fe6a40d0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:45.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.437+0000 7fe6ac7ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6a40b2130 con 0x7fe6a40d2830 2023-06-22T10:54:45.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.437+0000 7fe6ac7ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6a4160d60 con 0x7fe6a40b4e30 2023-06-22T10:54:45.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.437+0000 7fe6ac7ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a4161180 con 0x7fe6a415c720 2023-06-22T10:54:45.441 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.437+0000 7fe6aa59b700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe6a415c720 0x7fe6a40b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:45.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.437+0000 7fe6aad9c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe6a40b4e30 0x7fe6a40d0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:45.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.437+0000 7fe6aad9c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe6a40b4e30 0x7fe6a40d0d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.40:60998/0 (socket says 172.21.15.40:60998) 2023-06-22T10:54:45.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.437+0000 7fe6aad9c700 1 -- 172.21.15.40:0/3499703724 learned_addr learned my addr 172.21.15.40:0/3499703724 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:45.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.438+0000 7fe6aa59b700 1 -- 172.21.15.40:0/3499703724 >> v2:172.21.15.45:3300/0 conn(0x7fe6a40b4e30 msgr2=0x7fe6a40d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:45.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.438+0000 7fe6aa59b700 1 --2- 172.21.15.40:0/3499703724 >> v2:172.21.15.45:3300/0 conn(0x7fe6a40b4e30 0x7fe6a40d0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:45.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.438+0000 7fe6aa59b700 1 -- 172.21.15.40:0/3499703724 >> v1:172.21.15.45:6789/0 conn(0x7fe6a40d2830 legacy=0x7fe6a40b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:45.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.438+0000 7fe6aa59b700 1 -- 172.21.15.40:0/3499703724 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a41603c0 con 0x7fe6a415c720 2023-06-22T10:54:45.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.438+0000 7fe6aa59b700 1 --2- 172.21.15.40:0/3499703724 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe6a415c720 0x7fe6a40b1870 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe6a0009840 tx=0x7fe6a0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42d55c91800c81b6 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:45.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.438+0000 7fe6a9599700 1 -- 172.21.15.40:0/3499703724 <== mon.2 v2:172.21.15.45:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a0011830 con 0x7fe6a415c720 2023-06-22T10:54:45.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.438+0000 7fe6a9599700 1 -- 172.21.15.40:0/3499703724 <== mon.2 v2:172.21.15.45:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6a0011990 con 0x7fe6a415c720 2023-06-22T10:54:45.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.438+0000 7fe6a9599700 1 -- 172.21.15.40:0/3499703724 <== mon.2 v2:172.21.15.45:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a0011d20 con 0x7fe6a415c720 2023-06-22T10:54:45.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.439+0000 7fe6ac7ff700 1 -- 172.21.15.40:0/3499703724 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe6a415c720 msgr2=0x7fe6a40b1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:45.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.439+0000 7fe6ac7ff700 1 --2- 172.21.15.40:0/3499703724 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe6a415c720 0x7fe6a40b1870 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe6a0009840 tx=0x7fe6a0009b50 comp rx=0 tx=0).stop 2023-06-22T10:54:45.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.439+0000 7fe6ac7ff700 1 -- 172.21.15.40:0/3499703724 shutdown_connections 2023-06-22T10:54:45.444 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.439+0000 7fe6ac7ff700 1 --2- 172.21.15.40:0/3499703724 >> v2:172.21.15.45:3300/0 conn(0x7fe6a40b4e30 0x7fe6a40d0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:45.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.439+0000 7fe6ac7ff700 1 --2- 172.21.15.40:0/3499703724 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe6a415c720 0x7fe6a40b1870 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:45.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.439+0000 7fe6ac7ff700 1 -- 172.21.15.40:0/3499703724 >> 172.21.15.40:0/3499703724 conn(0x7fe6a40cf720 msgr2=0x7fe6a40cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:45.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.439+0000 7fe6ac7ff700 1 -- 172.21.15.40:0/3499703724 shutdown_connections 2023-06-22T10:54:45.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.439+0000 7fe6ac7ff700 1 -- 172.21.15.40:0/3499703724 wait complete. 2023-06-22T10:54:45.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.440+0000 7fe6ac7ff700 1 Processor -- start 2023-06-22T10:54:45.445 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.441+0000 7fe6ac7ff700 1 -- start start 2023-06-22T10:54:45.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.442+0000 7fe6ac7ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6a40b4e30 0x7fe6a41f1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:45.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.442+0000 7fe6ac7ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6a40d2830 0x7fe6a415d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:45.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.442+0000 7fe6ac7ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe6a415c720 0x7fe6a40ca030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:45.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.442+0000 7fe6ac7ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a40c76a0 con 0x7fe6a40d2830 2023-06-22T10:54:45.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.442+0000 7fe6ac7ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a41f1e40 con 0x7fe6a40b4e30 2023-06-22T10:54:45.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.442+0000 7fe6ac7ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a40c67b0 con 0x7fe6a415c720 2023-06-22T10:54:45.447 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.442+0000 7fe6a9d9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6a40d2830 0x7fe6a415d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:45.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.442+0000 7fe6aa59b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6a40b4e30 0x7fe6a41f1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:45.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.442+0000 7fe6a9d9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6a40d2830 0x7fe6a415d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56720/0 (socket says 172.21.15.40:56720) 2023-06-22T10:54:45.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.442+0000 7fe6aad9c700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe6a415c720 0x7fe6a40ca030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:45.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.442+0000 7fe6a9d9a700 1 -- 172.21.15.40:0/1344534807 learned_addr learned my addr 172.21.15.40:0/1344534807 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:45.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.442+0000 7fe6aa59b700 1 -- 172.21.15.40:0/1344534807 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe6a415c720 msgr2=0x7fe6a40ca030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:45.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.442+0000 7fe6aa59b700 1 --2- 172.21.15.40:0/1344534807 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe6a415c720 0x7fe6a40ca030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:45.448 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.442+0000 7fe6aa59b700 1 -- 172.21.15.40:0/1344534807 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6a40d2830 msgr2=0x7fe6a415d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:45.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.442+0000 7fe6aa59b700 1 --2- 172.21.15.40:0/1344534807 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6a40d2830 0x7fe6a415d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:45.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.442+0000 7fe6aa59b700 1 -- 172.21.15.40:0/1344534807 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a00094a0 con 0x7fe6a40b4e30 2023-06-22T10:54:45.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.443+0000 7fe6aa59b700 1 --2- 172.21.15.40:0/1344534807 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6a40b4e30 0x7fe6a41f1900 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe6a0016000 tx=0x7fe6a0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:45.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.443+0000 7fe69affd700 1 -- 172.21.15.40:0/1344534807 <== mon.1 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a0004590 con 0x7fe6a40b4e30 2023-06-22T10:54:45.449 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.443+0000 7fe69affd700 1 -- 172.21.15.40:0/1344534807 <== mon.1 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6a00036a0 con 0x7fe6a40b4e30 2023-06-22T10:54:45.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.443+0000 7fe6ac7ff700 1 -- 172.21.15.40:0/1344534807 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6a40c6a90 con 0x7fe6a40b4e30 2023-06-22T10:54:45.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.443+0000 7fe69affd700 1 -- 172.21.15.40:0/1344534807 <== mon.1 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a0003a50 con 0x7fe6a40b4e30 2023-06-22T10:54:45.450 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.443+0000 7fe6ac7ff700 1 -- 172.21.15.40:0/1344534807 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6a40c7050 con 0x7fe6a40b4e30 2023-06-22T10:54:45.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.444+0000 7fe6ac7ff700 1 -- 172.21.15.40:0/1344534807 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6a4067580 con 0x7fe6a40b4e30 2023-06-22T10:54:45.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.445+0000 7fe69affd700 1 -- 172.21.15.40:0/1344534807 <== mon.1 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe6a0003bb0 con 0x7fe6a40b4e30 2023-06-22T10:54:45.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.446+0000 7fe69affd700 1 --2- 172.21.15.40:0/1344534807 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe68806ace0 0x7fe68806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:45.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.446+0000 7fe69affd700 1 -- 172.21.15.40:0/1344534807 <== mon.1 v2:172.21.15.45:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe6a008a730 con 0x7fe6a40b4e30 2023-06-22T10:54:45.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.447+0000 7fe6a9d9a700 1 --2- 172.21.15.40:0/1344534807 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe68806ace0 0x7fe68806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:45.451 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.447+0000 7fe6a9d9a700 1 --2- 172.21.15.40:0/1344534807 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe68806ace0 0x7fe68806d190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4158c00 tx=0x7fe694009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:45.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.450+0000 7fe69affd700 1 -- 172.21.15.40:0/1344534807 <== mon.1 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe6a0055540 con 0x7fe6a40b4e30 2023-06-22T10:54:45.662 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.659+0000 7fe6ac7ff700 1 -- 172.21.15.40:0/1344534807 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe6a40b4670 con 0x7fe6a40b4e30 2023-06-22T10:54:45.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.661+0000 7fe69affd700 1 -- 172.21.15.40:0/1344534807 <== mon.1 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20132 (secure 0 0 0) 0x7fe6a0003e60 con 0x7fe6a40b4e30 2023-06-22T10:54:45.664 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:54:45.664 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":30,"fsid":"475560bc-1a7c-4a75-b3b6-6fc6b20bdc52","created":"2023-06-22T10:53:03.784568+0000","modified":"2023-06-22T10:54:12.717204+0000","last_up_change":"2023-06-22T10:53:17.830348+0000","last_in_change":"2023-06-22T10:53:07.329974+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-22T10:53:17.182228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-22T10:53:23.874432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-22T10:53:29.812963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-22T10:53:30.404021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-22T10:53:33.982289+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"918db6b4-053a-46ba-976d-6e1a0104017f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6809","nonce":2400162888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6811","nonce":2400162888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6815","nonce":2400162888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6813","nonce":2400162888}]},"public_addr":"172.21.15.40:6809/2400162888","cluster_addr":"172.21.15.40:6811/2400162888","heartbeat_back_addr":"172.21.15.40:6815/2400162888","heartbeat_front_addr":"172.21.15.40:6813/2400162888","state":["exists","up"]},{"osd":1,"uuid":"0c146e2b-1725-4dae-9b5c-38795943b9d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6801","nonce":230885800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6803","nonce":230885800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6807","nonce":230885800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6805","nonce":230885800}]},"public_addr":"172.21.15.40:6801/230885800","cluster_addr":"172.21.15.40:6803/230885800","heartbeat_back_addr":"172.21.15.40:6807/230885800","heartbeat_front_addr":"172.21.15.40:6805/230885800","state":["exists","up"]},{"osd":2,"uuid":"0b3727fd-f281-46d5-a675-86c8c5ab269e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6817","nonce":2681404929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6819","nonce":2681404929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6823","nonce":2681404929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6821","nonce":2681404929}]},"public_addr":"172.21.15.40:6817/2681404929","cluster_addr":"172.21.15.40:6819/2681404929","heartbeat_back_addr":"172.21.15.40:6823/2681404929","heartbeat_front_addr":"172.21.15.40:6821/2681404929","state":["exists","up"]},{"osd":3,"uuid":"2969c698-7039-4bbb-beda-f756f7a368a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6825","nonce":111110981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6827","nonce":111110981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6831","nonce":111110981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6829","nonce":111110981}]},"public_addr":"172.21.15.40:6825/111110981","cluster_addr":"172.21.15.40:6827/111110981","heartbeat_back_addr":"172.21.15.40:6831/111110981","heartbeat_front_addr":"172.21.15.40:6829/111110981","state":["exists","up"]},{"osd":4,"uuid":"3bb1d9c8-8e42-4a6b-998d-04834f34be5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6801","nonce":3625455711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6803","nonce":3625455711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6807","nonce":3625455711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6805","nonce":3625455711}]},"public_addr":"172.21.15.45:6801/3625455711","cluster_addr":"172.21.15.45:6803/3625455711","heartbeat_back_addr":"172.21.15.45:6807/3625455711","heartbeat_front_addr":"172.21.15.45:6805/3625455711","state":["exists","up"]},{"osd":5,"uuid":"f9854ee4-302c-41be-977b-bedda090a3d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6817","nonce":3354411217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6819","nonce":3354411217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6823","nonce":3354411217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6821","nonce":3354411217}]},"public_addr":"172.21.15.45:6817/3354411217","cluster_addr":"172.21.15.45:6819/3354411217","heartbeat_back_addr":"172.21.15.45:6823/3354411217","heartbeat_front_addr":"172.21.15.45:6821/3354411217","state":["exists","up"]},{"osd":6,"uuid":"bbdb1989-f6ac-4954-9b85-b8b540d683c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6809","nonce":320111074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6811","nonce":320111074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6815","nonce":320111074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6813","nonce":320111074}]},"public_addr":"172.21.15.45:6809/320111074","cluster_addr":"172.21.15.45:6811/320111074","heartbeat_back_addr":"172.21.15.45:6815/320111074","heartbeat_front_addr":"172.21.15.45:6813/320111074","state":["exists","up"]},{"osd":7,"uuid":"823d44e3-58f1-4d1d-8263-a4e4a69d4327","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6825","nonce":643617680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6827","nonce":643617680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6831","nonce":643617680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6829","nonce":643617680}]},"public_addr":"172.21.15.45:6825/643617680","cluster_addr":"172.21.15.45:6827/643617680","heartbeat_back_addr":"172.21.15.45:6831/643617680","heartbeat_front_addr":"172.21.15.45:6829/643617680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.731262+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.873226+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.898936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.666578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.645990+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.953699+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.642823+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.693395+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1b","mappings":[{"from":3,"to":2}]},{"pgid":"4.2a","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-22T10:54:45.666 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.663+0000 7fe6ac7ff700 1 -- 172.21.15.40:0/1344534807 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe68806ace0 msgr2=0x7fe68806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:45.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.663+0000 7fe6ac7ff700 1 --2- 172.21.15.40:0/1344534807 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe68806ace0 0x7fe68806d190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4158c00 tx=0x7fe694009040 comp rx=0 tx=0).stop 2023-06-22T10:54:45.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.663+0000 7fe6ac7ff700 1 -- 172.21.15.40:0/1344534807 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6a40b4e30 msgr2=0x7fe6a41f1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:45.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.663+0000 7fe6ac7ff700 1 --2- 172.21.15.40:0/1344534807 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6a40b4e30 0x7fe6a41f1900 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe6a0016000 tx=0x7fe6a0004750 comp rx=0 tx=0).stop 2023-06-22T10:54:45.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.663+0000 7fe6ac7ff700 1 -- 172.21.15.40:0/1344534807 shutdown_connections 2023-06-22T10:54:45.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.663+0000 7fe6ac7ff700 1 --2- 172.21.15.40:0/1344534807 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe68806ace0 0x7fe68806d190 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:45.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.663+0000 7fe6ac7ff700 1 --2- 172.21.15.40:0/1344534807 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe6a415c720 0x7fe6a40ca030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:45.667 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.663+0000 7fe6ac7ff700 1 --2- 172.21.15.40:0/1344534807 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6a40b4e30 0x7fe6a41f1900 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:45.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.663+0000 7fe6ac7ff700 1 --2- 172.21.15.40:0/1344534807 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6a40d2830 0x7fe6a415d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:45.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.663+0000 7fe6ac7ff700 1 -- 172.21.15.40:0/1344534807 >> 172.21.15.40:0/1344534807 conn(0x7fe6a40cf720 msgr2=0x7fe6a40b5bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:45.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.663+0000 7fe6ac7ff700 1 -- 172.21.15.40:0/1344534807 shutdown_connections 2023-06-22T10:54:45.668 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.663+0000 7fe6ac7ff700 1 -- 172.21.15.40:0/1344534807 wait complete. 2023-06-22T10:54:45.685 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-22T10:53:17.182228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-22T10:53:23.874432+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-22T10:53:29.812963+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-22T10:53:30.404021+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-22T10:53:33.982289+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-22T10:54:45.686 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-22T10:54:45.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.887+0000 7fcc94dff700 1 Processor -- start 2023-06-22T10:54:45.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.887+0000 7fcc94dff700 1 -- start start 2023-06-22T10:54:45.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.888+0000 7fcc94dff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcc900b45d0 0x7fcc900b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:45.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.888+0000 7fcc94dff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcc900d2130 0x7fcc900cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:45.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.888+0000 7fcc94dff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc900d1be0 con 0x7fcc900cd6e0 2023-06-22T10:54:45.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.888+0000 7fcc94dff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc900d17f0 con 0x7fcc900d2130 2023-06-22T10:54:45.892 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.888+0000 7fcc94dff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc900d1360 con 0x7fcc900b45d0 2023-06-22T10:54:45.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.889+0000 7fcc8dd9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcc900d2130 0x7fcc900cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:45.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.889+0000 7fcc8dd9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcc900d2130 0x7fcc900cd1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56734/0 (socket says 172.21.15.40:56734) 2023-06-22T10:54:45.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.889+0000 7fcc8dd9b700 1 -- 172.21.15.40:0/4013201948 learned_addr learned my addr 172.21.15.40:0/4013201948 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:45.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.889+0000 7fcc8e59c700 1 --2- 172.21.15.40:0/4013201948 >> v2:172.21.15.45:3300/0 conn(0x7fcc900b45d0 0x7fcc900b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:45.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.889+0000 7fcc8dd9b700 1 -- 172.21.15.40:0/4013201948 >> v2:172.21.15.45:3300/0 conn(0x7fcc900b45d0 msgr2=0x7fcc900b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:45.894 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.889+0000 7fcc8dd9b700 1 --2- 172.21.15.40:0/4013201948 >> v2:172.21.15.45:3300/0 conn(0x7fcc900b45d0 0x7fcc900b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:45.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.889+0000 7fcc8dd9b700 1 -- 172.21.15.40:0/4013201948 >> v1:172.21.15.45:6789/0 conn(0x7fcc900cd6e0 legacy=0x7fcc900b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:45.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.889+0000 7fcc8dd9b700 1 -- 172.21.15.40:0/4013201948 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc900b4ee0 con 0x7fcc900d2130 2023-06-22T10:54:45.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.889+0000 7fcc8dd9b700 1 --2- 172.21.15.40:0/4013201948 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc900d2130 0x7fcc900cd1a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fcc900668f0 tx=0x7fcc84009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7497f34d75a51a4 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:45.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.890+0000 7fcc8d59a700 1 -- 172.21.15.40:0/4013201948 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc84004230 con 0x7fcc900d2130 2023-06-22T10:54:45.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.890+0000 7fcc8d59a700 1 -- 172.21.15.40:0/4013201948 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc84004390 con 0x7fcc900d2130 2023-06-22T10:54:45.895 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.890+0000 7fcc8d59a700 1 -- 172.21.15.40:0/4013201948 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc840036a0 con 0x7fcc900d2130 2023-06-22T10:54:45.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.890+0000 7fcc94dff700 1 -- 172.21.15.40:0/4013201948 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc900d2130 msgr2=0x7fcc900cd1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:45.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.890+0000 7fcc94dff700 1 --2- 172.21.15.40:0/4013201948 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc900d2130 0x7fcc900cd1a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fcc900668f0 tx=0x7fcc84009bd0 comp rx=0 tx=0).stop 2023-06-22T10:54:45.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.890+0000 7fcc94dff700 1 -- 172.21.15.40:0/4013201948 shutdown_connections 2023-06-22T10:54:45.896 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.890+0000 7fcc94dff700 1 --2- 172.21.15.40:0/4013201948 >> v2:172.21.15.45:3300/0 conn(0x7fcc900b45d0 0x7fcc900b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:45.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.890+0000 7fcc94dff700 1 --2- 172.21.15.40:0/4013201948 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc900d2130 0x7fcc900cd1a0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:45.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.890+0000 7fcc94dff700 1 -- 172.21.15.40:0/4013201948 >> 172.21.15.40:0/4013201948 conn(0x7fcc900cf5d0 msgr2=0x7fcc900cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:45.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.890+0000 7fcc94dff700 1 -- 172.21.15.40:0/4013201948 shutdown_connections 2023-06-22T10:54:45.897 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.890+0000 7fcc94dff700 1 -- 172.21.15.40:0/4013201948 wait complete. 2023-06-22T10:54:45.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.892+0000 7fcc94dff700 1 Processor -- start 2023-06-22T10:54:45.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.892+0000 7fcc94dff700 1 -- start start 2023-06-22T10:54:45.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.893+0000 7fcc94dff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc900b45d0 0x7fcc900a9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:45.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.893+0000 7fcc94dff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc900cd6e0 0x7fcc900cd040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:45.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.893+0000 7fcc94dff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fcc900d2130 0x7fcc9014f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:45.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.893+0000 7fcc94dff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc900cd580 con 0x7fcc900cd6e0 2023-06-22T10:54:45.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.893+0000 7fcc94dff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc900a9b00 con 0x7fcc900b45d0 2023-06-22T10:54:45.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.893+0000 7fcc94dff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc900ca5e0 con 0x7fcc900d2130 2023-06-22T10:54:45.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.893+0000 7fcc8dd9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc900cd6e0 0x7fcc900cd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:45.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.893+0000 7fcc8dd9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc900cd6e0 0x7fcc900cd040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56742/0 (socket says 172.21.15.40:56742) 2023-06-22T10:54:45.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.893+0000 7fcc8dd9b700 1 -- 172.21.15.40:0/289913165 learned_addr learned my addr 172.21.15.40:0/289913165 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:45.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.894+0000 7fcc8e59c700 1 --2- 172.21.15.40:0/289913165 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc900b45d0 0x7fcc900a9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:45.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.894+0000 7fcc8ed9d700 1 --2- 172.21.15.40:0/289913165 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fcc900d2130 0x7fcc9014f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:45.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.894+0000 7fcc8dd9b700 1 -- 172.21.15.40:0/289913165 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fcc900d2130 msgr2=0x7fcc9014f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:45.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.894+0000 7fcc8dd9b700 1 --2- 172.21.15.40:0/289913165 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fcc900d2130 0x7fcc9014f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:45.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.894+0000 7fcc8dd9b700 1 -- 172.21.15.40:0/289913165 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc900b45d0 msgr2=0x7fcc900a9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:45.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.894+0000 7fcc8dd9b700 1 --2- 172.21.15.40:0/289913165 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc900b45d0 0x7fcc900a9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:45.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.894+0000 7fcc8dd9b700 1 -- 172.21.15.40:0/289913165 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc84009550 con 0x7fcc900cd6e0 2023-06-22T10:54:45.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.894+0000 7fcc8dd9b700 1 --2- 172.21.15.40:0/289913165 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc900cd6e0 0x7fcc900cd040 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fcc84009c10 tx=0x7fcc84004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:45.901 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.894+0000 7fcc7effd700 1 -- 172.21.15.40:0/289913165 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc84011630 con 0x7fcc900cd6e0 2023-06-22T10:54:45.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.894+0000 7fcc7effd700 1 -- 172.21.15.40:0/289913165 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc84011790 con 0x7fcc900cd6e0 2023-06-22T10:54:45.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.894+0000 7fcc94dff700 1 -- 172.21.15.40:0/289913165 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc900ca840 con 0x7fcc900cd6e0 2023-06-22T10:54:45.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.894+0000 7fcc7effd700 1 -- 172.21.15.40:0/289913165 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc84011b00 con 0x7fcc900cd6e0 2023-06-22T10:54:45.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.895+0000 7fcc94dff700 1 -- 172.21.15.40:0/289913165 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc900cae00 con 0x7fcc900cd6e0 2023-06-22T10:54:45.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.896+0000 7fcc94dff700 1 -- 172.21.15.40:0/289913165 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc900722f0 con 0x7fcc900cd6e0 2023-06-22T10:54:45.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.896+0000 7fcc7effd700 1 -- 172.21.15.40:0/289913165 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcc84011c60 con 0x7fcc900cd6e0 2023-06-22T10:54:45.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.897+0000 7fcc7effd700 1 --2- 172.21.15.40:0/289913165 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fcc7006ace0 0x7fcc7006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:45.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.897+0000 7fcc7effd700 1 -- 172.21.15.40:0/289913165 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fcc8408ad50 con 0x7fcc900cd6e0 2023-06-22T10:54:45.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.898+0000 7fcc8e59c700 1 --2- 172.21.15.40:0/289913165 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fcc7006ace0 0x7fcc7006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:45.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.898+0000 7fcc8e59c700 1 --2- 172.21.15.40:0/289913165 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fcc7006ace0 0x7fcc7006d190 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcc80009930 tx=0x7fcc80008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:45.905 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:45.902+0000 7fcc7effd700 1 -- 172.21.15.40:0/289913165 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcc84055b40 con 0x7fcc900cd6e0 2023-06-22T10:54:46.111 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.109+0000 7fcc94dff700 1 -- 172.21.15.40:0/289913165 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcc90067580 con 0x7fcc900cd6e0 2023-06-22T10:54:46.112 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.110+0000 7fcc7effd700 1 -- 172.21.15.40:0/289913165 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcc84028020 con 0x7fcc900cd6e0 2023-06-22T10:54:46.113 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-06-22T10:54:46.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.112+0000 7fcc94dff700 1 -- 172.21.15.40:0/289913165 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fcc7006ace0 msgr2=0x7fcc7006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:46.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.112+0000 7fcc94dff700 1 --2- 172.21.15.40:0/289913165 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fcc7006ace0 0x7fcc7006d190 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcc80009930 tx=0x7fcc80008040 comp rx=0 tx=0).stop 2023-06-22T10:54:46.115 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.112+0000 7fcc94dff700 1 -- 172.21.15.40:0/289913165 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc900cd6e0 msgr2=0x7fcc900cd040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:46.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.112+0000 7fcc94dff700 1 --2- 172.21.15.40:0/289913165 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc900cd6e0 0x7fcc900cd040 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fcc84009c10 tx=0x7fcc84004750 comp rx=0 tx=0).stop 2023-06-22T10:54:46.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.112+0000 7fcc94dff700 1 -- 172.21.15.40:0/289913165 shutdown_connections 2023-06-22T10:54:46.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.112+0000 7fcc94dff700 1 --2- 172.21.15.40:0/289913165 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fcc7006ace0 0x7fcc7006d190 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:46.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.112+0000 7fcc94dff700 1 --2- 172.21.15.40:0/289913165 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fcc900d2130 0x7fcc9014f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:46.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.112+0000 7fcc94dff700 1 --2- 172.21.15.40:0/289913165 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc900b45d0 0x7fcc900a9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:46.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.112+0000 7fcc94dff700 1 --2- 172.21.15.40:0/289913165 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc900cd6e0 0x7fcc900cd040 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:46.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.112+0000 7fcc94dff700 1 -- 172.21.15.40:0/289913165 >> 172.21.15.40:0/289913165 conn(0x7fcc900cf5d0 msgr2=0x7fcc900b3620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:46.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.112+0000 7fcc94dff700 1 -- 172.21.15.40:0/289913165 shutdown_connections 2023-06-22T10:54:46.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.112+0000 7fcc94dff700 1 -- 172.21.15.40:0/289913165 wait complete. 2023-06-22T10:54:46.133 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-22T10:54:46.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.334+0000 7fe7cc3ff700 1 Processor -- start 2023-06-22T10:54:46.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.335+0000 7fe7cc3ff700 1 -- start start 2023-06-22T10:54:46.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.336+0000 7fe7cc3ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe7c40b59a0 0x7fe7c40b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:46.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.336+0000 7fe7cc3ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7c40d1be0 con 0x7fe7c40d2130 2023-06-22T10:54:46.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.336+0000 7fe7cc3ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7c40d1360 con 0x7fe7c40b45d0 2023-06-22T10:54:46.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.336+0000 7fe7cc3ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7c40d17f0 con 0x7fe7c40b59a0 2023-06-22T10:54:46.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.336+0000 7fe7c999a700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe7c40d2130 0x7fe7c40cd1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51634/0 (socket says 172.21.15.40:51634) 2023-06-22T10:54:46.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.336+0000 7fe7c999a700 1 -- 172.21.15.40:0/881442094 learned_addr learned my addr 172.21.15.40:0/881442094 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:46.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.336+0000 7fe7ca99c700 1 --2- 172.21.15.40:0/881442094 >> v2:172.21.15.40:3300/0 conn(0x7fe7c40b59a0 0x7fe7c40b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:46.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.337+0000 7fe7ca99c700 1 -- 172.21.15.40:0/881442094 >> v1:172.21.15.45:6789/0 conn(0x7fe7c40b45d0 legacy=0x7fe7c40b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:46.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.337+0000 7fe7ca99c700 1 -- 172.21.15.40:0/881442094 >> v1:172.21.15.40:6789/0 conn(0x7fe7c40d2130 legacy=0x7fe7c40cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:46.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.337+0000 7fe7ca99c700 1 -- 172.21.15.40:0/881442094 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c40cef40 con 0x7fe7c40b59a0 2023-06-22T10:54:46.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.337+0000 7fe7ca99c700 1 --2- 172.21.15.40:0/881442094 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7c40b59a0 0x7fe7c40b5e40 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc009d90 tx=0x7fe7bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37c2ba87c3be3fcf server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:46.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.337+0000 7fe7c9199700 1 -- 172.21.15.40:0/881442094 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7bc00e070 con 0x7fe7c40b59a0 2023-06-22T10:54:46.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.337+0000 7fe7c9199700 1 -- 172.21.15.40:0/881442094 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7bc00bbd0 con 0x7fe7c40b59a0 2023-06-22T10:54:46.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.337+0000 7fe7c9199700 1 -- 172.21.15.40:0/881442094 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7bc012430 con 0x7fe7c40b59a0 2023-06-22T10:54:46.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.338+0000 7fe7cc3ff700 1 -- 172.21.15.40:0/881442094 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7c40b59a0 msgr2=0x7fe7c40b5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:46.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.338+0000 7fe7cc3ff700 1 --2- 172.21.15.40:0/881442094 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7c40b59a0 0x7fe7c40b5e40 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc009d90 tx=0x7fe7bc00b330 comp rx=0 tx=0).stop 2023-06-22T10:54:46.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.338+0000 7fe7cc3ff700 1 -- 172.21.15.40:0/881442094 shutdown_connections 2023-06-22T10:54:46.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.338+0000 7fe7cc3ff700 1 --2- 172.21.15.40:0/881442094 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7c40b59a0 0x7fe7c40b5e40 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:46.342 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.338+0000 7fe7cc3ff700 1 -- 172.21.15.40:0/881442094 >> 172.21.15.40:0/881442094 conn(0x7fe7c40cf5d0 msgr2=0x7fe7c40cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:46.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.338+0000 7fe7cc3ff700 1 -- 172.21.15.40:0/881442094 shutdown_connections 2023-06-22T10:54:46.343 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.338+0000 7fe7cc3ff700 1 -- 172.21.15.40:0/881442094 wait complete. 2023-06-22T10:54:46.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.340+0000 7fe7cc3ff700 1 Processor -- start 2023-06-22T10:54:46.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.340+0000 7fe7cc3ff700 1 -- start start 2023-06-22T10:54:46.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.341+0000 7fe7cc3ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe7c40b45d0 0x7fe7c4158fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:46.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.341+0000 7fe7cc3ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7c40b59a0 0x7fe7c40a9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:46.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.341+0000 7fe7cc3ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7c40d2130 0x7fe7c415e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:46.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.341+0000 7fe7cc3ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c40a9fc0 con 0x7fe7c40b59a0 2023-06-22T10:54:46.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.341+0000 7fe7cc3ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c40aa2a0 con 0x7fe7c40d2130 2023-06-22T10:54:46.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.341+0000 7fe7cc3ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c40aa580 con 0x7fe7c40b45d0 2023-06-22T10:54:46.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.341+0000 7fe7c999a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7c40b59a0 0x7fe7c40a9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:46.346 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.341+0000 7fe7c999a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7c40b59a0 0x7fe7c40a9520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56760/0 (socket says 172.21.15.40:56760) 2023-06-22T10:54:46.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.341+0000 7fe7c999a700 1 -- 172.21.15.40:0/3747907242 learned_addr learned my addr 172.21.15.40:0/3747907242 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:46.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.341+0000 7fe7ca99c700 1 --2- 172.21.15.40:0/3747907242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7c40d2130 0x7fe7c415e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:46.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.341+0000 7fe7ca19b700 1 --2- 172.21.15.40:0/3747907242 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe7c40b45d0 0x7fe7c4158fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:46.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.341+0000 7fe7c999a700 1 -- 172.21.15.40:0/3747907242 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe7c40b45d0 msgr2=0x7fe7c4158fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:46.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.341+0000 7fe7c999a700 1 --2- 172.21.15.40:0/3747907242 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe7c40b45d0 0x7fe7c4158fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:46.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.341+0000 7fe7c999a700 1 -- 172.21.15.40:0/3747907242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7c40d2130 msgr2=0x7fe7c415e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:46.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.341+0000 7fe7c999a700 1 --2- 172.21.15.40:0/3747907242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7c40d2130 0x7fe7c415e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:46.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.341+0000 7fe7c999a700 1 -- 172.21.15.40:0/3747907242 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7bc009a70 con 0x7fe7c40b59a0 2023-06-22T10:54:46.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.341+0000 7fe7ca99c700 1 --2- 172.21.15.40:0/3747907242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7c40d2130 0x7fe7c415e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:54:46.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.342+0000 7fe7c999a700 1 --2- 172.21.15.40:0/3747907242 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7c40b59a0 0x7fe7c40a9520 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe7b400c520 tx=0x7fe7b400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:46.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.342+0000 7fe7baffd700 1 -- 172.21.15.40:0/3747907242 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b4005d70 con 0x7fe7c40b59a0 2023-06-22T10:54:46.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.342+0000 7fe7baffd700 1 -- 172.21.15.40:0/3747907242 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7b40070d0 con 0x7fe7c40b59a0 2023-06-22T10:54:46.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.342+0000 7fe7cc3ff700 1 -- 172.21.15.40:0/3747907242 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7c40aa860 con 0x7fe7c40b59a0 2023-06-22T10:54:46.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.342+0000 7fe7baffd700 1 -- 172.21.15.40:0/3747907242 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b4007440 con 0x7fe7c40b59a0 2023-06-22T10:54:46.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.342+0000 7fe7cc3ff700 1 -- 172.21.15.40:0/3747907242 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7c40c9e50 con 0x7fe7c40b59a0 2023-06-22T10:54:46.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.343+0000 7fe7cc3ff700 1 -- 172.21.15.40:0/3747907242 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7c40b3790 con 0x7fe7c40b59a0 2023-06-22T10:54:46.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.344+0000 7fe7baffd700 1 -- 172.21.15.40:0/3747907242 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe7b40075a0 con 0x7fe7c40b59a0 2023-06-22T10:54:46.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.345+0000 7fe7baffd700 1 --2- 172.21.15.40:0/3747907242 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe7a806ace0 0x7fe7a806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:46.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.345+0000 7fe7baffd700 1 -- 172.21.15.40:0/3747907242 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe7b4088bd0 con 0x7fe7c40b59a0 2023-06-22T10:54:46.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.345+0000 7fe7ca19b700 1 --2- 172.21.15.40:0/3747907242 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe7a806ace0 0x7fe7a806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:46.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.346+0000 7fe7ca19b700 1 --2- 172.21.15.40:0/3747907242 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe7a806ace0 0x7fe7a806d190 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe7c40b1750 tx=0x7fe7c0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:46.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.349+0000 7fe7baffd700 1 -- 172.21.15.40:0/3747907242 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe7b40539f0 con 0x7fe7c40b59a0 2023-06-22T10:54:46.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.557+0000 7fe7cc3ff700 1 -- 172.21.15.40:0/3747907242 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe7c4067580 con 0x7fe7c40b59a0 2023-06-22T10:54:46.559 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.557+0000 7fe7baffd700 1 -- 172.21.15.40:0/3747907242 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe7b4057010 con 0x7fe7c40b59a0 2023-06-22T10:54:46.560 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 8 2023-06-22T10:54:46.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.559+0000 7fe7cc3ff700 1 -- 172.21.15.40:0/3747907242 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe7a806ace0 msgr2=0x7fe7a806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:46.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.559+0000 7fe7cc3ff700 1 --2- 172.21.15.40:0/3747907242 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe7a806ace0 0x7fe7a806d190 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe7c40b1750 tx=0x7fe7c0009040 comp rx=0 tx=0).stop 2023-06-22T10:54:46.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.559+0000 7fe7cc3ff700 1 -- 172.21.15.40:0/3747907242 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7c40b59a0 msgr2=0x7fe7c40a9520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:46.562 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.559+0000 7fe7cc3ff700 1 --2- 172.21.15.40:0/3747907242 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7c40b59a0 0x7fe7c40a9520 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe7b400c520 tx=0x7fe7b400c8e0 comp rx=0 tx=0).stop 2023-06-22T10:54:46.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.559+0000 7fe7cc3ff700 1 -- 172.21.15.40:0/3747907242 shutdown_connections 2023-06-22T10:54:46.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.559+0000 7fe7cc3ff700 1 --2- 172.21.15.40:0/3747907242 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe7a806ace0 0x7fe7a806d190 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:46.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.559+0000 7fe7cc3ff700 1 --2- 172.21.15.40:0/3747907242 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe7c40b45d0 0x7fe7c4158fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:46.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.559+0000 7fe7cc3ff700 1 --2- 172.21.15.40:0/3747907242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7c40d2130 0x7fe7c415e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:46.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.559+0000 7fe7cc3ff700 1 --2- 172.21.15.40:0/3747907242 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe7c40b59a0 0x7fe7c40a9520 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:46.563 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.560+0000 7fe7cc3ff700 1 -- 172.21.15.40:0/3747907242 >> 172.21.15.40:0/3747907242 conn(0x7fe7c40cf5d0 msgr2=0x7fe7c415b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:46.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.560+0000 7fe7cc3ff700 1 -- 172.21.15.40:0/3747907242 shutdown_connections 2023-06-22T10:54:46.564 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.560+0000 7fe7cc3ff700 1 -- 172.21.15.40:0/3747907242 wait complete. 2023-06-22T10:54:46.580 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-22T10:54:46.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.781+0000 7f318efff700 1 Processor -- start 2023-06-22T10:54:46.783 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.781+0000 7f318efff700 1 -- start start 2023-06-22T10:54:46.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.782+0000 7f318efff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f31880b45d0 0x7f31880b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:46.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.782+0000 7f318efff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31880d1be0 con 0x7f31880b59a0 2023-06-22T10:54:46.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.782+0000 7f318efff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31880d1360 con 0x7f31880d2130 2023-06-22T10:54:46.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.782+0000 7f318efff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31880d17f0 con 0x7f31880b45d0 2023-06-22T10:54:46.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.782+0000 7f318cd9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f31880b45d0 0x7f31880b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:46.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.782+0000 7f318cd9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f31880b45d0 0x7f31880b49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56768/0 (socket says 172.21.15.40:56768) 2023-06-22T10:54:46.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.782+0000 7f318cd9b700 1 -- 172.21.15.40:0/3187470902 learned_addr learned my addr 172.21.15.40:0/3187470902 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:46.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.783+0000 7f318cd9b700 1 -- 172.21.15.40:0/3187470902 >> v1:172.21.15.45:6789/0 conn(0x7f31880d2130 legacy=0x7f31880cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:46.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.783+0000 7f318cd9b700 1 -- 172.21.15.40:0/3187470902 >> v1:172.21.15.40:6789/0 conn(0x7f31880b59a0 legacy=0x7f3188166f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:46.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.783+0000 7f318cd9b700 1 -- 172.21.15.40:0/3187470902 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31880b4ee0 con 0x7f31880b45d0 2023-06-22T10:54:46.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.783+0000 7f318cd9b700 1 --2- 172.21.15.40:0/3187470902 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31880b45d0 0x7f31880b49a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f317c0098f0 tx=0x7f317c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6fad37d1ebdd832 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:46.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.783+0000 7f31877fe700 1 -- 172.21.15.40:0/3187470902 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317c00b8a0 con 0x7f31880b45d0 2023-06-22T10:54:46.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.783+0000 7f31877fe700 1 -- 172.21.15.40:0/3187470902 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f317c00ba00 con 0x7f31880b45d0 2023-06-22T10:54:46.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.783+0000 7f31877fe700 1 -- 172.21.15.40:0/3187470902 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317c00bd90 con 0x7f31880b45d0 2023-06-22T10:54:46.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.784+0000 7f318efff700 1 -- 172.21.15.40:0/3187470902 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31880b45d0 msgr2=0x7f31880b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:46.787 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.784+0000 7f318efff700 1 --2- 172.21.15.40:0/3187470902 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31880b45d0 0x7f31880b49a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f317c0098f0 tx=0x7f317c009c00 comp rx=0 tx=0).stop 2023-06-22T10:54:46.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.784+0000 7f318efff700 1 -- 172.21.15.40:0/3187470902 shutdown_connections 2023-06-22T10:54:46.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.784+0000 7f318efff700 1 --2- 172.21.15.40:0/3187470902 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31880b45d0 0x7f31880b49a0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:46.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.784+0000 7f318efff700 1 -- 172.21.15.40:0/3187470902 >> 172.21.15.40:0/3187470902 conn(0x7f31880cf5d0 msgr2=0x7f31880cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:46.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.784+0000 7f318efff700 1 -- 172.21.15.40:0/3187470902 shutdown_connections 2023-06-22T10:54:46.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.784+0000 7f318efff700 1 -- 172.21.15.40:0/3187470902 wait complete. 2023-06-22T10:54:46.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.786+0000 7f318efff700 1 Processor -- start 2023-06-22T10:54:46.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.786+0000 7f318efff700 1 -- start start 2023-06-22T10:54:46.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.787+0000 7f318efff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f31880b45d0 0x7f318814dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:46.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.787+0000 7f318efff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31880b59a0 0x7f31881f1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:46.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.787+0000 7f318efff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31880d2130 0x7f31880ca630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:46.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.787+0000 7f318efff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318814e4e0 con 0x7f31880d2130 2023-06-22T10:54:46.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.787+0000 7f318efff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31880cb010 con 0x7f31880b59a0 2023-06-22T10:54:46.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.787+0000 7f318efff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f318815c700 con 0x7f31880b45d0 2023-06-22T10:54:46.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.787+0000 7f318d59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31880d2130 0x7f31880ca630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:46.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.787+0000 7f318d59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31880d2130 0x7f31880ca630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56778/0 (socket says 172.21.15.40:56778) 2023-06-22T10:54:46.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.787+0000 7f318d59c700 1 -- 172.21.15.40:0/3444061113 learned_addr learned my addr 172.21.15.40:0/3444061113 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:46.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.787+0000 7f3187fff700 1 --2- 172.21.15.40:0/3444061113 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31880b59a0 0x7f31881f1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:46.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.787+0000 7f318cd9b700 1 --2- 172.21.15.40:0/3444061113 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f31880b45d0 0x7f318814dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:46.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.787+0000 7f318d59c700 1 -- 172.21.15.40:0/3444061113 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f31880b45d0 msgr2=0x7f318814dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:46.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.787+0000 7f318d59c700 1 --2- 172.21.15.40:0/3444061113 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f31880b45d0 0x7f318814dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:46.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.787+0000 7f318d59c700 1 -- 172.21.15.40:0/3444061113 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31880b59a0 msgr2=0x7f31881f1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:46.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.787+0000 7f318d59c700 1 --2- 172.21.15.40:0/3444061113 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31880b59a0 0x7f31881f1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:46.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.787+0000 7f318d59c700 1 -- 172.21.15.40:0/3444061113 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f317c009550 con 0x7f31880d2130 2023-06-22T10:54:46.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.788+0000 7f318d59c700 1 --2- 172.21.15.40:0/3444061113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31880d2130 0x7f31880ca630 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f318000cc50 tx=0x7f318000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:46.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.788+0000 7f31857fa700 1 -- 172.21.15.40:0/3444061113 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3180003c00 con 0x7f31880d2130 2023-06-22T10:54:46.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.788+0000 7f31857fa700 1 -- 172.21.15.40:0/3444061113 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3180003d60 con 0x7f31880d2130 2023-06-22T10:54:46.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.788+0000 7f31857fa700 1 -- 172.21.15.40:0/3444061113 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318000ab60 con 0x7f31880d2130 2023-06-22T10:54:46.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.788+0000 7f318efff700 1 -- 172.21.15.40:0/3444061113 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f318815c9e0 con 0x7f31880d2130 2023-06-22T10:54:46.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.788+0000 7f318efff700 1 -- 172.21.15.40:0/3444061113 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f318815cfa0 con 0x7f31880d2130 2023-06-22T10:54:46.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.789+0000 7f318efff700 1 -- 172.21.15.40:0/3444061113 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f318815d1c0 con 0x7f31880d2130 2023-06-22T10:54:46.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.790+0000 7f31857fa700 1 -- 172.21.15.40:0/3444061113 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f318000acc0 con 0x7f31880d2130 2023-06-22T10:54:46.794 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.791+0000 7f31857fa700 1 --2- 172.21.15.40:0/3444061113 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f316c06ace0 0x7f316c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:46.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.791+0000 7f31857fa700 1 -- 172.21.15.40:0/3444061113 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3180089910 con 0x7f31880d2130 2023-06-22T10:54:46.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.792+0000 7f318cd9b700 1 --2- 172.21.15.40:0/3444061113 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f316c06ace0 0x7f316c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:46.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.792+0000 7f318cd9b700 1 --2- 172.21.15.40:0/3444061113 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f316c06ace0 0x7f316c06d190 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f317c014040 tx=0x7f317c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:46.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:46.796+0000 7f31857fa700 1 -- 172.21.15.40:0/3444061113 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f31800545f0 con 0x7f31880d2130 2023-06-22T10:54:47.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.003+0000 7f318efff700 1 -- 172.21.15.40:0/3444061113 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3188067580 con 0x7f31880d2130 2023-06-22T10:54:47.006 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.003+0000 7f31857fa700 1 -- 172.21.15.40:0/3444061113 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3180057c10 con 0x7f31880d2130 2023-06-22T10:54:47.006 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-06-22T10:54:47.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.006+0000 7f318efff700 1 -- 172.21.15.40:0/3444061113 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f316c06ace0 msgr2=0x7f316c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:47.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.006+0000 7f318efff700 1 --2- 172.21.15.40:0/3444061113 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f316c06ace0 0x7f316c06d190 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f317c014040 tx=0x7f317c008030 comp rx=0 tx=0).stop 2023-06-22T10:54:47.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.006+0000 7f318efff700 1 -- 172.21.15.40:0/3444061113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31880d2130 msgr2=0x7f31880ca630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:47.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.006+0000 7f318efff700 1 --2- 172.21.15.40:0/3444061113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31880d2130 0x7f31880ca630 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f318000cc50 tx=0x7f318000cf60 comp rx=0 tx=0).stop 2023-06-22T10:54:47.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.006+0000 7f318efff700 1 -- 172.21.15.40:0/3444061113 shutdown_connections 2023-06-22T10:54:47.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.006+0000 7f318efff700 1 --2- 172.21.15.40:0/3444061113 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f316c06ace0 0x7f316c06d190 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:47.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.006+0000 7f318efff700 1 --2- 172.21.15.40:0/3444061113 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f31880b45d0 0x7f318814dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:47.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.006+0000 7f318efff700 1 --2- 172.21.15.40:0/3444061113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31880d2130 0x7f31880ca630 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:47.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.006+0000 7f318efff700 1 --2- 172.21.15.40:0/3444061113 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31880b59a0 0x7f31881f1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:47.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.006+0000 7f318efff700 1 -- 172.21.15.40:0/3444061113 >> 172.21.15.40:0/3444061113 conn(0x7f31880cf5d0 msgr2=0x7f31880d03e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:47.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.006+0000 7f318efff700 1 -- 172.21.15.40:0/3444061113 shutdown_connections 2023-06-22T10:54:47.010 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.006+0000 7f318efff700 1 -- 172.21.15.40:0/3444061113 wait complete. 2023-06-22T10:54:47.026 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-22T10:54:47.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.229+0000 7f942c7ff700 1 Processor -- start 2023-06-22T10:54:47.232 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.229+0000 7f942c7ff700 1 -- start start 2023-06-22T10:54:47.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.231+0000 7f942c7ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f94240b12b0 0x7f94240cf2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:47.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.231+0000 7f942c7ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9424160810 0x7f94240b1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:47.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.231+0000 7f942c7ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f942415d0e0 0x7f9424069f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:47.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.231+0000 7f942c7ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f942415cc50 con 0x7f9424160810 2023-06-22T10:54:47.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.231+0000 7f942c7ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f942415c920 con 0x7f942415d0e0 2023-06-22T10:54:47.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.231+0000 7f942c7ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94240b1bc0 con 0x7f94240b12b0 2023-06-22T10:54:47.236 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.231+0000 7f9429d9a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9424160810 0x7f94240b1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:47.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.231+0000 7f9429d9a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9424160810 0x7f94240b1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56780/0 (socket says 172.21.15.40:56780) 2023-06-22T10:54:47.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.231+0000 7f9429d9a700 1 -- 172.21.15.40:0/1434785230 learned_addr learned my addr 172.21.15.40:0/1434785230 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:47.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.231+0000 7f942a59b700 1 --2- 172.21.15.40:0/1434785230 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f94240b12b0 0x7f94240cf2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:47.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.231+0000 7f942ad9c700 1 --2- 172.21.15.40:0/1434785230 >> v2:172.21.15.45:3300/0 conn(0x7f942415d0e0 0x7f9424069f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:47.237 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.231+0000 7f9429d9a700 1 -- 172.21.15.40:0/1434785230 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f94240b12b0 msgr2=0x7f94240cf2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:47.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.231+0000 7f9429d9a700 1 --2- 172.21.15.40:0/1434785230 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f94240b12b0 0x7f94240cf2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:47.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.231+0000 7f9429d9a700 1 -- 172.21.15.40:0/1434785230 >> v2:172.21.15.45:3300/0 conn(0x7f942415d0e0 msgr2=0x7f9424069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:47.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.231+0000 7f9429d9a700 1 --2- 172.21.15.40:0/1434785230 >> v2:172.21.15.45:3300/0 conn(0x7f942415d0e0 0x7f9424069f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:47.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.231+0000 7f9429d9a700 1 -- 172.21.15.40:0/1434785230 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94240cd530 con 0x7f9424160810 2023-06-22T10:54:47.238 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.231+0000 7f942ad9c700 1 --2- 172.21.15.40:0/1434785230 >> v2:172.21.15.45:3300/0 conn(0x7f942415d0e0 0x7f9424069f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:54:47.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.232+0000 7f9429d9a700 1 --2- 172.21.15.40:0/1434785230 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9424160810 0x7f94240b1680 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f94240cc260 tx=0x7f9414009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8ce3908d2cf96e4 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:47.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.232+0000 7f9429599700 1 -- 172.21.15.40:0/1434785230 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941400b870 con 0x7f9424160810 2023-06-22T10:54:47.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.232+0000 7f9429599700 1 -- 172.21.15.40:0/1434785230 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f941400b9d0 con 0x7f9424160810 2023-06-22T10:54:47.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.232+0000 7f9429599700 1 -- 172.21.15.40:0/1434785230 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941400bd60 con 0x7f9424160810 2023-06-22T10:54:47.239 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.232+0000 7f942c7ff700 1 -- 172.21.15.40:0/1434785230 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9424160810 msgr2=0x7f94240b1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:47.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.232+0000 7f942c7ff700 1 --2- 172.21.15.40:0/1434785230 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9424160810 0x7f94240b1680 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f94240cc260 tx=0x7f9414009bd0 comp rx=0 tx=0).stop 2023-06-22T10:54:47.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.232+0000 7f942c7ff700 1 -- 172.21.15.40:0/1434785230 shutdown_connections 2023-06-22T10:54:47.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.232+0000 7f942c7ff700 1 --2- 172.21.15.40:0/1434785230 >> v2:172.21.15.45:3300/0 conn(0x7f942415d0e0 0x7f9424069f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:47.240 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.232+0000 7f942c7ff700 1 --2- 172.21.15.40:0/1434785230 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f94240b12b0 0x7f94240cf2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:47.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.232+0000 7f942c7ff700 1 --2- 172.21.15.40:0/1434785230 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9424160810 0x7f94240b1680 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:47.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.232+0000 7f942c7ff700 1 -- 172.21.15.40:0/1434785230 >> 172.21.15.40:0/1434785230 conn(0x7f942406e110 msgr2=0x7f94240cc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:47.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.233+0000 7f942c7ff700 1 -- 172.21.15.40:0/1434785230 shutdown_connections 2023-06-22T10:54:47.241 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.233+0000 7f942c7ff700 1 -- 172.21.15.40:0/1434785230 wait complete. 2023-06-22T10:54:47.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.234+0000 7f942c7ff700 1 Processor -- start 2023-06-22T10:54:47.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.234+0000 7f942c7ff700 1 -- start start 2023-06-22T10:54:47.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.235+0000 7f942c7ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94240b12b0 0x7f9424157160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:47.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.235+0000 7f942c7ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f942415d0e0 0x7f94240c54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:47.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.235+0000 7f942c7ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9424160810 0x7f94240c5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:47.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.235+0000 7f942c7ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9424158210 con 0x7f9424160810 2023-06-22T10:54:47.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.235+0000 7f942c7ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94241f2340 con 0x7f94240b12b0 2023-06-22T10:54:47.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.235+0000 7f942c7ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94241f2620 con 0x7f942415d0e0 2023-06-22T10:54:47.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.236+0000 7f942ad9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9424160810 0x7f94240c5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:47.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.236+0000 7f942ad9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9424160810 0x7f94240c5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56784/0 (socket says 172.21.15.40:56784) 2023-06-22T10:54:47.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.236+0000 7f942ad9c700 1 -- 172.21.15.40:0/417421340 learned_addr learned my addr 172.21.15.40:0/417421340 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:47.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.236+0000 7f9429d9a700 1 --2- 172.21.15.40:0/417421340 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f942415d0e0 0x7f94240c54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:47.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.236+0000 7f942a59b700 1 --2- 172.21.15.40:0/417421340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94240b12b0 0x7f9424157160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:47.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.236+0000 7f942ad9c700 1 -- 172.21.15.40:0/417421340 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f942415d0e0 msgr2=0x7f94240c54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:47.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.236+0000 7f942ad9c700 1 --2- 172.21.15.40:0/417421340 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f942415d0e0 0x7f94240c54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:47.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.236+0000 7f942ad9c700 1 -- 172.21.15.40:0/417421340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94240b12b0 msgr2=0x7f9424157160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:47.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.236+0000 7f942ad9c700 1 --2- 172.21.15.40:0/417421340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94240b12b0 0x7f9424157160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:47.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.236+0000 7f942ad9c700 1 -- 172.21.15.40:0/417421340 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9414009550 con 0x7f9424160810 2023-06-22T10:54:47.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.236+0000 7f942a59b700 1 --2- 172.21.15.40:0/417421340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94240b12b0 0x7f9424157160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:54:47.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.236+0000 7f942ad9c700 1 --2- 172.21.15.40:0/417421340 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9424160810 0x7f94240c5a10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f941c007e70 tx=0x7f941c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:47.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.236+0000 7f941affd700 1 -- 172.21.15.40:0/417421340 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941c00ddd0 con 0x7f9424160810 2023-06-22T10:54:47.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.236+0000 7f941affd700 1 -- 172.21.15.40:0/417421340 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f941c00f040 con 0x7f9424160810 2023-06-22T10:54:47.246 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.237+0000 7f942c7ff700 1 -- 172.21.15.40:0/417421340 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94241f2900 con 0x7f9424160810 2023-06-22T10:54:47.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.237+0000 7f941affd700 1 -- 172.21.15.40:0/417421340 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941c003c60 con 0x7f9424160810 2023-06-22T10:54:47.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.237+0000 7f942c7ff700 1 -- 172.21.15.40:0/417421340 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94241599d0 con 0x7f9424160810 2023-06-22T10:54:47.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.238+0000 7f942c7ff700 1 -- 172.21.15.40:0/417421340 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94241f2e20 con 0x7f9424160810 2023-06-22T10:54:47.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.239+0000 7f941affd700 1 -- 172.21.15.40:0/417421340 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f941c004030 con 0x7f9424160810 2023-06-22T10:54:47.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.240+0000 7f941affd700 1 --2- 172.21.15.40:0/417421340 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f940806ace0 0x7f940806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:47.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.240+0000 7f941affd700 1 -- 172.21.15.40:0/417421340 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f941c0898f0 con 0x7f9424160810 2023-06-22T10:54:47.247 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.240+0000 7f942a59b700 1 --2- 172.21.15.40:0/417421340 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f940806ace0 0x7f940806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:47.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.240+0000 7f942a59b700 1 --2- 172.21.15.40:0/417421340 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f940806ace0 0x7f940806d190 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f94240c6300 tx=0x7f9420008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:47.248 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.244+0000 7f941affd700 1 -- 172.21.15.40:0/417421340 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f94241f2e20 con 0x7f9424160810 2023-06-22T10:54:47.452 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.450+0000 7f942c7ff700 1 -- 172.21.15.40:0/417421340 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f94241f2e20 con 0x7f9424160810 2023-06-22T10:54:47.453 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.450+0000 7f941affd700 1 -- 172.21.15.40:0/417421340 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7f94241f2e20 con 0x7f9424160810 2023-06-22T10:54:47.453 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-06-22T10:54:47.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.453+0000 7f942c7ff700 1 -- 172.21.15.40:0/417421340 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f940806ace0 msgr2=0x7f940806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:47.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.453+0000 7f942c7ff700 1 --2- 172.21.15.40:0/417421340 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f940806ace0 0x7f940806d190 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f94240c6300 tx=0x7f9420008040 comp rx=0 tx=0).stop 2023-06-22T10:54:47.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.453+0000 7f942c7ff700 1 -- 172.21.15.40:0/417421340 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9424160810 msgr2=0x7f94240c5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:47.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.453+0000 7f942c7ff700 1 --2- 172.21.15.40:0/417421340 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9424160810 0x7f94240c5a10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f941c007e70 tx=0x7f941c00d3b0 comp rx=0 tx=0).stop 2023-06-22T10:54:47.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.453+0000 7f942c7ff700 1 -- 172.21.15.40:0/417421340 shutdown_connections 2023-06-22T10:54:47.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.453+0000 7f942c7ff700 1 --2- 172.21.15.40:0/417421340 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f940806ace0 0x7f940806d190 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:47.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.453+0000 7f942c7ff700 1 --2- 172.21.15.40:0/417421340 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9424160810 0x7f94240c5a10 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:47.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.453+0000 7f942c7ff700 1 --2- 172.21.15.40:0/417421340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94240b12b0 0x7f9424157160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:47.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.453+0000 7f942c7ff700 1 --2- 172.21.15.40:0/417421340 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f942415d0e0 0x7f94240c54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:47.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.453+0000 7f942c7ff700 1 -- 172.21.15.40:0/417421340 >> 172.21.15.40:0/417421340 conn(0x7f942406e110 msgr2=0x7f94240b3fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:47.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.453+0000 7f942c7ff700 1 -- 172.21.15.40:0/417421340 shutdown_connections 2023-06-22T10:54:47.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.453+0000 7f942c7ff700 1 -- 172.21.15.40:0/417421340 wait complete. 2023-06-22T10:54:47.473 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-22T10:54:47.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.676+0000 7f5330dff700 1 Processor -- start 2023-06-22T10:54:47.678 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.676+0000 7f5330dff700 1 -- start start 2023-06-22T10:54:47.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.677+0000 7f5330dff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f532c15d400 0x7f532c15e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:47.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.677+0000 7f5330dff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f532c15e940 con 0x7f532c0cd350 2023-06-22T10:54:47.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.677+0000 7f5330dff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f532c15c7e0 con 0x7f532c1609b0 2023-06-22T10:54:47.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.677+0000 7f5330dff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f532c15fef0 con 0x7f532c15d400 2023-06-22T10:54:47.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.677+0000 7f532a59c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f532c0cd350 0x7f532c0cd720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51646/0 (socket says 172.21.15.40:51646) 2023-06-22T10:54:47.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.677+0000 7f532a59c700 1 -- 172.21.15.40:0/3389448938 learned_addr learned my addr 172.21.15.40:0/3389448938 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:47.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.678+0000 7f532ad9d700 1 --2- 172.21.15.40:0/3389448938 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f532c15d400 0x7f532c15e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:47.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.678+0000 7f532959a700 1 -- 172.21.15.40:0/3389448938 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3414391771 0 0) 0x7f532c15e940 con 0x7f532c0cd350 2023-06-22T10:54:47.682 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.678+0000 7f532959a700 1 -- 172.21.15.40:0/3389448938 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53140035b0 con 0x7f532c0cd350 2023-06-22T10:54:47.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.678+0000 7f532ad9d700 1 -- 172.21.15.40:0/3389448938 >> v1:172.21.15.45:6789/0 conn(0x7f532c1609b0 legacy=0x7f532c15dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:47.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.678+0000 7f532959a700 1 -- 172.21.15.40:0/3389448938 <== mon.1 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3656031674 0 0) 0x7f532c15c7e0 con 0x7f532c1609b0 2023-06-22T10:54:47.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.678+0000 7f532ad9d700 1 -- 172.21.15.40:0/3389448938 >> v1:172.21.15.40:6789/0 conn(0x7f532c0cd350 legacy=0x7f532c0cd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:47.683 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.678+0000 7f532ad9d700 1 -- 172.21.15.40:0/3389448938 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f532c160e20 con 0x7f532c15d400 2023-06-22T10:54:47.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.678+0000 7f532ad9d700 1 --2- 172.21.15.40:0/3389448938 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f532c15d400 0x7f532c15e400 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5324009dc0 tx=0x7f532400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37be4ef97f6d3d19 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:47.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.679+0000 7f532959a700 1 -- 172.21.15.40:0/3389448938 <== mon.2 v2:172.21.15.45:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532400e070 con 0x7f532c15d400 2023-06-22T10:54:47.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.679+0000 7f532959a700 1 -- 172.21.15.40:0/3389448938 <== mon.2 v2:172.21.15.45:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f532400bb20 con 0x7f532c15d400 2023-06-22T10:54:47.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.679+0000 7f532959a700 1 -- 172.21.15.40:0/3389448938 <== mon.2 v2:172.21.15.45:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532400bed0 con 0x7f532c15d400 2023-06-22T10:54:47.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.679+0000 7f5330dff700 1 -- 172.21.15.40:0/3389448938 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f532c15d400 msgr2=0x7f532c15e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:47.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.679+0000 7f5330dff700 1 --2- 172.21.15.40:0/3389448938 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f532c15d400 0x7f532c15e400 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5324009dc0 tx=0x7f532400b330 comp rx=0 tx=0).stop 2023-06-22T10:54:47.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.679+0000 7f5330dff700 1 -- 172.21.15.40:0/3389448938 shutdown_connections 2023-06-22T10:54:47.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.679+0000 7f5330dff700 1 --2- 172.21.15.40:0/3389448938 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f532c15d400 0x7f532c15e400 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:47.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.679+0000 7f5330dff700 1 -- 172.21.15.40:0/3389448938 >> 172.21.15.40:0/3389448938 conn(0x7f532c069f30 msgr2=0x7f532c06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:47.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.679+0000 7f5330dff700 1 -- 172.21.15.40:0/3389448938 shutdown_connections 2023-06-22T10:54:47.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.679+0000 7f5330dff700 1 -- 172.21.15.40:0/3389448938 wait complete. 2023-06-22T10:54:47.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.681+0000 7f5330dff700 1 Processor -- start 2023-06-22T10:54:47.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.681+0000 7f5330dff700 1 -- start start 2023-06-22T10:54:47.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.682+0000 7f5330dff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f532c0cd350 0x7f532c155b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:47.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.682+0000 7f5330dff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f532c15d400 0x7f532c15b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:47.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.682+0000 7f5330dff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f532c1609b0 0x7f532c0c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:47.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.682+0000 7f5330dff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f532c15a980 con 0x7f532c15d400 2023-06-22T10:54:47.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.682+0000 7f5330dff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f532c15bf20 con 0x7f532c0cd350 2023-06-22T10:54:47.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.682+0000 7f5330dff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f532c15ac20 con 0x7f532c1609b0 2023-06-22T10:54:47.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.683+0000 7f5329d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f532c15d400 0x7f532c15b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:47.688 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.683+0000 7f5329d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f532c15d400 0x7f532c15b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56794/0 (socket says 172.21.15.40:56794) 2023-06-22T10:54:47.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.683+0000 7f5329d9b700 1 -- 172.21.15.40:0/1131774078 learned_addr learned my addr 172.21.15.40:0/1131774078 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:47.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.683+0000 7f532a59c700 1 --2- 172.21.15.40:0/1131774078 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f532c0cd350 0x7f532c155b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:47.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.683+0000 7f532ad9d700 1 --2- 172.21.15.40:0/1131774078 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f532c1609b0 0x7f532c0c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:47.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.683+0000 7f5329d9b700 1 -- 172.21.15.40:0/1131774078 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f532c1609b0 msgr2=0x7f532c0c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:47.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.683+0000 7f5329d9b700 1 --2- 172.21.15.40:0/1131774078 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f532c1609b0 0x7f532c0c9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:47.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.683+0000 7f5329d9b700 1 -- 172.21.15.40:0/1131774078 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f532c0cd350 msgr2=0x7f532c155b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:47.689 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.683+0000 7f5329d9b700 1 --2- 172.21.15.40:0/1131774078 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f532c0cd350 0x7f532c155b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:47.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.683+0000 7f5329d9b700 1 -- 172.21.15.40:0/1131774078 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5324009a70 con 0x7f532c15d400 2023-06-22T10:54:47.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.683+0000 7f5329d9b700 1 --2- 172.21.15.40:0/1131774078 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f532c15d400 0x7f532c15b9e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f532000c500 tx=0x7f532000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:47.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.684+0000 7f531affd700 1 -- 172.21.15.40:0/1131774078 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53200054e0 con 0x7f532c15d400 2023-06-22T10:54:47.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.684+0000 7f531affd700 1 -- 172.21.15.40:0/1131774078 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5320003680 con 0x7f532c15d400 2023-06-22T10:54:47.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.684+0000 7f5330dff700 1 -- 172.21.15.40:0/1131774078 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f532c15af00 con 0x7f532c15d400 2023-06-22T10:54:47.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.684+0000 7f531affd700 1 -- 172.21.15.40:0/1131774078 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5320003a30 con 0x7f532c15d400 2023-06-22T10:54:47.690 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.684+0000 7f5330dff700 1 -- 172.21.15.40:0/1131774078 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f532c15b4c0 con 0x7f532c15d400 2023-06-22T10:54:47.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.685+0000 7f5330dff700 1 -- 172.21.15.40:0/1131774078 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f532c067580 con 0x7f532c15d400 2023-06-22T10:54:47.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.686+0000 7f531affd700 1 -- 172.21.15.40:0/1131774078 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5320003b90 con 0x7f532c15d400 2023-06-22T10:54:47.691 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.687+0000 7f531affd700 1 --2- 172.21.15.40:0/1131774078 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f530c06ace0 0x7f530c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:47.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.687+0000 7f531affd700 1 -- 172.21.15.40:0/1131774078 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5320088c70 con 0x7f532c15d400 2023-06-22T10:54:47.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.687+0000 7f532a59c700 1 --2- 172.21.15.40:0/1131774078 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f530c06ace0 0x7f530c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:47.692 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.687+0000 7f532a59c700 1 --2- 172.21.15.40:0/1131774078 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f530c06ace0 0x7f530c06d190 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f531c007fd0 tx=0x7f531c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:47.693 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.691+0000 7f531affd700 1 -- 172.21.15.40:0/1131774078 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5320053950 con 0x7f532c15d400 2023-06-22T10:54:47.899 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.897+0000 7f5330dff700 1 -- 172.21.15.40:0/1131774078 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f532c0c41d0 con 0x7f532c15d400 2023-06-22T10:54:47.900 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.897+0000 7f531affd700 1 -- 172.21.15.40:0/1131774078 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7f53200170a0 con 0x7f532c15d400 2023-06-22T10:54:47.900 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-06-22T10:54:47.902 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.900+0000 7f5330dff700 1 -- 172.21.15.40:0/1131774078 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f530c06ace0 msgr2=0x7f530c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:47.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.900+0000 7f5330dff700 1 --2- 172.21.15.40:0/1131774078 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f530c06ace0 0x7f530c06d190 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f531c007fd0 tx=0x7f531c009040 comp rx=0 tx=0).stop 2023-06-22T10:54:47.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.900+0000 7f5330dff700 1 -- 172.21.15.40:0/1131774078 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f532c15d400 msgr2=0x7f532c15b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:47.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.900+0000 7f5330dff700 1 --2- 172.21.15.40:0/1131774078 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f532c15d400 0x7f532c15b9e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f532000c500 tx=0x7f532000c810 comp rx=0 tx=0).stop 2023-06-22T10:54:47.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.900+0000 7f5330dff700 1 -- 172.21.15.40:0/1131774078 shutdown_connections 2023-06-22T10:54:47.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.900+0000 7f5330dff700 1 --2- 172.21.15.40:0/1131774078 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f530c06ace0 0x7f530c06d190 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:47.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.900+0000 7f5330dff700 1 --2- 172.21.15.40:0/1131774078 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f532c1609b0 0x7f532c0c9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:47.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.900+0000 7f5330dff700 1 --2- 172.21.15.40:0/1131774078 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f532c0cd350 0x7f532c155b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:47.903 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.900+0000 7f5330dff700 1 --2- 172.21.15.40:0/1131774078 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f532c15d400 0x7f532c15b9e0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:47.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.900+0000 7f5330dff700 1 -- 172.21.15.40:0/1131774078 >> 172.21.15.40:0/1131774078 conn(0x7f532c069f30 msgr2=0x7f532c0cd720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:47.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.900+0000 7f5330dff700 1 -- 172.21.15.40:0/1131774078 shutdown_connections 2023-06-22T10:54:47.904 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:47.900+0000 7f5330dff700 1 -- 172.21.15.40:0/1131774078 wait complete. 2023-06-22T10:54:47.921 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-22T10:54:48.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.124+0000 7f924ebff700 1 Processor -- start 2023-06-22T10:54:48.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.124+0000 7f924ebff700 1 -- start start 2023-06-22T10:54:48.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.125+0000 7f924ebff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f924815c720 0x7f92480b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:48.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.125+0000 7f924ebff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92480b2130 con 0x7f92480b4e30 2023-06-22T10:54:48.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.125+0000 7f924ebff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9248161180 con 0x7f92480d2830 2023-06-22T10:54:48.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.125+0000 7f924ebff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9248160d60 con 0x7f924815c720 2023-06-22T10:54:48.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.126+0000 7f924d19c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f92480b4e30 0x7f92480d0d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:51662/0 (socket says 172.21.15.40:51662) 2023-06-22T10:54:48.129 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.126+0000 7f924d19c700 1 -- 172.21.15.40:0/2796499463 learned_addr learned my addr 172.21.15.40:0/2796499463 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:48.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.126+0000 7f924c99b700 1 --2- 172.21.15.40:0/2796499463 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f924815c720 0x7f92480b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:48.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.126+0000 7f923f7fe700 1 -- 172.21.15.40:0/2796499463 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4125768935 0 0) 0x7f92480b2130 con 0x7f92480b4e30 2023-06-22T10:54:48.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.126+0000 7f923f7fe700 1 -- 172.21.15.40:0/2796499463 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92300035b0 con 0x7f92480b4e30 2023-06-22T10:54:48.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.126+0000 7f923f7fe700 1 -- 172.21.15.40:0/2796499463 <== mon.1 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2551023879 0 0) 0x7f9248161180 con 0x7f92480d2830 2023-06-22T10:54:48.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.126+0000 7f923f7fe700 1 -- 172.21.15.40:0/2796499463 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92480b2130 con 0x7f92480d2830 2023-06-22T10:54:48.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.126+0000 7f924c99b700 1 -- 172.21.15.40:0/2796499463 >> v1:172.21.15.45:6789/0 conn(0x7f92480d2830 legacy=0x7f92480b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:48.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.126+0000 7f924c99b700 1 -- 172.21.15.40:0/2796499463 >> v1:172.21.15.40:6789/0 conn(0x7f92480b4e30 legacy=0x7f92480d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:48.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.126+0000 7f924c99b700 1 -- 172.21.15.40:0/2796499463 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92481603c0 con 0x7f924815c720 2023-06-22T10:54:48.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.127+0000 7f924c99b700 1 --2- 172.21.15.40:0/2796499463 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f924815c720 0x7f92480b1870 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9244009870 tx=0x7f9244009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dab1115553113407 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:48.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.127+0000 7f923f7fe700 1 -- 172.21.15.40:0/2796499463 <== mon.2 v2:172.21.15.45:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9244011830 con 0x7f924815c720 2023-06-22T10:54:48.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.127+0000 7f923f7fe700 1 -- 172.21.15.40:0/2796499463 <== mon.2 v2:172.21.15.45:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9244011990 con 0x7f924815c720 2023-06-22T10:54:48.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.127+0000 7f923f7fe700 1 -- 172.21.15.40:0/2796499463 <== mon.2 v2:172.21.15.45:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9244011d20 con 0x7f924815c720 2023-06-22T10:54:48.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.128+0000 7f924ebff700 1 -- 172.21.15.40:0/2796499463 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f924815c720 msgr2=0x7f92480b1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:48.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.128+0000 7f924ebff700 1 --2- 172.21.15.40:0/2796499463 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f924815c720 0x7f92480b1870 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9244009870 tx=0x7f9244009b80 comp rx=0 tx=0).stop 2023-06-22T10:54:48.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.128+0000 7f924ebff700 1 -- 172.21.15.40:0/2796499463 shutdown_connections 2023-06-22T10:54:48.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.128+0000 7f924ebff700 1 --2- 172.21.15.40:0/2796499463 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f924815c720 0x7f92480b1870 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:48.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.128+0000 7f924ebff700 1 -- 172.21.15.40:0/2796499463 >> 172.21.15.40:0/2796499463 conn(0x7f92480cf720 msgr2=0x7f92480cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:48.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.128+0000 7f924ebff700 1 -- 172.21.15.40:0/2796499463 shutdown_connections 2023-06-22T10:54:48.133 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.128+0000 7f924ebff700 1 -- 172.21.15.40:0/2796499463 wait complete. 2023-06-22T10:54:48.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.129+0000 7f924ebff700 1 Processor -- start 2023-06-22T10:54:48.134 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.130+0000 7f924ebff700 1 -- start start 2023-06-22T10:54:48.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.131+0000 7f924ebff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92480b4e30 0x7f92480b0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:48.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.131+0000 7f924ebff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f92480d2830 0x7f924814be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:48.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.131+0000 7f924ebff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f924815c720 0x7f924806b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:48.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.131+0000 7f924ebff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f924814cd90 con 0x7f924815c720 2023-06-22T10:54:48.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.131+0000 7f924ebff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f924814c7d0 con 0x7f92480b4e30 2023-06-22T10:54:48.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.131+0000 7f924ebff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f924814cab0 con 0x7f92480d2830 2023-06-22T10:54:48.135 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.131+0000 7f924d19c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f924815c720 0x7f924806b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:48.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.131+0000 7f924d19c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f924815c720 0x7f924806b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:56804/0 (socket says 172.21.15.40:56804) 2023-06-22T10:54:48.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.131+0000 7f923ffff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f92480d2830 0x7f924814be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:48.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.131+0000 7f924d19c700 1 -- 172.21.15.40:0/139558180 learned_addr learned my addr 172.21.15.40:0/139558180 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:48.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.131+0000 7f924c99b700 1 --2- 172.21.15.40:0/139558180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92480b4e30 0x7f92480b0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:48.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.131+0000 7f924d19c700 1 -- 172.21.15.40:0/139558180 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f92480d2830 msgr2=0x7f924814be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:48.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.131+0000 7f924d19c700 1 --2- 172.21.15.40:0/139558180 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f92480d2830 0x7f924814be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:48.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.131+0000 7f924d19c700 1 -- 172.21.15.40:0/139558180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92480b4e30 msgr2=0x7f92480b0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:48.136 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.131+0000 7f924d19c700 1 --2- 172.21.15.40:0/139558180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92480b4e30 0x7f92480b0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:48.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.131+0000 7f924d19c700 1 -- 172.21.15.40:0/139558180 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92440094a0 con 0x7f924815c720 2023-06-22T10:54:48.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.132+0000 7f924d19c700 1 --2- 172.21.15.40:0/139558180 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f924815c720 0x7f924806b4d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f924000cb10 tx=0x7f924000ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:48.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.132+0000 7f923d7fa700 1 -- 172.21.15.40:0/139558180 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924000a9e0 con 0x7f924815c720 2023-06-22T10:54:48.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.132+0000 7f923d7fa700 1 -- 172.21.15.40:0/139558180 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f924000ab60 con 0x7f924815c720 2023-06-22T10:54:48.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.132+0000 7f923d7fa700 1 -- 172.21.15.40:0/139558180 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9240012400 con 0x7f924815c720 2023-06-22T10:54:48.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.132+0000 7f924ebff700 1 -- 172.21.15.40:0/139558180 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9248149eb0 con 0x7f924815c720 2023-06-22T10:54:48.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.132+0000 7f924ebff700 1 -- 172.21.15.40:0/139558180 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f924815f390 con 0x7f924815c720 2023-06-22T10:54:48.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.133+0000 7f924ebff700 1 -- 172.21.15.40:0/139558180 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f924814a3d0 con 0x7f924815c720 2023-06-22T10:54:48.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.134+0000 7f923d7fa700 1 -- 172.21.15.40:0/139558180 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f924001b3b0 con 0x7f924815c720 2023-06-22T10:54:48.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.135+0000 7f923d7fa700 1 --2- 172.21.15.40:0/139558180 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f923406ace0 0x7f923406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:48.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.135+0000 7f923d7fa700 1 -- 172.21.15.40:0/139558180 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9240089500 con 0x7f924815c720 2023-06-22T10:54:48.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.135+0000 7f924c99b700 1 --2- 172.21.15.40:0/139558180 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f923406ace0 0x7f923406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:48.139 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.136+0000 7f924c99b700 1 --2- 172.21.15.40:0/139558180 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f923406ace0 0x7f923406d190 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f92440090b0 tx=0x7f924401c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:48.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.139+0000 7f923d7fa700 1 -- 172.21.15.40:0/139558180 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f924814a3d0 con 0x7f924815c720 2023-06-22T10:54:48.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.361+0000 7f924ebff700 1 -- 172.21.15.40:0/139558180 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f924814a3d0 con 0x7f924815c720 2023-06-22T10:54:48.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.362+0000 7f923d7fa700 1 -- 172.21.15.40:0/139558180 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v30) v1 ==== 80+0+0 (secure 0 0 0) 0x7f924814a3d0 con 0x7f924815c720 2023-06-22T10:54:48.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.364+0000 7f924ebff700 1 -- 172.21.15.40:0/139558180 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f923406ace0 msgr2=0x7f923406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:48.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.364+0000 7f924ebff700 1 --2- 172.21.15.40:0/139558180 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f923406ace0 0x7f923406d190 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f92440090b0 tx=0x7f924401c040 comp rx=0 tx=0).stop 2023-06-22T10:54:48.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.364+0000 7f924ebff700 1 -- 172.21.15.40:0/139558180 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f924815c720 msgr2=0x7f924806b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:48.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.364+0000 7f924ebff700 1 --2- 172.21.15.40:0/139558180 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f924815c720 0x7f924806b4d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f924000cb10 tx=0x7f924000ce20 comp rx=0 tx=0).stop 2023-06-22T10:54:48.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.364+0000 7f924ebff700 1 -- 172.21.15.40:0/139558180 shutdown_connections 2023-06-22T10:54:48.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.364+0000 7f924ebff700 1 --2- 172.21.15.40:0/139558180 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f923406ace0 0x7f923406d190 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:48.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.364+0000 7f924ebff700 1 --2- 172.21.15.40:0/139558180 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f924815c720 0x7f924806b4d0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:48.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.364+0000 7f924ebff700 1 --2- 172.21.15.40:0/139558180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92480b4e30 0x7f92480b0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:48.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.364+0000 7f924ebff700 1 --2- 172.21.15.40:0/139558180 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f92480d2830 0x7f924814be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:48.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.364+0000 7f924ebff700 1 -- 172.21.15.40:0/139558180 >> 172.21.15.40:0/139558180 conn(0x7f92480cf720 msgr2=0x7f92480b3360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:48.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.365+0000 7f924ebff700 1 -- 172.21.15.40:0/139558180 shutdown_connections 2023-06-22T10:54:48.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:48.365+0000 7f924ebff700 1 -- 172.21.15.40:0/139558180 wait complete. 2023-06-22T10:54:48.369 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2023-06-22T10:54:48.385 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-06-22T10:54:48.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:48.385 DEBUG:teuthology.orchestra.run.smithi045:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-06-22T10:54:48.481 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-06-22T10:54:48.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:48.482 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-06-22T10:54:48.543 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-06-22T10:54:48.543 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-22T10:54:48.589 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-06-22T10:54:48.590 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-22T10:54:48.676 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-06-22T10:54:48.676 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-22T10:54:48.762 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-22T10:54:49.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.001+0000 7facb81ff700 1 Processor -- start 2023-06-22T10:54:49.003 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.001+0000 7facb81ff700 1 -- start start 2023-06-22T10:54:49.004 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.002+0000 7facb81ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7facb015c720 0x7facb00b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:49.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.002+0000 7facb81ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7facb00b4e30 0x7facb00d0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:49.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.002+0000 7facb81ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facb00b2130 con 0x7facb00d2830 2023-06-22T10:54:49.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.002+0000 7facb81ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facb0160d60 con 0x7facb015c720 2023-06-22T10:54:49.005 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.002+0000 7facb81ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facb0161180 con 0x7facb00b4e30 2023-06-22T10:54:49.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.003+0000 7facb579a700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7facb00d2830 0x7facb00b4720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:58064/0 (socket says 172.21.15.40:58064) 2023-06-22T10:54:49.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.003+0000 7facb5f9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7facb015c720 0x7facb00b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:49.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.003+0000 7facb579a700 1 -- 172.21.15.40:0/1928216852 learned_addr learned my addr 172.21.15.40:0/1928216852 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:49.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.003+0000 7facb679c700 1 --2- 172.21.15.40:0/1928216852 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7facb00b4e30 0x7facb00d0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:49.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.003+0000 7facb5f9b700 1 -- 172.21.15.40:0/1928216852 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7facb00b4e30 msgr2=0x7facb00d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:49.007 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.003+0000 7facb4f99700 1 -- 172.21.15.40:0/1928216852 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3897582851 0 0) 0x7facb00b2130 con 0x7facb00d2830 2023-06-22T10:54:49.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.003+0000 7facb5f9b700 1 --2- 172.21.15.40:0/1928216852 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7facb00b4e30 0x7facb00d0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:49.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.003+0000 7facb5f9b700 1 -- 172.21.15.40:0/1928216852 >> v1:172.21.15.40:6789/0 conn(0x7facb00d2830 legacy=0x7facb00b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:49.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.003+0000 7facb5f9b700 1 -- 172.21.15.40:0/1928216852 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb01603c0 con 0x7facb015c720 2023-06-22T10:54:49.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.003+0000 7facb5f9b700 1 --2- 172.21.15.40:0/1928216852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7facb015c720 0x7facb00b1870 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7facac009870 tx=0x7facac009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6896be875f4e951 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:49.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.004+0000 7facb4f99700 1 -- 172.21.15.40:0/1928216852 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facac011830 con 0x7facb015c720 2023-06-22T10:54:49.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.004+0000 7facb4f99700 1 -- 172.21.15.40:0/1928216852 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facac011990 con 0x7facb015c720 2023-06-22T10:54:49.008 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.004+0000 7facb4f99700 1 -- 172.21.15.40:0/1928216852 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facac011d20 con 0x7facb015c720 2023-06-22T10:54:49.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.004+0000 7facb81ff700 1 -- 172.21.15.40:0/1928216852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7facb015c720 msgr2=0x7facb00b1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:49.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.004+0000 7facb81ff700 1 --2- 172.21.15.40:0/1928216852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7facb015c720 0x7facb00b1870 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7facac009870 tx=0x7facac009b80 comp rx=0 tx=0).stop 2023-06-22T10:54:49.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.004+0000 7facb81ff700 1 -- 172.21.15.40:0/1928216852 shutdown_connections 2023-06-22T10:54:49.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.004+0000 7facb81ff700 1 --2- 172.21.15.40:0/1928216852 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7facb00b4e30 0x7facb00d0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:49.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.004+0000 7facb81ff700 1 --2- 172.21.15.40:0/1928216852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7facb015c720 0x7facb00b1870 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:49.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.004+0000 7facb81ff700 1 -- 172.21.15.40:0/1928216852 >> 172.21.15.40:0/1928216852 conn(0x7facb00cf720 msgr2=0x7facb00cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:49.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.004+0000 7facb81ff700 1 -- 172.21.15.40:0/1928216852 shutdown_connections 2023-06-22T10:54:49.009 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.004+0000 7facb81ff700 1 -- 172.21.15.40:0/1928216852 wait complete. 2023-06-22T10:54:49.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.006+0000 7facb81ff700 1 Processor -- start 2023-06-22T10:54:49.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.006+0000 7facb81ff700 1 -- start start 2023-06-22T10:54:49.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.007+0000 7facb81ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7facb00b4e30 0x7facb00ca730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:49.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.007+0000 7facb81ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7facb00d2830 0x7facb01f5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:49.011 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.007+0000 7facb81ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7facb015c720 0x7facb01f5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:49.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.007+0000 7facb81ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb00a9830 con 0x7facb00d2830 2023-06-22T10:54:49.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.007+0000 7facb81ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb00cb200 con 0x7facb00b4e30 2023-06-22T10:54:49.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.007+0000 7facb81ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facb00cb4e0 con 0x7facb015c720 2023-06-22T10:54:49.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.007+0000 7facb579a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7facb00d2830 0x7facb01f5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:49.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.008+0000 7facb579a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7facb00d2830 0x7facb01f5550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46202/0 (socket says 172.21.15.40:46202) 2023-06-22T10:54:49.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.008+0000 7facb579a700 1 -- 172.21.15.40:0/871221574 learned_addr learned my addr 172.21.15.40:0/871221574 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:49.012 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.008+0000 7facb679c700 1 --2- 172.21.15.40:0/871221574 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7facb015c720 0x7facb01f5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:49.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.008+0000 7facb5f9b700 1 --2- 172.21.15.40:0/871221574 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7facb00b4e30 0x7facb00ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:49.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.008+0000 7facb579a700 1 -- 172.21.15.40:0/871221574 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7facb015c720 msgr2=0x7facb01f5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:49.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.008+0000 7facb579a700 1 --2- 172.21.15.40:0/871221574 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7facb015c720 0x7facb01f5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:49.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.008+0000 7facb579a700 1 -- 172.21.15.40:0/871221574 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7facb00b4e30 msgr2=0x7facb00ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:49.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.008+0000 7facb579a700 1 --2- 172.21.15.40:0/871221574 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7facb00b4e30 0x7facb00ca730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:49.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.008+0000 7facb579a700 1 -- 172.21.15.40:0/871221574 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facac0094a0 con 0x7facb00d2830 2023-06-22T10:54:49.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.008+0000 7facb679c700 1 --2- 172.21.15.40:0/871221574 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7facb015c720 0x7facb01f5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-22T10:54:49.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.008+0000 7facb5f9b700 1 --2- 172.21.15.40:0/871221574 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7facb00b4e30 0x7facb00ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-22T10:54:49.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.008+0000 7facb579a700 1 --2- 172.21.15.40:0/871221574 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7facb00d2830 0x7facb01f5550 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7faca000c520 tx=0x7faca000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:49.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.008+0000 7faca67fc700 1 -- 172.21.15.40:0/871221574 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca0004c80 con 0x7facb00d2830 2023-06-22T10:54:49.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.008+0000 7faca67fc700 1 -- 172.21.15.40:0/871221574 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faca0004de0 con 0x7facb00d2830 2023-06-22T10:54:49.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.008+0000 7faca67fc700 1 -- 172.21.15.40:0/871221574 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca00072d0 con 0x7facb00d2830 2023-06-22T10:54:49.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.008+0000 7facb81ff700 1 -- 172.21.15.40:0/871221574 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facb00cb7c0 con 0x7facb00d2830 2023-06-22T10:54:49.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.009+0000 7facb81ff700 1 -- 172.21.15.40:0/871221574 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facb00cac70 con 0x7facb00d2830 2023-06-22T10:54:49.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.010+0000 7facb81ff700 1 -- 172.21.15.40:0/871221574 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facb00ce080 con 0x7facb00d2830 2023-06-22T10:54:49.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.011+0000 7faca67fc700 1 -- 172.21.15.40:0/871221574 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7faca0007430 con 0x7facb00d2830 2023-06-22T10:54:49.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.011+0000 7faca67fc700 1 --2- 172.21.15.40:0/871221574 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fac9406ace0 0x7fac9406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:49.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.012+0000 7faca67fc700 1 -- 172.21.15.40:0/871221574 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7faca00894a0 con 0x7facb00d2830 2023-06-22T10:54:49.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.012+0000 7facb5f9b700 1 --2- 172.21.15.40:0/871221574 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fac9406ace0 0x7fac9406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:49.016 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.012+0000 7facb5f9b700 1 --2- 172.21.15.40:0/871221574 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fac9406ace0 0x7fac9406d190 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7facac000c00 tx=0x7facac008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:49.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.016+0000 7faca67fc700 1 -- 172.21.15.40:0/871221574 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7faca0054210 con 0x7facb00d2830 2023-06-22T10:54:49.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.227+0000 7facb81ff700 1 -- 172.21.15.40:0/871221574 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7facb00a95e0 con 0x7facb00d2830 2023-06-22T10:54:49.230 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.228+0000 7faca67fc700 1 -- 172.21.15.40:0/871221574 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20132 (secure 0 0 0) 0x7faca0057830 con 0x7facb00d2830 2023-06-22T10:54:49.231 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:54:49.231 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":30,"fsid":"475560bc-1a7c-4a75-b3b6-6fc6b20bdc52","created":"2023-06-22T10:53:03.784568+0000","modified":"2023-06-22T10:54:12.717204+0000","last_up_change":"2023-06-22T10:53:17.830348+0000","last_in_change":"2023-06-22T10:53:07.329974+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-22T10:53:17.182228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-22T10:53:23.874432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-22T10:53:29.812963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-22T10:53:30.404021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-22T10:53:33.982289+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"918db6b4-053a-46ba-976d-6e1a0104017f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6809","nonce":2400162888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6811","nonce":2400162888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6815","nonce":2400162888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6813","nonce":2400162888}]},"public_addr":"172.21.15.40:6809/2400162888","cluster_addr":"172.21.15.40:6811/2400162888","heartbeat_back_addr":"172.21.15.40:6815/2400162888","heartbeat_front_addr":"172.21.15.40:6813/2400162888","state":["exists","up"]},{"osd":1,"uuid":"0c146e2b-1725-4dae-9b5c-38795943b9d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6801","nonce":230885800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6803","nonce":230885800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6807","nonce":230885800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6805","nonce":230885800}]},"public_addr":"172.21.15.40:6801/230885800","cluster_addr":"172.21.15.40:6803/230885800","heartbeat_back_addr":"172.21.15.40:6807/230885800","heartbeat_front_addr":"172.21.15.40:6805/230885800","state":["exists","up"]},{"osd":2,"uuid":"0b3727fd-f281-46d5-a675-86c8c5ab269e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6817","nonce":2681404929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6819","nonce":2681404929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6823","nonce":2681404929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6821","nonce":2681404929}]},"public_addr":"172.21.15.40:6817/2681404929","cluster_addr":"172.21.15.40:6819/2681404929","heartbeat_back_addr":"172.21.15.40:6823/2681404929","heartbeat_front_addr":"172.21.15.40:6821/2681404929","state":["exists","up"]},{"osd":3,"uuid":"2969c698-7039-4bbb-beda-f756f7a368a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6825","nonce":111110981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6827","nonce":111110981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6831","nonce":111110981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6829","nonce":111110981}]},"public_addr":"172.21.15.40:6825/111110981","cluster_addr":"172.21.15.40:6827/111110981","heartbeat_back_addr":"172.21.15.40:6831/111110981","heartbeat_front_addr":"172.21.15.40:6829/111110981","state":["exists","up"]},{"osd":4,"uuid":"3bb1d9c8-8e42-4a6b-998d-04834f34be5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6801","nonce":3625455711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6803","nonce":3625455711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6807","nonce":3625455711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6805","nonce":3625455711}]},"public_addr":"172.21.15.45:6801/3625455711","cluster_addr":"172.21.15.45:6803/3625455711","heartbeat_back_addr":"172.21.15.45:6807/3625455711","heartbeat_front_addr":"172.21.15.45:6805/3625455711","state":["exists","up"]},{"osd":5,"uuid":"f9854ee4-302c-41be-977b-bedda090a3d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6817","nonce":3354411217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6819","nonce":3354411217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6823","nonce":3354411217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6821","nonce":3354411217}]},"public_addr":"172.21.15.45:6817/3354411217","cluster_addr":"172.21.15.45:6819/3354411217","heartbeat_back_addr":"172.21.15.45:6823/3354411217","heartbeat_front_addr":"172.21.15.45:6821/3354411217","state":["exists","up"]},{"osd":6,"uuid":"bbdb1989-f6ac-4954-9b85-b8b540d683c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6809","nonce":320111074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6811","nonce":320111074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6815","nonce":320111074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6813","nonce":320111074}]},"public_addr":"172.21.15.45:6809/320111074","cluster_addr":"172.21.15.45:6811/320111074","heartbeat_back_addr":"172.21.15.45:6815/320111074","heartbeat_front_addr":"172.21.15.45:6813/320111074","state":["exists","up"]},{"osd":7,"uuid":"823d44e3-58f1-4d1d-8263-a4e4a69d4327","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6825","nonce":643617680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6827","nonce":643617680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6831","nonce":643617680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6829","nonce":643617680}]},"public_addr":"172.21.15.45:6825/643617680","cluster_addr":"172.21.15.45:6827/643617680","heartbeat_back_addr":"172.21.15.45:6831/643617680","heartbeat_front_addr":"172.21.15.45:6829/643617680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.731262+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.873226+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.898936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.666578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.645990+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.953699+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.642823+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.693395+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1b","mappings":[{"from":3,"to":2}]},{"pgid":"4.2a","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-22T10:54:49.233 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.231+0000 7facb81ff700 1 -- 172.21.15.40:0/871221574 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fac9406ace0 msgr2=0x7fac9406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:49.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.231+0000 7facb81ff700 1 --2- 172.21.15.40:0/871221574 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fac9406ace0 0x7fac9406d190 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7facac000c00 tx=0x7facac008030 comp rx=0 tx=0).stop 2023-06-22T10:54:49.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.231+0000 7facb81ff700 1 -- 172.21.15.40:0/871221574 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7facb00d2830 msgr2=0x7facb01f5550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:49.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.231+0000 7facb81ff700 1 --2- 172.21.15.40:0/871221574 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7facb00d2830 0x7facb01f5550 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7faca000c520 tx=0x7faca000c8e0 comp rx=0 tx=0).stop 2023-06-22T10:54:49.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.231+0000 7facb81ff700 1 -- 172.21.15.40:0/871221574 shutdown_connections 2023-06-22T10:54:49.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.231+0000 7facb81ff700 1 --2- 172.21.15.40:0/871221574 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fac9406ace0 0x7fac9406d190 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:49.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.231+0000 7facb81ff700 1 --2- 172.21.15.40:0/871221574 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7facb015c720 0x7facb01f5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:49.234 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.231+0000 7facb81ff700 1 --2- 172.21.15.40:0/871221574 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7facb00b4e30 0x7facb00ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:49.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.231+0000 7facb81ff700 1 --2- 172.21.15.40:0/871221574 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7facb00d2830 0x7facb01f5550 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:49.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.231+0000 7facb81ff700 1 -- 172.21.15.40:0/871221574 >> 172.21.15.40:0/871221574 conn(0x7facb00cf720 msgr2=0x7facb00b28a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:49.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.231+0000 7facb81ff700 1 -- 172.21.15.40:0/871221574 shutdown_connections 2023-06-22T10:54:49.235 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.231+0000 7facb81ff700 1 -- 172.21.15.40:0/871221574 wait complete. 2023-06-22T10:54:49.251 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-22T10:53:17.182228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-22T10:53:23.874432+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-22T10:53:29.812963+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-22T10:53:30.404021+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-22T10:53:33.982289+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-22T10:54:49.252 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-22T10:54:49.455 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.453+0000 7f6fa05ff700 1 Processor -- start 2023-06-22T10:54:49.456 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.453+0000 7f6fa05ff700 1 -- start start 2023-06-22T10:54:49.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.454+0000 7f6fa05ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6f980b45d0 0x7f6f980b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:49.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.454+0000 7f6fa05ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f6f980d2130 0x7f6f980cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:49.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.454+0000 7f6fa05ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f980d1be0 con 0x7f6f980cd6e0 2023-06-22T10:54:49.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.454+0000 7f6fa05ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f980d17f0 con 0x7f6f980b45d0 2023-06-22T10:54:49.457 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.454+0000 7f6fa05ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f980d1360 con 0x7f6f980d2130 2023-06-22T10:54:49.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.455+0000 7f6f9db9a700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f6f980d2130 0x7f6f980cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:49.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.455+0000 7f6f9db9a700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f6f980d2130 0x7f6f980cd1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3301/0 says I am v2:172.21.15.40:50008/0 (socket says 172.21.15.40:50008) 2023-06-22T10:54:49.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.455+0000 7f6f9db9a700 1 -- 172.21.15.40:0/2641979427 learned_addr learned my addr 172.21.15.40:0/2641979427 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:49.458 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.455+0000 7f6f9e39b700 1 --2- 172.21.15.40:0/2641979427 >> v2:172.21.15.45:3300/0 conn(0x7f6f980b45d0 0x7f6f980b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:49.459 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.455+0000 7f6f9db9a700 1 -- 172.21.15.40:0/2641979427 >> v2:172.21.15.45:3300/0 conn(0x7f6f980b45d0 msgr2=0x7f6f980b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:49.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.455+0000 7f6f9db9a700 1 --2- 172.21.15.40:0/2641979427 >> v2:172.21.15.45:3300/0 conn(0x7f6f980b45d0 0x7f6f980b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:49.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.455+0000 7f6f9db9a700 1 -- 172.21.15.40:0/2641979427 >> v1:172.21.15.45:6789/0 conn(0x7f6f980cd6e0 legacy=0x7f6f980b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:49.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.455+0000 7f6f9db9a700 1 -- 172.21.15.40:0/2641979427 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f980b4ee0 con 0x7f6f980d2130 2023-06-22T10:54:49.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.455+0000 7f6f9db9a700 1 --2- 172.21.15.40:0/2641979427 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f6f980d2130 0x7f6f980cd1a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6f880098f0 tx=0x7f6f88009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7450ec3a0847b652 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:49.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.456+0000 7f6f9d399700 1 -- 172.21.15.40:0/2641979427 <== mon.2 v2:172.21.15.45:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f88011830 con 0x7f6f980d2130 2023-06-22T10:54:49.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.456+0000 7f6f9d399700 1 -- 172.21.15.40:0/2641979427 <== mon.2 v2:172.21.15.45:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f88011990 con 0x7f6f980d2130 2023-06-22T10:54:49.460 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.456+0000 7f6f9d399700 1 -- 172.21.15.40:0/2641979427 <== mon.2 v2:172.21.15.45:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f88011d20 con 0x7f6f980d2130 2023-06-22T10:54:49.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.456+0000 7f6fa05ff700 1 -- 172.21.15.40:0/2641979427 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f6f980d2130 msgr2=0x7f6f980cd1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:49.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.456+0000 7f6fa05ff700 1 --2- 172.21.15.40:0/2641979427 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f6f980d2130 0x7f6f980cd1a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6f880098f0 tx=0x7f6f88009c00 comp rx=0 tx=0).stop 2023-06-22T10:54:49.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.456+0000 7f6fa05ff700 1 -- 172.21.15.40:0/2641979427 shutdown_connections 2023-06-22T10:54:49.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.456+0000 7f6fa05ff700 1 --2- 172.21.15.40:0/2641979427 >> v2:172.21.15.45:3300/0 conn(0x7f6f980b45d0 0x7f6f980b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:49.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.456+0000 7f6fa05ff700 1 --2- 172.21.15.40:0/2641979427 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f6f980d2130 0x7f6f980cd1a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:49.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.456+0000 7f6fa05ff700 1 -- 172.21.15.40:0/2641979427 >> 172.21.15.40:0/2641979427 conn(0x7f6f980cf5d0 msgr2=0x7f6f980cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:49.461 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.456+0000 7f6fa05ff700 1 -- 172.21.15.40:0/2641979427 shutdown_connections 2023-06-22T10:54:49.462 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.457+0000 7f6fa05ff700 1 -- 172.21.15.40:0/2641979427 wait complete. 2023-06-22T10:54:49.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.458+0000 7f6fa05ff700 1 Processor -- start 2023-06-22T10:54:49.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.458+0000 7f6fa05ff700 1 -- start start 2023-06-22T10:54:49.463 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.459+0000 7f6fa05ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f980b45d0 0x7f6f98148ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:49.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.459+0000 7f6fa05ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f980cd6e0 0x7f6f980c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:49.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.459+0000 7f6fa05ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f6f980d2130 0x7f6f980ca160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:49.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.459+0000 7f6fa05ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f98149420 con 0x7f6f980cd6e0 2023-06-22T10:54:49.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.459+0000 7f6fa05ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9815d6b0 con 0x7f6f980b45d0 2023-06-22T10:54:49.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.459+0000 7f6fa05ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9815dc70 con 0x7f6f980d2130 2023-06-22T10:54:49.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.459+0000 7f6f9db9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f980cd6e0 0x7f6f980c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:49.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.460+0000 7f6f9db9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f980cd6e0 0x7f6f980c9c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46214/0 (socket says 172.21.15.40:46214) 2023-06-22T10:54:49.464 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.460+0000 7f6f9db9a700 1 -- 172.21.15.40:0/3944722246 learned_addr learned my addr 172.21.15.40:0/3944722246 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:49.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.460+0000 7f6f9e39b700 1 --2- 172.21.15.40:0/3944722246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f980b45d0 0x7f6f98148ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:49.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.460+0000 7f6f9eb9c700 1 --2- 172.21.15.40:0/3944722246 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f6f980d2130 0x7f6f980ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:49.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.460+0000 7f6f9db9a700 1 -- 172.21.15.40:0/3944722246 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f6f980d2130 msgr2=0x7f6f980ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:49.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.460+0000 7f6f9db9a700 1 --2- 172.21.15.40:0/3944722246 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f6f980d2130 0x7f6f980ca160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:49.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.460+0000 7f6f9db9a700 1 -- 172.21.15.40:0/3944722246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f980b45d0 msgr2=0x7f6f98148ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:49.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.460+0000 7f6f9db9a700 1 --2- 172.21.15.40:0/3944722246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f980b45d0 0x7f6f98148ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:49.465 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.460+0000 7f6f9db9a700 1 -- 172.21.15.40:0/3944722246 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f88009550 con 0x7f6f980cd6e0 2023-06-22T10:54:49.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.460+0000 7f6f9db9a700 1 --2- 172.21.15.40:0/3944722246 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f980cd6e0 0x7f6f980c9c20 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6f88009c40 tx=0x7f6f88004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:49.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.460+0000 7f6f8effd700 1 -- 172.21.15.40:0/3944722246 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f88004400 con 0x7f6f980cd6e0 2023-06-22T10:54:49.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.461+0000 7f6f8effd700 1 -- 172.21.15.40:0/3944722246 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f8801f070 con 0x7f6f980cd6e0 2023-06-22T10:54:49.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.461+0000 7f6f8effd700 1 -- 172.21.15.40:0/3944722246 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f880038e0 con 0x7f6f980cd6e0 2023-06-22T10:54:49.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.461+0000 7f6fa05ff700 1 -- 172.21.15.40:0/3944722246 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f980ccdb0 con 0x7f6f980cd6e0 2023-06-22T10:54:49.466 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.461+0000 7f6fa05ff700 1 -- 172.21.15.40:0/3944722246 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f9815d900 con 0x7f6f980cd6e0 2023-06-22T10:54:49.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.462+0000 7f6fa05ff700 1 -- 172.21.15.40:0/3944722246 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f9815de20 con 0x7f6f980cd6e0 2023-06-22T10:54:49.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.463+0000 7f6f8effd700 1 -- 172.21.15.40:0/3944722246 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6f88021030 con 0x7f6f980cd6e0 2023-06-22T10:54:49.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.464+0000 7f6f8effd700 1 --2- 172.21.15.40:0/3944722246 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f6f7c06ace0 0x7f6f7c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:49.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.464+0000 7f6f8effd700 1 -- 172.21.15.40:0/3944722246 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6f8808aae0 con 0x7f6f980cd6e0 2023-06-22T10:54:49.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.464+0000 7f6f9e39b700 1 --2- 172.21.15.40:0/3944722246 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f6f7c06ace0 0x7f6f7c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:49.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.465+0000 7f6f9e39b700 1 --2- 172.21.15.40:0/3944722246 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f6f7c06ace0 0x7f6f7c06d190 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6f94009b40 tx=0x7f6f94009210 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:49.470 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.468+0000 7f6f8effd700 1 -- 172.21.15.40:0/3944722246 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6f9815de20 con 0x7f6f980cd6e0 2023-06-22T10:54:49.680 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.677+0000 7f6fa05ff700 1 -- 172.21.15.40:0/3944722246 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6f980b4200 con 0x7f6f980cd6e0 2023-06-22T10:54:49.681 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.677+0000 7f6f8effd700 1 -- 172.21.15.40:0/3944722246 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6f88055850 con 0x7f6f980cd6e0 2023-06-22T10:54:49.682 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-06-22T10:54:49.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.680+0000 7f6fa05ff700 1 -- 172.21.15.40:0/3944722246 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f6f7c06ace0 msgr2=0x7f6f7c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:49.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.680+0000 7f6fa05ff700 1 --2- 172.21.15.40:0/3944722246 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f6f7c06ace0 0x7f6f7c06d190 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6f94009b40 tx=0x7f6f94009210 comp rx=0 tx=0).stop 2023-06-22T10:54:49.684 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.680+0000 7f6fa05ff700 1 -- 172.21.15.40:0/3944722246 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f980cd6e0 msgr2=0x7f6f980c9c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:49.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.680+0000 7f6fa05ff700 1 --2- 172.21.15.40:0/3944722246 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f980cd6e0 0x7f6f980c9c20 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6f88009c40 tx=0x7f6f88004750 comp rx=0 tx=0).stop 2023-06-22T10:54:49.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.680+0000 7f6fa05ff700 1 -- 172.21.15.40:0/3944722246 shutdown_connections 2023-06-22T10:54:49.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.680+0000 7f6fa05ff700 1 --2- 172.21.15.40:0/3944722246 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f6f7c06ace0 0x7f6f7c06d190 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:49.685 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.680+0000 7f6fa05ff700 1 --2- 172.21.15.40:0/3944722246 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f6f980d2130 0x7f6f980ca160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:49.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.680+0000 7f6fa05ff700 1 --2- 172.21.15.40:0/3944722246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f980b45d0 0x7f6f98148ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:49.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.680+0000 7f6fa05ff700 1 --2- 172.21.15.40:0/3944722246 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f980cd6e0 0x7f6f980c9c20 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:49.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.680+0000 7f6fa05ff700 1 -- 172.21.15.40:0/3944722246 >> 172.21.15.40:0/3944722246 conn(0x7f6f980cf5d0 msgr2=0x7f6f980b3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:49.686 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.680+0000 7f6fa05ff700 1 -- 172.21.15.40:0/3944722246 shutdown_connections 2023-06-22T10:54:49.687 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.680+0000 7f6fa05ff700 1 -- 172.21.15.40:0/3944722246 wait complete. 2023-06-22T10:54:49.701 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-22T10:54:49.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.904+0000 7fd3b1fff700 1 Processor -- start 2023-06-22T10:54:49.907 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.904+0000 7fd3b1fff700 1 -- start start 2023-06-22T10:54:49.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.905+0000 7fd3b1fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd3ac0b45d0 0x7fd3ac0b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:49.908 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.905+0000 7fd3b1fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd3ac0d2130 0x7fd3ac0cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:49.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.905+0000 7fd3b1fff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3ac0d1be0 con 0x7fd3ac0cd6e0 2023-06-22T10:54:49.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.905+0000 7fd3b1fff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3ac0d17f0 con 0x7fd3ac0d2130 2023-06-22T10:54:49.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.905+0000 7fd3b1fff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3ac0d1360 con 0x7fd3ac0b45d0 2023-06-22T10:54:49.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.905+0000 7fd3aaffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd3ac0d2130 0x7fd3ac0cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:49.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.905+0000 7fd3aaffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd3ac0d2130 0x7fd3ac0cd1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46224/0 (socket says 172.21.15.40:46224) 2023-06-22T10:54:49.909 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.905+0000 7fd3aaffd700 1 -- 172.21.15.40:0/653809194 learned_addr learned my addr 172.21.15.40:0/653809194 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:49.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.906+0000 7fd3ab7fe700 1 --2- 172.21.15.40:0/653809194 >> v2:172.21.15.45:3300/0 conn(0x7fd3ac0b45d0 0x7fd3ac0b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:49.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.906+0000 7fd3aaffd700 1 -- 172.21.15.40:0/653809194 >> v2:172.21.15.45:3300/0 conn(0x7fd3ac0b45d0 msgr2=0x7fd3ac0b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:49.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.906+0000 7fd3aaffd700 1 --2- 172.21.15.40:0/653809194 >> v2:172.21.15.45:3300/0 conn(0x7fd3ac0b45d0 0x7fd3ac0b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:49.911 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.906+0000 7fd3aaffd700 1 -- 172.21.15.40:0/653809194 >> v1:172.21.15.45:6789/0 conn(0x7fd3ac0cd6e0 legacy=0x7fd3ac0b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:49.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.906+0000 7fd3aaffd700 1 -- 172.21.15.40:0/653809194 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3ac0b4ee0 con 0x7fd3ac0d2130 2023-06-22T10:54:49.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.906+0000 7fd3aaffd700 1 --2- 172.21.15.40:0/653809194 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3ac0d2130 0x7fd3ac0cd1a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac0668f0 tx=0x7fd3a0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eed57ae8479e47d4 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:49.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.906+0000 7fd3aa7fc700 1 -- 172.21.15.40:0/653809194 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a000b870 con 0x7fd3ac0d2130 2023-06-22T10:54:49.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.906+0000 7fd3aa7fc700 1 -- 172.21.15.40:0/653809194 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a000b9d0 con 0x7fd3ac0d2130 2023-06-22T10:54:49.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.906+0000 7fd3aa7fc700 1 -- 172.21.15.40:0/653809194 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a000bd60 con 0x7fd3ac0d2130 2023-06-22T10:54:49.912 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.907+0000 7fd3b1fff700 1 -- 172.21.15.40:0/653809194 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3ac0d2130 msgr2=0x7fd3ac0cd1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:49.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.907+0000 7fd3b1fff700 1 --2- 172.21.15.40:0/653809194 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3ac0d2130 0x7fd3ac0cd1a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac0668f0 tx=0x7fd3a0009bd0 comp rx=0 tx=0).stop 2023-06-22T10:54:49.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.907+0000 7fd3b1fff700 1 -- 172.21.15.40:0/653809194 shutdown_connections 2023-06-22T10:54:49.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.907+0000 7fd3b1fff700 1 --2- 172.21.15.40:0/653809194 >> v2:172.21.15.45:3300/0 conn(0x7fd3ac0b45d0 0x7fd3ac0b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:49.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.907+0000 7fd3b1fff700 1 --2- 172.21.15.40:0/653809194 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3ac0d2130 0x7fd3ac0cd1a0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:49.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.907+0000 7fd3b1fff700 1 -- 172.21.15.40:0/653809194 >> 172.21.15.40:0/653809194 conn(0x7fd3ac0cf5d0 msgr2=0x7fd3ac0cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:49.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.907+0000 7fd3b1fff700 1 -- 172.21.15.40:0/653809194 shutdown_connections 2023-06-22T10:54:49.913 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.907+0000 7fd3b1fff700 1 -- 172.21.15.40:0/653809194 wait complete. 2023-06-22T10:54:49.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.909+0000 7fd3b1fff700 1 Processor -- start 2023-06-22T10:54:49.915 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.909+0000 7fd3b1fff700 1 -- start start 2023-06-22T10:54:49.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.910+0000 7fd3b1fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3ac0b45d0 0x7fd3ac14afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:49.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.910+0000 7fd3b1fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3ac0cd6e0 0x7fd3ac0cc690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:49.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.910+0000 7fd3b1fff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd3ac0d2130 0x7fd3ac0d03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:49.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.910+0000 7fd3b1fff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ac0cbb40 con 0x7fd3ac0cd6e0 2023-06-22T10:54:49.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.910+0000 7fd3b1fff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ac0caaa0 con 0x7fd3ac0b45d0 2023-06-22T10:54:49.916 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.910+0000 7fd3b1fff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ac0cad80 con 0x7fd3ac0d2130 2023-06-22T10:54:49.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.910+0000 7fd3aaffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3ac0cd6e0 0x7fd3ac0cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:49.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.910+0000 7fd3aaffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3ac0cd6e0 0x7fd3ac0cc690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46232/0 (socket says 172.21.15.40:46232) 2023-06-22T10:54:49.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.910+0000 7fd3aaffd700 1 -- 172.21.15.40:0/376312895 learned_addr learned my addr 172.21.15.40:0/376312895 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:49.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.910+0000 7fd3ab7fe700 1 --2- 172.21.15.40:0/376312895 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3ac0b45d0 0x7fd3ac14afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:49.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.910+0000 7fd3abfff700 1 --2- 172.21.15.40:0/376312895 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd3ac0d2130 0x7fd3ac0d03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:49.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.911+0000 7fd3aaffd700 1 -- 172.21.15.40:0/376312895 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd3ac0d2130 msgr2=0x7fd3ac0d03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:49.917 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.911+0000 7fd3aaffd700 1 --2- 172.21.15.40:0/376312895 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd3ac0d2130 0x7fd3ac0d03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:49.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.911+0000 7fd3aaffd700 1 -- 172.21.15.40:0/376312895 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3ac0b45d0 msgr2=0x7fd3ac14afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:49.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.911+0000 7fd3aaffd700 1 --2- 172.21.15.40:0/376312895 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3ac0b45d0 0x7fd3ac14afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:49.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.911+0000 7fd3aaffd700 1 -- 172.21.15.40:0/376312895 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a0009550 con 0x7fd3ac0cd6e0 2023-06-22T10:54:49.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.911+0000 7fd3abfff700 1 --2- 172.21.15.40:0/376312895 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd3ac0d2130 0x7fd3ac0d03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:54:49.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.911+0000 7fd3aaffd700 1 --2- 172.21.15.40:0/376312895 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3ac0cd6e0 0x7fd3ac0cc690 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd3a0014040 tx=0x7fd3a0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:49.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.911+0000 7fd393fff700 1 -- 172.21.15.40:0/376312895 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a0004520 con 0x7fd3ac0cd6e0 2023-06-22T10:54:49.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.911+0000 7fd393fff700 1 -- 172.21.15.40:0/376312895 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a00036a0 con 0x7fd3ac0cd6e0 2023-06-22T10:54:49.918 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.911+0000 7fd393fff700 1 -- 172.21.15.40:0/376312895 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a0003a10 con 0x7fd3ac0cd6e0 2023-06-22T10:54:49.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.911+0000 7fd3b1fff700 1 -- 172.21.15.40:0/376312895 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3ac0cb060 con 0x7fd3ac0cd6e0 2023-06-22T10:54:49.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.911+0000 7fd3b1fff700 1 -- 172.21.15.40:0/376312895 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3ac0cb620 con 0x7fd3ac0cd6e0 2023-06-22T10:54:49.919 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.912+0000 7fd3b1fff700 1 -- 172.21.15.40:0/376312895 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3ac0cdab0 con 0x7fd3ac0cd6e0 2023-06-22T10:54:49.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.913+0000 7fd393fff700 1 -- 172.21.15.40:0/376312895 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd3a0021070 con 0x7fd3ac0cd6e0 2023-06-22T10:54:49.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.914+0000 7fd393fff700 1 --2- 172.21.15.40:0/376312895 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fd39806ace0 0x7fd39806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:49.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.914+0000 7fd393fff700 1 -- 172.21.15.40:0/376312895 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd3a008ae70 con 0x7fd3ac0cd6e0 2023-06-22T10:54:49.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.915+0000 7fd3ab7fe700 1 --2- 172.21.15.40:0/376312895 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fd39806ace0 0x7fd39806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:49.920 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.915+0000 7fd3ab7fe700 1 --2- 172.21.15.40:0/376312895 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fd39806ace0 0x7fd39806d190 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd39c006b20 tx=0x7fd39c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:49.921 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:49.919+0000 7fd393fff700 1 -- 172.21.15.40:0/376312895 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd3a0055c00 con 0x7fd3ac0cd6e0 2023-06-22T10:54:50.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.124+0000 7fd3b1fff700 1 -- 172.21.15.40:0/376312895 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd3ac067580 con 0x7fd3ac0cd6e0 2023-06-22T10:54:50.128 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.124+0000 7fd393fff700 1 -- 172.21.15.40:0/376312895 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd3a0059220 con 0x7fd3ac0cd6e0 2023-06-22T10:54:50.128 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 8 2023-06-22T10:54:50.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.126+0000 7fd3b1fff700 1 -- 172.21.15.40:0/376312895 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fd39806ace0 msgr2=0x7fd39806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:50.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.126+0000 7fd3b1fff700 1 --2- 172.21.15.40:0/376312895 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fd39806ace0 0x7fd39806d190 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd39c006b20 tx=0x7fd39c008040 comp rx=0 tx=0).stop 2023-06-22T10:54:50.130 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.126+0000 7fd3b1fff700 1 -- 172.21.15.40:0/376312895 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3ac0cd6e0 msgr2=0x7fd3ac0cc690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:50.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.126+0000 7fd3b1fff700 1 --2- 172.21.15.40:0/376312895 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3ac0cd6e0 0x7fd3ac0cc690 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd3a0014040 tx=0x7fd3a0004750 comp rx=0 tx=0).stop 2023-06-22T10:54:50.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.127+0000 7fd3b1fff700 1 -- 172.21.15.40:0/376312895 shutdown_connections 2023-06-22T10:54:50.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.127+0000 7fd3b1fff700 1 --2- 172.21.15.40:0/376312895 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fd39806ace0 0x7fd39806d190 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:50.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.127+0000 7fd3b1fff700 1 --2- 172.21.15.40:0/376312895 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd3ac0d2130 0x7fd3ac0d03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:50.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.127+0000 7fd3b1fff700 1 --2- 172.21.15.40:0/376312895 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3ac0b45d0 0x7fd3ac14afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:50.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.127+0000 7fd3b1fff700 1 --2- 172.21.15.40:0/376312895 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd3ac0cd6e0 0x7fd3ac0cc690 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:50.131 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.127+0000 7fd3b1fff700 1 -- 172.21.15.40:0/376312895 >> 172.21.15.40:0/376312895 conn(0x7fd3ac0cf5d0 msgr2=0x7fd3ac159a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:50.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.127+0000 7fd3b1fff700 1 -- 172.21.15.40:0/376312895 shutdown_connections 2023-06-22T10:54:50.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.127+0000 7fd3b1fff700 1 -- 172.21.15.40:0/376312895 wait complete. 2023-06-22T10:54:50.148 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-22T10:54:50.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.347+0000 7f29225ff700 1 Processor -- start 2023-06-22T10:54:50.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.348+0000 7f29225ff700 1 -- start start 2023-06-22T10:54:50.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.349+0000 7f29225ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f291c0d2130 0x7f291c0cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:50.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.349+0000 7f29225ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f291c0cd6e0 0x7f291c0b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:50.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.349+0000 7f29225ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f291c0d1be0 con 0x7f291c0b45d0 2023-06-22T10:54:50.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.349+0000 7f29225ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f291c0d17f0 con 0x7f291c0cd6e0 2023-06-22T10:54:50.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.349+0000 7f29225ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f291c0d1360 con 0x7f291c0d2130 2023-06-22T10:54:50.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.349+0000 7f291bfff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f291c0b45d0 0x7f291c0b49a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:58068/0 (socket says 172.21.15.40:58068) 2023-06-22T10:54:50.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.349+0000 7f2920b9c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f291c0cd6e0 0x7f291c0b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:50.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.349+0000 7f291bfff700 1 -- 172.21.15.40:0/1928421535 learned_addr learned my addr 172.21.15.40:0/1928421535 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:50.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.349+0000 7f291b7fe700 1 --2- 172.21.15.40:0/1928421535 >> v2:172.21.15.45:3300/0 conn(0x7f291c0d2130 0x7f291c0cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:50.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.350+0000 7f291affd700 1 -- 172.21.15.40:0/1928421535 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 989074586 0 0) 0x7f291c0d1be0 con 0x7f291c0b45d0 2023-06-22T10:54:50.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.350+0000 7f291affd700 1 -- 172.21.15.40:0/1928421535 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29040035b0 con 0x7f291c0b45d0 2023-06-22T10:54:50.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.350+0000 7f2920b9c700 1 -- 172.21.15.40:0/1928421535 >> v2:172.21.15.45:3300/0 conn(0x7f291c0d2130 msgr2=0x7f291c0cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:50.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.350+0000 7f2920b9c700 1 --2- 172.21.15.40:0/1928421535 >> v2:172.21.15.45:3300/0 conn(0x7f291c0d2130 0x7f291c0cd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:50.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.350+0000 7f2920b9c700 1 -- 172.21.15.40:0/1928421535 >> v1:172.21.15.40:6789/0 conn(0x7f291c0b45d0 legacy=0x7f291c0b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:50.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.350+0000 7f2920b9c700 1 -- 172.21.15.40:0/1928421535 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f291c0cef40 con 0x7f291c0cd6e0 2023-06-22T10:54:50.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.350+0000 7f2920b9c700 1 --2- 172.21.15.40:0/1928421535 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f291c0cd6e0 0x7f291c0b59a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f291c0668c0 tx=0x7f291400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ded849da18539dbc server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:50.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.350+0000 7f291affd700 1 -- 172.21.15.40:0/1928421535 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291400e070 con 0x7f291c0cd6e0 2023-06-22T10:54:50.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.350+0000 7f291affd700 1 -- 172.21.15.40:0/1928421535 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f291400bb20 con 0x7f291c0cd6e0 2023-06-22T10:54:50.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.350+0000 7f291affd700 1 -- 172.21.15.40:0/1928421535 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2914012430 con 0x7f291c0cd6e0 2023-06-22T10:54:50.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.351+0000 7f29225ff700 1 -- 172.21.15.40:0/1928421535 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f291c0cd6e0 msgr2=0x7f291c0b59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:50.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.351+0000 7f29225ff700 1 --2- 172.21.15.40:0/1928421535 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f291c0cd6e0 0x7f291c0b59a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f291c0668c0 tx=0x7f291400b330 comp rx=0 tx=0).stop 2023-06-22T10:54:50.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.351+0000 7f29225ff700 1 -- 172.21.15.40:0/1928421535 shutdown_connections 2023-06-22T10:54:50.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.351+0000 7f29225ff700 1 --2- 172.21.15.40:0/1928421535 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f291c0cd6e0 0x7f291c0b59a0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:50.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.351+0000 7f29225ff700 1 --2- 172.21.15.40:0/1928421535 >> v2:172.21.15.45:3300/0 conn(0x7f291c0d2130 0x7f291c0cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:50.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.351+0000 7f29225ff700 1 -- 172.21.15.40:0/1928421535 >> 172.21.15.40:0/1928421535 conn(0x7f291c0cf5d0 msgr2=0x7f291c0cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:50.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.351+0000 7f29225ff700 1 -- 172.21.15.40:0/1928421535 shutdown_connections 2023-06-22T10:54:50.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.351+0000 7f29225ff700 1 -- 172.21.15.40:0/1928421535 wait complete. 2023-06-22T10:54:50.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.353+0000 7f29225ff700 1 Processor -- start 2023-06-22T10:54:50.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.353+0000 7f29225ff700 1 -- start start 2023-06-22T10:54:50.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.354+0000 7f29225ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f291c0b45d0 0x7f291c0a9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:50.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.354+0000 7f29225ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f291c0cd6e0 0x7f291c0b5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:50.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.354+0000 7f29225ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f291c0d2130 0x7f291c0b5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:50.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.354+0000 7f29225ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f291c14c7d0 con 0x7f291c0b45d0 2023-06-22T10:54:50.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.354+0000 7f29225ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f291c149770 con 0x7f291c0cd6e0 2023-06-22T10:54:50.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.354+0000 7f29225ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f291c149a50 con 0x7f291c0d2130 2023-06-22T10:54:50.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.354+0000 7f291bfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f291c0b45d0 0x7f291c0a9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:50.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.354+0000 7f291bfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f291c0b45d0 0x7f291c0a9520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46254/0 (socket says 172.21.15.40:46254) 2023-06-22T10:54:50.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.354+0000 7f291bfff700 1 -- 172.21.15.40:0/1654217187 learned_addr learned my addr 172.21.15.40:0/1654217187 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:50.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.354+0000 7f2920b9c700 1 --2- 172.21.15.40:0/1654217187 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f291c0d2130 0x7f291c0b5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:50.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.354+0000 7f291b7fe700 1 --2- 172.21.15.40:0/1654217187 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f291c0cd6e0 0x7f291c0b5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:50.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.355+0000 7f291bfff700 1 -- 172.21.15.40:0/1654217187 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f291c0d2130 msgr2=0x7f291c0b5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:50.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.355+0000 7f291bfff700 1 --2- 172.21.15.40:0/1654217187 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f291c0d2130 0x7f291c0b5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:50.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.355+0000 7f291bfff700 1 -- 172.21.15.40:0/1654217187 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f291c0cd6e0 msgr2=0x7f291c0b5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:50.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.355+0000 7f291bfff700 1 --2- 172.21.15.40:0/1654217187 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f291c0cd6e0 0x7f291c0b5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:50.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.355+0000 7f291bfff700 1 -- 172.21.15.40:0/1654217187 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2914009a70 con 0x7f291c0b45d0 2023-06-22T10:54:50.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.355+0000 7f2920b9c700 1 --2- 172.21.15.40:0/1654217187 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f291c0d2130 0x7f291c0b5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:54:50.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.355+0000 7f291b7fe700 1 --2- 172.21.15.40:0/1654217187 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f291c0cd6e0 0x7f291c0b5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:54:50.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.355+0000 7f291bfff700 1 --2- 172.21.15.40:0/1654217187 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f291c0b45d0 0x7f291c0a9520 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f290c00c700 tx=0x7f290c00cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:50.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.355+0000 7f2918ff9700 1 -- 172.21.15.40:0/1654217187 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f290c005d70 con 0x7f291c0b45d0 2023-06-22T10:54:50.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.355+0000 7f2918ff9700 1 -- 172.21.15.40:0/1654217187 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f290c0070d0 con 0x7f291c0b45d0 2023-06-22T10:54:50.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.355+0000 7f2918ff9700 1 -- 172.21.15.40:0/1654217187 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f290c007460 con 0x7f291c0b45d0 2023-06-22T10:54:50.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.355+0000 7f29225ff700 1 -- 172.21.15.40:0/1654217187 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f291c0a9a60 con 0x7f291c0b45d0 2023-06-22T10:54:50.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.355+0000 7f29225ff700 1 -- 172.21.15.40:0/1654217187 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f291c0b6d30 con 0x7f291c0b45d0 2023-06-22T10:54:50.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.356+0000 7f29225ff700 1 -- 172.21.15.40:0/1654217187 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f291c067580 con 0x7f291c0b45d0 2023-06-22T10:54:50.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.357+0000 7f2918ff9700 1 -- 172.21.15.40:0/1654217187 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f290c0075c0 con 0x7f291c0b45d0 2023-06-22T10:54:50.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.358+0000 7f2918ff9700 1 --2- 172.21.15.40:0/1654217187 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f290806ace0 0x7f290806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:50.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.358+0000 7f2918ff9700 1 -- 172.21.15.40:0/1654217187 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f290c088e60 con 0x7f291c0b45d0 2023-06-22T10:54:50.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.358+0000 7f291b7fe700 1 --2- 172.21.15.40:0/1654217187 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f290806ace0 0x7f290806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:50.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.359+0000 7f291b7fe700 1 --2- 172.21.15.40:0/1654217187 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f290806ace0 0x7f290806d190 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f291c159840 tx=0x7f2910008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:50.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.363+0000 7f2918ff9700 1 -- 172.21.15.40:0/1654217187 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f290c053b50 con 0x7f291c0b45d0 2023-06-22T10:54:50.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.569+0000 7f29225ff700 1 -- 172.21.15.40:0/1654217187 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f291c0b5380 con 0x7f291c0b45d0 2023-06-22T10:54:50.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.570+0000 7f2918ff9700 1 -- 172.21.15.40:0/1654217187 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7f290c057170 con 0x7f291c0b45d0 2023-06-22T10:54:50.574 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-06-22T10:54:50.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.572+0000 7f29225ff700 1 -- 172.21.15.40:0/1654217187 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f290806ace0 msgr2=0x7f290806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:50.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.572+0000 7f29225ff700 1 --2- 172.21.15.40:0/1654217187 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f290806ace0 0x7f290806d190 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f291c159840 tx=0x7f2910008040 comp rx=0 tx=0).stop 2023-06-22T10:54:50.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.572+0000 7f29225ff700 1 -- 172.21.15.40:0/1654217187 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f291c0b45d0 msgr2=0x7f291c0a9520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:50.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.572+0000 7f29225ff700 1 --2- 172.21.15.40:0/1654217187 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f291c0b45d0 0x7f291c0a9520 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f290c00c700 tx=0x7f290c00cac0 comp rx=0 tx=0).stop 2023-06-22T10:54:50.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.572+0000 7f29225ff700 1 -- 172.21.15.40:0/1654217187 shutdown_connections 2023-06-22T10:54:50.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.573+0000 7f29225ff700 1 --2- 172.21.15.40:0/1654217187 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f290806ace0 0x7f290806d190 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:50.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.573+0000 7f29225ff700 1 --2- 172.21.15.40:0/1654217187 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f291c0d2130 0x7f291c0b5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:50.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.573+0000 7f29225ff700 1 --2- 172.21.15.40:0/1654217187 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f291c0b45d0 0x7f291c0a9520 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:50.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.573+0000 7f29225ff700 1 --2- 172.21.15.40:0/1654217187 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f291c0cd6e0 0x7f291c0b5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:50.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.573+0000 7f29225ff700 1 -- 172.21.15.40:0/1654217187 >> 172.21.15.40:0/1654217187 conn(0x7f291c0cf5d0 msgr2=0x7f291c0b3ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:50.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.573+0000 7f29225ff700 1 -- 172.21.15.40:0/1654217187 shutdown_connections 2023-06-22T10:54:50.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.573+0000 7f29225ff700 1 -- 172.21.15.40:0/1654217187 wait complete. 2023-06-22T10:54:50.593 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-22T10:54:50.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.794+0000 7fe99f1ff700 1 Processor -- start 2023-06-22T10:54:50.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.794+0000 7fe99f1ff700 1 -- start start 2023-06-22T10:54:50.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.795+0000 7fe99f1ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe9980b45d0 0x7fe9980b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:50.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.795+0000 7fe99f1ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe9980b59a0 0x7fe9980b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:50.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.795+0000 7fe99f1ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9980d1be0 con 0x7fe9980d2130 2023-06-22T10:54:50.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.795+0000 7fe99f1ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9980d17f0 con 0x7fe9980b45d0 2023-06-22T10:54:50.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.795+0000 7fe99f1ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9980d1360 con 0x7fe9980b59a0 2023-06-22T10:54:50.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.795+0000 7fe99cf9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe9980b45d0 0x7fe9980b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:50.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.796+0000 7fe99cf9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe9980b45d0 0x7fe9980b49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46268/0 (socket says 172.21.15.40:46268) 2023-06-22T10:54:50.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.796+0000 7fe99cf9b700 1 -- 172.21.15.40:0/3784137773 learned_addr learned my addr 172.21.15.40:0/3784137773 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:50.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.796+0000 7fe99d79c700 1 --2- 172.21.15.40:0/3784137773 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe9980b59a0 0x7fe9980b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:50.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.796+0000 7fe99cf9b700 1 -- 172.21.15.40:0/3784137773 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe9980b59a0 msgr2=0x7fe9980b5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:50.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.796+0000 7fe99cf9b700 1 --2- 172.21.15.40:0/3784137773 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe9980b59a0 0x7fe9980b5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:50.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.796+0000 7fe99cf9b700 1 -- 172.21.15.40:0/3784137773 >> v1:172.21.15.45:6789/0 conn(0x7fe9980d2130 legacy=0x7fe9980cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:50.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.796+0000 7fe99cf9b700 1 -- 172.21.15.40:0/3784137773 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9980b4ee0 con 0x7fe9980b45d0 2023-06-22T10:54:50.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.796+0000 7fe99cf9b700 1 --2- 172.21.15.40:0/3784137773 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9980b45d0 0x7fe9980b49a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe98c0098f0 tx=0x7fe98c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbc7f3f039a3b4e4 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:50.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.796+0000 7fe9977fe700 1 -- 172.21.15.40:0/3784137773 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe98c00b8a0 con 0x7fe9980b45d0 2023-06-22T10:54:50.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.796+0000 7fe9977fe700 1 -- 172.21.15.40:0/3784137773 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe98c00ba00 con 0x7fe9980b45d0 2023-06-22T10:54:50.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.796+0000 7fe9977fe700 1 -- 172.21.15.40:0/3784137773 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe98c00bd90 con 0x7fe9980b45d0 2023-06-22T10:54:50.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.797+0000 7fe99f1ff700 1 -- 172.21.15.40:0/3784137773 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9980b45d0 msgr2=0x7fe9980b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:50.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.797+0000 7fe99f1ff700 1 --2- 172.21.15.40:0/3784137773 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9980b45d0 0x7fe9980b49a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe98c0098f0 tx=0x7fe98c009c00 comp rx=0 tx=0).stop 2023-06-22T10:54:50.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.797+0000 7fe99f1ff700 1 -- 172.21.15.40:0/3784137773 shutdown_connections 2023-06-22T10:54:50.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.797+0000 7fe99f1ff700 1 --2- 172.21.15.40:0/3784137773 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9980b45d0 0x7fe9980b49a0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:50.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.797+0000 7fe99f1ff700 1 --2- 172.21.15.40:0/3784137773 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe9980b59a0 0x7fe9980b5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:50.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.797+0000 7fe99f1ff700 1 -- 172.21.15.40:0/3784137773 >> 172.21.15.40:0/3784137773 conn(0x7fe9980cf5d0 msgr2=0x7fe9980cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:50.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.797+0000 7fe99f1ff700 1 -- 172.21.15.40:0/3784137773 shutdown_connections 2023-06-22T10:54:50.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.797+0000 7fe99f1ff700 1 -- 172.21.15.40:0/3784137773 wait complete. 2023-06-22T10:54:50.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.799+0000 7fe99f1ff700 1 Processor -- start 2023-06-22T10:54:50.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.799+0000 7fe99f1ff700 1 -- start start 2023-06-22T10:54:50.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.800+0000 7fe99f1ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9980b45d0 0x7fe998151e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:50.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.800+0000 7fe99f1ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9980b59a0 0x7fe99815e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:50.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.800+0000 7fe99f1ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe9980d2130 0x7fe99815ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:50.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.800+0000 7fe99f1ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9980aadb0 con 0x7fe9980b45d0 2023-06-22T10:54:50.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.800+0000 7fe99f1ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9981f1d80 con 0x7fe9980b59a0 2023-06-22T10:54:50.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.800+0000 7fe99f1ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9980aa230 con 0x7fe9980d2130 2023-06-22T10:54:50.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.800+0000 7fe99cf9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9980b45d0 0x7fe998151e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:50.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.800+0000 7fe99cf9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9980b45d0 0x7fe998151e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46284/0 (socket says 172.21.15.40:46284) 2023-06-22T10:54:50.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.800+0000 7fe99cf9b700 1 -- 172.21.15.40:0/2524666005 learned_addr learned my addr 172.21.15.40:0/2524666005 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:50.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.801+0000 7fe99cf9b700 1 -- 172.21.15.40:0/2524666005 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe9980d2130 msgr2=0x7fe99815ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:50.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.801+0000 7fe99cf9b700 1 --2- 172.21.15.40:0/2524666005 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe9980d2130 0x7fe99815ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:50.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.801+0000 7fe99cf9b700 1 -- 172.21.15.40:0/2524666005 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9980b59a0 msgr2=0x7fe99815e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:50.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.801+0000 7fe99cf9b700 1 --2- 172.21.15.40:0/2524666005 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9980b59a0 0x7fe99815e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:50.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.801+0000 7fe99cf9b700 1 -- 172.21.15.40:0/2524666005 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe98c009550 con 0x7fe9980b45d0 2023-06-22T10:54:50.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.801+0000 7fe99cf9b700 1 --2- 172.21.15.40:0/2524666005 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9980b45d0 0x7fe998151e90 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fe98c009c40 tx=0x7fe98c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:50.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.801+0000 7fe9957fa700 1 -- 172.21.15.40:0/2524666005 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe98c0036a0 con 0x7fe9980b45d0 2023-06-22T10:54:50.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.801+0000 7fe9957fa700 1 -- 172.21.15.40:0/2524666005 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe98c01e070 con 0x7fe9980b45d0 2023-06-22T10:54:50.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.801+0000 7fe9957fa700 1 -- 172.21.15.40:0/2524666005 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe98c003a40 con 0x7fe9980b45d0 2023-06-22T10:54:50.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.801+0000 7fe99f1ff700 1 -- 172.21.15.40:0/2524666005 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9980aa510 con 0x7fe9980b45d0 2023-06-22T10:54:50.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.801+0000 7fe99f1ff700 1 -- 172.21.15.40:0/2524666005 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9980aaad0 con 0x7fe9980b45d0 2023-06-22T10:54:50.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.802+0000 7fe99f1ff700 1 -- 172.21.15.40:0/2524666005 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9981f1f40 con 0x7fe9980b45d0 2023-06-22T10:54:50.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.804+0000 7fe9957fa700 1 -- 172.21.15.40:0/2524666005 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe98c003ba0 con 0x7fe9980b45d0 2023-06-22T10:54:50.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.806+0000 7fe9957fa700 1 --2- 172.21.15.40:0/2524666005 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe97c06ace0 0x7fe97c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:50.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.806+0000 7fe9957fa700 1 -- 172.21.15.40:0/2524666005 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe98c020070 con 0x7fe9980b45d0 2023-06-22T10:54:50.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.806+0000 7fe997fff700 1 --2- 172.21.15.40:0/2524666005 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe97c06ace0 0x7fe97c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:50.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.807+0000 7fe997fff700 1 --2- 172.21.15.40:0/2524666005 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe97c06ace0 0x7fe97c06d190 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe984000f60 tx=0x7fe984007a60 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:50.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:50.809+0000 7fe9957fa700 1 -- 172.21.15.40:0/2524666005 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe98c055fa0 con 0x7fe9980b45d0 2023-06-22T10:54:51.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.019+0000 7fe99f1ff700 1 -- 172.21.15.40:0/2524666005 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe998067580 con 0x7fe9980b45d0 2023-06-22T10:54:51.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.020+0000 7fe9957fa700 1 -- 172.21.15.40:0/2524666005 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe98c0595c0 con 0x7fe9980b45d0 2023-06-22T10:54:51.023 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-06-22T10:54:51.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.022+0000 7fe99f1ff700 1 -- 172.21.15.40:0/2524666005 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe97c06ace0 msgr2=0x7fe97c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:51.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.022+0000 7fe99f1ff700 1 --2- 172.21.15.40:0/2524666005 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe97c06ace0 0x7fe97c06d190 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe984000f60 tx=0x7fe984007a60 comp rx=0 tx=0).stop 2023-06-22T10:54:51.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.022+0000 7fe99f1ff700 1 -- 172.21.15.40:0/2524666005 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9980b45d0 msgr2=0x7fe998151e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:51.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.022+0000 7fe99f1ff700 1 --2- 172.21.15.40:0/2524666005 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9980b45d0 0x7fe998151e90 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fe98c009c40 tx=0x7fe98c004750 comp rx=0 tx=0).stop 2023-06-22T10:54:51.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.022+0000 7fe99f1ff700 1 -- 172.21.15.40:0/2524666005 shutdown_connections 2023-06-22T10:54:51.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.022+0000 7fe99f1ff700 1 --2- 172.21.15.40:0/2524666005 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe97c06ace0 0x7fe97c06d190 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:51.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.022+0000 7fe99f1ff700 1 --2- 172.21.15.40:0/2524666005 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe9980d2130 0x7fe99815ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:51.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.022+0000 7fe99f1ff700 1 --2- 172.21.15.40:0/2524666005 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9980b45d0 0x7fe998151e90 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:51.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.022+0000 7fe99f1ff700 1 --2- 172.21.15.40:0/2524666005 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9980b59a0 0x7fe99815e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:51.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.022+0000 7fe99f1ff700 1 -- 172.21.15.40:0/2524666005 >> 172.21.15.40:0/2524666005 conn(0x7fe9980cf5d0 msgr2=0x7fe9980d03e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:51.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.022+0000 7fe99f1ff700 1 -- 172.21.15.40:0/2524666005 shutdown_connections 2023-06-22T10:54:51.027 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.022+0000 7fe99f1ff700 1 -- 172.21.15.40:0/2524666005 wait complete. 2023-06-22T10:54:51.043 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-22T10:54:51.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.245+0000 7f876d7ff700 1 Processor -- start 2023-06-22T10:54:51.249 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.246+0000 7f876d7ff700 1 -- start start 2023-06-22T10:54:51.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.247+0000 7f876d7ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f87680c8df0 0x7f87680703b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:51.250 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.247+0000 7f876d7ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f87680708f0 0x7f87680cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:51.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.247+0000 7f876d7ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87680cf460 con 0x7f8768153730 2023-06-22T10:54:51.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.247+0000 7f876d7ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87680c5000 con 0x7f87680708f0 2023-06-22T10:54:51.251 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.247+0000 7f876d7ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8768070d60 con 0x7f87680c8df0 2023-06-22T10:54:51.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.248+0000 7f875ffff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f87680c8df0 0x7f87680703b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:51.252 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.248+0000 7f87677fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f87680708f0 0x7f87680cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:51.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.248+0000 7f87677fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f87680708f0 0x7f87680cd740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.40:36758/0 (socket says 172.21.15.40:36758) 2023-06-22T10:54:51.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.248+0000 7f87677fe700 1 -- 172.21.15.40:0/892790558 learned_addr learned my addr 172.21.15.40:0/892790558 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:51.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.248+0000 7f875ffff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f87680c8df0 0x7f87680703b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3301/0 says I am v2:172.21.15.40:50058/0 (socket says 172.21.15.40:50058) 2023-06-22T10:54:51.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.248+0000 7f87677fe700 1 -- 172.21.15.40:0/892790558 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f87680c8df0 msgr2=0x7f87680703b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:51.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.248+0000 7f87677fe700 1 --2- 172.21.15.40:0/892790558 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f87680c8df0 0x7f87680703b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:51.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.248+0000 7f87677fe700 1 -- 172.21.15.40:0/892790558 >> v1:172.21.15.45:6789/0 conn(0x7f8768153730 legacy=0x7f87680c3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:51.253 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.248+0000 7f87677fe700 1 -- 172.21.15.40:0/892790558 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87680ccfa0 con 0x7f87680708f0 2023-06-22T10:54:51.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.249+0000 7f87677fe700 1 --2- 172.21.15.40:0/892790558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87680708f0 0x7f87680cd740 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8760009e80 tx=0x7f876000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cce30bb1e8a0da1b server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:51.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.249+0000 7f87667fc700 1 -- 172.21.15.40:0/892790558 <== mon.1 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876000e070 con 0x7f87680708f0 2023-06-22T10:54:51.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.249+0000 7f87667fc700 1 -- 172.21.15.40:0/892790558 <== mon.1 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f876000b8d0 con 0x7f87680708f0 2023-06-22T10:54:51.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.249+0000 7f87667fc700 1 -- 172.21.15.40:0/892790558 <== mon.1 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876000bc80 con 0x7f87680708f0 2023-06-22T10:54:51.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.249+0000 7f876d7ff700 1 -- 172.21.15.40:0/892790558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87680708f0 msgr2=0x7f87680cd740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:51.254 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.249+0000 7f876d7ff700 1 --2- 172.21.15.40:0/892790558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87680708f0 0x7f87680cd740 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8760009e80 tx=0x7f876000b330 comp rx=0 tx=0).stop 2023-06-22T10:54:51.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.249+0000 7f876d7ff700 1 -- 172.21.15.40:0/892790558 shutdown_connections 2023-06-22T10:54:51.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.249+0000 7f876d7ff700 1 --2- 172.21.15.40:0/892790558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87680708f0 0x7f87680cd740 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:51.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.249+0000 7f876d7ff700 1 --2- 172.21.15.40:0/892790558 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f87680c8df0 0x7f87680703b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:51.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.249+0000 7f876d7ff700 1 -- 172.21.15.40:0/892790558 >> 172.21.15.40:0/892790558 conn(0x7f87680b1030 msgr2=0x7f87680ce7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:51.255 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.250+0000 7f876d7ff700 1 -- 172.21.15.40:0/892790558 shutdown_connections 2023-06-22T10:54:51.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.250+0000 7f876d7ff700 1 -- 172.21.15.40:0/892790558 wait complete. 2023-06-22T10:54:51.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.251+0000 7f876d7ff700 1 Processor -- start 2023-06-22T10:54:51.256 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.251+0000 7f876d7ff700 1 -- start start 2023-06-22T10:54:51.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.252+0000 7f876d7ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f87680708f0 0x7f8768152790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:51.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.252+0000 7f876d7ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87680c8df0 0x7f8768154650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:51.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.252+0000 7f876d7ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8768153730 0x7f8768154b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:51.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.252+0000 7f876d7ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8768153ea0 con 0x7f8768153730 2023-06-22T10:54:51.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.252+0000 7f876d7ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87680aeaf0 con 0x7f87680c8df0 2023-06-22T10:54:51.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.252+0000 7f876d7ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87680aed90 con 0x7f87680708f0 2023-06-22T10:54:51.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.253+0000 7f87677fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8768153730 0x7f8768154b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:51.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.253+0000 7f87677fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8768153730 0x7f8768154b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46290/0 (socket says 172.21.15.40:46290) 2023-06-22T10:54:51.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.253+0000 7f87677fe700 1 -- 172.21.15.40:0/1544175737 learned_addr learned my addr 172.21.15.40:0/1544175737 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:51.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.253+0000 7f8766ffd700 1 --2- 172.21.15.40:0/1544175737 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f87680708f0 0x7f8768152790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:51.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.253+0000 7f875ffff700 1 --2- 172.21.15.40:0/1544175737 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87680c8df0 0x7f8768154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:51.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.253+0000 7f87677fe700 1 -- 172.21.15.40:0/1544175737 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f87680708f0 msgr2=0x7f8768152790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:51.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.253+0000 7f87677fe700 1 --2- 172.21.15.40:0/1544175737 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f87680708f0 0x7f8768152790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:51.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.253+0000 7f87677fe700 1 -- 172.21.15.40:0/1544175737 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87680c8df0 msgr2=0x7f8768154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:51.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.253+0000 7f87677fe700 1 --2- 172.21.15.40:0/1544175737 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87680c8df0 0x7f8768154650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:51.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.253+0000 7f87677fe700 1 -- 172.21.15.40:0/1544175737 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8760009b30 con 0x7f8768153730 2023-06-22T10:54:51.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.253+0000 7f87677fe700 1 --2- 172.21.15.40:0/1544175737 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8768153730 0x7f8768154b90 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f876806ff30 tx=0x7f8760004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:51.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.254+0000 7f875f7fe700 1 -- 172.21.15.40:0/1544175737 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8760003ea0 con 0x7f8768153730 2023-06-22T10:54:51.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.254+0000 7f875f7fe700 1 -- 172.21.15.40:0/1544175737 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8760004820 con 0x7f8768153730 2023-06-22T10:54:51.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.254+0000 7f875f7fe700 1 -- 172.21.15.40:0/1544175737 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876001c680 con 0x7f8768153730 2023-06-22T10:54:51.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.254+0000 7f876d7ff700 1 -- 172.21.15.40:0/1544175737 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87680af070 con 0x7f8768153730 2023-06-22T10:54:51.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.254+0000 7f876d7ff700 1 -- 172.21.15.40:0/1544175737 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8768155210 con 0x7f8768153730 2023-06-22T10:54:51.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.255+0000 7f876d7ff700 1 -- 172.21.15.40:0/1544175737 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87680af590 con 0x7f8768153730 2023-06-22T10:54:51.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.256+0000 7f875f7fe700 1 -- 172.21.15.40:0/1544175737 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f876001c7e0 con 0x7f8768153730 2023-06-22T10:54:51.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.257+0000 7f875f7fe700 1 --2- 172.21.15.40:0/1544175737 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f874806ace0 0x7f874806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:51.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.257+0000 7f875f7fe700 1 -- 172.21.15.40:0/1544175737 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f876008b390 con 0x7f8768153730 2023-06-22T10:54:51.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.257+0000 7f8766ffd700 1 --2- 172.21.15.40:0/1544175737 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f874806ace0 0x7f874806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:51.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.258+0000 7f8766ffd700 1 --2- 172.21.15.40:0/1544175737 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f874806ace0 0x7f874806d190 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8758007fd0 tx=0x7f8758009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:51.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.261+0000 7f875f7fe700 1 -- 172.21.15.40:0/1544175737 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f87680af590 con 0x7f8768153730 2023-06-22T10:54:51.471 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.468+0000 7f876d7ff700 1 -- 172.21.15.40:0/1544175737 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f87680af590 con 0x7f8768153730 2023-06-22T10:54:51.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.469+0000 7f875f7fe700 1 -- 172.21.15.40:0/1544175737 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7f87680af590 con 0x7f8768153730 2023-06-22T10:54:51.472 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-06-22T10:54:51.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.471+0000 7f876d7ff700 1 -- 172.21.15.40:0/1544175737 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f874806ace0 msgr2=0x7f874806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:51.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.471+0000 7f876d7ff700 1 --2- 172.21.15.40:0/1544175737 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f874806ace0 0x7f874806d190 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8758007fd0 tx=0x7f8758009040 comp rx=0 tx=0).stop 2023-06-22T10:54:51.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.471+0000 7f876d7ff700 1 -- 172.21.15.40:0/1544175737 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8768153730 msgr2=0x7f8768154b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:51.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.471+0000 7f876d7ff700 1 --2- 172.21.15.40:0/1544175737 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8768153730 0x7f8768154b90 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f876806ff30 tx=0x7f8760004ad0 comp rx=0 tx=0).stop 2023-06-22T10:54:51.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.471+0000 7f876d7ff700 1 -- 172.21.15.40:0/1544175737 shutdown_connections 2023-06-22T10:54:51.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.471+0000 7f876d7ff700 1 --2- 172.21.15.40:0/1544175737 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f874806ace0 0x7f874806d190 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:51.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.471+0000 7f876d7ff700 1 --2- 172.21.15.40:0/1544175737 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f87680708f0 0x7f8768152790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:51.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.471+0000 7f876d7ff700 1 --2- 172.21.15.40:0/1544175737 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8768153730 0x7f8768154b90 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:51.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.471+0000 7f876d7ff700 1 --2- 172.21.15.40:0/1544175737 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f87680c8df0 0x7f8768154650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:51.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.471+0000 7f876d7ff700 1 -- 172.21.15.40:0/1544175737 >> 172.21.15.40:0/1544175737 conn(0x7f87680b1030 msgr2=0x7f876814d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:51.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.471+0000 7f876d7ff700 1 -- 172.21.15.40:0/1544175737 shutdown_connections 2023-06-22T10:54:51.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.471+0000 7f876d7ff700 1 -- 172.21.15.40:0/1544175737 wait complete. 2023-06-22T10:54:51.493 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-22T10:54:51.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.691+0000 7f26af3ff700 1 Processor -- start 2023-06-22T10:54:51.694 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.691+0000 7f26af3ff700 1 -- start start 2023-06-22T10:54:51.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.692+0000 7f26af3ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f26a80b4e30 0x7f26a8167410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:51.695 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.692+0000 7f26af3ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26a80b2130 con 0x7f26a815c720 2023-06-22T10:54:51.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.692+0000 7f26af3ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26a8161180 con 0x7f26a80d2830 2023-06-22T10:54:51.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.692+0000 7f26af3ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26a8160d60 con 0x7f26a80b4e30 2023-06-22T10:54:51.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.692+0000 7f26ad19b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f26a815c720 0x7f26a80b1870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:58082/0 (socket says 172.21.15.40:58082) 2023-06-22T10:54:51.696 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.692+0000 7f26ad19b700 1 -- 172.21.15.40:0/1481891027 learned_addr learned my addr 172.21.15.40:0/1481891027 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:51.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.693+0000 7f26ad99c700 1 --2- 172.21.15.40:0/1481891027 >> v2:172.21.15.45:3300/0 conn(0x7f26a80b4e30 0x7f26a8167410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:51.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.693+0000 7f269ffff700 1 -- 172.21.15.40:0/1481891027 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 872321687 0 0) 0x7f26a80b2130 con 0x7f26a815c720 2023-06-22T10:54:51.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.693+0000 7f269ffff700 1 -- 172.21.15.40:0/1481891027 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26940035b0 con 0x7f26a815c720 2023-06-22T10:54:51.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.693+0000 7f26ad99c700 1 -- 172.21.15.40:0/1481891027 >> v1:172.21.15.45:6789/0 conn(0x7f26a80d2830 legacy=0x7f26a80b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:51.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.693+0000 7f26ad99c700 1 -- 172.21.15.40:0/1481891027 >> v1:172.21.15.40:6789/0 conn(0x7f26a815c720 legacy=0x7f26a80b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:51.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.693+0000 7f26ad99c700 1 -- 172.21.15.40:0/1481891027 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26a81603c0 con 0x7f26a80b4e30 2023-06-22T10:54:51.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.693+0000 7f26ad99c700 1 --2- 172.21.15.40:0/1481891027 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26a80b4e30 0x7f26a8167410 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f26a0009dc0 tx=0x7f26a000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=768cfd846a7e5b0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:51.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.694+0000 7f269ffff700 1 -- 172.21.15.40:0/1481891027 <== mon.1 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a000e070 con 0x7f26a80b4e30 2023-06-22T10:54:51.698 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.694+0000 7f269ffff700 1 -- 172.21.15.40:0/1481891027 <== mon.1 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26a000bae0 con 0x7f26a80b4e30 2023-06-22T10:54:51.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.694+0000 7f269ffff700 1 -- 172.21.15.40:0/1481891027 <== mon.1 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a000be90 con 0x7f26a80b4e30 2023-06-22T10:54:51.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.694+0000 7f26af3ff700 1 -- 172.21.15.40:0/1481891027 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26a80b4e30 msgr2=0x7f26a8167410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:51.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.694+0000 7f26af3ff700 1 --2- 172.21.15.40:0/1481891027 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26a80b4e30 0x7f26a8167410 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f26a0009dc0 tx=0x7f26a000b330 comp rx=0 tx=0).stop 2023-06-22T10:54:51.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.694+0000 7f26af3ff700 1 -- 172.21.15.40:0/1481891027 shutdown_connections 2023-06-22T10:54:51.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.694+0000 7f26af3ff700 1 --2- 172.21.15.40:0/1481891027 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26a80b4e30 0x7f26a8167410 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:51.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.694+0000 7f26af3ff700 1 -- 172.21.15.40:0/1481891027 >> 172.21.15.40:0/1481891027 conn(0x7f26a80cf720 msgr2=0x7f26a80cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:51.699 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.694+0000 7f26af3ff700 1 -- 172.21.15.40:0/1481891027 shutdown_connections 2023-06-22T10:54:51.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.694+0000 7f26af3ff700 1 -- 172.21.15.40:0/1481891027 wait complete. 2023-06-22T10:54:51.700 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.696+0000 7f26af3ff700 1 Processor -- start 2023-06-22T10:54:51.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.696+0000 7f26af3ff700 1 -- start start 2023-06-22T10:54:51.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.697+0000 7f26af3ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f26a80b4e30 0x7f26a80ca780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:51.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.697+0000 7f26af3ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26a80d2830 0x7f26a815b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:51.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.697+0000 7f26af3ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26a815c720 0x7f26a8155c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:51.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.697+0000 7f26af3ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a815be30 con 0x7f26a815c720 2023-06-22T10:54:51.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.697+0000 7f26af3ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a80cb160 con 0x7f26a80d2830 2023-06-22T10:54:51.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.697+0000 7f26af3ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26a80cbd00 con 0x7f26a80b4e30 2023-06-22T10:54:51.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.697+0000 7f26ad99c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26a815c720 0x7f26a8155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:51.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.697+0000 7f26ad99c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26a815c720 0x7f26a8155c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46302/0 (socket says 172.21.15.40:46302) 2023-06-22T10:54:51.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.697+0000 7f26ad99c700 1 -- 172.21.15.40:0/196268189 learned_addr learned my addr 172.21.15.40:0/196268189 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:51.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.698+0000 7f26ac99a700 1 --2- 172.21.15.40:0/196268189 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26a80d2830 0x7f26a815b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:51.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.698+0000 7f26ad19b700 1 --2- 172.21.15.40:0/196268189 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f26a80b4e30 0x7f26a80ca780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:51.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.698+0000 7f26ad99c700 1 -- 172.21.15.40:0/196268189 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f26a80b4e30 msgr2=0x7f26a80ca780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:51.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.698+0000 7f26ad99c700 1 --2- 172.21.15.40:0/196268189 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f26a80b4e30 0x7f26a80ca780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:51.703 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.698+0000 7f26ad99c700 1 -- 172.21.15.40:0/196268189 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26a80d2830 msgr2=0x7f26a815b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:51.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.698+0000 7f26ad99c700 1 --2- 172.21.15.40:0/196268189 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26a80d2830 0x7f26a815b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:51.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.698+0000 7f26ad99c700 1 -- 172.21.15.40:0/196268189 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26a0009a70 con 0x7f26a815c720 2023-06-22T10:54:51.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.698+0000 7f26ac99a700 1 --2- 172.21.15.40:0/196268189 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26a80d2830 0x7f26a815b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-22T10:54:51.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.698+0000 7f26ad19b700 1 --2- 172.21.15.40:0/196268189 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f26a80b4e30 0x7f26a80ca780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-22T10:54:51.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.698+0000 7f26ad99c700 1 --2- 172.21.15.40:0/196268189 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26a815c720 0x7f26a8155c00 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f26a0014040 tx=0x7f26a0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:51.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.698+0000 7f269dffb700 1 -- 172.21.15.40:0/196268189 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a0004780 con 0x7f26a815c720 2023-06-22T10:54:51.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.698+0000 7f269dffb700 1 -- 172.21.15.40:0/196268189 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26a0020070 con 0x7f26a815c720 2023-06-22T10:54:51.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.698+0000 7f26af3ff700 1 -- 172.21.15.40:0/196268189 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26a8156140 con 0x7f26a815c720 2023-06-22T10:54:51.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.698+0000 7f269dffb700 1 -- 172.21.15.40:0/196268189 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a00276c0 con 0x7f26a815c720 2023-06-22T10:54:51.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.699+0000 7f26af3ff700 1 -- 172.21.15.40:0/196268189 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26a80cb6b0 con 0x7f26a815c720 2023-06-22T10:54:51.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.699+0000 7f26af3ff700 1 -- 172.21.15.40:0/196268189 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26a8067580 con 0x7f26a815c720 2023-06-22T10:54:51.705 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.700+0000 7f269dffb700 1 -- 172.21.15.40:0/196268189 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f26a0012430 con 0x7f26a815c720 2023-06-22T10:54:51.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.702+0000 7f269dffb700 1 --2- 172.21.15.40:0/196268189 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f268c06ace0 0x7f268c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:51.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.702+0000 7f269dffb700 1 -- 172.21.15.40:0/196268189 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f26a0022070 con 0x7f26a815c720 2023-06-22T10:54:51.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.702+0000 7f26ad19b700 1 --2- 172.21.15.40:0/196268189 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f268c06ace0 0x7f268c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:51.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.703+0000 7f26ad19b700 1 --2- 172.21.15.40:0/196268189 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f268c06ace0 0x7f268c06d190 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f26a40011e0 tx=0x7f26a4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:51.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.706+0000 7f269dffb700 1 -- 172.21.15.40:0/196268189 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f26a005a190 con 0x7f26a815c720 2023-06-22T10:54:51.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.929+0000 7f26af3ff700 1 -- 172.21.15.40:0/196268189 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f26a80cbe40 con 0x7f26a815c720 2023-06-22T10:54:51.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.929+0000 7f269dffb700 1 -- 172.21.15.40:0/196268189 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v30) v1 ==== 80+0+0 (secure 0 0 0) 0x7f26a0059d20 con 0x7f26a815c720 2023-06-22T10:54:51.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.932+0000 7f26af3ff700 1 -- 172.21.15.40:0/196268189 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f268c06ace0 msgr2=0x7f268c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:51.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.932+0000 7f26af3ff700 1 --2- 172.21.15.40:0/196268189 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f268c06ace0 0x7f268c06d190 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f26a40011e0 tx=0x7f26a4009040 comp rx=0 tx=0).stop 2023-06-22T10:54:51.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.932+0000 7f26af3ff700 1 -- 172.21.15.40:0/196268189 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26a815c720 msgr2=0x7f26a8155c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:51.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.932+0000 7f26af3ff700 1 --2- 172.21.15.40:0/196268189 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26a815c720 0x7f26a8155c00 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f26a0014040 tx=0x7f26a0004ad0 comp rx=0 tx=0).stop 2023-06-22T10:54:51.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.932+0000 7f26af3ff700 1 -- 172.21.15.40:0/196268189 shutdown_connections 2023-06-22T10:54:51.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.932+0000 7f26af3ff700 1 --2- 172.21.15.40:0/196268189 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f268c06ace0 0x7f268c06d190 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:51.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.932+0000 7f26af3ff700 1 --2- 172.21.15.40:0/196268189 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f26a80b4e30 0x7f26a80ca780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:51.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.932+0000 7f26af3ff700 1 --2- 172.21.15.40:0/196268189 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f26a815c720 0x7f26a8155c00 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:51.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.932+0000 7f26af3ff700 1 --2- 172.21.15.40:0/196268189 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26a80d2830 0x7f26a815b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:51.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.932+0000 7f26af3ff700 1 -- 172.21.15.40:0/196268189 >> 172.21.15.40:0/196268189 conn(0x7f26a80cf720 msgr2=0x7f26a806bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:51.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.932+0000 7f26af3ff700 1 -- 172.21.15.40:0/196268189 shutdown_connections 2023-06-22T10:54:51.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:51.932+0000 7f26af3ff700 1 -- 172.21.15.40:0/196268189 wait complete. 2023-06-22T10:54:51.937 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2023-06-22T10:54:51.955 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-06-22T10:54:51.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:51.956 DEBUG:teuthology.orchestra.run.smithi040:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-06-22T10:54:52.043 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi040.front.sepia.ceph.com 2023-06-22T10:54:52.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:52.044 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-06-22T10:54:52.090 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-06-22T10:54:52.091 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-22T10:54:52.143 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-06-22T10:54:52.143 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-22T10:54:52.191 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-06-22T10:54:52.192 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-22T10:54:52.279 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-22T10:54:52.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.477+0000 7fd5bd9ff700 1 Processor -- start 2023-06-22T10:54:52.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.477+0000 7fd5bd9ff700 1 -- start start 2023-06-22T10:54:52.481 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.478+0000 7fd5bd9ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd5b815c720 0x7fd5b80b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:52.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.478+0000 7fd5bd9ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd5b80b4e30 0x7fd5b80d0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:52.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.478+0000 7fd5bd9ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5b80b2130 con 0x7fd5b80d2830 2023-06-22T10:54:52.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.478+0000 7fd5bd9ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5b8160d60 con 0x7fd5b815c720 2023-06-22T10:54:52.482 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.478+0000 7fd5bd9ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5b8161180 con 0x7fd5b80b4e30 2023-06-22T10:54:52.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.479+0000 7fd5b6ffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd5b815c720 0x7fd5b80b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:52.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.479+0000 7fd5b6ffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd5b815c720 0x7fd5b80b1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46304/0 (socket says 172.21.15.40:46304) 2023-06-22T10:54:52.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.479+0000 7fd5b6ffd700 1 -- 172.21.15.40:0/3111408135 learned_addr learned my addr 172.21.15.40:0/3111408135 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:52.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.479+0000 7fd5b77fe700 1 --2- 172.21.15.40:0/3111408135 >> v2:172.21.15.45:3300/0 conn(0x7fd5b80b4e30 0x7fd5b80d0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:52.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.479+0000 7fd5b6ffd700 1 -- 172.21.15.40:0/3111408135 >> v2:172.21.15.45:3300/0 conn(0x7fd5b80b4e30 msgr2=0x7fd5b80d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:52.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.479+0000 7fd5b6ffd700 1 --2- 172.21.15.40:0/3111408135 >> v2:172.21.15.45:3300/0 conn(0x7fd5b80b4e30 0x7fd5b80d0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:52.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.479+0000 7fd5b6ffd700 1 -- 172.21.15.40:0/3111408135 >> v1:172.21.15.45:6789/0 conn(0x7fd5b80d2830 legacy=0x7fd5b80b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:52.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.479+0000 7fd5b6ffd700 1 -- 172.21.15.40:0/3111408135 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5b81603c0 con 0x7fd5b815c720 2023-06-22T10:54:52.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.479+0000 7fd5b6ffd700 1 --2- 172.21.15.40:0/3111408135 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5b815c720 0x7fd5b80b1870 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd5a80098f0 tx=0x7fd5a8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee62458331fde786 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:52.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.480+0000 7fd5b5ffb700 1 -- 172.21.15.40:0/3111408135 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a800b860 con 0x7fd5b815c720 2023-06-22T10:54:52.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.480+0000 7fd5b5ffb700 1 -- 172.21.15.40:0/3111408135 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a800b9c0 con 0x7fd5b815c720 2023-06-22T10:54:52.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.480+0000 7fd5b5ffb700 1 -- 172.21.15.40:0/3111408135 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a800bd50 con 0x7fd5b815c720 2023-06-22T10:54:52.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.480+0000 7fd5bd9ff700 1 -- 172.21.15.40:0/3111408135 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5b815c720 msgr2=0x7fd5b80b1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:52.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.480+0000 7fd5bd9ff700 1 --2- 172.21.15.40:0/3111408135 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5b815c720 0x7fd5b80b1870 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd5a80098f0 tx=0x7fd5a8009c00 comp rx=0 tx=0).stop 2023-06-22T10:54:52.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.480+0000 7fd5bd9ff700 1 -- 172.21.15.40:0/3111408135 shutdown_connections 2023-06-22T10:54:52.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.480+0000 7fd5bd9ff700 1 --2- 172.21.15.40:0/3111408135 >> v2:172.21.15.45:3300/0 conn(0x7fd5b80b4e30 0x7fd5b80d0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:52.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.480+0000 7fd5bd9ff700 1 --2- 172.21.15.40:0/3111408135 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5b815c720 0x7fd5b80b1870 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:52.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.480+0000 7fd5bd9ff700 1 -- 172.21.15.40:0/3111408135 >> 172.21.15.40:0/3111408135 conn(0x7fd5b80cf720 msgr2=0x7fd5b80cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:52.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.480+0000 7fd5bd9ff700 1 -- 172.21.15.40:0/3111408135 shutdown_connections 2023-06-22T10:54:52.486 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.480+0000 7fd5bd9ff700 1 -- 172.21.15.40:0/3111408135 wait complete. 2023-06-22T10:54:52.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.482+0000 7fd5bd9ff700 1 Processor -- start 2023-06-22T10:54:52.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.482+0000 7fd5bd9ff700 1 -- start start 2023-06-22T10:54:52.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.483+0000 7fd5bd9ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5b80b4e30 0x7fd5b8157da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:52.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.483+0000 7fd5bd9ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5b80d2830 0x7fd5b8156320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:52.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.483+0000 7fd5bd9ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd5b815c720 0x7fd5b8151a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:52.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.483+0000 7fd5bd9ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b815cf30 con 0x7fd5b80b4e30 2023-06-22T10:54:52.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.483+0000 7fd5bd9ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b815d210 con 0x7fd5b80d2830 2023-06-22T10:54:52.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.483+0000 7fd5bd9ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b815d4f0 con 0x7fd5b815c720 2023-06-22T10:54:52.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.483+0000 7fd5b6ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5b80b4e30 0x7fd5b8157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:52.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.483+0000 7fd5b6ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5b80b4e30 0x7fd5b8157da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46306/0 (socket says 172.21.15.40:46306) 2023-06-22T10:54:52.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.483+0000 7fd5b6ffd700 1 -- 172.21.15.40:0/2228411974 learned_addr learned my addr 172.21.15.40:0/2228411974 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:52.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.484+0000 7fd5b6ffd700 1 -- 172.21.15.40:0/2228411974 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd5b815c720 msgr2=0x7fd5b8151a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:52.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.484+0000 7fd5b6ffd700 1 --2- 172.21.15.40:0/2228411974 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd5b815c720 0x7fd5b8151a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:52.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.484+0000 7fd5b6ffd700 1 -- 172.21.15.40:0/2228411974 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5b80d2830 msgr2=0x7fd5b8156320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:52.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.484+0000 7fd5b6ffd700 1 --2- 172.21.15.40:0/2228411974 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5b80d2830 0x7fd5b8156320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:52.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.484+0000 7fd5b6ffd700 1 -- 172.21.15.40:0/2228411974 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a8009550 con 0x7fd5b80b4e30 2023-06-22T10:54:52.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.484+0000 7fd5b6ffd700 1 --2- 172.21.15.40:0/2228411974 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5b80b4e30 0x7fd5b8157da0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd5a8009c40 tx=0x7fd5a8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:52.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.484+0000 7fd59ffff700 1 -- 172.21.15.40:0/2228411974 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a80036a0 con 0x7fd5b80b4e30 2023-06-22T10:54:52.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.484+0000 7fd59ffff700 1 -- 172.21.15.40:0/2228411974 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a8003800 con 0x7fd5b80b4e30 2023-06-22T10:54:52.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.484+0000 7fd59ffff700 1 -- 172.21.15.40:0/2228411974 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a8003b90 con 0x7fd5b80b4e30 2023-06-22T10:54:52.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.484+0000 7fd5bd9ff700 1 -- 172.21.15.40:0/2228411974 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5b815d7d0 con 0x7fd5b80b4e30 2023-06-22T10:54:52.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.484+0000 7fd5bd9ff700 1 -- 172.21.15.40:0/2228411974 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5b8151fb0 con 0x7fd5b80b4e30 2023-06-22T10:54:52.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.486+0000 7fd5bd9ff700 1 -- 172.21.15.40:0/2228411974 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5b815d070 con 0x7fd5b80b4e30 2023-06-22T10:54:52.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.487+0000 7fd59ffff700 1 -- 172.21.15.40:0/2228411974 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd5a8003cf0 con 0x7fd5b80b4e30 2023-06-22T10:54:52.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.487+0000 7fd59ffff700 1 --2- 172.21.15.40:0/2228411974 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fd5a406ace0 0x7fd5a406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:52.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.487+0000 7fd59ffff700 1 -- 172.21.15.40:0/2228411974 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd5a8021030 con 0x7fd5b80b4e30 2023-06-22T10:54:52.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.488+0000 7fd5b67fc700 1 --2- 172.21.15.40:0/2228411974 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fd5a406ace0 0x7fd5a406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:52.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.488+0000 7fd5b67fc700 1 --2- 172.21.15.40:0/2228411974 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fd5a406ace0 0x7fd5a406d190 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac000f60 tx=0x7fd5ac007a40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:52.495 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.492+0000 7fd59ffff700 1 -- 172.21.15.40:0/2228411974 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd5b815d070 con 0x7fd5b80b4e30 2023-06-22T10:54:52.702 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.699+0000 7fd5bd9ff700 1 -- 172.21.15.40:0/2228411974 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd5b815d070 con 0x7fd5b80b4e30 2023-06-22T10:54:52.704 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.700+0000 7fd59ffff700 1 -- 172.21.15.40:0/2228411974 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20132 (secure 0 0 0) 0x7fd5b815d070 con 0x7fd5b80b4e30 2023-06-22T10:54:52.704 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:54:52.705 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":30,"fsid":"475560bc-1a7c-4a75-b3b6-6fc6b20bdc52","created":"2023-06-22T10:53:03.784568+0000","modified":"2023-06-22T10:54:12.717204+0000","last_up_change":"2023-06-22T10:53:17.830348+0000","last_in_change":"2023-06-22T10:53:07.329974+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-22T10:53:17.182228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-22T10:53:23.874432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-22T10:53:29.812963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-22T10:53:30.404021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-22T10:53:33.982289+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"918db6b4-053a-46ba-976d-6e1a0104017f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6809","nonce":2400162888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6811","nonce":2400162888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6815","nonce":2400162888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6813","nonce":2400162888}]},"public_addr":"172.21.15.40:6809/2400162888","cluster_addr":"172.21.15.40:6811/2400162888","heartbeat_back_addr":"172.21.15.40:6815/2400162888","heartbeat_front_addr":"172.21.15.40:6813/2400162888","state":["exists","up"]},{"osd":1,"uuid":"0c146e2b-1725-4dae-9b5c-38795943b9d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6801","nonce":230885800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6803","nonce":230885800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6807","nonce":230885800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6805","nonce":230885800}]},"public_addr":"172.21.15.40:6801/230885800","cluster_addr":"172.21.15.40:6803/230885800","heartbeat_back_addr":"172.21.15.40:6807/230885800","heartbeat_front_addr":"172.21.15.40:6805/230885800","state":["exists","up"]},{"osd":2,"uuid":"0b3727fd-f281-46d5-a675-86c8c5ab269e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6817","nonce":2681404929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6819","nonce":2681404929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6823","nonce":2681404929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6821","nonce":2681404929}]},"public_addr":"172.21.15.40:6817/2681404929","cluster_addr":"172.21.15.40:6819/2681404929","heartbeat_back_addr":"172.21.15.40:6823/2681404929","heartbeat_front_addr":"172.21.15.40:6821/2681404929","state":["exists","up"]},{"osd":3,"uuid":"2969c698-7039-4bbb-beda-f756f7a368a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6825","nonce":111110981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6827","nonce":111110981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6831","nonce":111110981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6829","nonce":111110981}]},"public_addr":"172.21.15.40:6825/111110981","cluster_addr":"172.21.15.40:6827/111110981","heartbeat_back_addr":"172.21.15.40:6831/111110981","heartbeat_front_addr":"172.21.15.40:6829/111110981","state":["exists","up"]},{"osd":4,"uuid":"3bb1d9c8-8e42-4a6b-998d-04834f34be5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6801","nonce":3625455711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6803","nonce":3625455711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6807","nonce":3625455711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6805","nonce":3625455711}]},"public_addr":"172.21.15.45:6801/3625455711","cluster_addr":"172.21.15.45:6803/3625455711","heartbeat_back_addr":"172.21.15.45:6807/3625455711","heartbeat_front_addr":"172.21.15.45:6805/3625455711","state":["exists","up"]},{"osd":5,"uuid":"f9854ee4-302c-41be-977b-bedda090a3d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6817","nonce":3354411217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6819","nonce":3354411217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6823","nonce":3354411217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6821","nonce":3354411217}]},"public_addr":"172.21.15.45:6817/3354411217","cluster_addr":"172.21.15.45:6819/3354411217","heartbeat_back_addr":"172.21.15.45:6823/3354411217","heartbeat_front_addr":"172.21.15.45:6821/3354411217","state":["exists","up"]},{"osd":6,"uuid":"bbdb1989-f6ac-4954-9b85-b8b540d683c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6809","nonce":320111074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6811","nonce":320111074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6815","nonce":320111074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6813","nonce":320111074}]},"public_addr":"172.21.15.45:6809/320111074","cluster_addr":"172.21.15.45:6811/320111074","heartbeat_back_addr":"172.21.15.45:6815/320111074","heartbeat_front_addr":"172.21.15.45:6813/320111074","state":["exists","up"]},{"osd":7,"uuid":"823d44e3-58f1-4d1d-8263-a4e4a69d4327","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6825","nonce":643617680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6827","nonce":643617680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6831","nonce":643617680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6829","nonce":643617680}]},"public_addr":"172.21.15.45:6825/643617680","cluster_addr":"172.21.15.45:6827/643617680","heartbeat_back_addr":"172.21.15.45:6831/643617680","heartbeat_front_addr":"172.21.15.45:6829/643617680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.731262+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.873226+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.898936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.666578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.645990+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.953699+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.642823+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.693395+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1b","mappings":[{"from":3,"to":2}]},{"pgid":"4.2a","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-22T10:54:52.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.703+0000 7fd5bd9ff700 1 -- 172.21.15.40:0/2228411974 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fd5a406ace0 msgr2=0x7fd5a406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:52.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.703+0000 7fd5bd9ff700 1 --2- 172.21.15.40:0/2228411974 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fd5a406ace0 0x7fd5a406d190 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac000f60 tx=0x7fd5ac007a40 comp rx=0 tx=0).stop 2023-06-22T10:54:52.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.703+0000 7fd5bd9ff700 1 -- 172.21.15.40:0/2228411974 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5b80b4e30 msgr2=0x7fd5b8157da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:52.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.703+0000 7fd5bd9ff700 1 --2- 172.21.15.40:0/2228411974 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5b80b4e30 0x7fd5b8157da0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd5a8009c40 tx=0x7fd5a8004750 comp rx=0 tx=0).stop 2023-06-22T10:54:52.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.703+0000 7fd5bd9ff700 1 -- 172.21.15.40:0/2228411974 shutdown_connections 2023-06-22T10:54:52.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.703+0000 7fd5bd9ff700 1 --2- 172.21.15.40:0/2228411974 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fd5a406ace0 0x7fd5a406d190 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:52.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.703+0000 7fd5bd9ff700 1 --2- 172.21.15.40:0/2228411974 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd5b815c720 0x7fd5b8151a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:52.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.703+0000 7fd5bd9ff700 1 --2- 172.21.15.40:0/2228411974 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5b80b4e30 0x7fd5b8157da0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:52.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.703+0000 7fd5bd9ff700 1 --2- 172.21.15.40:0/2228411974 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5b80d2830 0x7fd5b8156320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:52.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.703+0000 7fd5bd9ff700 1 -- 172.21.15.40:0/2228411974 >> 172.21.15.40:0/2228411974 conn(0x7fd5b80cf720 msgr2=0x7fd5b80b5bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:52.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.703+0000 7fd5bd9ff700 1 -- 172.21.15.40:0/2228411974 shutdown_connections 2023-06-22T10:54:52.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.703+0000 7fd5bd9ff700 1 -- 172.21.15.40:0/2228411974 wait complete. 2023-06-22T10:54:52.725 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-22T10:53:17.182228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-22T10:53:23.874432+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-22T10:53:29.812963+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-22T10:53:30.404021+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-22T10:53:33.982289+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-22T10:54:52.726 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-22T10:54:52.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.926+0000 7f9c5c3ff700 1 Processor -- start 2023-06-22T10:54:52.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.927+0000 7f9c5c3ff700 1 -- start start 2023-06-22T10:54:52.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.928+0000 7f9c5c3ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9c540b45d0 0x7f9c540b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:52.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.928+0000 7f9c5c3ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9c540d2130 0x7f9c540cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:52.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.928+0000 7f9c5c3ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c540d1be0 con 0x7f9c540cd6e0 2023-06-22T10:54:52.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.928+0000 7f9c5c3ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c540d17f0 con 0x7f9c540d2130 2023-06-22T10:54:52.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.928+0000 7f9c5c3ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c540d1360 con 0x7f9c540b45d0 2023-06-22T10:54:52.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.928+0000 7f9c5a99c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f9c540cd6e0 0x7f9c540b59a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:58086/0 (socket says 172.21.15.40:58086) 2023-06-22T10:54:52.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.928+0000 7f9c5a99c700 1 -- 172.21.15.40:0/3391924273 learned_addr learned my addr 172.21.15.40:0/3391924273 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:52.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.928+0000 7f9c5999a700 1 --2- 172.21.15.40:0/3391924273 >> v2:172.21.15.45:3300/0 conn(0x7f9c540d2130 0x7f9c540cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:52.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.928+0000 7f9c5a19b700 1 --2- 172.21.15.40:0/3391924273 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9c540b45d0 0x7f9c540b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:52.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.928+0000 7f9c59199700 1 -- 172.21.15.40:0/3391924273 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1545443403 0 0) 0x7f9c540d1be0 con 0x7f9c540cd6e0 2023-06-22T10:54:52.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.929+0000 7f9c59199700 1 -- 172.21.15.40:0/3391924273 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c400035b0 con 0x7f9c540cd6e0 2023-06-22T10:54:52.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.929+0000 7f9c5999a700 1 -- 172.21.15.40:0/3391924273 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9c540b45d0 msgr2=0x7f9c540b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:52.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.929+0000 7f9c5999a700 1 --2- 172.21.15.40:0/3391924273 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9c540b45d0 0x7f9c540b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:52.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.929+0000 7f9c5999a700 1 -- 172.21.15.40:0/3391924273 >> v1:172.21.15.40:6789/0 conn(0x7f9c540cd6e0 legacy=0x7f9c540b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:52.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.929+0000 7f9c5999a700 1 -- 172.21.15.40:0/3391924273 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c540b4ee0 con 0x7f9c540d2130 2023-06-22T10:54:52.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.929+0000 7f9c5a19b700 1 --2- 172.21.15.40:0/3391924273 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9c540b45d0 0x7f9c540b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-22T10:54:52.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.929+0000 7f9c5999a700 1 --2- 172.21.15.40:0/3391924273 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c540d2130 0x7f9c540cd1a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9c44009840 tx=0x7f9c44009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e78867e2ba9aae9a server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:52.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.929+0000 7f9c59199700 1 -- 172.21.15.40:0/3391924273 <== mon.1 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c44011830 con 0x7f9c540d2130 2023-06-22T10:54:52.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.929+0000 7f9c59199700 1 -- 172.21.15.40:0/3391924273 <== mon.1 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c44011990 con 0x7f9c540d2130 2023-06-22T10:54:52.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.929+0000 7f9c59199700 1 -- 172.21.15.40:0/3391924273 <== mon.1 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c44011d20 con 0x7f9c540d2130 2023-06-22T10:54:52.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.930+0000 7f9c5c3ff700 1 -- 172.21.15.40:0/3391924273 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c540d2130 msgr2=0x7f9c540cd1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:52.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.930+0000 7f9c5c3ff700 1 --2- 172.21.15.40:0/3391924273 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c540d2130 0x7f9c540cd1a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9c44009840 tx=0x7f9c44009b50 comp rx=0 tx=0).stop 2023-06-22T10:54:52.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.930+0000 7f9c5c3ff700 1 -- 172.21.15.40:0/3391924273 shutdown_connections 2023-06-22T10:54:52.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.930+0000 7f9c5c3ff700 1 --2- 172.21.15.40:0/3391924273 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9c540b45d0 0x7f9c540b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:52.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.930+0000 7f9c5c3ff700 1 --2- 172.21.15.40:0/3391924273 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c540d2130 0x7f9c540cd1a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:52.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.930+0000 7f9c5c3ff700 1 -- 172.21.15.40:0/3391924273 >> 172.21.15.40:0/3391924273 conn(0x7f9c540cf5d0 msgr2=0x7f9c540cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:52.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.930+0000 7f9c5c3ff700 1 -- 172.21.15.40:0/3391924273 shutdown_connections 2023-06-22T10:54:52.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.930+0000 7f9c5c3ff700 1 -- 172.21.15.40:0/3391924273 wait complete. 2023-06-22T10:54:52.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.932+0000 7f9c5c3ff700 1 Processor -- start 2023-06-22T10:54:52.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.933+0000 7f9c5c3ff700 1 -- start start 2023-06-22T10:54:52.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.934+0000 7f9c5c3ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9c540b45d0 0x7f9c541588d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:52.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.934+0000 7f9c5c3ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c540cd6e0 0x7f9c541580b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:52.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.934+0000 7f9c5c3ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c540d2130 0x7f9c540b2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:52.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.934+0000 7f9c5c3ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c540cae80 con 0x7f9c540cd6e0 2023-06-22T10:54:52.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.934+0000 7f9c5c3ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c540ca5e0 con 0x7f9c540d2130 2023-06-22T10:54:52.938 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.934+0000 7f9c5c3ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c540ca8c0 con 0x7f9c540b45d0 2023-06-22T10:54:52.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.934+0000 7f9c5999a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c540cd6e0 0x7f9c541580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:52.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.934+0000 7f9c5999a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c540cd6e0 0x7f9c541580b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46320/0 (socket says 172.21.15.40:46320) 2023-06-22T10:54:52.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.934+0000 7f9c5999a700 1 -- 172.21.15.40:0/3923965901 learned_addr learned my addr 172.21.15.40:0/3923965901 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:52.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.935+0000 7f9c5999a700 1 -- 172.21.15.40:0/3923965901 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9c540b45d0 msgr2=0x7f9c541588d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:52.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.935+0000 7f9c5999a700 1 --2- 172.21.15.40:0/3923965901 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9c540b45d0 0x7f9c541588d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:52.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.935+0000 7f9c5999a700 1 -- 172.21.15.40:0/3923965901 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c540d2130 msgr2=0x7f9c540b2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:52.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.935+0000 7f9c5999a700 1 --2- 172.21.15.40:0/3923965901 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c540d2130 0x7f9c540b2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:52.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.935+0000 7f9c5999a700 1 -- 172.21.15.40:0/3923965901 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c500094a0 con 0x7f9c540cd6e0 2023-06-22T10:54:52.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.935+0000 7f9c5999a700 1 --2- 172.21.15.40:0/3923965901 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c540cd6e0 0x7f9c541580b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9c44000c00 tx=0x7f9c44004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:52.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.935+0000 7f9c4affd700 1 -- 172.21.15.40:0/3923965901 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c440036a0 con 0x7f9c540cd6e0 2023-06-22T10:54:52.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.935+0000 7f9c4affd700 1 -- 172.21.15.40:0/3923965901 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c4401f070 con 0x7f9c540cd6e0 2023-06-22T10:54:52.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.935+0000 7f9c5c3ff700 1 -- 172.21.15.40:0/3923965901 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c440094a0 con 0x7f9c540cd6e0 2023-06-22T10:54:52.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.935+0000 7f9c4affd700 1 -- 172.21.15.40:0/3923965901 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c44003a40 con 0x7f9c540cd6e0 2023-06-22T10:54:52.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.935+0000 7f9c5c3ff700 1 -- 172.21.15.40:0/3923965901 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c5415d810 con 0x7f9c540cd6e0 2023-06-22T10:54:52.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.936+0000 7f9c5c3ff700 1 -- 172.21.15.40:0/3923965901 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c5415da00 con 0x7f9c540cd6e0 2023-06-22T10:54:52.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.938+0000 7f9c4affd700 1 -- 172.21.15.40:0/3923965901 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9c44003ba0 con 0x7f9c540cd6e0 2023-06-22T10:54:52.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.938+0000 7f9c4affd700 1 --2- 172.21.15.40:0/3923965901 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f9c3806ace0 0x7f9c3806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:52.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.939+0000 7f9c4affd700 1 -- 172.21.15.40:0/3923965901 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9c44021070 con 0x7f9c540cd6e0 2023-06-22T10:54:52.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.939+0000 7f9c5a19b700 1 --2- 172.21.15.40:0/3923965901 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f9c3806ace0 0x7f9c3806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:52.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.939+0000 7f9c5a19b700 1 --2- 172.21.15.40:0/3923965901 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f9c3806ace0 0x7f9c3806d190 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9c50006f10 tx=0x7f9c50006e60 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:52.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:52.943+0000 7f9c4affd700 1 -- 172.21.15.40:0/3923965901 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9c44055d90 con 0x7f9c540cd6e0 2023-06-22T10:54:53.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.150+0000 7f9c5c3ff700 1 -- 172.21.15.40:0/3923965901 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9c54067580 con 0x7f9c540cd6e0 2023-06-22T10:54:53.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.151+0000 7f9c4affd700 1 -- 172.21.15.40:0/3923965901 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9c440593b0 con 0x7f9c540cd6e0 2023-06-22T10:54:53.154 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-06-22T10:54:53.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.153+0000 7f9c5c3ff700 1 -- 172.21.15.40:0/3923965901 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f9c3806ace0 msgr2=0x7f9c3806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:53.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.153+0000 7f9c5c3ff700 1 --2- 172.21.15.40:0/3923965901 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f9c3806ace0 0x7f9c3806d190 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9c50006f10 tx=0x7f9c50006e60 comp rx=0 tx=0).stop 2023-06-22T10:54:53.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.153+0000 7f9c5c3ff700 1 -- 172.21.15.40:0/3923965901 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c540cd6e0 msgr2=0x7f9c541580b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:53.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.153+0000 7f9c5c3ff700 1 --2- 172.21.15.40:0/3923965901 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c540cd6e0 0x7f9c541580b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9c44000c00 tx=0x7f9c44004750 comp rx=0 tx=0).stop 2023-06-22T10:54:53.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.153+0000 7f9c5c3ff700 1 -- 172.21.15.40:0/3923965901 shutdown_connections 2023-06-22T10:54:53.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.153+0000 7f9c5c3ff700 1 --2- 172.21.15.40:0/3923965901 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f9c3806ace0 0x7f9c3806d190 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:53.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.153+0000 7f9c5c3ff700 1 --2- 172.21.15.40:0/3923965901 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9c540b45d0 0x7f9c541588d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:53.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.153+0000 7f9c5c3ff700 1 --2- 172.21.15.40:0/3923965901 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c540d2130 0x7f9c540b2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:53.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.153+0000 7f9c5c3ff700 1 --2- 172.21.15.40:0/3923965901 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9c540cd6e0 0x7f9c541580b0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:53.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.153+0000 7f9c5c3ff700 1 -- 172.21.15.40:0/3923965901 >> 172.21.15.40:0/3923965901 conn(0x7f9c540cf5d0 msgr2=0x7f9c540b7990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:53.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.153+0000 7f9c5c3ff700 1 -- 172.21.15.40:0/3923965901 shutdown_connections 2023-06-22T10:54:53.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.153+0000 7f9c5c3ff700 1 -- 172.21.15.40:0/3923965901 wait complete. 2023-06-22T10:54:53.175 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-22T10:54:53.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.376+0000 7fb85cfff700 1 Processor -- start 2023-06-22T10:54:53.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.376+0000 7fb85cfff700 1 -- start start 2023-06-22T10:54:53.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.377+0000 7fb85cfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb8580b45d0 0x7fb8580b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:53.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.377+0000 7fb85cfff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb8580b59a0 0x7fb8580b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:53.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.377+0000 7fb85cfff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8580d1be0 con 0x7fb8580d2130 2023-06-22T10:54:53.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.377+0000 7fb85cfff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8580d17f0 con 0x7fb8580b45d0 2023-06-22T10:54:53.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.377+0000 7fb85cfff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8580d1360 con 0x7fb8580b59a0 2023-06-22T10:54:53.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.378+0000 7fb85659c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb8580b45d0 0x7fb8580b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:53.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.378+0000 7fb856d9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb8580b59a0 0x7fb8580b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:53.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.378+0000 7fb85659c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb8580b45d0 0x7fb8580b49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46330/0 (socket says 172.21.15.40:46330) 2023-06-22T10:54:53.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.378+0000 7fb85659c700 1 -- 172.21.15.40:0/1489990551 learned_addr learned my addr 172.21.15.40:0/1489990551 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:53.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.378+0000 7fb855d9b700 1 --1- 172.21.15.40:0/1489990551 >> v1:172.21.15.45:6789/0 conn(0x7fb8580d2130 0x7fb8580cd1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.40:46640/0 (socket says 172.21.15.40:46640) 2023-06-22T10:54:53.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.378+0000 7fb85659c700 1 -- 172.21.15.40:0/1489990551 >> v2:172.21.15.45:3300/0 conn(0x7fb8580b59a0 msgr2=0x7fb8580b5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:53.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.378+0000 7fb85659c700 1 --2- 172.21.15.40:0/1489990551 >> v2:172.21.15.45:3300/0 conn(0x7fb8580b59a0 0x7fb8580b5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:53.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.378+0000 7fb85659c700 1 -- 172.21.15.40:0/1489990551 >> v1:172.21.15.45:6789/0 conn(0x7fb8580d2130 legacy=0x7fb8580cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:53.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.378+0000 7fb85559a700 1 -- 172.21.15.40:0/1489990551 <== mon.1 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3680337508 0 0) 0x7fb8580d1be0 con 0x7fb8580d2130 2023-06-22T10:54:53.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.378+0000 7fb85659c700 1 -- 172.21.15.40:0/1489990551 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8580b4ee0 con 0x7fb8580b45d0 2023-06-22T10:54:53.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.379+0000 7fb85659c700 1 --2- 172.21.15.40:0/1489990551 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8580b45d0 0x7fb8580b49a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb8580b1aa0 tx=0x7fb848009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65b185c0bcc3dbb3 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:53.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.379+0000 7fb85559a700 1 -- 172.21.15.40:0/1489990551 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb848011830 con 0x7fb8580b45d0 2023-06-22T10:54:53.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.379+0000 7fb85559a700 1 -- 172.21.15.40:0/1489990551 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb848011990 con 0x7fb8580b45d0 2023-06-22T10:54:53.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.379+0000 7fb85559a700 1 -- 172.21.15.40:0/1489990551 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb848011d20 con 0x7fb8580b45d0 2023-06-22T10:54:53.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.379+0000 7fb85cfff700 1 -- 172.21.15.40:0/1489990551 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8580b45d0 msgr2=0x7fb8580b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:53.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.379+0000 7fb85cfff700 1 --2- 172.21.15.40:0/1489990551 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8580b45d0 0x7fb8580b49a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb8580b1aa0 tx=0x7fb848009bd0 comp rx=0 tx=0).stop 2023-06-22T10:54:53.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.379+0000 7fb85cfff700 1 -- 172.21.15.40:0/1489990551 shutdown_connections 2023-06-22T10:54:53.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.379+0000 7fb85cfff700 1 --2- 172.21.15.40:0/1489990551 >> v2:172.21.15.45:3300/0 conn(0x7fb8580b59a0 0x7fb8580b5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:53.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.379+0000 7fb85cfff700 1 --2- 172.21.15.40:0/1489990551 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8580b45d0 0x7fb8580b49a0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:53.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.379+0000 7fb85cfff700 1 -- 172.21.15.40:0/1489990551 >> 172.21.15.40:0/1489990551 conn(0x7fb8580cf5d0 msgr2=0x7fb8580cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:53.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.380+0000 7fb85cfff700 1 -- 172.21.15.40:0/1489990551 shutdown_connections 2023-06-22T10:54:53.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.380+0000 7fb85cfff700 1 -- 172.21.15.40:0/1489990551 wait complete. 2023-06-22T10:54:53.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.381+0000 7fb85cfff700 1 Processor -- start 2023-06-22T10:54:53.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.382+0000 7fb85cfff700 1 -- start start 2023-06-22T10:54:53.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.382+0000 7fb85cfff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fb8580b45d0 0x7fb8581f5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:53.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.382+0000 7fb85cfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8580b59a0 0x7fb8580b6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:53.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.383+0000 7fb85cfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8580d2130 0x7fb8580b6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:53.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.383+0000 7fb85cfff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8580cc020 con 0x7fb8580b59a0 2023-06-22T10:54:53.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.383+0000 7fb85cfff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85815e680 con 0x7fb8580d2130 2023-06-22T10:54:53.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.383+0000 7fb85cfff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb85815e960 con 0x7fb8580b45d0 2023-06-22T10:54:53.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.383+0000 7fb855d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8580b59a0 0x7fb8580b6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:53.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.383+0000 7fb855d9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8580b59a0 0x7fb8580b6a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46346/0 (socket says 172.21.15.40:46346) 2023-06-22T10:54:53.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.383+0000 7fb855d9b700 1 -- 172.21.15.40:0/3436628317 learned_addr learned my addr 172.21.15.40:0/3436628317 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:53.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.383+0000 7fb856d9d700 1 --2- 172.21.15.40:0/3436628317 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8580d2130 0x7fb8580b6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:53.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.383+0000 7fb85659c700 1 --2- 172.21.15.40:0/3436628317 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fb8580b45d0 0x7fb8581f5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:53.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.383+0000 7fb855d9b700 1 -- 172.21.15.40:0/3436628317 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fb8580b45d0 msgr2=0x7fb8581f5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:53.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.383+0000 7fb855d9b700 1 --2- 172.21.15.40:0/3436628317 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fb8580b45d0 0x7fb8581f5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:53.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.383+0000 7fb855d9b700 1 -- 172.21.15.40:0/3436628317 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8580d2130 msgr2=0x7fb8580b6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:53.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.383+0000 7fb855d9b700 1 --2- 172.21.15.40:0/3436628317 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8580d2130 0x7fb8580b6fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:53.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.383+0000 7fb855d9b700 1 -- 172.21.15.40:0/3436628317 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb848009550 con 0x7fb8580b59a0 2023-06-22T10:54:53.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.384+0000 7fb855d9b700 1 --2- 172.21.15.40:0/3436628317 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8580b59a0 0x7fb8580b6a60 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fb84c0011e0 tx=0x7fb84c00ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:53.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.384+0000 7fb846ffd700 1 -- 172.21.15.40:0/3436628317 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84c004c80 con 0x7fb8580b59a0 2023-06-22T10:54:53.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.384+0000 7fb846ffd700 1 -- 172.21.15.40:0/3436628317 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb84c004e00 con 0x7fb8580b59a0 2023-06-22T10:54:53.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.384+0000 7fb85cfff700 1 -- 172.21.15.40:0/3436628317 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb85815ec40 con 0x7fb8580b59a0 2023-06-22T10:54:53.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.384+0000 7fb846ffd700 1 -- 172.21.15.40:0/3436628317 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84c007310 con 0x7fb8580b59a0 2023-06-22T10:54:53.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.384+0000 7fb85cfff700 1 -- 172.21.15.40:0/3436628317 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb85815f440 con 0x7fb8580b59a0 2023-06-22T10:54:53.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.385+0000 7fb85cfff700 1 -- 172.21.15.40:0/3436628317 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb85815f160 con 0x7fb8580b59a0 2023-06-22T10:54:53.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.386+0000 7fb846ffd700 1 -- 172.21.15.40:0/3436628317 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb84c007470 con 0x7fb8580b59a0 2023-06-22T10:54:53.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.387+0000 7fb846ffd700 1 --2- 172.21.15.40:0/3436628317 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fb83806ace0 0x7fb83806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:53.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.387+0000 7fb846ffd700 1 -- 172.21.15.40:0/3436628317 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb84c089420 con 0x7fb8580b59a0 2023-06-22T10:54:53.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.388+0000 7fb85659c700 1 --2- 172.21.15.40:0/3436628317 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fb83806ace0 0x7fb83806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:53.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.388+0000 7fb85659c700 1 --2- 172.21.15.40:0/3436628317 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fb83806ace0 0x7fb83806d190 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb848014040 tx=0x7fb848008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:53.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.392+0000 7fb846ffd700 1 -- 172.21.15.40:0/3436628317 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb85815f160 con 0x7fb8580b59a0 2023-06-22T10:54:53.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.599+0000 7fb85cfff700 1 -- 172.21.15.40:0/3436628317 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb85815f160 con 0x7fb8580b59a0 2023-06-22T10:54:53.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.599+0000 7fb846ffd700 1 -- 172.21.15.40:0/3436628317 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb85815f160 con 0x7fb8580b59a0 2023-06-22T10:54:53.603 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 8 2023-06-22T10:54:53.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.601+0000 7fb85cfff700 1 -- 172.21.15.40:0/3436628317 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fb83806ace0 msgr2=0x7fb83806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:53.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.601+0000 7fb85cfff700 1 --2- 172.21.15.40:0/3436628317 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fb83806ace0 0x7fb83806d190 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb848014040 tx=0x7fb848008030 comp rx=0 tx=0).stop 2023-06-22T10:54:53.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.601+0000 7fb85cfff700 1 -- 172.21.15.40:0/3436628317 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8580b59a0 msgr2=0x7fb8580b6a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:53.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.601+0000 7fb85cfff700 1 --2- 172.21.15.40:0/3436628317 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8580b59a0 0x7fb8580b6a60 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fb84c0011e0 tx=0x7fb84c00ca30 comp rx=0 tx=0).stop 2023-06-22T10:54:53.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.602+0000 7fb85cfff700 1 -- 172.21.15.40:0/3436628317 shutdown_connections 2023-06-22T10:54:53.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.602+0000 7fb85cfff700 1 --2- 172.21.15.40:0/3436628317 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fb83806ace0 0x7fb83806d190 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:53.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.602+0000 7fb85cfff700 1 --2- 172.21.15.40:0/3436628317 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fb8580b45d0 0x7fb8581f5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:53.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.602+0000 7fb85cfff700 1 --2- 172.21.15.40:0/3436628317 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8580d2130 0x7fb8580b6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:53.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.602+0000 7fb85cfff700 1 --2- 172.21.15.40:0/3436628317 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8580b59a0 0x7fb8580b6a60 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:53.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.602+0000 7fb85cfff700 1 -- 172.21.15.40:0/3436628317 >> 172.21.15.40:0/3436628317 conn(0x7fb8580cf5d0 msgr2=0x7fb85815b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:53.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.602+0000 7fb85cfff700 1 -- 172.21.15.40:0/3436628317 shutdown_connections 2023-06-22T10:54:53.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.602+0000 7fb85cfff700 1 -- 172.21.15.40:0/3436628317 wait complete. 2023-06-22T10:54:53.622 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-22T10:54:53.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.824+0000 7fefc65ff700 1 Processor -- start 2023-06-22T10:54:53.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.824+0000 7fefc65ff700 1 -- start start 2023-06-22T10:54:53.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.825+0000 7fefc65ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fefc00b45d0 0x7fefc00b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:53.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.825+0000 7fefc65ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fefc00d2130 0x7fefc00cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:53.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.825+0000 7fefc65ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefc00d1be0 con 0x7fefc00cd6e0 2023-06-22T10:54:53.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.825+0000 7fefc65ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefc00d17f0 con 0x7fefc00d2130 2023-06-22T10:54:53.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.825+0000 7fefc65ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefc00d1360 con 0x7fefc00b45d0 2023-06-22T10:54:53.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.826+0000 7fefb7fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fefc00d2130 0x7fefc00cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:53.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.826+0000 7fefbffff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fefc00b45d0 0x7fefc00b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:53.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.826+0000 7fefc4b9c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fefc00cd6e0 0x7fefc00b59a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.40:46648/0 (socket says 172.21.15.40:46648) 2023-06-22T10:54:53.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.826+0000 7fefbffff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fefc00b45d0 0x7fefc00b49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3301/0 says I am v2:172.21.15.40:50128/0 (socket says 172.21.15.40:50128) 2023-06-22T10:54:53.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.826+0000 7fefc4b9c700 1 -- 172.21.15.40:0/2595665723 learned_addr learned my addr 172.21.15.40:0/2595665723 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:53.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.826+0000 7fefb7fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fefc00d2130 0x7fefc00cd1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.40:36828/0 (socket says 172.21.15.40:36828) 2023-06-22T10:54:53.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.826+0000 7fefbffff700 1 -- 172.21.15.40:0/2595665723 >> v2:172.21.15.45:3300/0 conn(0x7fefc00d2130 msgr2=0x7fefc00cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:53.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.826+0000 7fefbffff700 1 --2- 172.21.15.40:0/2595665723 >> v2:172.21.15.45:3300/0 conn(0x7fefc00d2130 0x7fefc00cd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:53.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.826+0000 7fefbffff700 1 -- 172.21.15.40:0/2595665723 >> v1:172.21.15.45:6789/0 conn(0x7fefc00cd6e0 legacy=0x7fefc00b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:53.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.826+0000 7fefbffff700 1 -- 172.21.15.40:0/2595665723 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefc00b4ee0 con 0x7fefc00b45d0 2023-06-22T10:54:53.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.826+0000 7fefbf7fe700 1 -- 172.21.15.40:0/2595665723 <== mon.1 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1303590130 0 0) 0x7fefc00d1be0 con 0x7fefc00cd6e0 2023-06-22T10:54:53.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.827+0000 7fefb7fff700 1 --2- 172.21.15.40:0/2595665723 >> v2:172.21.15.45:3300/0 conn(0x7fefc00d2130 0x7fefc00cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-22T10:54:53.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.827+0000 7fefbffff700 1 --2- 172.21.15.40:0/2595665723 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fefc00b45d0 0x7fefc00b49a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fefb0009840 tx=0x7fefb0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4024180482ba8731 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:53.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.827+0000 7fefbf7fe700 1 -- 172.21.15.40:0/2595665723 <== mon.2 v2:172.21.15.45:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb0011830 con 0x7fefc00b45d0 2023-06-22T10:54:53.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.827+0000 7fefbf7fe700 1 -- 172.21.15.40:0/2595665723 <== mon.2 v2:172.21.15.45:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefb0011990 con 0x7fefc00b45d0 2023-06-22T10:54:53.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.827+0000 7fefbf7fe700 1 -- 172.21.15.40:0/2595665723 <== mon.2 v2:172.21.15.45:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb0011d20 con 0x7fefc00b45d0 2023-06-22T10:54:53.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.828+0000 7fefc65ff700 1 -- 172.21.15.40:0/2595665723 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fefc00b45d0 msgr2=0x7fefc00b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:53.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.828+0000 7fefc65ff700 1 --2- 172.21.15.40:0/2595665723 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fefc00b45d0 0x7fefc00b49a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fefb0009840 tx=0x7fefb0009b50 comp rx=0 tx=0).stop 2023-06-22T10:54:53.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.828+0000 7fefc65ff700 1 -- 172.21.15.40:0/2595665723 shutdown_connections 2023-06-22T10:54:53.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.828+0000 7fefc65ff700 1 --2- 172.21.15.40:0/2595665723 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fefc00b45d0 0x7fefc00b49a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:53.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.828+0000 7fefc65ff700 1 --2- 172.21.15.40:0/2595665723 >> v2:172.21.15.45:3300/0 conn(0x7fefc00d2130 0x7fefc00cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:53.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.828+0000 7fefc65ff700 1 -- 172.21.15.40:0/2595665723 >> 172.21.15.40:0/2595665723 conn(0x7fefc00cf5d0 msgr2=0x7fefc00cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:53.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.828+0000 7fefc65ff700 1 -- 172.21.15.40:0/2595665723 shutdown_connections 2023-06-22T10:54:53.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.828+0000 7fefc65ff700 1 -- 172.21.15.40:0/2595665723 wait complete. 2023-06-22T10:54:53.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.830+0000 7fefc65ff700 1 Processor -- start 2023-06-22T10:54:53.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.830+0000 7fefc65ff700 1 -- start start 2023-06-22T10:54:53.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.831+0000 7fefc65ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefc00b45d0 0x7fefc00c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:53.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.831+0000 7fefc65ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fefc00cd6e0 0x7fefc01571c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:53.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.831+0000 7fefc65ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefc00d2130 0x7fefc015e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:53.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.831+0000 7fefc65ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefc0157700 con 0x7fefc00b45d0 2023-06-22T10:54:53.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.831+0000 7fefc65ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefc00ca200 con 0x7fefc00d2130 2023-06-22T10:54:53.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.831+0000 7fefc65ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefc00ca4e0 con 0x7fefc00cd6e0 2023-06-22T10:54:53.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.831+0000 7fefbffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefc00b45d0 0x7fefc00c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:53.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.831+0000 7fefbffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefc00b45d0 0x7fefc00c9c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46360/0 (socket says 172.21.15.40:46360) 2023-06-22T10:54:53.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.831+0000 7fefbffff700 1 -- 172.21.15.40:0/3540731562 learned_addr learned my addr 172.21.15.40:0/3540731562 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:53.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.831+0000 7fefc4b9c700 1 --2- 172.21.15.40:0/3540731562 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefc00d2130 0x7fefc015e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:53.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.831+0000 7fefb7fff700 1 --2- 172.21.15.40:0/3540731562 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fefc00cd6e0 0x7fefc01571c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:53.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.831+0000 7fefbffff700 1 -- 172.21.15.40:0/3540731562 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fefc00cd6e0 msgr2=0x7fefc01571c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:53.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.831+0000 7fefbffff700 1 --2- 172.21.15.40:0/3540731562 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fefc00cd6e0 0x7fefc01571c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:53.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.831+0000 7fefbffff700 1 -- 172.21.15.40:0/3540731562 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefc00d2130 msgr2=0x7fefc015e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:53.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.831+0000 7fefbffff700 1 --2- 172.21.15.40:0/3540731562 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefc00d2130 0x7fefc015e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:53.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.831+0000 7fefbffff700 1 -- 172.21.15.40:0/3540731562 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefa80094a0 con 0x7fefc00b45d0 2023-06-22T10:54:53.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.832+0000 7fefbffff700 1 --2- 172.21.15.40:0/3540731562 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefc00b45d0 0x7fefc00c9c20 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fefb00090b0 tx=0x7fefb0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:53.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.832+0000 7fefbd7fa700 1 -- 172.21.15.40:0/3540731562 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb00036a0 con 0x7fefc00b45d0 2023-06-22T10:54:53.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.832+0000 7fefc65ff700 1 -- 172.21.15.40:0/3540731562 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefb00094a0 con 0x7fefc00b45d0 2023-06-22T10:54:53.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.832+0000 7fefc65ff700 1 -- 172.21.15.40:0/3540731562 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefc00caaa0 con 0x7fefc00b45d0 2023-06-22T10:54:53.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.833+0000 7fefbd7fa700 1 -- 172.21.15.40:0/3540731562 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefb001e070 con 0x7fefc00b45d0 2023-06-22T10:54:53.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.833+0000 7fefbd7fa700 1 -- 172.21.15.40:0/3540731562 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb0003a00 con 0x7fefc00b45d0 2023-06-22T10:54:53.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.833+0000 7fefc65ff700 1 -- 172.21.15.40:0/3540731562 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefa40052f0 con 0x7fefc00b45d0 2023-06-22T10:54:53.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.834+0000 7fefbd7fa700 1 -- 172.21.15.40:0/3540731562 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fefb0003b60 con 0x7fefc00b45d0 2023-06-22T10:54:53.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.835+0000 7fefbd7fa700 1 --2- 172.21.15.40:0/3540731562 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fefa006ace0 0x7fefa006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:53.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.835+0000 7fefbd7fa700 1 -- 172.21.15.40:0/3540731562 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fefb008a850 con 0x7fefc00b45d0 2023-06-22T10:54:53.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.836+0000 7fefb7fff700 1 --2- 172.21.15.40:0/3540731562 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fefa006ace0 0x7fefa006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:53.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.836+0000 7fefb7fff700 1 --2- 172.21.15.40:0/3540731562 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fefa006ace0 0x7fefa006d190 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fefc00b1930 tx=0x7fefa8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:53.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:53.840+0000 7fefbd7fa700 1 -- 172.21.15.40:0/3540731562 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fefb00554d0 con 0x7fefc00b45d0 2023-06-22T10:54:54.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.047+0000 7fefc65ff700 1 -- 172.21.15.40:0/3540731562 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fefa4005b20 con 0x7fefc00b45d0 2023-06-22T10:54:54.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.048+0000 7fefbd7fa700 1 -- 172.21.15.40:0/3540731562 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7fefb0058af0 con 0x7fefc00b45d0 2023-06-22T10:54:54.051 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-06-22T10:54:54.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.050+0000 7fefc65ff700 1 -- 172.21.15.40:0/3540731562 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fefa006ace0 msgr2=0x7fefa006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:54.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.050+0000 7fefc65ff700 1 --2- 172.21.15.40:0/3540731562 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fefa006ace0 0x7fefa006d190 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fefc00b1930 tx=0x7fefa8008040 comp rx=0 tx=0).stop 2023-06-22T10:54:54.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.050+0000 7fefc65ff700 1 -- 172.21.15.40:0/3540731562 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefc00b45d0 msgr2=0x7fefc00c9c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:54.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.050+0000 7fefc65ff700 1 --2- 172.21.15.40:0/3540731562 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefc00b45d0 0x7fefc00c9c20 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fefb00090b0 tx=0x7fefb0004750 comp rx=0 tx=0).stop 2023-06-22T10:54:54.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.050+0000 7fefc65ff700 1 -- 172.21.15.40:0/3540731562 shutdown_connections 2023-06-22T10:54:54.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.050+0000 7fefc65ff700 1 --2- 172.21.15.40:0/3540731562 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fefa006ace0 0x7fefa006d190 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:54.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.050+0000 7fefc65ff700 1 --2- 172.21.15.40:0/3540731562 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fefc00d2130 0x7fefc015e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:54.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.050+0000 7fefc65ff700 1 --2- 172.21.15.40:0/3540731562 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefc00b45d0 0x7fefc00c9c20 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:54.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.050+0000 7fefc65ff700 1 --2- 172.21.15.40:0/3540731562 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fefc00cd6e0 0x7fefc01571c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:54.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.050+0000 7fefc65ff700 1 -- 172.21.15.40:0/3540731562 >> 172.21.15.40:0/3540731562 conn(0x7fefc00cf5d0 msgr2=0x7fefc00b3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:54.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.050+0000 7fefc65ff700 1 -- 172.21.15.40:0/3540731562 shutdown_connections 2023-06-22T10:54:54.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.050+0000 7fefc65ff700 1 -- 172.21.15.40:0/3540731562 wait complete. 2023-06-22T10:54:54.071 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-22T10:54:54.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.271+0000 7faffb7ff700 1 Processor -- start 2023-06-22T10:54:54.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.272+0000 7faffb7ff700 1 -- start start 2023-06-22T10:54:54.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.273+0000 7faffb7ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faff40b59a0 0x7faff40b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:54.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.273+0000 7faffb7ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faff40d1be0 con 0x7faff40d2130 2023-06-22T10:54:54.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.273+0000 7faffb7ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faff40d1360 con 0x7faff40b45d0 2023-06-22T10:54:54.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.273+0000 7faffb7ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faff40d17f0 con 0x7faff40b59a0 2023-06-22T10:54:54.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.273+0000 7faff9d9c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7faff40b59a0 0x7faff40b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:54.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.273+0000 7faff8d9a700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7faff40d2130 0x7faff40cd1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:58092/0 (socket says 172.21.15.40:58092) 2023-06-22T10:54:54.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.273+0000 7faff8d9a700 1 -- 172.21.15.40:0/2970384829 learned_addr learned my addr 172.21.15.40:0/2970384829 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:54.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.273+0000 7faff9d9c700 1 -- 172.21.15.40:0/2970384829 >> v1:172.21.15.45:6789/0 conn(0x7faff40b45d0 legacy=0x7faff40b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:54.278 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.273+0000 7faff9d9c700 1 -- 172.21.15.40:0/2970384829 >> v1:172.21.15.40:6789/0 conn(0x7faff40d2130 legacy=0x7faff40cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:54.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.273+0000 7faff9d9c700 1 -- 172.21.15.40:0/2970384829 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff40cef40 con 0x7faff40b59a0 2023-06-22T10:54:54.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.273+0000 7fafebfff700 1 -- 172.21.15.40:0/2970384829 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2647849329 0 0) 0x7faff40d1be0 con 0x7faff40d2130 2023-06-22T10:54:54.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.274+0000 7faff9d9c700 1 --2- 172.21.15.40:0/2970384829 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faff40b59a0 0x7faff40b5e40 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fafec009d90 tx=0x7fafec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0645114327f5d7e server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:54.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.274+0000 7fafebfff700 1 -- 172.21.15.40:0/2970384829 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafec00e070 con 0x7faff40b59a0 2023-06-22T10:54:54.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.274+0000 7fafebfff700 1 -- 172.21.15.40:0/2970384829 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafec00bbd0 con 0x7faff40b59a0 2023-06-22T10:54:54.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.274+0000 7fafebfff700 1 -- 172.21.15.40:0/2970384829 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafec012430 con 0x7faff40b59a0 2023-06-22T10:54:54.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.275+0000 7faffb7ff700 1 -- 172.21.15.40:0/2970384829 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faff40b59a0 msgr2=0x7faff40b5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:54.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.275+0000 7faffb7ff700 1 --2- 172.21.15.40:0/2970384829 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faff40b59a0 0x7faff40b5e40 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fafec009d90 tx=0x7fafec00b330 comp rx=0 tx=0).stop 2023-06-22T10:54:54.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.275+0000 7faffb7ff700 1 -- 172.21.15.40:0/2970384829 shutdown_connections 2023-06-22T10:54:54.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.275+0000 7faffb7ff700 1 --2- 172.21.15.40:0/2970384829 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faff40b59a0 0x7faff40b5e40 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:54.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.275+0000 7faffb7ff700 1 -- 172.21.15.40:0/2970384829 >> 172.21.15.40:0/2970384829 conn(0x7faff40cf5d0 msgr2=0x7faff40cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:54.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.275+0000 7faffb7ff700 1 -- 172.21.15.40:0/2970384829 shutdown_connections 2023-06-22T10:54:54.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.275+0000 7faffb7ff700 1 -- 172.21.15.40:0/2970384829 wait complete. 2023-06-22T10:54:54.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.277+0000 7faffb7ff700 1 Processor -- start 2023-06-22T10:54:54.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.277+0000 7faffb7ff700 1 -- start start 2023-06-22T10:54:54.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.278+0000 7faffb7ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7faff40b45d0 0x7faff40a9f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:54.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.278+0000 7faffb7ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faff40b59a0 0x7faff41f12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:54.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.278+0000 7faffb7ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faff40d2130 0x7faff40cbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:54.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.278+0000 7faffb7ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff40cad10 con 0x7faff40d2130 2023-06-22T10:54:54.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.278+0000 7faffb7ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff40caff0 con 0x7faff40b59a0 2023-06-22T10:54:54.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.278+0000 7faffb7ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faff40cb2d0 con 0x7faff40b45d0 2023-06-22T10:54:54.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.278+0000 7faff9d9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faff40d2130 0x7faff40cbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:54.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.278+0000 7faff8d9a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faff40b59a0 0x7faff41f12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:54.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.278+0000 7faff9d9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faff40d2130 0x7faff40cbdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46384/0 (socket says 172.21.15.40:46384) 2023-06-22T10:54:54.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.278+0000 7faff9d9c700 1 -- 172.21.15.40:0/962341396 learned_addr learned my addr 172.21.15.40:0/962341396 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:54.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.278+0000 7faff959b700 1 --2- 172.21.15.40:0/962341396 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7faff40b45d0 0x7faff40a9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:54.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.278+0000 7faff9d9c700 1 -- 172.21.15.40:0/962341396 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7faff40b45d0 msgr2=0x7faff40a9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:54.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.278+0000 7faff9d9c700 1 --2- 172.21.15.40:0/962341396 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7faff40b45d0 0x7faff40a9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:54.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.278+0000 7faff9d9c700 1 -- 172.21.15.40:0/962341396 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faff40b59a0 msgr2=0x7faff41f12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:54.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.278+0000 7faff9d9c700 1 --2- 172.21.15.40:0/962341396 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faff40b59a0 0x7faff41f12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:54.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.278+0000 7faff9d9c700 1 -- 172.21.15.40:0/962341396 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafec009a70 con 0x7faff40d2130 2023-06-22T10:54:54.285 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.279+0000 7faff9d9c700 1 --2- 172.21.15.40:0/962341396 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faff40d2130 0x7faff40cbdb0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fafec014040 tx=0x7fafec004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:54.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.279+0000 7fafe9ffb700 1 -- 172.21.15.40:0/962341396 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafec01b810 con 0x7faff40d2130 2023-06-22T10:54:54.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.279+0000 7fafe9ffb700 1 -- 172.21.15.40:0/962341396 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafec020070 con 0x7faff40d2130 2023-06-22T10:54:54.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.279+0000 7fafe9ffb700 1 -- 172.21.15.40:0/962341396 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafec01bbd0 con 0x7faff40d2130 2023-06-22T10:54:54.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.279+0000 7faffb7ff700 1 -- 172.21.15.40:0/962341396 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faff40cb5b0 con 0x7faff40d2130 2023-06-22T10:54:54.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.279+0000 7faffb7ff700 1 -- 172.21.15.40:0/962341396 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faff40aa470 con 0x7faff40d2130 2023-06-22T10:54:54.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.280+0000 7faffb7ff700 1 -- 172.21.15.40:0/962341396 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faff40cbad0 con 0x7faff40d2130 2023-06-22T10:54:54.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.281+0000 7fafe9ffb700 1 -- 172.21.15.40:0/962341396 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fafec01bd30 con 0x7faff40d2130 2023-06-22T10:54:54.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.282+0000 7fafe9ffb700 1 --2- 172.21.15.40:0/962341396 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fafd806ace0 0x7fafd806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:54.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.282+0000 7fafe9ffb700 1 -- 172.21.15.40:0/962341396 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fafec022070 con 0x7faff40d2130 2023-06-22T10:54:54.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.282+0000 7faff959b700 1 --2- 172.21.15.40:0/962341396 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fafd806ace0 0x7fafd806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:54.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.283+0000 7faff959b700 1 --2- 172.21.15.40:0/962341396 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fafd806ace0 0x7fafd806d190 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7faff0007fd0 tx=0x7faff0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:54.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.286+0000 7fafe9ffb700 1 -- 172.21.15.40:0/962341396 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7faff40cbad0 con 0x7faff40d2130 2023-06-22T10:54:54.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.490+0000 7faffb7ff700 1 -- 172.21.15.40:0/962341396 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7faff40cbad0 con 0x7faff40d2130 2023-06-22T10:54:54.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.491+0000 7fafe9ffb700 1 -- 172.21.15.40:0/962341396 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7fafec02c020 con 0x7faff40d2130 2023-06-22T10:54:54.494 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-06-22T10:54:54.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.493+0000 7faffb7ff700 1 -- 172.21.15.40:0/962341396 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fafd806ace0 msgr2=0x7fafd806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:54.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.493+0000 7faffb7ff700 1 --2- 172.21.15.40:0/962341396 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fafd806ace0 0x7fafd806d190 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7faff0007fd0 tx=0x7faff0009040 comp rx=0 tx=0).stop 2023-06-22T10:54:54.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.493+0000 7faffb7ff700 1 -- 172.21.15.40:0/962341396 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faff40d2130 msgr2=0x7faff40cbdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:54.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.493+0000 7faffb7ff700 1 --2- 172.21.15.40:0/962341396 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faff40d2130 0x7faff40cbdb0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fafec014040 tx=0x7fafec004ad0 comp rx=0 tx=0).stop 2023-06-22T10:54:54.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.493+0000 7faffb7ff700 1 -- 172.21.15.40:0/962341396 shutdown_connections 2023-06-22T10:54:54.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.494+0000 7faffb7ff700 1 --2- 172.21.15.40:0/962341396 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fafd806ace0 0x7fafd806d190 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:54.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.494+0000 7faffb7ff700 1 --2- 172.21.15.40:0/962341396 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7faff40b45d0 0x7faff40a9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:54.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.494+0000 7faffb7ff700 1 --2- 172.21.15.40:0/962341396 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7faff40d2130 0x7faff40cbdb0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:54.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.494+0000 7faffb7ff700 1 --2- 172.21.15.40:0/962341396 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faff40b59a0 0x7faff41f12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:54.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.494+0000 7faffb7ff700 1 -- 172.21.15.40:0/962341396 >> 172.21.15.40:0/962341396 conn(0x7faff40cf5d0 msgr2=0x7faff40d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:54.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.494+0000 7faffb7ff700 1 -- 172.21.15.40:0/962341396 shutdown_connections 2023-06-22T10:54:54.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.494+0000 7faffb7ff700 1 -- 172.21.15.40:0/962341396 wait complete. 2023-06-22T10:54:54.515 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-22T10:54:54.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.715+0000 7f3e9e1ff700 1 Processor -- start 2023-06-22T10:54:54.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.716+0000 7f3e9e1ff700 1 -- start start 2023-06-22T10:54:54.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.717+0000 7f3e9e1ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3e980b45d0 0x7f3e980b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:54.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.717+0000 7f3e9e1ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f3e980d2130 0x7f3e980cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:54.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.717+0000 7f3e9e1ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e980d1be0 con 0x7f3e980cd6e0 2023-06-22T10:54:54.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.717+0000 7f3e9e1ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e980d17f0 con 0x7f3e980b45d0 2023-06-22T10:54:54.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.717+0000 7f3e9e1ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e980d1360 con 0x7f3e980d2130 2023-06-22T10:54:54.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.717+0000 7f3e977fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3e980b45d0 0x7f3e980b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:54.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.717+0000 7f3e96ffd700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f3e980d2130 0x7f3e980cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:54.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.717+0000 7f3e977fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3e980b45d0 0x7f3e980b49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.40:36868/0 (socket says 172.21.15.40:36868) 2023-06-22T10:54:54.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.717+0000 7f3e97fff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f3e980cd6e0 0x7f3e980b59a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.40:46672/0 (socket says 172.21.15.40:46672) 2023-06-22T10:54:54.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.717+0000 7f3e977fe700 1 -- 172.21.15.40:0/4167515606 learned_addr learned my addr 172.21.15.40:0/4167515606 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:54.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.718+0000 7f3e96ffd700 1 -- 172.21.15.40:0/4167515606 >> v2:172.21.15.45:3300/0 conn(0x7f3e980b45d0 msgr2=0x7f3e980b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:54.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.718+0000 7f3e96ffd700 1 --2- 172.21.15.40:0/4167515606 >> v2:172.21.15.45:3300/0 conn(0x7f3e980b45d0 0x7f3e980b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:54.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.718+0000 7f3e96ffd700 1 -- 172.21.15.40:0/4167515606 >> v1:172.21.15.45:6789/0 conn(0x7f3e980cd6e0 legacy=0x7f3e980b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:54.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.718+0000 7f3e96ffd700 1 -- 172.21.15.40:0/4167515606 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e980b4ee0 con 0x7f3e980d2130 2023-06-22T10:54:54.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.718+0000 7f3e96ffd700 1 --2- 172.21.15.40:0/4167515606 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f3e980d2130 0x7f3e980cd1a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c009840 tx=0x7f3e8c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e348f94a0ab20b5 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:54.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.718+0000 7f3e967fc700 1 -- 172.21.15.40:0/4167515606 <== mon.2 v2:172.21.15.45:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c011830 con 0x7f3e980d2130 2023-06-22T10:54:54.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.718+0000 7f3e967fc700 1 -- 172.21.15.40:0/4167515606 <== mon.2 v2:172.21.15.45:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e8c011990 con 0x7f3e980d2130 2023-06-22T10:54:54.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.718+0000 7f3e967fc700 1 -- 172.21.15.40:0/4167515606 <== mon.2 v2:172.21.15.45:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c011d20 con 0x7f3e980d2130 2023-06-22T10:54:54.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.719+0000 7f3e9e1ff700 1 -- 172.21.15.40:0/4167515606 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f3e980d2130 msgr2=0x7f3e980cd1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:54.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.719+0000 7f3e9e1ff700 1 --2- 172.21.15.40:0/4167515606 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f3e980d2130 0x7f3e980cd1a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c009840 tx=0x7f3e8c009b50 comp rx=0 tx=0).stop 2023-06-22T10:54:54.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.719+0000 7f3e9e1ff700 1 -- 172.21.15.40:0/4167515606 shutdown_connections 2023-06-22T10:54:54.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.719+0000 7f3e9e1ff700 1 --2- 172.21.15.40:0/4167515606 >> v2:172.21.15.45:3300/0 conn(0x7f3e980b45d0 0x7f3e980b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:54.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.719+0000 7f3e9e1ff700 1 --2- 172.21.15.40:0/4167515606 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f3e980d2130 0x7f3e980cd1a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:54.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.719+0000 7f3e9e1ff700 1 -- 172.21.15.40:0/4167515606 >> 172.21.15.40:0/4167515606 conn(0x7f3e980cf5d0 msgr2=0x7f3e980cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:54.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.719+0000 7f3e9e1ff700 1 -- 172.21.15.40:0/4167515606 shutdown_connections 2023-06-22T10:54:54.729 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.719+0000 7f3e9e1ff700 1 -- 172.21.15.40:0/4167515606 wait complete. 2023-06-22T10:54:54.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.721+0000 7f3e9e1ff700 1 Processor -- start 2023-06-22T10:54:54.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.721+0000 7f3e9e1ff700 1 -- start start 2023-06-22T10:54:54.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.722+0000 7f3e9e1ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e980b45d0 0x7f3e9815dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:54.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.722+0000 7f3e9e1ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e980cd6e0 0x7f3e98155530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:54.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.722+0000 7f3e9e1ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f3e980d2130 0x7f3e98156550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:54.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.722+0000 7f3e9e1ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9815cb40 con 0x7f3e980cd6e0 2023-06-22T10:54:54.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.722+0000 7f3e9e1ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9815ce20 con 0x7f3e980b45d0 2023-06-22T10:54:54.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.722+0000 7f3e9e1ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9815d100 con 0x7f3e980d2130 2023-06-22T10:54:54.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.722+0000 7f3e96ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e980cd6e0 0x7f3e98155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:54.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.722+0000 7f3e96ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e980cd6e0 0x7f3e98155530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46386/0 (socket says 172.21.15.40:46386) 2023-06-22T10:54:54.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.722+0000 7f3e96ffd700 1 -- 172.21.15.40:0/4107708032 learned_addr learned my addr 172.21.15.40:0/4107708032 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:54.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.722+0000 7f3e977fe700 1 --2- 172.21.15.40:0/4107708032 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e980b45d0 0x7f3e9815dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:54.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.722+0000 7f3e97fff700 1 --2- 172.21.15.40:0/4107708032 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f3e980d2130 0x7f3e98156550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:54.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.723+0000 7f3e96ffd700 1 -- 172.21.15.40:0/4107708032 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f3e980d2130 msgr2=0x7f3e98156550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:54.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.723+0000 7f3e96ffd700 1 --2- 172.21.15.40:0/4107708032 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f3e980d2130 0x7f3e98156550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:54.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.723+0000 7f3e96ffd700 1 -- 172.21.15.40:0/4107708032 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e980b45d0 msgr2=0x7f3e9815dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:54.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.723+0000 7f3e96ffd700 1 --2- 172.21.15.40:0/4107708032 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e980b45d0 0x7f3e9815dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:54.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.723+0000 7f3e96ffd700 1 -- 172.21.15.40:0/4107708032 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e8c0094a0 con 0x7f3e980cd6e0 2023-06-22T10:54:54.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.723+0000 7f3e97fff700 1 --2- 172.21.15.40:0/4107708032 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f3e980d2130 0x7f3e98156550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:54:54.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.723+0000 7f3e96ffd700 1 --2- 172.21.15.40:0/4107708032 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e980cd6e0 0x7f3e98155530 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c000c00 tx=0x7f3e8c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:54.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.723+0000 7f3e7ffff700 1 -- 172.21.15.40:0/4107708032 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c0036a0 con 0x7f3e980cd6e0 2023-06-22T10:54:54.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.723+0000 7f3e7ffff700 1 -- 172.21.15.40:0/4107708032 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e8c01f070 con 0x7f3e980cd6e0 2023-06-22T10:54:54.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.723+0000 7f3e7ffff700 1 -- 172.21.15.40:0/4107708032 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c003a00 con 0x7f3e980cd6e0 2023-06-22T10:54:54.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.723+0000 7f3e9e1ff700 1 -- 172.21.15.40:0/4107708032 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e9815d3e0 con 0x7f3e980cd6e0 2023-06-22T10:54:54.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.723+0000 7f3e9e1ff700 1 -- 172.21.15.40:0/4107708032 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e98155a70 con 0x7f3e980cd6e0 2023-06-22T10:54:54.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.724+0000 7f3e9e1ff700 1 -- 172.21.15.40:0/4107708032 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e9815d900 con 0x7f3e980cd6e0 2023-06-22T10:54:54.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.725+0000 7f3e7ffff700 1 -- 172.21.15.40:0/4107708032 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3e8c003b60 con 0x7f3e980cd6e0 2023-06-22T10:54:54.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.726+0000 7f3e7ffff700 1 --2- 172.21.15.40:0/4107708032 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f3e8406ace0 0x7f3e8406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:54.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.726+0000 7f3e7ffff700 1 -- 172.21.15.40:0/4107708032 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3e8c021070 con 0x7f3e980cd6e0 2023-06-22T10:54:54.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.727+0000 7f3e977fe700 1 --2- 172.21.15.40:0/4107708032 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f3e8406ace0 0x7f3e8406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:54.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.727+0000 7f3e977fe700 1 --2- 172.21.15.40:0/4107708032 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f3e8406ace0 0x7f3e8406d190 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3e88009b30 tx=0x7f3e880092c0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:54.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.730+0000 7f3e7ffff700 1 -- 172.21.15.40:0/4107708032 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3e9815d900 con 0x7f3e980cd6e0 2023-06-22T10:54:54.881 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T10:54:54.886 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T10:54:54.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.937+0000 7f3e9e1ff700 1 -- 172.21.15.40:0/4107708032 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f3e9815d900 con 0x7f3e980cd6e0 2023-06-22T10:54:54.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.937+0000 7f3e7ffff700 1 -- 172.21.15.40:0/4107708032 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3e9815d900 con 0x7f3e980cd6e0 2023-06-22T10:54:54.941 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-06-22T10:54:54.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.939+0000 7f3e9e1ff700 1 -- 172.21.15.40:0/4107708032 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f3e8406ace0 msgr2=0x7f3e8406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:54.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.939+0000 7f3e9e1ff700 1 --2- 172.21.15.40:0/4107708032 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f3e8406ace0 0x7f3e8406d190 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3e88009b30 tx=0x7f3e880092c0 comp rx=0 tx=0).stop 2023-06-22T10:54:54.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.939+0000 7f3e9e1ff700 1 -- 172.21.15.40:0/4107708032 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e980cd6e0 msgr2=0x7f3e98155530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:54.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.939+0000 7f3e9e1ff700 1 --2- 172.21.15.40:0/4107708032 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e980cd6e0 0x7f3e98155530 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c000c00 tx=0x7f3e8c004750 comp rx=0 tx=0).stop 2023-06-22T10:54:54.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.940+0000 7f3e9e1ff700 1 -- 172.21.15.40:0/4107708032 shutdown_connections 2023-06-22T10:54:54.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.940+0000 7f3e9e1ff700 1 --2- 172.21.15.40:0/4107708032 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f3e8406ace0 0x7f3e8406d190 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:54.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.940+0000 7f3e9e1ff700 1 --2- 172.21.15.40:0/4107708032 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f3e980d2130 0x7f3e98156550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:54.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.940+0000 7f3e9e1ff700 1 --2- 172.21.15.40:0/4107708032 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3e980b45d0 0x7f3e9815dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:54.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.940+0000 7f3e9e1ff700 1 --2- 172.21.15.40:0/4107708032 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e980cd6e0 0x7f3e98155530 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:54.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.940+0000 7f3e9e1ff700 1 -- 172.21.15.40:0/4107708032 >> 172.21.15.40:0/4107708032 conn(0x7f3e980cf5d0 msgr2=0x7f3e980b3e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:54.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.940+0000 7f3e9e1ff700 1 -- 172.21.15.40:0/4107708032 shutdown_connections 2023-06-22T10:54:54.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:54.940+0000 7f3e9e1ff700 1 -- 172.21.15.40:0/4107708032 wait complete. 2023-06-22T10:54:54.962 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-22T10:54:55.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.160+0000 7f94e45ff700 1 Processor -- start 2023-06-22T10:54:55.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.160+0000 7f94e45ff700 1 -- start start 2023-06-22T10:54:55.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.161+0000 7f94e45ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f94dc15c720 0x7f94dc0b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:55.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.161+0000 7f94e45ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f94dc0d2830 0x7f94dc0b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:55.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.161+0000 7f94e45ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94dc0b50a0 con 0x7f94dc0b4c60 2023-06-22T10:54:55.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.161+0000 7f94e45ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94dc160d60 con 0x7f94dc0d2830 2023-06-22T10:54:55.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.161+0000 7f94e45ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94dc0b2130 con 0x7f94dc15c720 2023-06-22T10:54:55.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.162+0000 7f94e1b9a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f94dc0d2830 0x7f94dc0b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:55.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.162+0000 7f94e2b9c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f94dc0b4c60 0x7f94dc06b4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:58098/0 (socket says 172.21.15.40:58098) 2023-06-22T10:54:55.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.162+0000 7f94e2b9c700 1 -- 172.21.15.40:0/4071856002 learned_addr learned my addr 172.21.15.40:0/4071856002 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:55.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.162+0000 7f94e239b700 1 --2- 172.21.15.40:0/4071856002 >> v2:172.21.15.45:3300/0 conn(0x7f94dc15c720 0x7f94dc0b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:55.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.162+0000 7f94e1399700 1 -- 172.21.15.40:0/4071856002 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 556428568 0 0) 0x7f94dc0b50a0 con 0x7f94dc0b4c60 2023-06-22T10:54:55.167 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.162+0000 7f94e1b9a700 1 -- 172.21.15.40:0/4071856002 >> v2:172.21.15.45:3300/0 conn(0x7f94dc15c720 msgr2=0x7f94dc0b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:55.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.162+0000 7f94e1b9a700 1 --2- 172.21.15.40:0/4071856002 >> v2:172.21.15.45:3300/0 conn(0x7f94dc15c720 0x7f94dc0b1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:55.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.162+0000 7f94e1b9a700 1 -- 172.21.15.40:0/4071856002 >> v1:172.21.15.40:6789/0 conn(0x7f94dc0b4c60 legacy=0x7f94dc06b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:55.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.162+0000 7f94e1b9a700 1 -- 172.21.15.40:0/4071856002 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94dc161180 con 0x7f94dc0d2830 2023-06-22T10:54:55.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.162+0000 7f94e1b9a700 1 --2- 172.21.15.40:0/4071856002 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94dc0d2830 0x7f94dc0b4720 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f94cc009840 tx=0x7f94cc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93cfcc848fbb4ef6 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:55.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.162+0000 7f94e1399700 1 -- 172.21.15.40:0/4071856002 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94cc011830 con 0x7f94dc0d2830 2023-06-22T10:54:55.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.163+0000 7f94e1399700 1 -- 172.21.15.40:0/4071856002 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94cc011990 con 0x7f94dc0d2830 2023-06-22T10:54:55.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.163+0000 7f94e1399700 1 -- 172.21.15.40:0/4071856002 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94cc011d20 con 0x7f94dc0d2830 2023-06-22T10:54:55.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.163+0000 7f94e45ff700 1 -- 172.21.15.40:0/4071856002 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94dc0d2830 msgr2=0x7f94dc0b4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:55.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.163+0000 7f94e45ff700 1 --2- 172.21.15.40:0/4071856002 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94dc0d2830 0x7f94dc0b4720 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f94cc009840 tx=0x7f94cc009b50 comp rx=0 tx=0).stop 2023-06-22T10:54:55.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.163+0000 7f94e45ff700 1 -- 172.21.15.40:0/4071856002 shutdown_connections 2023-06-22T10:54:55.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.163+0000 7f94e45ff700 1 --2- 172.21.15.40:0/4071856002 >> v2:172.21.15.45:3300/0 conn(0x7f94dc15c720 0x7f94dc0b1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:55.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.163+0000 7f94e45ff700 1 --2- 172.21.15.40:0/4071856002 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94dc0d2830 0x7f94dc0b4720 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:55.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.163+0000 7f94e45ff700 1 -- 172.21.15.40:0/4071856002 >> 172.21.15.40:0/4071856002 conn(0x7f94dc0cf720 msgr2=0x7f94dc0cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:55.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.163+0000 7f94e45ff700 1 -- 172.21.15.40:0/4071856002 shutdown_connections 2023-06-22T10:54:55.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.163+0000 7f94e45ff700 1 -- 172.21.15.40:0/4071856002 wait complete. 2023-06-22T10:54:55.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.165+0000 7f94e45ff700 1 Processor -- start 2023-06-22T10:54:55.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.165+0000 7f94e45ff700 1 -- start start 2023-06-22T10:54:55.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.166+0000 7f94e45ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94dc0b4c60 0x7f94dc0cc100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:55.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.166+0000 7f94e45ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94dc0d2830 0x7f94dc15f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:55.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.166+0000 7f94e45ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f94dc15c720 0x7f94dc0ab250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:55.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.166+0000 7f94e45ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94dc0a9710 con 0x7f94dc0b4c60 2023-06-22T10:54:55.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.166+0000 7f94e45ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94dc0a99b0 con 0x7f94dc0d2830 2023-06-22T10:54:55.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.166+0000 7f94e45ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94dc0cb900 con 0x7f94dc15c720 2023-06-22T10:54:55.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.166+0000 7f94e239b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94dc0b4c60 0x7f94dc0cc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:55.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.166+0000 7f94e239b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94dc0b4c60 0x7f94dc0cc100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46398/0 (socket says 172.21.15.40:46398) 2023-06-22T10:54:55.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.166+0000 7f94e239b700 1 -- 172.21.15.40:0/2219966830 learned_addr learned my addr 172.21.15.40:0/2219966830 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:55.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.167+0000 7f94e1b9a700 1 --2- 172.21.15.40:0/2219966830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94dc0d2830 0x7f94dc15f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:55.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.167+0000 7f94e2b9c700 1 --2- 172.21.15.40:0/2219966830 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f94dc15c720 0x7f94dc0ab250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:55.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.167+0000 7f94e239b700 1 -- 172.21.15.40:0/2219966830 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f94dc15c720 msgr2=0x7f94dc0ab250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:55.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.167+0000 7f94e239b700 1 --2- 172.21.15.40:0/2219966830 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f94dc15c720 0x7f94dc0ab250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:55.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.167+0000 7f94e239b700 1 -- 172.21.15.40:0/2219966830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94dc0d2830 msgr2=0x7f94dc15f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:55.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.167+0000 7f94e239b700 1 --2- 172.21.15.40:0/2219966830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94dc0d2830 0x7f94dc15f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:55.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.167+0000 7f94e239b700 1 -- 172.21.15.40:0/2219966830 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94cc0094a0 con 0x7f94dc0b4c60 2023-06-22T10:54:55.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.167+0000 7f94e2b9c700 1 --2- 172.21.15.40:0/2219966830 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f94dc15c720 0x7f94dc0ab250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-22T10:54:55.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.167+0000 7f94e239b700 1 --2- 172.21.15.40:0/2219966830 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94dc0b4c60 0x7f94dc0cc100 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f94d800e9b0 tx=0x7f94d800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:55.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.167+0000 7f94d2ffd700 1 -- 172.21.15.40:0/2219966830 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d8009710 con 0x7f94dc0b4c60 2023-06-22T10:54:55.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.167+0000 7f94d2ffd700 1 -- 172.21.15.40:0/2219966830 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d800c850 con 0x7f94dc0b4c60 2023-06-22T10:54:55.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.167+0000 7f94d2ffd700 1 -- 172.21.15.40:0/2219966830 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d800cbc0 con 0x7f94dc0b4c60 2023-06-22T10:54:55.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.167+0000 7f94e45ff700 1 -- 172.21.15.40:0/2219966830 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94dc0cbbe0 con 0x7f94dc0b4c60 2023-06-22T10:54:55.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.167+0000 7f94e45ff700 1 -- 172.21.15.40:0/2219966830 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94dc0cc640 con 0x7f94dc0b4c60 2023-06-22T10:54:55.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.168+0000 7f94e45ff700 1 -- 172.21.15.40:0/2219966830 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94dc0cbf50 con 0x7f94dc0b4c60 2023-06-22T10:54:55.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.169+0000 7f94d2ffd700 1 -- 172.21.15.40:0/2219966830 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f94d800cd20 con 0x7f94dc0b4c60 2023-06-22T10:54:55.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.170+0000 7f94d2ffd700 1 --2- 172.21.15.40:0/2219966830 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f94c006ace0 0x7f94c006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:55.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.170+0000 7f94d2ffd700 1 -- 172.21.15.40:0/2219966830 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f94d8089930 con 0x7f94dc0b4c60 2023-06-22T10:54:55.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.171+0000 7f94e1b9a700 1 --2- 172.21.15.40:0/2219966830 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f94c006ace0 0x7f94c006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:55.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.171+0000 7f94e1b9a700 1 --2- 172.21.15.40:0/2219966830 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f94c006ace0 0x7f94c006d190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f94dc0d2c70 tx=0x7f94cc01c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:55.178 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.175+0000 7f94d2ffd700 1 -- 172.21.15.40:0/2219966830 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f94d8058130 con 0x7f94dc0b4c60 2023-06-22T10:54:55.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.395+0000 7f94e45ff700 1 -- 172.21.15.40:0/2219966830 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f94dc160950 con 0x7f94dc0b4c60 2023-06-22T10:54:55.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.396+0000 7f94d2ffd700 1 -- 172.21.15.40:0/2219966830 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v30) v1 ==== 80+0+0 (secure 0 0 0) 0x7f94d8057cc0 con 0x7f94dc0b4c60 2023-06-22T10:54:55.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.398+0000 7f94e45ff700 1 -- 172.21.15.40:0/2219966830 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f94c006ace0 msgr2=0x7f94c006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:55.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.398+0000 7f94e45ff700 1 --2- 172.21.15.40:0/2219966830 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f94c006ace0 0x7f94c006d190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f94dc0d2c70 tx=0x7f94cc01c040 comp rx=0 tx=0).stop 2023-06-22T10:54:55.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.398+0000 7f94e45ff700 1 -- 172.21.15.40:0/2219966830 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94dc0b4c60 msgr2=0x7f94dc0cc100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:55.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.398+0000 7f94e45ff700 1 --2- 172.21.15.40:0/2219966830 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94dc0b4c60 0x7f94dc0cc100 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f94d800e9b0 tx=0x7f94d800ed70 comp rx=0 tx=0).stop 2023-06-22T10:54:55.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.398+0000 7f94e45ff700 1 -- 172.21.15.40:0/2219966830 shutdown_connections 2023-06-22T10:54:55.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.398+0000 7f94e45ff700 1 --2- 172.21.15.40:0/2219966830 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f94c006ace0 0x7f94c006d190 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:55.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.398+0000 7f94e45ff700 1 --2- 172.21.15.40:0/2219966830 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f94dc15c720 0x7f94dc0ab250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:55.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.398+0000 7f94e45ff700 1 --2- 172.21.15.40:0/2219966830 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94dc0b4c60 0x7f94dc0cc100 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:55.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.398+0000 7f94e45ff700 1 --2- 172.21.15.40:0/2219966830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94dc0d2830 0x7f94dc15f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:55.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.398+0000 7f94e45ff700 1 -- 172.21.15.40:0/2219966830 >> 172.21.15.40:0/2219966830 conn(0x7f94dc0cf720 msgr2=0x7f94dc0b4520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:55.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.398+0000 7f94e45ff700 1 -- 172.21.15.40:0/2219966830 shutdown_connections 2023-06-22T10:54:55.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.398+0000 7f94e45ff700 1 -- 172.21.15.40:0/2219966830 wait complete. 2023-06-22T10:54:55.407 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2023-06-22T10:54:55.419 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-06-22T10:54:55.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:55.420 DEBUG:teuthology.orchestra.run.smithi045:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-06-22T10:54:55.515 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-06-22T10:54:55.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:54:55.516 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-06-22T10:54:55.564 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-06-22T10:54:55.565 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-22T10:54:55.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.761+0000 7f6f1a9ff700 1 Processor -- start 2023-06-22T10:54:55.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.761+0000 7f6f1a9ff700 1 -- start start 2023-06-22T10:54:55.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.763+0000 7f6f1a9ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f6f140b4630 0x7f6f140cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:55.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.763+0000 7f6f1a9ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6f140cd200 0x7f6f140d1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:55.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.763+0000 7f6f1a9ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6f140b4a00 0x7f6f140b5a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:55.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.763+0000 7f6f1a9ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f140d1b60 con 0x7f6f140b4a00 2023-06-22T10:54:55.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.763+0000 7f6f1a9ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f140d2530 con 0x7f6f140cd200 2023-06-22T10:54:55.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.763+0000 7f6f1a9ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f140d1230 con 0x7f6f140b4630 2023-06-22T10:54:55.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.763+0000 7f6f18f9c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6f140b4a00 0x7f6f140b5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:55.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.763+0000 7f6f18f9c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6f140b4a00 0x7f6f140b5a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46412/0 (socket says 172.21.15.40:46412) 2023-06-22T10:54:55.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.763+0000 7f6f18f9c700 1 -- 172.21.15.40:0/2574602896 learned_addr learned my addr 172.21.15.40:0/2574602896 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:55.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.763+0000 7f6f13fff700 1 --2- 172.21.15.40:0/2574602896 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f6f140b4630 0x7f6f140cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:55.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.763+0000 7f6f137fe700 1 --2- 172.21.15.40:0/2574602896 >> v2:172.21.15.45:3300/0 conn(0x7f6f140cd200 0x7f6f140d1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:55.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.763+0000 7f6f18f9c700 1 -- 172.21.15.40:0/2574602896 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f6f140b4630 msgr2=0x7f6f140cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:55.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.763+0000 7f6f18f9c700 1 --2- 172.21.15.40:0/2574602896 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f6f140b4630 0x7f6f140cf050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:55.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.763+0000 7f6f18f9c700 1 -- 172.21.15.40:0/2574602896 >> v2:172.21.15.45:3300/0 conn(0x7f6f140cd200 msgr2=0x7f6f140d1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:55.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.763+0000 7f6f18f9c700 1 --2- 172.21.15.40:0/2574602896 >> v2:172.21.15.45:3300/0 conn(0x7f6f140cd200 0x7f6f140d1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:55.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.763+0000 7f6f18f9c700 1 -- 172.21.15.40:0/2574602896 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f140d1510 con 0x7f6f140b4a00 2023-06-22T10:54:55.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.764+0000 7f6f18f9c700 1 --2- 172.21.15.40:0/2574602896 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f140b4a00 0x7f6f140b5a00 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f6f1406c660 tx=0x7f6f0c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88d35cefb5a9c39f server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:55.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.764+0000 7f6f12ffd700 1 -- 172.21.15.40:0/2574602896 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c00e070 con 0x7f6f140b4a00 2023-06-22T10:54:55.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.764+0000 7f6f12ffd700 1 -- 172.21.15.40:0/2574602896 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f0c00b910 con 0x7f6f140b4a00 2023-06-22T10:54:55.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.764+0000 7f6f12ffd700 1 -- 172.21.15.40:0/2574602896 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c00bcc0 con 0x7f6f140b4a00 2023-06-22T10:54:55.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.764+0000 7f6f1a9ff700 1 -- 172.21.15.40:0/2574602896 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f140b4a00 msgr2=0x7f6f140b5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:55.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.764+0000 7f6f1a9ff700 1 --2- 172.21.15.40:0/2574602896 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f140b4a00 0x7f6f140b5a00 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f6f1406c660 tx=0x7f6f0c00b330 comp rx=0 tx=0).stop 2023-06-22T10:54:55.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.765+0000 7f6f1a9ff700 1 -- 172.21.15.40:0/2574602896 shutdown_connections 2023-06-22T10:54:55.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.765+0000 7f6f1a9ff700 1 --2- 172.21.15.40:0/2574602896 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f140b4a00 0x7f6f140b5a00 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:55.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.765+0000 7f6f1a9ff700 1 --2- 172.21.15.40:0/2574602896 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f6f140b4630 0x7f6f140cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:55.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.765+0000 7f6f1a9ff700 1 --2- 172.21.15.40:0/2574602896 >> v2:172.21.15.45:3300/0 conn(0x7f6f140cd200 0x7f6f140d1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:55.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.765+0000 7f6f1a9ff700 1 -- 172.21.15.40:0/2574602896 >> 172.21.15.40:0/2574602896 conn(0x7f6f140cf630 msgr2=0x7f6f140cfa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:55.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.765+0000 7f6f1a9ff700 1 -- 172.21.15.40:0/2574602896 shutdown_connections 2023-06-22T10:54:55.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.765+0000 7f6f1a9ff700 1 -- 172.21.15.40:0/2574602896 wait complete. 2023-06-22T10:54:55.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.767+0000 7f6f1a9ff700 1 Processor -- start 2023-06-22T10:54:55.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.767+0000 7f6f1a9ff700 1 -- start start 2023-06-22T10:54:55.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.769+0000 7f6f1a9ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f140b4630 0x7f6f140c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:55.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.769+0000 7f6f1a9ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f140b4a00 0x7f6f14150ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:55.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.769+0000 7f6f1a9ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f6f140cd200 0x7f6f140c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:55.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.769+0000 7f6f1a9ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f140b61d0 con 0x7f6f140b4a00 2023-06-22T10:54:55.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.769+0000 7f6f1a9ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f140c7c00 con 0x7f6f140b4630 2023-06-22T10:54:55.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.769+0000 7f6f1a9ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f140c7920 con 0x7f6f140cd200 2023-06-22T10:54:55.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.769+0000 7f6f137fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f140b4a00 0x7f6f14150ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:55.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.769+0000 7f6f137fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f140b4a00 0x7f6f14150ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46416/0 (socket says 172.21.15.40:46416) 2023-06-22T10:54:55.774 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.769+0000 7f6f137fe700 1 -- 172.21.15.40:0/2577608311 learned_addr learned my addr 172.21.15.40:0/2577608311 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:55.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.769+0000 7f6f13fff700 1 --2- 172.21.15.40:0/2577608311 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f140b4630 0x7f6f140c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:55.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.769+0000 7f6f18f9c700 1 --2- 172.21.15.40:0/2577608311 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f6f140cd200 0x7f6f140c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:55.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.769+0000 7f6f137fe700 1 -- 172.21.15.40:0/2577608311 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f6f140cd200 msgr2=0x7f6f140c86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:55.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.769+0000 7f6f137fe700 1 --2- 172.21.15.40:0/2577608311 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f6f140cd200 0x7f6f140c86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:55.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.769+0000 7f6f137fe700 1 -- 172.21.15.40:0/2577608311 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f140b4630 msgr2=0x7f6f140c70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:55.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.769+0000 7f6f137fe700 1 --2- 172.21.15.40:0/2577608311 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f140b4630 0x7f6f140c70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:55.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.769+0000 7f6f137fe700 1 -- 172.21.15.40:0/2577608311 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f0c009b30 con 0x7f6f140b4a00 2023-06-22T10:54:55.775 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.770+0000 7f6f137fe700 1 --2- 172.21.15.40:0/2577608311 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f140b4a00 0x7f6f14150ac0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f6f0800e9b0 tx=0x7f6f0800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:55.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.770+0000 7f6f10ff9700 1 -- 172.21.15.40:0/2577608311 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f08009710 con 0x7f6f140b4a00 2023-06-22T10:54:55.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.770+0000 7f6f10ff9700 1 -- 172.21.15.40:0/2577608311 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f0800ee50 con 0x7f6f140b4a00 2023-06-22T10:54:55.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.770+0000 7f6f1a9ff700 1 -- 172.21.15.40:0/2577608311 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f140b5b10 con 0x7f6f140b4a00 2023-06-22T10:54:55.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.770+0000 7f6f10ff9700 1 -- 172.21.15.40:0/2577608311 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f0800ca50 con 0x7f6f140b4a00 2023-06-22T10:54:55.776 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.770+0000 7f6f1a9ff700 1 -- 172.21.15.40:0/2577608311 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f140c7610 con 0x7f6f140b4a00 2023-06-22T10:54:55.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.771+0000 7f6f1a9ff700 1 -- 172.21.15.40:0/2577608311 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f140b6310 con 0x7f6f140b4a00 2023-06-22T10:54:55.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.772+0000 7f6f10ff9700 1 -- 172.21.15.40:0/2577608311 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6f0800cbb0 con 0x7f6f140b4a00 2023-06-22T10:54:55.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.773+0000 7f6f10ff9700 1 --2- 172.21.15.40:0/2577608311 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f6f0006ace0 0x7f6f0006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:55.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.773+0000 7f6f10ff9700 1 -- 172.21.15.40:0/2577608311 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6f080897b0 con 0x7f6f140b4a00 2023-06-22T10:54:55.777 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.773+0000 7f6f13fff700 1 --2- 172.21.15.40:0/2577608311 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f6f0006ace0 0x7f6f0006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:55.778 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.774+0000 7f6f13fff700 1 --2- 172.21.15.40:0/2577608311 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f6f0006ace0 0x7f6f0006d190 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6f140d11a0 tx=0x7f6f04009210 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:55.780 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:55.777+0000 7f6f10ff9700 1 -- 172.21.15.40:0/2577608311 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6f140b6310 con 0x7f6f140b4a00 2023-06-22T10:54:56.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.031+0000 7f6f1a9ff700 1 -- 172.21.15.40:0/2577608311 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6f140b6310 con 0x7f6f140b4a00 2023-06-22T10:54:56.035 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.032+0000 7f6f10ff9700 1 -- 172.21.15.40:0/2577608311 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4664 (secure 0 0 0) 0x7f6f140b6310 con 0x7f6f140b4a00 2023-06-22T10:54:56.036 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:54:56.036 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/627935577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":627935577},{"type":"v1","addr":"172.21.15.40:6835","nonce":627935577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3018871402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3018871402},{"type":"v1","addr":"172.21.15.40:6837","nonce":3018871402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/4036649607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":4036649607},{"type":"v1","addr":"172.21.15.45:6834","nonce":4036649607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-22T10:53:31.430326+0000","modified":"2023-06-22T10:53:59.666730+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4303},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4303":{"gid":4303,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/1579627519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":1579627519},{"type":"v1","addr":"172.21.15.45:6835","nonce":1579627519}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-22T10:54:56.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.034+0000 7f6f1a9ff700 1 -- 172.21.15.40:0/2577608311 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f6f0006ace0 msgr2=0x7f6f0006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:56.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.034+0000 7f6f1a9ff700 1 --2- 172.21.15.40:0/2577608311 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f6f0006ace0 0x7f6f0006d190 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6f140d11a0 tx=0x7f6f04009210 comp rx=0 tx=0).stop 2023-06-22T10:54:56.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.034+0000 7f6f1a9ff700 1 -- 172.21.15.40:0/2577608311 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f140b4a00 msgr2=0x7f6f14150ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:56.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.034+0000 7f6f1a9ff700 1 --2- 172.21.15.40:0/2577608311 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f140b4a00 0x7f6f14150ac0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f6f0800e9b0 tx=0x7f6f0800ecc0 comp rx=0 tx=0).stop 2023-06-22T10:54:56.038 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.035+0000 7f6f1a9ff700 1 -- 172.21.15.40:0/2577608311 shutdown_connections 2023-06-22T10:54:56.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.035+0000 7f6f1a9ff700 1 --2- 172.21.15.40:0/2577608311 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f6f0006ace0 0x7f6f0006d190 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:56.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.035+0000 7f6f1a9ff700 1 --2- 172.21.15.40:0/2577608311 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f6f140cd200 0x7f6f140c86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:56.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.035+0000 7f6f1a9ff700 1 --2- 172.21.15.40:0/2577608311 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f140b4630 0x7f6f140c70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:56.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.035+0000 7f6f1a9ff700 1 --2- 172.21.15.40:0/2577608311 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f140b4a00 0x7f6f14150ac0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:56.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.035+0000 7f6f1a9ff700 1 -- 172.21.15.40:0/2577608311 >> 172.21.15.40:0/2577608311 conn(0x7f6f140cf630 msgr2=0x7f6f140b25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:56.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.035+0000 7f6f1a9ff700 1 -- 172.21.15.40:0/2577608311 shutdown_connections 2023-06-22T10:54:56.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.035+0000 7f6f1a9ff700 1 -- 172.21.15.40:0/2577608311 wait complete. 2023-06-22T10:54:56.040 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 9 2023-06-22T10:54:56.056 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-22T10:54:56.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.253+0000 7f7f7d9ff700 1 Processor -- start 2023-06-22T10:54:56.257 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.254+0000 7f7f7d9ff700 1 -- start start 2023-06-22T10:54:56.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.255+0000 7f7f7d9ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7f780cd3b0 0x7f7f78160a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:56.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.255+0000 7f7f7d9ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7f780cd780 0x7f7f780d0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:56.258 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.255+0000 7f7f7d9ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f7f7815d2f0 0x7f7f7815ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:56.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.255+0000 7f7f7d9ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f7815ce60 con 0x7f7f780cd780 2023-06-22T10:54:56.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.255+0000 7f7f7d9ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f780ce6a0 con 0x7f7f780cd3b0 2023-06-22T10:54:56.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.255+0000 7f7f7d9ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f780ce940 con 0x7f7f7815d2f0 2023-06-22T10:54:56.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.255+0000 7f7f767fc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7f780cd780 0x7f7f780d0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:56.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.255+0000 7f7f767fc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7f780cd780 0x7f7f780d0210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46432/0 (socket says 172.21.15.40:46432) 2023-06-22T10:54:56.259 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.255+0000 7f7f767fc700 1 -- 172.21.15.40:0/1727168592 learned_addr learned my addr 172.21.15.40:0/1727168592 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:56.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.255+0000 7f7f777fe700 1 --2- 172.21.15.40:0/1727168592 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f7f7815d2f0 0x7f7f7815ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:56.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.255+0000 7f7f76ffd700 1 --2- 172.21.15.40:0/1727168592 >> v2:172.21.15.45:3300/0 conn(0x7f7f780cd3b0 0x7f7f78160a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:56.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.256+0000 7f7f767fc700 1 -- 172.21.15.40:0/1727168592 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f7f7815d2f0 msgr2=0x7f7f7815ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:56.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.256+0000 7f7f767fc700 1 --2- 172.21.15.40:0/1727168592 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f7f7815d2f0 0x7f7f7815ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:56.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.256+0000 7f7f767fc700 1 -- 172.21.15.40:0/1727168592 >> v2:172.21.15.45:3300/0 conn(0x7f7f780cd3b0 msgr2=0x7f7f78160a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:56.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.256+0000 7f7f767fc700 1 --2- 172.21.15.40:0/1727168592 >> v2:172.21.15.45:3300/0 conn(0x7f7f780cd3b0 0x7f7f78160a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:56.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.256+0000 7f7f767fc700 1 -- 172.21.15.40:0/1727168592 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f7815caf0 con 0x7f7f780cd780 2023-06-22T10:54:56.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.256+0000 7f7f767fc700 1 --2- 172.21.15.40:0/1727168592 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f780cd780 0x7f7f780d0210 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f7f7806af10 tx=0x7f7f6c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6caa86d3ac4aeb58 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:56.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.256+0000 7f7f75ffb700 1 -- 172.21.15.40:0/1727168592 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c00b870 con 0x7f7f780cd780 2023-06-22T10:54:56.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.256+0000 7f7f75ffb700 1 -- 172.21.15.40:0/1727168592 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f6c00b9d0 con 0x7f7f780cd780 2023-06-22T10:54:56.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.256+0000 7f7f75ffb700 1 -- 172.21.15.40:0/1727168592 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c00bd60 con 0x7f7f780cd780 2023-06-22T10:54:56.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.257+0000 7f7f7d9ff700 1 -- 172.21.15.40:0/1727168592 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f780cd780 msgr2=0x7f7f780d0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:56.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.257+0000 7f7f7d9ff700 1 --2- 172.21.15.40:0/1727168592 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f780cd780 0x7f7f780d0210 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f7f7806af10 tx=0x7f7f6c009bd0 comp rx=0 tx=0).stop 2023-06-22T10:54:56.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.257+0000 7f7f7d9ff700 1 -- 172.21.15.40:0/1727168592 shutdown_connections 2023-06-22T10:54:56.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.257+0000 7f7f7d9ff700 1 --2- 172.21.15.40:0/1727168592 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f7f7815d2f0 0x7f7f7815ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:56.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.257+0000 7f7f7d9ff700 1 --2- 172.21.15.40:0/1727168592 >> v2:172.21.15.45:3300/0 conn(0x7f7f780cd3b0 0x7f7f78160a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:56.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.257+0000 7f7f7d9ff700 1 --2- 172.21.15.40:0/1727168592 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f780cd780 0x7f7f780d0210 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:56.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.257+0000 7f7f7d9ff700 1 -- 172.21.15.40:0/1727168592 >> 172.21.15.40:0/1727168592 conn(0x7f7f7806e630 msgr2=0x7f7f7806ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:56.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.257+0000 7f7f7d9ff700 1 -- 172.21.15.40:0/1727168592 shutdown_connections 2023-06-22T10:54:56.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.257+0000 7f7f7d9ff700 1 -- 172.21.15.40:0/1727168592 wait complete. 2023-06-22T10:54:56.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.259+0000 7f7f7d9ff700 1 Processor -- start 2023-06-22T10:54:56.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.259+0000 7f7f7d9ff700 1 -- start start 2023-06-22T10:54:56.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.261+0000 7f7f7d9ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f780cd3b0 0x7f7f78156020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:56.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.261+0000 7f7f7d9ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f7f780cd780 0x7f7f780c9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:56.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.261+0000 7f7f7d9ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f7815d2f0 0x7f7f780ca180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:56.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.261+0000 7f7f7d9ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f781e5df0 con 0x7f7f7815d2f0 2023-06-22T10:54:56.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.261+0000 7f7f7d9ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f781e6090 con 0x7f7f780cd3b0 2023-06-22T10:54:56.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.261+0000 7f7f7d9ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f781e6370 con 0x7f7f780cd780 2023-06-22T10:54:56.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.261+0000 7f7f777fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f7815d2f0 0x7f7f780ca180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:56.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.261+0000 7f7f777fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f7815d2f0 0x7f7f780ca180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46446/0 (socket says 172.21.15.40:46446) 2023-06-22T10:54:56.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.261+0000 7f7f777fe700 1 -- 172.21.15.40:0/282701935 learned_addr learned my addr 172.21.15.40:0/282701935 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:56.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.261+0000 7f7f76ffd700 1 --2- 172.21.15.40:0/282701935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f780cd3b0 0x7f7f78156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:56.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.261+0000 7f7f767fc700 1 --2- 172.21.15.40:0/282701935 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f7f780cd780 0x7f7f780c9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:56.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.261+0000 7f7f777fe700 1 -- 172.21.15.40:0/282701935 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f7f780cd780 msgr2=0x7f7f780c9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:56.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.261+0000 7f7f777fe700 1 --2- 172.21.15.40:0/282701935 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f7f780cd780 0x7f7f780c9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:56.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.261+0000 7f7f777fe700 1 -- 172.21.15.40:0/282701935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f780cd3b0 msgr2=0x7f7f78156020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:56.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.261+0000 7f7f777fe700 1 --2- 172.21.15.40:0/282701935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f780cd3b0 0x7f7f78156020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:56.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.261+0000 7f7f777fe700 1 -- 172.21.15.40:0/282701935 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f6c009550 con 0x7f7f7815d2f0 2023-06-22T10:54:56.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.261+0000 7f7f767fc700 1 --2- 172.21.15.40:0/282701935 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f7f780cd780 0x7f7f780c9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:54:56.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.262+0000 7f7f777fe700 1 --2- 172.21.15.40:0/282701935 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f7815d2f0 0x7f7f780ca180 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7f70007e40 tx=0x7f7f7000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:56.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.262+0000 7f7f5ffff700 1 -- 172.21.15.40:0/282701935 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7000ede0 con 0x7f7f7815d2f0 2023-06-22T10:54:56.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.262+0000 7f7f5ffff700 1 -- 172.21.15.40:0/282701935 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f70014420 con 0x7f7f7815d2f0 2023-06-22T10:54:56.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.262+0000 7f7f7d9ff700 1 -- 172.21.15.40:0/282701935 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f781e6650 con 0x7f7f7815d2f0 2023-06-22T10:54:56.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.262+0000 7f7f5ffff700 1 -- 172.21.15.40:0/282701935 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f700147d0 con 0x7f7f7815d2f0 2023-06-22T10:54:56.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.262+0000 7f7f7d9ff700 1 -- 172.21.15.40:0/282701935 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f780b4750 con 0x7f7f7815d2f0 2023-06-22T10:54:56.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.263+0000 7f7f7d9ff700 1 -- 172.21.15.40:0/282701935 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f781e6840 con 0x7f7f7815d2f0 2023-06-22T10:54:56.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.264+0000 7f7f5ffff700 1 -- 172.21.15.40:0/282701935 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7f70014930 con 0x7f7f7815d2f0 2023-06-22T10:54:56.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.265+0000 7f7f5ffff700 1 --2- 172.21.15.40:0/282701935 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f7f6406ace0 0x7f7f6406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:56.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.265+0000 7f7f5ffff700 1 -- 172.21.15.40:0/282701935 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7f70089f40 con 0x7f7f7815d2f0 2023-06-22T10:54:56.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.265+0000 7f7f76ffd700 1 --2- 172.21.15.40:0/282701935 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f7f6406ace0 0x7f7f6406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:56.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.266+0000 7f7f76ffd700 1 --2- 172.21.15.40:0/282701935 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f7f6406ace0 0x7f7f6406d190 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7f780cab50 tx=0x7f7f68008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:56.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.269+0000 7f7f5ffff700 1 -- 172.21.15.40:0/282701935 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7f70058740 con 0x7f7f7815d2f0 2023-06-22T10:54:56.479 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.476+0000 7f7f7d9ff700 1 -- 172.21.15.40:0/282701935 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7f78067580 con 0x7f7f7815d2f0 2023-06-22T10:54:56.480 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.477+0000 7f7f5ffff700 1 -- 172.21.15.40:0/282701935 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20132 (secure 0 0 0) 0x7f7f700582d0 con 0x7f7f7815d2f0 2023-06-22T10:54:56.481 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:54:56.481 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":30,"fsid":"475560bc-1a7c-4a75-b3b6-6fc6b20bdc52","created":"2023-06-22T10:53:03.784568+0000","modified":"2023-06-22T10:54:12.717204+0000","last_up_change":"2023-06-22T10:53:17.830348+0000","last_in_change":"2023-06-22T10:53:07.329974+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-22T10:53:17.182228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-22T10:53:23.874432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-22T10:53:29.812963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-22T10:53:30.404021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-22T10:53:33.982289+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"918db6b4-053a-46ba-976d-6e1a0104017f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6809","nonce":2400162888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6811","nonce":2400162888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6815","nonce":2400162888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6813","nonce":2400162888}]},"public_addr":"172.21.15.40:6809/2400162888","cluster_addr":"172.21.15.40:6811/2400162888","heartbeat_back_addr":"172.21.15.40:6815/2400162888","heartbeat_front_addr":"172.21.15.40:6813/2400162888","state":["exists","up"]},{"osd":1,"uuid":"0c146e2b-1725-4dae-9b5c-38795943b9d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6801","nonce":230885800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6803","nonce":230885800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6807","nonce":230885800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6805","nonce":230885800}]},"public_addr":"172.21.15.40:6801/230885800","cluster_addr":"172.21.15.40:6803/230885800","heartbeat_back_addr":"172.21.15.40:6807/230885800","heartbeat_front_addr":"172.21.15.40:6805/230885800","state":["exists","up"]},{"osd":2,"uuid":"0b3727fd-f281-46d5-a675-86c8c5ab269e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6817","nonce":2681404929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6819","nonce":2681404929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6823","nonce":2681404929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6821","nonce":2681404929}]},"public_addr":"172.21.15.40:6817/2681404929","cluster_addr":"172.21.15.40:6819/2681404929","heartbeat_back_addr":"172.21.15.40:6823/2681404929","heartbeat_front_addr":"172.21.15.40:6821/2681404929","state":["exists","up"]},{"osd":3,"uuid":"2969c698-7039-4bbb-beda-f756f7a368a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6825","nonce":111110981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6827","nonce":111110981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6831","nonce":111110981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6829","nonce":111110981}]},"public_addr":"172.21.15.40:6825/111110981","cluster_addr":"172.21.15.40:6827/111110981","heartbeat_back_addr":"172.21.15.40:6831/111110981","heartbeat_front_addr":"172.21.15.40:6829/111110981","state":["exists","up"]},{"osd":4,"uuid":"3bb1d9c8-8e42-4a6b-998d-04834f34be5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6801","nonce":3625455711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6803","nonce":3625455711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6807","nonce":3625455711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6805","nonce":3625455711}]},"public_addr":"172.21.15.45:6801/3625455711","cluster_addr":"172.21.15.45:6803/3625455711","heartbeat_back_addr":"172.21.15.45:6807/3625455711","heartbeat_front_addr":"172.21.15.45:6805/3625455711","state":["exists","up"]},{"osd":5,"uuid":"f9854ee4-302c-41be-977b-bedda090a3d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6817","nonce":3354411217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6819","nonce":3354411217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6823","nonce":3354411217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6821","nonce":3354411217}]},"public_addr":"172.21.15.45:6817/3354411217","cluster_addr":"172.21.15.45:6819/3354411217","heartbeat_back_addr":"172.21.15.45:6823/3354411217","heartbeat_front_addr":"172.21.15.45:6821/3354411217","state":["exists","up"]},{"osd":6,"uuid":"bbdb1989-f6ac-4954-9b85-b8b540d683c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6809","nonce":320111074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6811","nonce":320111074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6815","nonce":320111074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6813","nonce":320111074}]},"public_addr":"172.21.15.45:6809/320111074","cluster_addr":"172.21.15.45:6811/320111074","heartbeat_back_addr":"172.21.15.45:6815/320111074","heartbeat_front_addr":"172.21.15.45:6813/320111074","state":["exists","up"]},{"osd":7,"uuid":"823d44e3-58f1-4d1d-8263-a4e4a69d4327","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6825","nonce":643617680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6827","nonce":643617680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6831","nonce":643617680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6829","nonce":643617680}]},"public_addr":"172.21.15.45:6825/643617680","cluster_addr":"172.21.15.45:6827/643617680","heartbeat_back_addr":"172.21.15.45:6831/643617680","heartbeat_front_addr":"172.21.15.45:6829/643617680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.731262+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.873226+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.898936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.666578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.645990+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.953699+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.642823+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.693395+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1b","mappings":[{"from":3,"to":2}]},{"pgid":"4.2a","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-22T10:54:56.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.480+0000 7f7f7d9ff700 1 -- 172.21.15.40:0/282701935 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f7f6406ace0 msgr2=0x7f7f6406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:56.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.480+0000 7f7f7d9ff700 1 --2- 172.21.15.40:0/282701935 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f7f6406ace0 0x7f7f6406d190 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7f780cab50 tx=0x7f7f68008040 comp rx=0 tx=0).stop 2023-06-22T10:54:56.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.480+0000 7f7f7d9ff700 1 -- 172.21.15.40:0/282701935 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f7815d2f0 msgr2=0x7f7f780ca180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:56.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.480+0000 7f7f7d9ff700 1 --2- 172.21.15.40:0/282701935 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f7815d2f0 0x7f7f780ca180 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7f70007e40 tx=0x7f7f7000e3c0 comp rx=0 tx=0).stop 2023-06-22T10:54:56.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.480+0000 7f7f7d9ff700 1 -- 172.21.15.40:0/282701935 shutdown_connections 2023-06-22T10:54:56.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.480+0000 7f7f7d9ff700 1 --2- 172.21.15.40:0/282701935 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f7f6406ace0 0x7f7f6406d190 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:56.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.480+0000 7f7f7d9ff700 1 --2- 172.21.15.40:0/282701935 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7f7815d2f0 0x7f7f780ca180 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:56.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.480+0000 7f7f7d9ff700 1 --2- 172.21.15.40:0/282701935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f780cd3b0 0x7f7f78156020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:56.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.480+0000 7f7f7d9ff700 1 --2- 172.21.15.40:0/282701935 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f7f780cd780 0x7f7f780c9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:56.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.480+0000 7f7f7d9ff700 1 -- 172.21.15.40:0/282701935 >> 172.21.15.40:0/282701935 conn(0x7f7f7806e630 msgr2=0x7f7f7815ecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:56.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.480+0000 7f7f7d9ff700 1 -- 172.21.15.40:0/282701935 shutdown_connections 2023-06-22T10:54:56.485 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.480+0000 7f7f7d9ff700 1 -- 172.21.15.40:0/282701935 wait complete. 2023-06-22T10:54:56.502 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-22T10:53:17.182228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-22T10:53:23.874432+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-22T10:53:29.812963+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-22T10:53:30.404021+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-22T10:53:33.982289+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-22T10:54:56.503 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-22T10:54:56.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.703+0000 7f0f825ff700 1 Processor -- start 2023-06-22T10:54:56.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.703+0000 7f0f825ff700 1 -- start start 2023-06-22T10:54:56.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.704+0000 7f0f825ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0f7c0b45d0 0x7f0f7c0b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:56.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.704+0000 7f0f825ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0f7c0d2130 0x7f0f7c0cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:56.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.704+0000 7f0f825ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f0f7c0cd6e0 0x7f0f7c0b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:56.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.704+0000 7f0f825ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f7c0d17f0 con 0x7f0f7c0b45d0 2023-06-22T10:54:56.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.704+0000 7f0f825ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f7c0d1be0 con 0x7f0f7c0d2130 2023-06-22T10:54:56.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.704+0000 7f0f825ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7c0d1360 con 0x7f0f7c0cd6e0 2023-06-22T10:54:56.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.705+0000 7f0f7bfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0f7c0b45d0 0x7f0f7c0b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:56.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.705+0000 7f0f7bfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0f7c0b45d0 0x7f0f7c0b49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46462/0 (socket says 172.21.15.40:46462) 2023-06-22T10:54:56.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.705+0000 7f0f7bfff700 1 -- 172.21.15.40:0/4122993209 learned_addr learned my addr 172.21.15.40:0/4122993209 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:56.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.705+0000 7f0f7b7fe700 1 --2- 172.21.15.40:0/4122993209 >> v2:172.21.15.45:3300/0 conn(0x7f0f7c0d2130 0x7f0f7c0cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:56.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.705+0000 7f0f80b9c700 1 --2- 172.21.15.40:0/4122993209 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f0f7c0cd6e0 0x7f0f7c0b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:56.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.705+0000 7f0f7bfff700 1 -- 172.21.15.40:0/4122993209 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f0f7c0cd6e0 msgr2=0x7f0f7c0b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:56.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.705+0000 7f0f7bfff700 1 --2- 172.21.15.40:0/4122993209 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f0f7c0cd6e0 0x7f0f7c0b59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:56.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.705+0000 7f0f7bfff700 1 -- 172.21.15.40:0/4122993209 >> v2:172.21.15.45:3300/0 conn(0x7f0f7c0d2130 msgr2=0x7f0f7c0cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:56.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.705+0000 7f0f7bfff700 1 --2- 172.21.15.40:0/4122993209 >> v2:172.21.15.45:3300/0 conn(0x7f0f7c0d2130 0x7f0f7c0cd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:56.710 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.705+0000 7f0f7bfff700 1 -- 172.21.15.40:0/4122993209 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f7c0b4ee0 con 0x7f0f7c0b45d0 2023-06-22T10:54:56.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.705+0000 7f0f80b9c700 1 --2- 172.21.15.40:0/4122993209 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f0f7c0cd6e0 0x7f0f7c0b59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:54:56.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.705+0000 7f0f7b7fe700 1 --2- 172.21.15.40:0/4122993209 >> v2:172.21.15.45:3300/0 conn(0x7f0f7c0d2130 0x7f0f7c0cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:54:56.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.705+0000 7f0f7bfff700 1 --2- 172.21.15.40:0/4122993209 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f7c0b45d0 0x7f0f7c0b49a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c0668c0 tx=0x7f0f6c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=610d079238a591ff server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:56.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.706+0000 7f0f7affd700 1 -- 172.21.15.40:0/4122993209 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f6c00b870 con 0x7f0f7c0b45d0 2023-06-22T10:54:56.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.706+0000 7f0f7affd700 1 -- 172.21.15.40:0/4122993209 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f6c00b9d0 con 0x7f0f7c0b45d0 2023-06-22T10:54:56.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.706+0000 7f0f7affd700 1 -- 172.21.15.40:0/4122993209 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f6c00bd60 con 0x7f0f7c0b45d0 2023-06-22T10:54:56.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.706+0000 7f0f825ff700 1 -- 172.21.15.40:0/4122993209 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f7c0b45d0 msgr2=0x7f0f7c0b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:56.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.706+0000 7f0f825ff700 1 --2- 172.21.15.40:0/4122993209 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f7c0b45d0 0x7f0f7c0b49a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c0668c0 tx=0x7f0f6c009bd0 comp rx=0 tx=0).stop 2023-06-22T10:54:56.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.706+0000 7f0f825ff700 1 -- 172.21.15.40:0/4122993209 shutdown_connections 2023-06-22T10:54:56.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.706+0000 7f0f825ff700 1 --2- 172.21.15.40:0/4122993209 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f0f7c0cd6e0 0x7f0f7c0b59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:56.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.706+0000 7f0f825ff700 1 --2- 172.21.15.40:0/4122993209 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f7c0b45d0 0x7f0f7c0b49a0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:56.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.706+0000 7f0f825ff700 1 --2- 172.21.15.40:0/4122993209 >> v2:172.21.15.45:3300/0 conn(0x7f0f7c0d2130 0x7f0f7c0cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:56.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.706+0000 7f0f825ff700 1 -- 172.21.15.40:0/4122993209 >> 172.21.15.40:0/4122993209 conn(0x7f0f7c0cf5d0 msgr2=0x7f0f7c0cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:56.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.706+0000 7f0f825ff700 1 -- 172.21.15.40:0/4122993209 shutdown_connections 2023-06-22T10:54:56.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.706+0000 7f0f825ff700 1 -- 172.21.15.40:0/4122993209 wait complete. 2023-06-22T10:54:56.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.708+0000 7f0f825ff700 1 Processor -- start 2023-06-22T10:54:56.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.708+0000 7f0f825ff700 1 -- start start 2023-06-22T10:54:56.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.709+0000 7f0f825ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f7c0b45d0 0x7f0f7c0cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:56.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.709+0000 7f0f825ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f0f7c0cd6e0 0x7f0f7c156020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:56.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.709+0000 7f0f825ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f7c0d2130 0x7f0f7c15e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:56.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.709+0000 7f0f825ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7c1f1d40 con 0x7f0f7c0d2130 2023-06-22T10:54:56.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.709+0000 7f0f825ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7c1f5820 con 0x7f0f7c0b45d0 2023-06-22T10:54:56.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.709+0000 7f0f825ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7c1f5b00 con 0x7f0f7c0cd6e0 2023-06-22T10:54:56.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.709+0000 7f0f80b9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f7c0d2130 0x7f0f7c15e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:56.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.710+0000 7f0f80b9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f7c0d2130 0x7f0f7c15e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46472/0 (socket says 172.21.15.40:46472) 2023-06-22T10:54:56.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.710+0000 7f0f80b9c700 1 -- 172.21.15.40:0/58229245 learned_addr learned my addr 172.21.15.40:0/58229245 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:56.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.710+0000 7f0f7bfff700 1 --2- 172.21.15.40:0/58229245 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f7c0b45d0 0x7f0f7c0cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:56.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.710+0000 7f0f7b7fe700 1 --2- 172.21.15.40:0/58229245 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f0f7c0cd6e0 0x7f0f7c156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:56.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.710+0000 7f0f80b9c700 1 -- 172.21.15.40:0/58229245 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f0f7c0cd6e0 msgr2=0x7f0f7c156020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:56.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.710+0000 7f0f80b9c700 1 --2- 172.21.15.40:0/58229245 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f0f7c0cd6e0 0x7f0f7c156020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:56.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.710+0000 7f0f80b9c700 1 -- 172.21.15.40:0/58229245 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f7c0b45d0 msgr2=0x7f0f7c0cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:56.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.710+0000 7f0f80b9c700 1 --2- 172.21.15.40:0/58229245 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f7c0b45d0 0x7f0f7c0cafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:56.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.710+0000 7f0f80b9c700 1 -- 172.21.15.40:0/58229245 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f6c009550 con 0x7f0f7c0d2130 2023-06-22T10:54:56.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.710+0000 7f0f7b7fe700 1 --2- 172.21.15.40:0/58229245 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f0f7c0cd6e0 0x7f0f7c156020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:54:56.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.710+0000 7f0f80b9c700 1 --2- 172.21.15.40:0/58229245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f7c0d2130 0x7f0f7c15e060 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0f74007e10 tx=0x7f0f7400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:56.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.710+0000 7f0f78ff9700 1 -- 172.21.15.40:0/58229245 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7400ddd0 con 0x7f0f7c0d2130 2023-06-22T10:54:56.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.710+0000 7f0f78ff9700 1 -- 172.21.15.40:0/58229245 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f7400f040 con 0x7f0f7c0d2130 2023-06-22T10:54:56.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.710+0000 7f0f78ff9700 1 -- 172.21.15.40:0/58229245 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f74003c60 con 0x7f0f7c0d2130 2023-06-22T10:54:56.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.711+0000 7f0f825ff700 1 -- 172.21.15.40:0/58229245 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f7c1f5de0 con 0x7f0f7c0d2130 2023-06-22T10:54:56.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.711+0000 7f0f825ff700 1 -- 172.21.15.40:0/58229245 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f7c156560 con 0x7f0f7c0d2130 2023-06-22T10:54:56.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.712+0000 7f0f825ff700 1 -- 172.21.15.40:0/58229245 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f7c072bf0 con 0x7f0f7c0d2130 2023-06-22T10:54:56.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.713+0000 7f0f78ff9700 1 -- 172.21.15.40:0/58229245 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0f74004030 con 0x7f0f7c0d2130 2023-06-22T10:54:56.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.714+0000 7f0f78ff9700 1 --2- 172.21.15.40:0/58229245 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f0f6806ace0 0x7f0f6806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:56.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.714+0000 7f0f78ff9700 1 -- 172.21.15.40:0/58229245 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0f74089910 con 0x7f0f7c0d2130 2023-06-22T10:54:56.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.714+0000 7f0f7bfff700 1 --2- 172.21.15.40:0/58229245 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f0f6806ace0 0x7f0f6806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:56.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.715+0000 7f0f7bfff700 1 --2- 172.21.15.40:0/58229245 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f0f6806ace0 0x7f0f6806d190 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c014040 tx=0x7f0f6c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:56.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.719+0000 7f0f78ff9700 1 -- 172.21.15.40:0/58229245 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0f740545f0 con 0x7f0f7c0d2130 2023-06-22T10:54:56.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.925+0000 7f0f825ff700 1 -- 172.21.15.40:0/58229245 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0f7c0cdb00 con 0x7f0f7c0d2130 2023-06-22T10:54:56.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.926+0000 7f0f78ff9700 1 -- 172.21.15.40:0/58229245 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0f74057c10 con 0x7f0f7c0d2130 2023-06-22T10:54:56.929 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-06-22T10:54:56.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.928+0000 7f0f825ff700 1 -- 172.21.15.40:0/58229245 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f0f6806ace0 msgr2=0x7f0f6806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:56.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.928+0000 7f0f825ff700 1 --2- 172.21.15.40:0/58229245 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f0f6806ace0 0x7f0f6806d190 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c014040 tx=0x7f0f6c008030 comp rx=0 tx=0).stop 2023-06-22T10:54:56.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.928+0000 7f0f825ff700 1 -- 172.21.15.40:0/58229245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f7c0d2130 msgr2=0x7f0f7c15e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:56.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.928+0000 7f0f825ff700 1 --2- 172.21.15.40:0/58229245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f7c0d2130 0x7f0f7c15e060 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0f74007e10 tx=0x7f0f7400d3b0 comp rx=0 tx=0).stop 2023-06-22T10:54:56.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.928+0000 7f0f825ff700 1 -- 172.21.15.40:0/58229245 shutdown_connections 2023-06-22T10:54:56.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.928+0000 7f0f825ff700 1 --2- 172.21.15.40:0/58229245 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f0f6806ace0 0x7f0f6806d190 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:56.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.928+0000 7f0f825ff700 1 --2- 172.21.15.40:0/58229245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f7c0d2130 0x7f0f7c15e060 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:56.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.928+0000 7f0f825ff700 1 --2- 172.21.15.40:0/58229245 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f7c0b45d0 0x7f0f7c0cafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:56.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.928+0000 7f0f825ff700 1 --2- 172.21.15.40:0/58229245 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f0f7c0cd6e0 0x7f0f7c156020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:56.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.928+0000 7f0f825ff700 1 -- 172.21.15.40:0/58229245 >> 172.21.15.40:0/58229245 conn(0x7f0f7c0cf5d0 msgr2=0x7f0f7c15aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:56.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.928+0000 7f0f825ff700 1 -- 172.21.15.40:0/58229245 shutdown_connections 2023-06-22T10:54:56.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:56.928+0000 7f0f825ff700 1 -- 172.21.15.40:0/58229245 wait complete. 2023-06-22T10:54:56.949 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-22T10:54:57.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.150+0000 7f0d15dff700 1 Processor -- start 2023-06-22T10:54:57.153 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.150+0000 7f0d15dff700 1 -- start start 2023-06-22T10:54:57.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.151+0000 7f0d15dff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f0d100b45d0 0x7f0d100b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:57.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.151+0000 7f0d15dff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0d100d2130 0x7f0d100cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:57.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.151+0000 7f0d15dff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d100d1be0 con 0x7f0d100cd6e0 2023-06-22T10:54:57.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.151+0000 7f0d15dff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d100d17f0 con 0x7f0d100d2130 2023-06-22T10:54:57.155 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.151+0000 7f0d15dff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d100d1360 con 0x7f0d100b45d0 2023-06-22T10:54:57.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.152+0000 7f0d0f7fe700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f0d100b45d0 0x7f0d100b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:57.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.152+0000 7f0d0effd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0d100d2130 0x7f0d100cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:57.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.152+0000 7f0d0ffff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f0d100cd6e0 0x7f0d100b59a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.40:46678/0 (socket says 172.21.15.40:46678) 2023-06-22T10:54:57.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.152+0000 7f0d0f7fe700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f0d100b45d0 0x7f0d100b49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3301/0 says I am v2:172.21.15.40:50228/0 (socket says 172.21.15.40:50228) 2023-06-22T10:54:57.156 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.152+0000 7f0d0ffff700 1 -- 172.21.15.40:0/3308618560 learned_addr learned my addr 172.21.15.40:0/3308618560 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:57.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.153+0000 7f0d0f7fe700 1 -- 172.21.15.40:0/3308618560 >> v2:172.21.15.45:3300/0 conn(0x7f0d100d2130 msgr2=0x7f0d100cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:57.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.153+0000 7f0d0e7fc700 1 -- 172.21.15.40:0/3308618560 <== mon.1 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 590254664 0 0) 0x7f0d100d1be0 con 0x7f0d100cd6e0 2023-06-22T10:54:57.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.153+0000 7f0d0f7fe700 1 --2- 172.21.15.40:0/3308618560 >> v2:172.21.15.45:3300/0 conn(0x7f0d100d2130 0x7f0d100cd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:57.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.153+0000 7f0d0f7fe700 1 -- 172.21.15.40:0/3308618560 >> v1:172.21.15.45:6789/0 conn(0x7f0d100cd6e0 legacy=0x7f0d100b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:57.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.153+0000 7f0d0f7fe700 1 -- 172.21.15.40:0/3308618560 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d100b4ee0 con 0x7f0d100b45d0 2023-06-22T10:54:57.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.153+0000 7f0d0f7fe700 1 --2- 172.21.15.40:0/3308618560 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f0d100b45d0 0x7f0d100b49a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0d00009840 tx=0x7f0d00009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a961cf2c034c21a7 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:57.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.153+0000 7f0d0e7fc700 1 -- 172.21.15.40:0/3308618560 <== mon.2 v2:172.21.15.45:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d00011830 con 0x7f0d100b45d0 2023-06-22T10:54:57.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.153+0000 7f0d0e7fc700 1 -- 172.21.15.40:0/3308618560 <== mon.2 v2:172.21.15.45:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d00011990 con 0x7f0d100b45d0 2023-06-22T10:54:57.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.153+0000 7f0d0e7fc700 1 -- 172.21.15.40:0/3308618560 <== mon.2 v2:172.21.15.45:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d00011d20 con 0x7f0d100b45d0 2023-06-22T10:54:57.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.154+0000 7f0d15dff700 1 -- 172.21.15.40:0/3308618560 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f0d100b45d0 msgr2=0x7f0d100b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:57.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.154+0000 7f0d15dff700 1 --2- 172.21.15.40:0/3308618560 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f0d100b45d0 0x7f0d100b49a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0d00009840 tx=0x7f0d00009b50 comp rx=0 tx=0).stop 2023-06-22T10:54:57.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.154+0000 7f0d15dff700 1 -- 172.21.15.40:0/3308618560 shutdown_connections 2023-06-22T10:54:57.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.154+0000 7f0d15dff700 1 --2- 172.21.15.40:0/3308618560 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f0d100b45d0 0x7f0d100b49a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:57.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.154+0000 7f0d15dff700 1 --2- 172.21.15.40:0/3308618560 >> v2:172.21.15.45:3300/0 conn(0x7f0d100d2130 0x7f0d100cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:57.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.154+0000 7f0d15dff700 1 -- 172.21.15.40:0/3308618560 >> 172.21.15.40:0/3308618560 conn(0x7f0d100cf5d0 msgr2=0x7f0d100cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:57.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.154+0000 7f0d15dff700 1 -- 172.21.15.40:0/3308618560 shutdown_connections 2023-06-22T10:54:57.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.154+0000 7f0d15dff700 1 -- 172.21.15.40:0/3308618560 wait complete. 2023-06-22T10:54:57.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.156+0000 7f0d15dff700 1 Processor -- start 2023-06-22T10:54:57.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.156+0000 7f0d15dff700 1 -- start start 2023-06-22T10:54:57.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.157+0000 7f0d15dff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d100b45d0 0x7f0d100cc480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:57.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.157+0000 7f0d15dff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f0d100cd6e0 0x7f0d101494e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:57.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.157+0000 7f0d15dff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d100d2130 0x7f0d10149a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:57.161 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.157+0000 7f0d15dff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d100cc9c0 con 0x7f0d100b45d0 2023-06-22T10:54:57.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.157+0000 7f0d15dff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1014a050 con 0x7f0d100d2130 2023-06-22T10:54:57.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.157+0000 7f0d15dff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1014a330 con 0x7f0d100cd6e0 2023-06-22T10:54:57.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.157+0000 7f0d0f7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d100b45d0 0x7f0d100cc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:57.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.157+0000 7f0d0f7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d100b45d0 0x7f0d100cc480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46482/0 (socket says 172.21.15.40:46482) 2023-06-22T10:54:57.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.157+0000 7f0d0f7fe700 1 -- 172.21.15.40:0/2060686062 learned_addr learned my addr 172.21.15.40:0/2060686062 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:57.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.158+0000 7f0d0effd700 1 --2- 172.21.15.40:0/2060686062 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f0d100cd6e0 0x7f0d101494e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:57.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.158+0000 7f0d0ffff700 1 --2- 172.21.15.40:0/2060686062 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d100d2130 0x7f0d10149a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:57.162 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.158+0000 7f0d0f7fe700 1 -- 172.21.15.40:0/2060686062 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f0d100cd6e0 msgr2=0x7f0d101494e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:57.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.158+0000 7f0d0f7fe700 1 --2- 172.21.15.40:0/2060686062 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f0d100cd6e0 0x7f0d101494e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:57.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.158+0000 7f0d0f7fe700 1 -- 172.21.15.40:0/2060686062 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d100d2130 msgr2=0x7f0d10149a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:57.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.158+0000 7f0d0f7fe700 1 --2- 172.21.15.40:0/2060686062 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d100d2130 0x7f0d10149a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:57.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.158+0000 7f0d0f7fe700 1 -- 172.21.15.40:0/2060686062 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d000094a0 con 0x7f0d100b45d0 2023-06-22T10:54:57.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.158+0000 7f0d0effd700 1 --2- 172.21.15.40:0/2060686062 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f0d100cd6e0 0x7f0d101494e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-22T10:54:57.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.158+0000 7f0d0ffff700 1 --2- 172.21.15.40:0/2060686062 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d100d2130 0x7f0d10149a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-22T10:54:57.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.158+0000 7f0d0f7fe700 1 --2- 172.21.15.40:0/2060686062 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d100b45d0 0x7f0d100cc480 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f0d00009b90 tx=0x7f0d00004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:57.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.158+0000 7f0cf7fff700 1 -- 172.21.15.40:0/2060686062 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d000038a0 con 0x7f0d100b45d0 2023-06-22T10:54:57.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.158+0000 7f0cf7fff700 1 -- 172.21.15.40:0/2060686062 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d0001e070 con 0x7f0d100b45d0 2023-06-22T10:54:57.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.158+0000 7f0cf7fff700 1 -- 172.21.15.40:0/2060686062 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d00003c00 con 0x7f0d100b45d0 2023-06-22T10:54:57.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.158+0000 7f0d15dff700 1 -- 172.21.15.40:0/2060686062 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d1014a610 con 0x7f0d100b45d0 2023-06-22T10:54:57.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.158+0000 7f0d15dff700 1 -- 172.21.15.40:0/2060686062 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d1014abd0 con 0x7f0d100b45d0 2023-06-22T10:54:57.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.159+0000 7f0d15dff700 1 -- 172.21.15.40:0/2060686062 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d10067580 con 0x7f0d100b45d0 2023-06-22T10:54:57.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.160+0000 7f0cf7fff700 1 -- 172.21.15.40:0/2060686062 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0d0002d450 con 0x7f0d100b45d0 2023-06-22T10:54:57.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.161+0000 7f0cf7fff700 1 --2- 172.21.15.40:0/2060686062 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f0cfc06ace0 0x7f0cfc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:57.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.161+0000 7f0cf7fff700 1 -- 172.21.15.40:0/2060686062 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0d0008a800 con 0x7f0d100b45d0 2023-06-22T10:54:57.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.161+0000 7f0d0effd700 1 --2- 172.21.15.40:0/2060686062 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f0cfc06ace0 0x7f0cfc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:57.166 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.162+0000 7f0d0effd700 1 --2- 172.21.15.40:0/2060686062 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f0cfc06ace0 0x7f0cfc06d190 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0d10159e40 tx=0x7f0d04008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:57.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.166+0000 7f0cf7fff700 1 -- 172.21.15.40:0/2060686062 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0d00055570 con 0x7f0d100b45d0 2023-06-22T10:54:57.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.373+0000 7f0d15dff700 1 -- 172.21.15.40:0/2060686062 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0d1006bf00 con 0x7f0d100b45d0 2023-06-22T10:54:57.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.373+0000 7f0cf7fff700 1 -- 172.21.15.40:0/2060686062 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0d00058b90 con 0x7f0d100b45d0 2023-06-22T10:54:57.377 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 8 2023-06-22T10:54:57.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.376+0000 7f0d15dff700 1 -- 172.21.15.40:0/2060686062 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f0cfc06ace0 msgr2=0x7f0cfc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:57.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.376+0000 7f0d15dff700 1 --2- 172.21.15.40:0/2060686062 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f0cfc06ace0 0x7f0cfc06d190 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0d10159e40 tx=0x7f0d04008040 comp rx=0 tx=0).stop 2023-06-22T10:54:57.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.376+0000 7f0d15dff700 1 -- 172.21.15.40:0/2060686062 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d100b45d0 msgr2=0x7f0d100cc480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:57.379 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.376+0000 7f0d15dff700 1 --2- 172.21.15.40:0/2060686062 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d100b45d0 0x7f0d100cc480 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f0d00009b90 tx=0x7f0d00004750 comp rx=0 tx=0).stop 2023-06-22T10:54:57.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.376+0000 7f0d15dff700 1 -- 172.21.15.40:0/2060686062 shutdown_connections 2023-06-22T10:54:57.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.376+0000 7f0d15dff700 1 --2- 172.21.15.40:0/2060686062 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f0cfc06ace0 0x7f0cfc06d190 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:57.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.376+0000 7f0d15dff700 1 --2- 172.21.15.40:0/2060686062 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d100d2130 0x7f0d10149a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:57.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.376+0000 7f0d15dff700 1 --2- 172.21.15.40:0/2060686062 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0d100b45d0 0x7f0d100cc480 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:57.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.376+0000 7f0d15dff700 1 --2- 172.21.15.40:0/2060686062 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f0d100cd6e0 0x7f0d101494e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:57.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.376+0000 7f0d15dff700 1 -- 172.21.15.40:0/2060686062 >> 172.21.15.40:0/2060686062 conn(0x7f0d100cf5d0 msgr2=0x7f0d100b7990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:57.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.376+0000 7f0d15dff700 1 -- 172.21.15.40:0/2060686062 shutdown_connections 2023-06-22T10:54:57.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.376+0000 7f0d15dff700 1 -- 172.21.15.40:0/2060686062 wait complete. 2023-06-22T10:54:57.397 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-22T10:54:57.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.598+0000 7f21d5bff700 1 Processor -- start 2023-06-22T10:54:57.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.599+0000 7f21d5bff700 1 -- start start 2023-06-22T10:54:57.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.600+0000 7f21d5bff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f21d00d2130 0x7f21d00cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:57.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.600+0000 7f21d5bff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21d00d1be0 con 0x7f21d00cd6e0 2023-06-22T10:54:57.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.600+0000 7f21d5bff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21d00d1360 con 0x7f21d00b45d0 2023-06-22T10:54:57.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.600+0000 7f21d5bff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21d00d17f0 con 0x7f21d00d2130 2023-06-22T10:54:57.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.600+0000 7f21c7fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f21d00d2130 0x7f21d00cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:57.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.600+0000 7f21cffff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f21d00cd6e0 0x7f21d00b59a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:58110/0 (socket says 172.21.15.40:58110) 2023-06-22T10:54:57.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.600+0000 7f21cffff700 1 -- 172.21.15.40:0/3710589157 learned_addr learned my addr 172.21.15.40:0/3710589157 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:57.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.601+0000 7f21c7fff700 1 -- 172.21.15.40:0/3710589157 >> v1:172.21.15.45:6789/0 conn(0x7f21d00b45d0 legacy=0x7f21d00b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:57.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.601+0000 7f21c7fff700 1 -- 172.21.15.40:0/3710589157 >> v1:172.21.15.40:6789/0 conn(0x7f21d00cd6e0 legacy=0x7f21d00b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:57.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.601+0000 7f21c7fff700 1 -- 172.21.15.40:0/3710589157 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d00cef40 con 0x7f21d00d2130 2023-06-22T10:54:57.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.601+0000 7f21c7fff700 1 --2- 172.21.15.40:0/3710589157 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f21d00d2130 0x7f21d00cd1a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f21b8009840 tx=0x7f21b8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8ca371aa4aa2dab server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:57.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.601+0000 7f21ceffd700 1 -- 172.21.15.40:0/3710589157 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b8004230 con 0x7f21d00d2130 2023-06-22T10:54:57.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.601+0000 7f21ceffd700 1 -- 172.21.15.40:0/3710589157 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b8004390 con 0x7f21d00d2130 2023-06-22T10:54:57.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.601+0000 7f21ceffd700 1 -- 172.21.15.40:0/3710589157 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b80036a0 con 0x7f21d00d2130 2023-06-22T10:54:57.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.602+0000 7f21d5bff700 1 -- 172.21.15.40:0/3710589157 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f21d00d2130 msgr2=0x7f21d00cd1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:57.606 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.602+0000 7f21d5bff700 1 --2- 172.21.15.40:0/3710589157 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f21d00d2130 0x7f21d00cd1a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f21b8009840 tx=0x7f21b8009b50 comp rx=0 tx=0).stop 2023-06-22T10:54:57.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.602+0000 7f21d5bff700 1 -- 172.21.15.40:0/3710589157 shutdown_connections 2023-06-22T10:54:57.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.602+0000 7f21d5bff700 1 --2- 172.21.15.40:0/3710589157 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f21d00d2130 0x7f21d00cd1a0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:57.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.602+0000 7f21d5bff700 1 -- 172.21.15.40:0/3710589157 >> 172.21.15.40:0/3710589157 conn(0x7f21d00cf5d0 msgr2=0x7f21d00cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:57.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.602+0000 7f21d5bff700 1 -- 172.21.15.40:0/3710589157 shutdown_connections 2023-06-22T10:54:57.607 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.602+0000 7f21d5bff700 1 -- 172.21.15.40:0/3710589157 wait complete. 2023-06-22T10:54:57.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.603+0000 7f21d5bff700 1 Processor -- start 2023-06-22T10:54:57.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.604+0000 7f21d5bff700 1 -- start start 2023-06-22T10:54:57.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.605+0000 7f21d5bff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f21d00b45d0 0x7f21d0147410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:57.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.605+0000 7f21d5bff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f21d00cd6e0 0x7f21d00c88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:57.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.605+0000 7f21d5bff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21d00d2130 0x7f21d0145960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:57.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.605+0000 7f21d5bff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d00c8e20 con 0x7f21d00cd6e0 2023-06-22T10:54:57.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.605+0000 7f21d5bff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d0146370 con 0x7f21d00d2130 2023-06-22T10:54:57.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.605+0000 7f21d5bff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21d0146650 con 0x7f21d00b45d0 2023-06-22T10:54:57.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.605+0000 7f21c7fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f21d00cd6e0 0x7f21d00c88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:57.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.605+0000 7f21c7fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f21d00cd6e0 0x7f21d00c88e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46508/0 (socket says 172.21.15.40:46508) 2023-06-22T10:54:57.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.605+0000 7f21c7fff700 1 -- 172.21.15.40:0/422459830 learned_addr learned my addr 172.21.15.40:0/422459830 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:57.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.605+0000 7f21cffff700 1 --2- 172.21.15.40:0/422459830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21d00d2130 0x7f21d0145960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:57.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.605+0000 7f21cf7fe700 1 --2- 172.21.15.40:0/422459830 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f21d00b45d0 0x7f21d0147410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:57.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.605+0000 7f21c7fff700 1 -- 172.21.15.40:0/422459830 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f21d00b45d0 msgr2=0x7f21d0147410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:57.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.605+0000 7f21c7fff700 1 --2- 172.21.15.40:0/422459830 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f21d00b45d0 0x7f21d0147410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:57.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.605+0000 7f21c7fff700 1 -- 172.21.15.40:0/422459830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21d00d2130 msgr2=0x7f21d0145960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:57.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.605+0000 7f21c7fff700 1 --2- 172.21.15.40:0/422459830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21d00d2130 0x7f21d0145960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:57.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.605+0000 7f21c7fff700 1 -- 172.21.15.40:0/422459830 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b80094a0 con 0x7f21d00cd6e0 2023-06-22T10:54:57.611 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.605+0000 7f21cffff700 1 --2- 172.21.15.40:0/422459830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21d00d2130 0x7f21d0145960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:54:57.612 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.606+0000 7f21c7fff700 1 --2- 172.21.15.40:0/422459830 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f21d00cd6e0 0x7f21d00c88e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f21b80090b0 tx=0x7f21b8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:57.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.606+0000 7f21ccff9700 1 -- 172.21.15.40:0/422459830 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b8003e70 con 0x7f21d00cd6e0 2023-06-22T10:54:57.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.606+0000 7f21ccff9700 1 -- 172.21.15.40:0/422459830 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b801f070 con 0x7f21d00cd6e0 2023-06-22T10:54:57.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.606+0000 7f21d5bff700 1 -- 172.21.15.40:0/422459830 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21d0146930 con 0x7f21d00cd6e0 2023-06-22T10:54:57.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.606+0000 7f21ccff9700 1 -- 172.21.15.40:0/422459830 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b8011850 con 0x7f21d00cd6e0 2023-06-22T10:54:57.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.606+0000 7f21d5bff700 1 -- 172.21.15.40:0/422459830 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21d0146ef0 con 0x7f21d00cd6e0 2023-06-22T10:54:57.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.607+0000 7f21d5bff700 1 -- 172.21.15.40:0/422459830 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21d0147110 con 0x7f21d00cd6e0 2023-06-22T10:54:57.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.608+0000 7f21ccff9700 1 -- 172.21.15.40:0/422459830 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f21b8021030 con 0x7f21d00cd6e0 2023-06-22T10:54:57.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.609+0000 7f21ccff9700 1 --2- 172.21.15.40:0/422459830 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f21b006ace0 0x7f21b006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:57.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.609+0000 7f21ccff9700 1 -- 172.21.15.40:0/422459830 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f21b808ae90 con 0x7f21d00cd6e0 2023-06-22T10:54:57.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.609+0000 7f21cf7fe700 1 --2- 172.21.15.40:0/422459830 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f21b006ace0 0x7f21b006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:57.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.610+0000 7f21cf7fe700 1 --2- 172.21.15.40:0/422459830 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f21b006ace0 0x7f21b006d190 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f21c0004f30 tx=0x7f21c0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:57.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.613+0000 7f21ccff9700 1 -- 172.21.15.40:0/422459830 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f21b8055d20 con 0x7f21d00cd6e0 2023-06-22T10:54:57.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.821+0000 7f21d5bff700 1 -- 172.21.15.40:0/422459830 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f21d0147110 con 0x7f21d00cd6e0 2023-06-22T10:54:57.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.822+0000 7f21ccff9700 1 -- 172.21.15.40:0/422459830 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7f21b8059340 con 0x7f21d00cd6e0 2023-06-22T10:54:57.825 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-06-22T10:54:57.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.824+0000 7f21d5bff700 1 -- 172.21.15.40:0/422459830 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f21b006ace0 msgr2=0x7f21b006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:57.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.824+0000 7f21d5bff700 1 --2- 172.21.15.40:0/422459830 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f21b006ace0 0x7f21b006d190 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f21c0004f30 tx=0x7f21c0009040 comp rx=0 tx=0).stop 2023-06-22T10:54:57.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.824+0000 7f21d5bff700 1 -- 172.21.15.40:0/422459830 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f21d00cd6e0 msgr2=0x7f21d00c88e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:57.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.824+0000 7f21d5bff700 1 --2- 172.21.15.40:0/422459830 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f21d00cd6e0 0x7f21d00c88e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f21b80090b0 tx=0x7f21b8004750 comp rx=0 tx=0).stop 2023-06-22T10:54:57.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.824+0000 7f21d5bff700 1 -- 172.21.15.40:0/422459830 shutdown_connections 2023-06-22T10:54:57.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.824+0000 7f21d5bff700 1 --2- 172.21.15.40:0/422459830 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f21b006ace0 0x7f21b006d190 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:57.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.824+0000 7f21d5bff700 1 --2- 172.21.15.40:0/422459830 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f21d00b45d0 0x7f21d0147410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:57.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.824+0000 7f21d5bff700 1 --2- 172.21.15.40:0/422459830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21d00d2130 0x7f21d0145960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:57.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.824+0000 7f21d5bff700 1 --2- 172.21.15.40:0/422459830 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f21d00cd6e0 0x7f21d00c88e0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:57.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.824+0000 7f21d5bff700 1 -- 172.21.15.40:0/422459830 >> 172.21.15.40:0/422459830 conn(0x7f21d00cf5d0 msgr2=0x7f21d015b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:57.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.825+0000 7f21d5bff700 1 -- 172.21.15.40:0/422459830 shutdown_connections 2023-06-22T10:54:57.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:57.825+0000 7f21d5bff700 1 -- 172.21.15.40:0/422459830 wait complete. 2023-06-22T10:54:57.846 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-22T10:54:58.053 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.047+0000 7f0eab3ff700 1 Processor -- start 2023-06-22T10:54:58.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.047+0000 7f0eab3ff700 1 -- start start 2023-06-22T10:54:58.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.048+0000 7f0eab3ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f0ea40b45d0 0x7f0ea40b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:58.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.048+0000 7f0eab3ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0ea40d2130 0x7f0ea40cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:58.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.048+0000 7f0eab3ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ea40d1be0 con 0x7f0ea40cd6e0 2023-06-22T10:54:58.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.048+0000 7f0eab3ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ea40d17f0 con 0x7f0ea40d2130 2023-06-22T10:54:58.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.048+0000 7f0eab3ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea40d1360 con 0x7f0ea40b45d0 2023-06-22T10:54:58.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.048+0000 7f0ea899a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0ea40d2130 0x7f0ea40cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:58.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.048+0000 7f0ea999c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f0ea40cd6e0 0x7f0ea40b59a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:58120/0 (socket says 172.21.15.40:58120) 2023-06-22T10:54:58.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.048+0000 7f0ea999c700 1 -- 172.21.15.40:0/647273063 learned_addr learned my addr 172.21.15.40:0/647273063 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:58.056 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.049+0000 7f0ea919b700 1 --2- 172.21.15.40:0/647273063 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f0ea40b45d0 0x7f0ea40b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:58.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.049+0000 7f0ea899a700 1 -- 172.21.15.40:0/647273063 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f0ea40b45d0 msgr2=0x7f0ea40b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:58.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.049+0000 7f0ea899a700 1 --2- 172.21.15.40:0/647273063 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f0ea40b45d0 0x7f0ea40b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:58.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.049+0000 7f0ea899a700 1 -- 172.21.15.40:0/647273063 >> v1:172.21.15.40:6789/0 conn(0x7f0ea40cd6e0 legacy=0x7f0ea40b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:58.057 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.049+0000 7f0ea899a700 1 -- 172.21.15.40:0/647273063 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea40b4ee0 con 0x7f0ea40d2130 2023-06-22T10:54:58.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.049+0000 7f0e9bfff700 1 -- 172.21.15.40:0/647273063 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1400589556 0 0) 0x7f0ea40d1be0 con 0x7f0ea40cd6e0 2023-06-22T10:54:58.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.049+0000 7f0ea919b700 1 --2- 172.21.15.40:0/647273063 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f0ea40b45d0 0x7f0ea40b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:54:58.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.049+0000 7f0ea899a700 1 --2- 172.21.15.40:0/647273063 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ea40d2130 0x7f0ea40cd1a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f0e94009840 tx=0x7f0e94009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=248253a33e793edd server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:58.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.049+0000 7f0e9bfff700 1 -- 172.21.15.40:0/647273063 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e94011830 con 0x7f0ea40d2130 2023-06-22T10:54:58.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.049+0000 7f0e9bfff700 1 -- 172.21.15.40:0/647273063 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e94011990 con 0x7f0ea40d2130 2023-06-22T10:54:58.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.049+0000 7f0e9bfff700 1 -- 172.21.15.40:0/647273063 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e94011d20 con 0x7f0ea40d2130 2023-06-22T10:54:58.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.050+0000 7f0eab3ff700 1 -- 172.21.15.40:0/647273063 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ea40d2130 msgr2=0x7f0ea40cd1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:58.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.050+0000 7f0eab3ff700 1 --2- 172.21.15.40:0/647273063 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ea40d2130 0x7f0ea40cd1a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f0e94009840 tx=0x7f0e94009b50 comp rx=0 tx=0).stop 2023-06-22T10:54:58.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.050+0000 7f0eab3ff700 1 -- 172.21.15.40:0/647273063 shutdown_connections 2023-06-22T10:54:58.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.050+0000 7f0eab3ff700 1 --2- 172.21.15.40:0/647273063 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f0ea40b45d0 0x7f0ea40b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:58.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.050+0000 7f0eab3ff700 1 --2- 172.21.15.40:0/647273063 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ea40d2130 0x7f0ea40cd1a0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:58.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.050+0000 7f0eab3ff700 1 -- 172.21.15.40:0/647273063 >> 172.21.15.40:0/647273063 conn(0x7f0ea40cf5d0 msgr2=0x7f0ea40cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:58.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.050+0000 7f0eab3ff700 1 -- 172.21.15.40:0/647273063 shutdown_connections 2023-06-22T10:54:58.061 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.050+0000 7f0eab3ff700 1 -- 172.21.15.40:0/647273063 wait complete. 2023-06-22T10:54:58.064 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.052+0000 7f0eab3ff700 1 Processor -- start 2023-06-22T10:54:58.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.052+0000 7f0eab3ff700 1 -- start start 2023-06-22T10:54:58.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.053+0000 7f0eab3ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ea40b45d0 0x7f0ea40ca630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:58.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.053+0000 7f0eab3ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ea40cd6e0 0x7f0ea41f23f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:58.065 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.053+0000 7f0eab3ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f0ea40d2130 0x7f0ea40ccef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:58.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.053+0000 7f0eab3ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea40b1700 con 0x7f0ea40b45d0 2023-06-22T10:54:58.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.053+0000 7f0eab3ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea41f19a0 con 0x7f0ea40cd6e0 2023-06-22T10:54:58.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.053+0000 7f0eab3ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea40cb3b0 con 0x7f0ea40d2130 2023-06-22T10:54:58.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.053+0000 7f0ea919b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ea40b45d0 0x7f0ea40ca630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:58.066 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.053+0000 7f0ea919b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ea40b45d0 0x7f0ea40ca630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46526/0 (socket says 172.21.15.40:46526) 2023-06-22T10:54:58.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.053+0000 7f0ea919b700 1 -- 172.21.15.40:0/1204041937 learned_addr learned my addr 172.21.15.40:0/1204041937 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:58.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.054+0000 7f0ea999c700 1 --2- 172.21.15.40:0/1204041937 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f0ea40d2130 0x7f0ea40ccef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:58.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.054+0000 7f0ea899a700 1 --2- 172.21.15.40:0/1204041937 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ea40cd6e0 0x7f0ea41f23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:58.067 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.054+0000 7f0ea919b700 1 -- 172.21.15.40:0/1204041937 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f0ea40d2130 msgr2=0x7f0ea40ccef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:58.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.054+0000 7f0ea919b700 1 --2- 172.21.15.40:0/1204041937 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f0ea40d2130 0x7f0ea40ccef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:58.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.054+0000 7f0ea919b700 1 -- 172.21.15.40:0/1204041937 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ea40cd6e0 msgr2=0x7f0ea41f23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:58.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.054+0000 7f0ea919b700 1 --2- 172.21.15.40:0/1204041937 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ea40cd6e0 0x7f0ea41f23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:58.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.054+0000 7f0ea919b700 1 -- 172.21.15.40:0/1204041937 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e940094a0 con 0x7f0ea40b45d0 2023-06-22T10:54:58.068 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.054+0000 7f0ea899a700 1 --2- 172.21.15.40:0/1204041937 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ea40cd6e0 0x7f0ea41f23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-22T10:54:58.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.054+0000 7f0ea919b700 1 --2- 172.21.15.40:0/1204041937 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ea40b45d0 0x7f0ea40ca630 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f0ea000e810 tx=0x7f0ea000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:58.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.054+0000 7f0e99ffb700 1 -- 172.21.15.40:0/1204041937 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea000c020 con 0x7f0ea40b45d0 2023-06-22T10:54:58.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.054+0000 7f0e99ffb700 1 -- 172.21.15.40:0/1204041937 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea0004250 con 0x7f0ea40b45d0 2023-06-22T10:54:58.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.054+0000 7f0e99ffb700 1 -- 172.21.15.40:0/1204041937 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea00036a0 con 0x7f0ea40b45d0 2023-06-22T10:54:58.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.054+0000 7f0eab3ff700 1 -- 172.21.15.40:0/1204041937 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ea40cab70 con 0x7f0ea40b45d0 2023-06-22T10:54:58.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.054+0000 7f0eab3ff700 1 -- 172.21.15.40:0/1204041937 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ea41f1bf0 con 0x7f0ea40b45d0 2023-06-22T10:54:58.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.055+0000 7f0eab3ff700 1 -- 172.21.15.40:0/1204041937 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ea40cae50 con 0x7f0ea40b45d0 2023-06-22T10:54:58.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.056+0000 7f0e99ffb700 1 -- 172.21.15.40:0/1204041937 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0ea0003800 con 0x7f0ea40b45d0 2023-06-22T10:54:58.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.057+0000 7f0e99ffb700 1 --2- 172.21.15.40:0/1204041937 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f0e8806ace0 0x7f0e8806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:58.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.057+0000 7f0e99ffb700 1 -- 172.21.15.40:0/1204041937 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0ea0089260 con 0x7f0ea40b45d0 2023-06-22T10:54:58.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.058+0000 7f0ea899a700 1 --2- 172.21.15.40:0/1204041937 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f0e8806ace0 0x7f0e8806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:58.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.058+0000 7f0ea899a700 1 --2- 172.21.15.40:0/1204041937 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f0e8806ace0 0x7f0e8806d190 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0ea40b3bb0 tx=0x7f0e94008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:58.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.061+0000 7f0e99ffb700 1 -- 172.21.15.40:0/1204041937 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0ea0053fd0 con 0x7f0ea40b45d0 2023-06-22T10:54:58.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.267+0000 7f0eab3ff700 1 -- 172.21.15.40:0/1204041937 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0ea40cef10 con 0x7f0ea40b45d0 2023-06-22T10:54:58.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.267+0000 7f0e99ffb700 1 -- 172.21.15.40:0/1204041937 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0ea00575f0 con 0x7f0ea40b45d0 2023-06-22T10:54:58.271 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2023-06-22T10:54:58.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.269+0000 7f0eab3ff700 1 -- 172.21.15.40:0/1204041937 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f0e8806ace0 msgr2=0x7f0e8806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:58.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.269+0000 7f0eab3ff700 1 --2- 172.21.15.40:0/1204041937 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f0e8806ace0 0x7f0e8806d190 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0ea40b3bb0 tx=0x7f0e94008030 comp rx=0 tx=0).stop 2023-06-22T10:54:58.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.269+0000 7f0eab3ff700 1 -- 172.21.15.40:0/1204041937 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ea40b45d0 msgr2=0x7f0ea40ca630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:58.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.269+0000 7f0eab3ff700 1 --2- 172.21.15.40:0/1204041937 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ea40b45d0 0x7f0ea40ca630 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f0ea000e810 tx=0x7f0ea000ebd0 comp rx=0 tx=0).stop 2023-06-22T10:54:58.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.270+0000 7f0eab3ff700 1 -- 172.21.15.40:0/1204041937 shutdown_connections 2023-06-22T10:54:58.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.270+0000 7f0eab3ff700 1 --2- 172.21.15.40:0/1204041937 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f0e8806ace0 0x7f0e8806d190 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:58.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.270+0000 7f0eab3ff700 1 --2- 172.21.15.40:0/1204041937 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f0ea40d2130 0x7f0ea40ccef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:58.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.270+0000 7f0eab3ff700 1 --2- 172.21.15.40:0/1204041937 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ea40b45d0 0x7f0ea40ca630 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:58.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.270+0000 7f0eab3ff700 1 --2- 172.21.15.40:0/1204041937 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ea40cd6e0 0x7f0ea41f23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:58.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.270+0000 7f0eab3ff700 1 -- 172.21.15.40:0/1204041937 >> 172.21.15.40:0/1204041937 conn(0x7f0ea40cf5d0 msgr2=0x7f0ea406bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:58.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.270+0000 7f0eab3ff700 1 -- 172.21.15.40:0/1204041937 shutdown_connections 2023-06-22T10:54:58.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.270+0000 7f0eab3ff700 1 -- 172.21.15.40:0/1204041937 wait complete. 2023-06-22T10:54:58.294 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-22T10:54:58.497 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.494+0000 7f6c1edff700 1 Processor -- start 2023-06-22T10:54:58.498 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.494+0000 7f6c1edff700 1 -- start start 2023-06-22T10:54:58.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.495+0000 7f6c1edff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f6c180b45d0 0x7f6c180b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:58.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.495+0000 7f6c1edff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6c180d2130 0x7f6c180cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:58.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.496+0000 7f6c1edff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6c180cd6e0 0x7f6c180b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:58.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.496+0000 7f6c1edff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c180d17f0 con 0x7f6c180cd6e0 2023-06-22T10:54:58.499 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.496+0000 7f6c1edff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c180d1be0 con 0x7f6c180d2130 2023-06-22T10:54:58.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.496+0000 7f6c1edff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c180d1360 con 0x7f6c180b45d0 2023-06-22T10:54:58.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.496+0000 7f6c1d39c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6c180cd6e0 0x7f6c180b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:58.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.496+0000 7f6c1d39c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6c180cd6e0 0x7f6c180b59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57830/0 (socket says 172.21.15.40:57830) 2023-06-22T10:54:58.500 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.496+0000 7f6c1d39c700 1 -- 172.21.15.40:0/4134601316 learned_addr learned my addr 172.21.15.40:0/4134601316 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:58.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.496+0000 7f6c17fff700 1 --2- 172.21.15.40:0/4134601316 >> v2:172.21.15.45:3300/0 conn(0x7f6c180d2130 0x7f6c180cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:58.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.496+0000 7f6c1cb9b700 1 --2- 172.21.15.40:0/4134601316 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f6c180b45d0 0x7f6c180b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:58.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.496+0000 7f6c1d39c700 1 -- 172.21.15.40:0/4134601316 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f6c180b45d0 msgr2=0x7f6c180b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:58.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.496+0000 7f6c1d39c700 1 --2- 172.21.15.40:0/4134601316 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f6c180b45d0 0x7f6c180b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:58.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.496+0000 7f6c1d39c700 1 -- 172.21.15.40:0/4134601316 >> v2:172.21.15.45:3300/0 conn(0x7f6c180d2130 msgr2=0x7f6c180cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:58.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.496+0000 7f6c1d39c700 1 --2- 172.21.15.40:0/4134601316 >> v2:172.21.15.45:3300/0 conn(0x7f6c180d2130 0x7f6c180cd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:58.502 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.496+0000 7f6c1d39c700 1 -- 172.21.15.40:0/4134601316 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c180b4ee0 con 0x7f6c180cd6e0 2023-06-22T10:54:58.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.496+0000 7f6c1cb9b700 1 --2- 172.21.15.40:0/4134601316 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f6c180b45d0 0x7f6c180b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:54:58.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.497+0000 7f6c1d39c700 1 --2- 172.21.15.40:0/4134601316 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c180cd6e0 0x7f6c180b59a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f6c18069fa0 tx=0x7f6c1000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9f650dfcc98ccb1 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:58.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.497+0000 7f6c177fe700 1 -- 172.21.15.40:0/4134601316 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1000e070 con 0x7f6c180cd6e0 2023-06-22T10:54:58.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.497+0000 7f6c177fe700 1 -- 172.21.15.40:0/4134601316 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c1000b9c0 con 0x7f6c180cd6e0 2023-06-22T10:54:58.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.497+0000 7f6c177fe700 1 -- 172.21.15.40:0/4134601316 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1000bd70 con 0x7f6c180cd6e0 2023-06-22T10:54:58.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.497+0000 7f6c1edff700 1 -- 172.21.15.40:0/4134601316 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c180cd6e0 msgr2=0x7f6c180b59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:58.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.497+0000 7f6c1edff700 1 --2- 172.21.15.40:0/4134601316 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c180cd6e0 0x7f6c180b59a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f6c18069fa0 tx=0x7f6c1000b330 comp rx=0 tx=0).stop 2023-06-22T10:54:58.503 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.498+0000 7f6c1edff700 1 -- 172.21.15.40:0/4134601316 shutdown_connections 2023-06-22T10:54:58.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.498+0000 7f6c1edff700 1 --2- 172.21.15.40:0/4134601316 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c180cd6e0 0x7f6c180b59a0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:58.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.498+0000 7f6c1edff700 1 --2- 172.21.15.40:0/4134601316 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f6c180b45d0 0x7f6c180b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:58.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.498+0000 7f6c1edff700 1 --2- 172.21.15.40:0/4134601316 >> v2:172.21.15.45:3300/0 conn(0x7f6c180d2130 0x7f6c180cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:58.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.498+0000 7f6c1edff700 1 -- 172.21.15.40:0/4134601316 >> 172.21.15.40:0/4134601316 conn(0x7f6c180cf5d0 msgr2=0x7f6c180cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:58.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.498+0000 7f6c1edff700 1 -- 172.21.15.40:0/4134601316 shutdown_connections 2023-06-22T10:54:58.504 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.498+0000 7f6c1edff700 1 -- 172.21.15.40:0/4134601316 wait complete. 2023-06-22T10:54:58.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.499+0000 7f6c1edff700 1 Processor -- start 2023-06-22T10:54:58.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.499+0000 7f6c1edff700 1 -- start start 2023-06-22T10:54:58.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.500+0000 7f6c1edff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c180b45d0 0x7f6c181f1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:58.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.500+0000 7f6c1edff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c180cd6e0 0x7f6c1815e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:58.506 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.500+0000 7f6c1edff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f6c180d2130 0x7f6c1815ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:58.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.500+0000 7f6c1edff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c181f2d80 con 0x7f6c180cd6e0 2023-06-22T10:54:58.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.500+0000 7f6c1edff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c181f1ea0 con 0x7f6c180b45d0 2023-06-22T10:54:58.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.500+0000 7f6c1edff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c181f2130 con 0x7f6c180d2130 2023-06-22T10:54:58.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.501+0000 7f6c17fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c180cd6e0 0x7f6c1815e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:58.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.501+0000 7f6c17fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c180cd6e0 0x7f6c1815e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57836/0 (socket says 172.21.15.40:57836) 2023-06-22T10:54:58.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.501+0000 7f6c17fff700 1 -- 172.21.15.40:0/933088604 learned_addr learned my addr 172.21.15.40:0/933088604 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:58.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.501+0000 7f6c1cb9b700 1 --2- 172.21.15.40:0/933088604 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c180b45d0 0x7f6c181f1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:58.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.501+0000 7f6c1d39c700 1 --2- 172.21.15.40:0/933088604 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f6c180d2130 0x7f6c1815ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:58.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.501+0000 7f6c17fff700 1 -- 172.21.15.40:0/933088604 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f6c180d2130 msgr2=0x7f6c1815ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:58.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.501+0000 7f6c17fff700 1 --2- 172.21.15.40:0/933088604 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f6c180d2130 0x7f6c1815ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:58.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.501+0000 7f6c17fff700 1 -- 172.21.15.40:0/933088604 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c180b45d0 msgr2=0x7f6c181f1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:58.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.501+0000 7f6c17fff700 1 --2- 172.21.15.40:0/933088604 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c180b45d0 0x7f6c181f1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:58.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.501+0000 7f6c17fff700 1 -- 172.21.15.40:0/933088604 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c10009b30 con 0x7f6c180cd6e0 2023-06-22T10:54:58.508 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.501+0000 7f6c17fff700 1 --2- 172.21.15.40:0/933088604 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c180cd6e0 0x7f6c1815e830 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f6c0400e810 tx=0x7f6c0400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:58.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.502+0000 7f6c157fa700 1 -- 172.21.15.40:0/933088604 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0400c070 con 0x7f6c180cd6e0 2023-06-22T10:54:58.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.502+0000 7f6c157fa700 1 -- 172.21.15.40:0/933088604 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c04013610 con 0x7f6c180cd6e0 2023-06-22T10:54:58.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.502+0000 7f6c157fa700 1 -- 172.21.15.40:0/933088604 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c040139c0 con 0x7f6c180cd6e0 2023-06-22T10:54:58.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.502+0000 7f6c1edff700 1 -- 172.21.15.40:0/933088604 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c181f2410 con 0x7f6c180cd6e0 2023-06-22T10:54:58.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.502+0000 7f6c1edff700 1 -- 172.21.15.40:0/933088604 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c181f29d0 con 0x7f6c180cd6e0 2023-06-22T10:54:58.509 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.503+0000 7f6c1edff700 1 -- 172.21.15.40:0/933088604 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c181f2f30 con 0x7f6c180cd6e0 2023-06-22T10:54:58.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.504+0000 7f6c157fa700 1 -- 172.21.15.40:0/933088604 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6c04013b20 con 0x7f6c180cd6e0 2023-06-22T10:54:58.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.505+0000 7f6c157fa700 1 --2- 172.21.15.40:0/933088604 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f6bfc06ace0 0x7f6bfc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:58.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.505+0000 7f6c157fa700 1 -- 172.21.15.40:0/933088604 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6c04089590 con 0x7f6c180cd6e0 2023-06-22T10:54:58.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.505+0000 7f6c1cb9b700 1 --2- 172.21.15.40:0/933088604 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f6bfc06ace0 0x7f6bfc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:58.510 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.506+0000 7f6c1cb9b700 1 --2- 172.21.15.40:0/933088604 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f6bfc06ace0 0x7f6bfc06d190 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c0045f0 tx=0x7f6c0c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:58.512 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.509+0000 7f6c157fa700 1 -- 172.21.15.40:0/933088604 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6c181f2f30 con 0x7f6c180cd6e0 2023-06-22T10:54:58.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.713+0000 7f6c1edff700 1 -- 172.21.15.40:0/933088604 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f6c181f2f30 con 0x7f6c180cd6e0 2023-06-22T10:54:58.717 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.714+0000 7f6c157fa700 1 -- 172.21.15.40:0/933088604 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7f6c181f2f30 con 0x7f6c180cd6e0 2023-06-22T10:54:58.717 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2023-06-22T10:54:58.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.716+0000 7f6c1edff700 1 -- 172.21.15.40:0/933088604 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f6bfc06ace0 msgr2=0x7f6bfc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:58.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.716+0000 7f6c1edff700 1 --2- 172.21.15.40:0/933088604 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f6bfc06ace0 0x7f6bfc06d190 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c0045f0 tx=0x7f6c0c008040 comp rx=0 tx=0).stop 2023-06-22T10:54:58.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.716+0000 7f6c1edff700 1 -- 172.21.15.40:0/933088604 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c180cd6e0 msgr2=0x7f6c1815e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:58.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.716+0000 7f6c1edff700 1 --2- 172.21.15.40:0/933088604 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c180cd6e0 0x7f6c1815e830 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f6c0400e810 tx=0x7f6c0400eb20 comp rx=0 tx=0).stop 2023-06-22T10:54:58.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.716+0000 7f6c1edff700 1 -- 172.21.15.40:0/933088604 shutdown_connections 2023-06-22T10:54:58.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.716+0000 7f6c1edff700 1 --2- 172.21.15.40:0/933088604 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f6bfc06ace0 0x7f6bfc06d190 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:58.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.716+0000 7f6c1edff700 1 --2- 172.21.15.40:0/933088604 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f6c180d2130 0x7f6c1815ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:58.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.716+0000 7f6c1edff700 1 --2- 172.21.15.40:0/933088604 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c180b45d0 0x7f6c181f1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:58.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.716+0000 7f6c1edff700 1 --2- 172.21.15.40:0/933088604 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c180cd6e0 0x7f6c1815e830 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:58.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.716+0000 7f6c1edff700 1 -- 172.21.15.40:0/933088604 >> 172.21.15.40:0/933088604 conn(0x7f6c180cf5d0 msgr2=0x7f6c1815aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:58.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.716+0000 7f6c1edff700 1 -- 172.21.15.40:0/933088604 shutdown_connections 2023-06-22T10:54:58.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.716+0000 7f6c1edff700 1 -- 172.21.15.40:0/933088604 wait complete. 2023-06-22T10:54:58.738 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-22T10:54:58.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.936+0000 7fc2eb3ff700 1 Processor -- start 2023-06-22T10:54:58.939 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.936+0000 7fc2eb3ff700 1 -- start start 2023-06-22T10:54:58.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.937+0000 7fc2eb3ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fc2e415c720 0x7fc2e40b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:58.940 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.937+0000 7fc2eb3ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc2e40b4e30 0x7fc2e40d0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:58.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.937+0000 7fc2eb3ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2e40b2130 con 0x7fc2e40d2830 2023-06-22T10:54:58.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.937+0000 7fc2eb3ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2e4160d60 con 0x7fc2e40b4e30 2023-06-22T10:54:58.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.937+0000 7fc2eb3ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e4161180 con 0x7fc2e415c720 2023-06-22T10:54:58.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.937+0000 7fc2e899a700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc2e40d2830 0x7fc2e40b4720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:35896/0 (socket says 172.21.15.40:35896) 2023-06-22T10:54:58.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.938+0000 7fc2e899a700 1 -- 172.21.15.40:0/932179246 learned_addr learned my addr 172.21.15.40:0/932179246 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:58.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.938+0000 7fc2e999c700 1 --2- 172.21.15.40:0/932179246 >> v2:172.21.15.45:3300/0 conn(0x7fc2e40b4e30 0x7fc2e40d0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:58.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.938+0000 7fc2e919b700 1 --2- 172.21.15.40:0/932179246 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fc2e415c720 0x7fc2e40b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:58.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.938+0000 7fc2dbfff700 1 -- 172.21.15.40:0/932179246 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 184601161 0 0) 0x7fc2e40b2130 con 0x7fc2e40d2830 2023-06-22T10:54:58.942 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.938+0000 7fc2dbfff700 1 -- 172.21.15.40:0/932179246 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2d00035b0 con 0x7fc2e40d2830 2023-06-22T10:54:58.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.938+0000 7fc2e919b700 1 -- 172.21.15.40:0/932179246 >> v2:172.21.15.45:3300/0 conn(0x7fc2e40b4e30 msgr2=0x7fc2e40d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:58.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.938+0000 7fc2e919b700 1 --2- 172.21.15.40:0/932179246 >> v2:172.21.15.45:3300/0 conn(0x7fc2e40b4e30 0x7fc2e40d0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:58.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.938+0000 7fc2e919b700 1 -- 172.21.15.40:0/932179246 >> v1:172.21.15.40:6789/0 conn(0x7fc2e40d2830 legacy=0x7fc2e40b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:58.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.938+0000 7fc2e919b700 1 -- 172.21.15.40:0/932179246 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e41603c0 con 0x7fc2e415c720 2023-06-22T10:54:58.943 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.939+0000 7fc2e919b700 1 --2- 172.21.15.40:0/932179246 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fc2e415c720 0x7fc2e40b1870 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0009d90 tx=0x7fc2e000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9fff6265ef2f1325 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:58.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.939+0000 7fc2dbfff700 1 -- 172.21.15.40:0/932179246 <== mon.2 v2:172.21.15.45:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e000e070 con 0x7fc2e415c720 2023-06-22T10:54:58.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.939+0000 7fc2dbfff700 1 -- 172.21.15.40:0/932179246 <== mon.2 v2:172.21.15.45:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e000bb20 con 0x7fc2e415c720 2023-06-22T10:54:58.944 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.939+0000 7fc2dbfff700 1 -- 172.21.15.40:0/932179246 <== mon.2 v2:172.21.15.45:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e0012430 con 0x7fc2e415c720 2023-06-22T10:54:58.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.940+0000 7fc2eb3ff700 1 -- 172.21.15.40:0/932179246 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fc2e415c720 msgr2=0x7fc2e40b1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:58.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.940+0000 7fc2eb3ff700 1 --2- 172.21.15.40:0/932179246 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fc2e415c720 0x7fc2e40b1870 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0009d90 tx=0x7fc2e000b330 comp rx=0 tx=0).stop 2023-06-22T10:54:58.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.940+0000 7fc2eb3ff700 1 -- 172.21.15.40:0/932179246 shutdown_connections 2023-06-22T10:54:58.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.940+0000 7fc2eb3ff700 1 --2- 172.21.15.40:0/932179246 >> v2:172.21.15.45:3300/0 conn(0x7fc2e40b4e30 0x7fc2e40d0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:58.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.940+0000 7fc2eb3ff700 1 --2- 172.21.15.40:0/932179246 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fc2e415c720 0x7fc2e40b1870 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:58.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.940+0000 7fc2eb3ff700 1 -- 172.21.15.40:0/932179246 >> 172.21.15.40:0/932179246 conn(0x7fc2e40cf720 msgr2=0x7fc2e40cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:58.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.940+0000 7fc2eb3ff700 1 -- 172.21.15.40:0/932179246 shutdown_connections 2023-06-22T10:54:58.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.940+0000 7fc2eb3ff700 1 -- 172.21.15.40:0/932179246 wait complete. 2023-06-22T10:54:58.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.942+0000 7fc2eb3ff700 1 Processor -- start 2023-06-22T10:54:58.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.942+0000 7fc2eb3ff700 1 -- start start 2023-06-22T10:54:58.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.943+0000 7fc2eb3ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fc2e40b4e30 0x7fc2e414e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:58.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.943+0000 7fc2eb3ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2e40d2830 0x7fc2e40b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:58.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.943+0000 7fc2eb3ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2e415c720 0x7fc2e40b3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:58.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.943+0000 7fc2eb3ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e414e610 con 0x7fc2e415c720 2023-06-22T10:54:58.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.943+0000 7fc2eb3ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e40cadb0 con 0x7fc2e40d2830 2023-06-22T10:54:58.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.943+0000 7fc2eb3ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e40cb090 con 0x7fc2e40b4e30 2023-06-22T10:54:58.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.943+0000 7fc2e999c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2e415c720 0x7fc2e40b3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:58.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.943+0000 7fc2e919b700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fc2e40b4e30 0x7fc2e414e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:58.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.943+0000 7fc2e919b700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fc2e40b4e30 0x7fc2e414e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3301/0 says I am v2:172.21.15.40:42808/0 (socket says 172.21.15.40:42808) 2023-06-22T10:54:58.948 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.943+0000 7fc2e919b700 1 -- 172.21.15.40:0/13190919 learned_addr learned my addr 172.21.15.40:0/13190919 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:58.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.943+0000 7fc2e899a700 1 --2- 172.21.15.40:0/13190919 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2e40d2830 0x7fc2e40b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:58.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.944+0000 7fc2e999c700 1 -- 172.21.15.40:0/13190919 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fc2e40b4e30 msgr2=0x7fc2e414e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:58.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.944+0000 7fc2e999c700 1 --2- 172.21.15.40:0/13190919 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fc2e40b4e30 0x7fc2e414e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:58.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.944+0000 7fc2e999c700 1 -- 172.21.15.40:0/13190919 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2e40d2830 msgr2=0x7fc2e40b38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:58.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.944+0000 7fc2e999c700 1 --2- 172.21.15.40:0/13190919 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2e40d2830 0x7fc2e40b38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:58.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.944+0000 7fc2e999c700 1 -- 172.21.15.40:0/13190919 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e0009a70 con 0x7fc2e415c720 2023-06-22T10:54:58.949 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.944+0000 7fc2e999c700 1 --2- 172.21.15.40:0/13190919 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2e415c720 0x7fc2e40b3df0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc00e7c0 tx=0x7fc2dc00ead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:58.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.944+0000 7fc2d9ffb700 1 -- 172.21.15.40:0/13190919 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc013680 con 0x7fc2e415c720 2023-06-22T10:54:58.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.944+0000 7fc2d9ffb700 1 -- 172.21.15.40:0/13190919 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2dc013800 con 0x7fc2e415c720 2023-06-22T10:54:58.950 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.944+0000 7fc2d9ffb700 1 -- 172.21.15.40:0/13190919 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc013bb0 con 0x7fc2e415c720 2023-06-22T10:54:58.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.944+0000 7fc2eb3ff700 1 -- 172.21.15.40:0/13190919 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2e40cb370 con 0x7fc2e415c720 2023-06-22T10:54:58.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.945+0000 7fc2eb3ff700 1 -- 172.21.15.40:0/13190919 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2e40cb930 con 0x7fc2e415c720 2023-06-22T10:54:58.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.946+0000 7fc2eb3ff700 1 -- 172.21.15.40:0/13190919 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2e40cbb20 con 0x7fc2e415c720 2023-06-22T10:54:58.951 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.947+0000 7fc2d9ffb700 1 -- 172.21.15.40:0/13190919 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc2dc013d10 con 0x7fc2e415c720 2023-06-22T10:54:58.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.947+0000 7fc2d9ffb700 1 --2- 172.21.15.40:0/13190919 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fc2c806ace0 0x7fc2c806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:58.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.948+0000 7fc2d9ffb700 1 -- 172.21.15.40:0/13190919 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc2dc0891e0 con 0x7fc2e415c720 2023-06-22T10:54:58.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.948+0000 7fc2e919b700 1 --2- 172.21.15.40:0/13190919 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fc2c806ace0 0x7fc2c806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:58.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.948+0000 7fc2e919b700 1 --2- 172.21.15.40:0/13190919 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fc2c806ace0 0x7fc2c806d190 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0000f80 tx=0x7fc2e0011000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:58.955 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:58.952+0000 7fc2d9ffb700 1 -- 172.21.15.40:0/13190919 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc2dc053f50 con 0x7fc2e415c720 2023-06-22T10:54:59.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.200+0000 7fc2eb3ff700 1 -- 172.21.15.40:0/13190919 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc2e4067580 con 0x7fc2e415c720 2023-06-22T10:54:59.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.200+0000 7fc2d9ffb700 1 -- 172.21.15.40:0/13190919 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4664 (secure 0 0 0) 0x7fc2dc057570 con 0x7fc2e415c720 2023-06-22T10:54:59.204 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:54:59.204 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/627935577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":627935577},{"type":"v1","addr":"172.21.15.40:6835","nonce":627935577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3018871402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3018871402},{"type":"v1","addr":"172.21.15.40:6837","nonce":3018871402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/4036649607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":4036649607},{"type":"v1","addr":"172.21.15.45:6834","nonce":4036649607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-22T10:53:31.430326+0000","modified":"2023-06-22T10:53:59.666730+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4303},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4303":{"gid":4303,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/1579627519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":1579627519},{"type":"v1","addr":"172.21.15.45:6835","nonce":1579627519}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-22T10:54:59.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.203+0000 7fc2eb3ff700 1 -- 172.21.15.40:0/13190919 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fc2c806ace0 msgr2=0x7fc2c806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:59.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.203+0000 7fc2eb3ff700 1 --2- 172.21.15.40:0/13190919 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fc2c806ace0 0x7fc2c806d190 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0000f80 tx=0x7fc2e0011000 comp rx=0 tx=0).stop 2023-06-22T10:54:59.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.203+0000 7fc2eb3ff700 1 -- 172.21.15.40:0/13190919 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2e415c720 msgr2=0x7fc2e40b3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:59.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.203+0000 7fc2eb3ff700 1 --2- 172.21.15.40:0/13190919 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2e415c720 0x7fc2e40b3df0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc00e7c0 tx=0x7fc2dc00ead0 comp rx=0 tx=0).stop 2023-06-22T10:54:59.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.203+0000 7fc2eb3ff700 1 -- 172.21.15.40:0/13190919 shutdown_connections 2023-06-22T10:54:59.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.203+0000 7fc2eb3ff700 1 --2- 172.21.15.40:0/13190919 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fc2c806ace0 0x7fc2c806d190 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:59.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.203+0000 7fc2eb3ff700 1 --2- 172.21.15.40:0/13190919 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fc2e40b4e30 0x7fc2e414e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:59.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.203+0000 7fc2eb3ff700 1 --2- 172.21.15.40:0/13190919 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2e415c720 0x7fc2e40b3df0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:59.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.203+0000 7fc2eb3ff700 1 --2- 172.21.15.40:0/13190919 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2e40d2830 0x7fc2e40b38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:59.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.203+0000 7fc2eb3ff700 1 -- 172.21.15.40:0/13190919 >> 172.21.15.40:0/13190919 conn(0x7fc2e40cf720 msgr2=0x7fc2e406b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:59.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.203+0000 7fc2eb3ff700 1 -- 172.21.15.40:0/13190919 shutdown_connections 2023-06-22T10:54:59.208 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.203+0000 7fc2eb3ff700 1 -- 172.21.15.40:0/13190919 wait complete. 2023-06-22T10:54:59.208 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 9 2023-06-22T10:54:59.224 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-22T10:54:59.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.422+0000 7f9aca7ff700 1 Processor -- start 2023-06-22T10:54:59.426 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.423+0000 7f9aca7ff700 1 -- start start 2023-06-22T10:54:59.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.424+0000 7f9aca7ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9ac415c720 0x7f9ac40b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:59.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.424+0000 7f9aca7ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9ac40d2830 0x7f9ac40b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:59.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.424+0000 7f9aca7ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9ac40b4c60 0x7f9ac406b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:59.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.424+0000 7f9aca7ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ac4160d60 con 0x7f9ac40b4c60 2023-06-22T10:54:59.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.424+0000 7f9aca7ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ac40b50e0 con 0x7f9ac40d2830 2023-06-22T10:54:59.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.424+0000 7f9aca7ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac40b2130 con 0x7f9ac415c720 2023-06-22T10:54:59.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.424+0000 7f9ac8d9c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9ac40b4c60 0x7f9ac406b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:59.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.424+0000 7f9ac8d9c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9ac40b4c60 0x7f9ac406b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57846/0 (socket says 172.21.15.40:57846) 2023-06-22T10:54:59.428 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.424+0000 7f9ac8d9c700 1 -- 172.21.15.40:0/2307349798 learned_addr learned my addr 172.21.15.40:0/2307349798 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:59.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.424+0000 7f9ac3fff700 1 --2- 172.21.15.40:0/2307349798 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9ac415c720 0x7f9ac40b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:59.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.424+0000 7f9ac37fe700 1 --2- 172.21.15.40:0/2307349798 >> v2:172.21.15.45:3300/0 conn(0x7f9ac40d2830 0x7f9ac40b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:59.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.425+0000 7f9ac8d9c700 1 -- 172.21.15.40:0/2307349798 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9ac415c720 msgr2=0x7f9ac40b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:59.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.425+0000 7f9ac8d9c700 1 --2- 172.21.15.40:0/2307349798 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9ac415c720 0x7f9ac40b1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:59.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.425+0000 7f9ac8d9c700 1 -- 172.21.15.40:0/2307349798 >> v2:172.21.15.45:3300/0 conn(0x7f9ac40d2830 msgr2=0x7f9ac40b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:59.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.425+0000 7f9ac8d9c700 1 --2- 172.21.15.40:0/2307349798 >> v2:172.21.15.45:3300/0 conn(0x7f9ac40d2830 0x7f9ac40b4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:59.430 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.425+0000 7f9ac8d9c700 1 -- 172.21.15.40:0/2307349798 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac4161180 con 0x7f9ac40b4c60 2023-06-22T10:54:59.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.425+0000 7f9ac37fe700 1 --2- 172.21.15.40:0/2307349798 >> v2:172.21.15.45:3300/0 conn(0x7f9ac40d2830 0x7f9ac40b4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:54:59.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.425+0000 7f9ac8d9c700 1 --2- 172.21.15.40:0/2307349798 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ac40b4c60 0x7f9ac406b4d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9ac406c760 tx=0x7f9abc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85f8ec6c1af1f02f server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:59.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.425+0000 7f9ac2ffd700 1 -- 172.21.15.40:0/2307349798 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9abc00e070 con 0x7f9ac40b4c60 2023-06-22T10:54:59.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.425+0000 7f9ac2ffd700 1 -- 172.21.15.40:0/2307349798 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9abc00b910 con 0x7f9ac40b4c60 2023-06-22T10:54:59.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.425+0000 7f9ac2ffd700 1 -- 172.21.15.40:0/2307349798 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9abc00bcc0 con 0x7f9ac40b4c60 2023-06-22T10:54:59.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.426+0000 7f9aca7ff700 1 -- 172.21.15.40:0/2307349798 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ac40b4c60 msgr2=0x7f9ac406b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:59.431 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.426+0000 7f9aca7ff700 1 --2- 172.21.15.40:0/2307349798 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ac40b4c60 0x7f9ac406b4d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9ac406c760 tx=0x7f9abc00b330 comp rx=0 tx=0).stop 2023-06-22T10:54:59.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.426+0000 7f9aca7ff700 1 -- 172.21.15.40:0/2307349798 shutdown_connections 2023-06-22T10:54:59.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.426+0000 7f9aca7ff700 1 --2- 172.21.15.40:0/2307349798 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ac40b4c60 0x7f9ac406b4d0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:59.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.426+0000 7f9aca7ff700 1 --2- 172.21.15.40:0/2307349798 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9ac415c720 0x7f9ac40b1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:59.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.426+0000 7f9aca7ff700 1 --2- 172.21.15.40:0/2307349798 >> v2:172.21.15.45:3300/0 conn(0x7f9ac40d2830 0x7f9ac40b4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:59.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.426+0000 7f9aca7ff700 1 -- 172.21.15.40:0/2307349798 >> 172.21.15.40:0/2307349798 conn(0x7f9ac40cf720 msgr2=0x7f9ac40cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:59.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.426+0000 7f9aca7ff700 1 -- 172.21.15.40:0/2307349798 shutdown_connections 2023-06-22T10:54:59.432 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.426+0000 7f9aca7ff700 1 -- 172.21.15.40:0/2307349798 wait complete. 2023-06-22T10:54:59.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.428+0000 7f9aca7ff700 1 Processor -- start 2023-06-22T10:54:59.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.428+0000 7f9aca7ff700 1 -- start start 2023-06-22T10:54:59.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.429+0000 7f9aca7ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ac40b4c60 0x7f9ac40c8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:59.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.429+0000 7f9aca7ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9ac40d2830 0x7f9ac40b5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:59.434 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.429+0000 7f9aca7ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ac415c720 0x7f9ac41f18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:59.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.429+0000 7f9aca7ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac415f0d0 con 0x7f9ac415c720 2023-06-22T10:54:59.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.429+0000 7f9aca7ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac40c9100 con 0x7f9ac40b4c60 2023-06-22T10:54:59.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.429+0000 7f9aca7ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac415eaa0 con 0x7f9ac40d2830 2023-06-22T10:54:59.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.429+0000 7f9ac8d9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ac415c720 0x7f9ac41f18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:59.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.429+0000 7f9ac8d9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ac415c720 0x7f9ac41f18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57858/0 (socket says 172.21.15.40:57858) 2023-06-22T10:54:59.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.429+0000 7f9ac8d9c700 1 -- 172.21.15.40:0/49873567 learned_addr learned my addr 172.21.15.40:0/49873567 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:59.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.429+0000 7f9ac3fff700 1 --2- 172.21.15.40:0/49873567 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ac40b4c60 0x7f9ac40c8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:59.435 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.429+0000 7f9ac37fe700 1 --2- 172.21.15.40:0/49873567 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9ac40d2830 0x7f9ac40b5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:59.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.429+0000 7f9ac8d9c700 1 -- 172.21.15.40:0/49873567 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9ac40d2830 msgr2=0x7f9ac40b5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:59.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.429+0000 7f9ac8d9c700 1 --2- 172.21.15.40:0/49873567 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9ac40d2830 0x7f9ac40b5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:59.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.429+0000 7f9ac8d9c700 1 -- 172.21.15.40:0/49873567 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ac40b4c60 msgr2=0x7f9ac40c8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:59.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.429+0000 7f9ac8d9c700 1 --2- 172.21.15.40:0/49873567 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ac40b4c60 0x7f9ac40c8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:59.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.429+0000 7f9ac8d9c700 1 -- 172.21.15.40:0/49873567 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9abc009b30 con 0x7f9ac415c720 2023-06-22T10:54:59.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.430+0000 7f9ac8d9c700 1 --2- 172.21.15.40:0/49873567 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ac415c720 0x7f9ac41f18a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f9ac406b090 tx=0x7f9abc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:59.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.430+0000 7f9ac0ff9700 1 -- 172.21.15.40:0/49873567 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9abc0099b0 con 0x7f9ac415c720 2023-06-22T10:54:59.436 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.430+0000 7f9ac0ff9700 1 -- 172.21.15.40:0/49873567 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9abc0092e0 con 0x7f9ac415c720 2023-06-22T10:54:59.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.430+0000 7f9ac0ff9700 1 -- 172.21.15.40:0/49873567 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9abc004470 con 0x7f9ac415c720 2023-06-22T10:54:59.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.430+0000 7f9aca7ff700 1 -- 172.21.15.40:0/49873567 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ac41f23b0 con 0x7f9ac415c720 2023-06-22T10:54:59.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.430+0000 7f9aca7ff700 1 -- 172.21.15.40:0/49873567 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ac415ed60 con 0x7f9ac415c720 2023-06-22T10:54:59.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.431+0000 7f9aca7ff700 1 -- 172.21.15.40:0/49873567 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ac41f28d0 con 0x7f9ac415c720 2023-06-22T10:54:59.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.432+0000 7f9ac0ff9700 1 -- 172.21.15.40:0/49873567 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9abc0045d0 con 0x7f9ac415c720 2023-06-22T10:54:59.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.433+0000 7f9ac0ff9700 1 --2- 172.21.15.40:0/49873567 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f9ab006ace0 0x7f9ab006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:59.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.433+0000 7f9ac0ff9700 1 -- 172.21.15.40:0/49873567 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9abc08a7c0 con 0x7f9ac415c720 2023-06-22T10:54:59.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.433+0000 7f9ac3fff700 1 --2- 172.21.15.40:0/49873567 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f9ab006ace0 0x7f9ab006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:59.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.434+0000 7f9ac3fff700 1 --2- 172.21.15.40:0/49873567 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f9ab006ace0 0x7f9ab006d190 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9ab4009be0 tx=0x7f9ab4009210 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:59.440 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.437+0000 7f9ac0ff9700 1 -- 172.21.15.40:0/49873567 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9abc058fc0 con 0x7f9ac415c720 2023-06-22T10:54:59.646 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.643+0000 7f9aca7ff700 1 -- 172.21.15.40:0/49873567 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9ac4067580 con 0x7f9ac415c720 2023-06-22T10:54:59.647 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.644+0000 7f9ac0ff9700 1 -- 172.21.15.40:0/49873567 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20132 (secure 0 0 0) 0x7f9abc007310 con 0x7f9ac415c720 2023-06-22T10:54:59.648 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:54:59.648 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":30,"fsid":"475560bc-1a7c-4a75-b3b6-6fc6b20bdc52","created":"2023-06-22T10:53:03.784568+0000","modified":"2023-06-22T10:54:12.717204+0000","last_up_change":"2023-06-22T10:53:17.830348+0000","last_in_change":"2023-06-22T10:53:07.329974+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-22T10:53:17.182228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-22T10:53:23.874432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-22T10:53:29.812963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-22T10:53:30.404021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-22T10:53:33.982289+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"918db6b4-053a-46ba-976d-6e1a0104017f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6809","nonce":2400162888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6811","nonce":2400162888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6815","nonce":2400162888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6813","nonce":2400162888}]},"public_addr":"172.21.15.40:6809/2400162888","cluster_addr":"172.21.15.40:6811/2400162888","heartbeat_back_addr":"172.21.15.40:6815/2400162888","heartbeat_front_addr":"172.21.15.40:6813/2400162888","state":["exists","up"]},{"osd":1,"uuid":"0c146e2b-1725-4dae-9b5c-38795943b9d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6801","nonce":230885800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6803","nonce":230885800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6807","nonce":230885800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6805","nonce":230885800}]},"public_addr":"172.21.15.40:6801/230885800","cluster_addr":"172.21.15.40:6803/230885800","heartbeat_back_addr":"172.21.15.40:6807/230885800","heartbeat_front_addr":"172.21.15.40:6805/230885800","state":["exists","up"]},{"osd":2,"uuid":"0b3727fd-f281-46d5-a675-86c8c5ab269e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6817","nonce":2681404929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6819","nonce":2681404929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6823","nonce":2681404929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6821","nonce":2681404929}]},"public_addr":"172.21.15.40:6817/2681404929","cluster_addr":"172.21.15.40:6819/2681404929","heartbeat_back_addr":"172.21.15.40:6823/2681404929","heartbeat_front_addr":"172.21.15.40:6821/2681404929","state":["exists","up"]},{"osd":3,"uuid":"2969c698-7039-4bbb-beda-f756f7a368a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6825","nonce":111110981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6827","nonce":111110981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6831","nonce":111110981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6829","nonce":111110981}]},"public_addr":"172.21.15.40:6825/111110981","cluster_addr":"172.21.15.40:6827/111110981","heartbeat_back_addr":"172.21.15.40:6831/111110981","heartbeat_front_addr":"172.21.15.40:6829/111110981","state":["exists","up"]},{"osd":4,"uuid":"3bb1d9c8-8e42-4a6b-998d-04834f34be5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6801","nonce":3625455711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6803","nonce":3625455711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6807","nonce":3625455711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6805","nonce":3625455711}]},"public_addr":"172.21.15.45:6801/3625455711","cluster_addr":"172.21.15.45:6803/3625455711","heartbeat_back_addr":"172.21.15.45:6807/3625455711","heartbeat_front_addr":"172.21.15.45:6805/3625455711","state":["exists","up"]},{"osd":5,"uuid":"f9854ee4-302c-41be-977b-bedda090a3d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6817","nonce":3354411217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6819","nonce":3354411217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6823","nonce":3354411217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6821","nonce":3354411217}]},"public_addr":"172.21.15.45:6817/3354411217","cluster_addr":"172.21.15.45:6819/3354411217","heartbeat_back_addr":"172.21.15.45:6823/3354411217","heartbeat_front_addr":"172.21.15.45:6821/3354411217","state":["exists","up"]},{"osd":6,"uuid":"bbdb1989-f6ac-4954-9b85-b8b540d683c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6809","nonce":320111074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6811","nonce":320111074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6815","nonce":320111074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6813","nonce":320111074}]},"public_addr":"172.21.15.45:6809/320111074","cluster_addr":"172.21.15.45:6811/320111074","heartbeat_back_addr":"172.21.15.45:6815/320111074","heartbeat_front_addr":"172.21.15.45:6813/320111074","state":["exists","up"]},{"osd":7,"uuid":"823d44e3-58f1-4d1d-8263-a4e4a69d4327","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6825","nonce":643617680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6827","nonce":643617680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6831","nonce":643617680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6829","nonce":643617680}]},"public_addr":"172.21.15.45:6825/643617680","cluster_addr":"172.21.15.45:6827/643617680","heartbeat_back_addr":"172.21.15.45:6831/643617680","heartbeat_front_addr":"172.21.15.45:6829/643617680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.731262+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.873226+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.898936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.666578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.645990+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.953699+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.642823+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.693395+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1b","mappings":[{"from":3,"to":2}]},{"pgid":"4.2a","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-22T10:54:59.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.646+0000 7f9aca7ff700 1 -- 172.21.15.40:0/49873567 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f9ab006ace0 msgr2=0x7f9ab006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:59.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.646+0000 7f9aca7ff700 1 --2- 172.21.15.40:0/49873567 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f9ab006ace0 0x7f9ab006d190 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9ab4009be0 tx=0x7f9ab4009210 comp rx=0 tx=0).stop 2023-06-22T10:54:59.650 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.646+0000 7f9aca7ff700 1 -- 172.21.15.40:0/49873567 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ac415c720 msgr2=0x7f9ac41f18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:59.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.647+0000 7f9aca7ff700 1 --2- 172.21.15.40:0/49873567 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ac415c720 0x7f9ac41f18a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f9ac406b090 tx=0x7f9abc004ad0 comp rx=0 tx=0).stop 2023-06-22T10:54:59.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.647+0000 7f9aca7ff700 1 -- 172.21.15.40:0/49873567 shutdown_connections 2023-06-22T10:54:59.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.647+0000 7f9aca7ff700 1 --2- 172.21.15.40:0/49873567 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f9ab006ace0 0x7f9ab006d190 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:59.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.647+0000 7f9aca7ff700 1 --2- 172.21.15.40:0/49873567 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ac415c720 0x7f9ac41f18a0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:59.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.647+0000 7f9aca7ff700 1 --2- 172.21.15.40:0/49873567 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9ac40b4c60 0x7f9ac40c8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:59.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.647+0000 7f9aca7ff700 1 --2- 172.21.15.40:0/49873567 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9ac40d2830 0x7f9ac40b5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:59.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.647+0000 7f9aca7ff700 1 -- 172.21.15.40:0/49873567 >> 172.21.15.40:0/49873567 conn(0x7f9ac40cf720 msgr2=0x7f9ac415aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:59.651 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.647+0000 7f9aca7ff700 1 -- 172.21.15.40:0/49873567 shutdown_connections 2023-06-22T10:54:59.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.647+0000 7f9aca7ff700 1 -- 172.21.15.40:0/49873567 wait complete. 2023-06-22T10:54:59.668 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-06-22T10:54:59.669 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-22T10:54:59.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.866+0000 7f91a29ff700 1 Processor -- start 2023-06-22T10:54:59.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.866+0000 7f91a29ff700 1 -- start start 2023-06-22T10:54:59.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.867+0000 7f91a29ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f919c06df20 0x7f919c0cd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:59.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.867+0000 7f91a29ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f919c0b3b60 0x7f919c0b3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:59.870 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.867+0000 7f91a29ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f919c0b44c0 con 0x7f919c15a130 2023-06-22T10:54:59.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.867+0000 7f91a29ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f919c0b05e0 con 0x7f919c06df20 2023-06-22T10:54:59.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.867+0000 7f91a29ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f919c0b0880 con 0x7f919c0b3b60 2023-06-22T10:54:59.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.867+0000 7f919bfff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f919c15a130 0x7f919c0caa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:35912/0 (socket says 172.21.15.40:35912) 2023-06-22T10:54:59.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.867+0000 7f919bfff700 1 -- 172.21.15.40:0/2156047750 learned_addr learned my addr 172.21.15.40:0/2156047750 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:54:59.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.867+0000 7f919b7fe700 1 --2- 172.21.15.40:0/2156047750 >> v2:172.21.15.40:3300/0 conn(0x7f919c06df20 0x7f919c0cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:59.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.868+0000 7f91a0f9c700 1 --2- 172.21.15.40:0/2156047750 >> v2:172.21.15.45:3300/0 conn(0x7f919c0b3b60 0x7f919c0b3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:59.872 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.868+0000 7f919b7fe700 1 -- 172.21.15.40:0/2156047750 >> v2:172.21.15.45:3300/0 conn(0x7f919c0b3b60 msgr2=0x7f919c0b3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:54:59.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.868+0000 7f919b7fe700 1 --2- 172.21.15.40:0/2156047750 >> v2:172.21.15.45:3300/0 conn(0x7f919c0b3b60 0x7f919c0b3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:59.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.868+0000 7f919b7fe700 1 -- 172.21.15.40:0/2156047750 >> v1:172.21.15.40:6789/0 conn(0x7f919c15a130 legacy=0x7f919c0caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:59.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.868+0000 7f919affd700 1 -- 172.21.15.40:0/2156047750 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2577373600 0 0) 0x7f919c0b44c0 con 0x7f919c15a130 2023-06-22T10:54:59.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.868+0000 7f919b7fe700 1 -- 172.21.15.40:0/2156047750 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f919c0b0b60 con 0x7f919c06df20 2023-06-22T10:54:59.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.868+0000 7f919b7fe700 1 --2- 172.21.15.40:0/2156047750 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f919c06df20 0x7f919c0cd220 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f919c06adb0 tx=0x7f9190009b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3329c0e0a7c55a2c server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:59.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.868+0000 7f919affd700 1 -- 172.21.15.40:0/2156047750 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9190005e30 con 0x7f919c06df20 2023-06-22T10:54:59.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.868+0000 7f919affd700 1 -- 172.21.15.40:0/2156047750 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9190006030 con 0x7f919c06df20 2023-06-22T10:54:59.873 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.868+0000 7f919affd700 1 -- 172.21.15.40:0/2156047750 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91900063c0 con 0x7f919c06df20 2023-06-22T10:54:59.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.869+0000 7f91a29ff700 1 -- 172.21.15.40:0/2156047750 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f919c06df20 msgr2=0x7f919c0cd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:59.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.869+0000 7f91a29ff700 1 --2- 172.21.15.40:0/2156047750 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f919c06df20 0x7f919c0cd220 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f919c06adb0 tx=0x7f9190009b00 comp rx=0 tx=0).stop 2023-06-22T10:54:59.874 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.869+0000 7f91a29ff700 1 -- 172.21.15.40:0/2156047750 shutdown_connections 2023-06-22T10:54:59.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.869+0000 7f91a29ff700 1 --2- 172.21.15.40:0/2156047750 >> v2:172.21.15.45:3300/0 conn(0x7f919c0b3b60 0x7f919c0b3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:59.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.869+0000 7f91a29ff700 1 --2- 172.21.15.40:0/2156047750 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f919c06df20 0x7f919c0cd220 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:59.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.869+0000 7f91a29ff700 1 -- 172.21.15.40:0/2156047750 >> 172.21.15.40:0/2156047750 conn(0x7f919c069f30 msgr2=0x7f919c06a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:54:59.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.869+0000 7f91a29ff700 1 -- 172.21.15.40:0/2156047750 shutdown_connections 2023-06-22T10:54:59.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.869+0000 7f91a29ff700 1 -- 172.21.15.40:0/2156047750 wait complete. 2023-06-22T10:54:59.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.871+0000 7f91a29ff700 1 Processor -- start 2023-06-22T10:54:59.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.871+0000 7f91a29ff700 1 -- start start 2023-06-22T10:54:59.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.872+0000 7f91a29ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f919c06df20 0x7f919c1f1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:59.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.872+0000 7f91a29ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f919c0b3b60 0x7f919c1f2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:59.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.872+0000 7f91a29ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f919c15a130 0x7f919c0c8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:59.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.872+0000 7f91a29ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f919c0c8070 con 0x7f919c0b3b60 2023-06-22T10:54:59.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.872+0000 7f91a29ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f919c1f2a80 con 0x7f919c15a130 2023-06-22T10:54:59.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.872+0000 7f91a29ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f919c1f24c0 con 0x7f919c06df20 2023-06-22T10:54:59.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.872+0000 7f919b7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f919c0b3b60 0x7f919c1f2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:59.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.873+0000 7f919b7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f919c0b3b60 0x7f919c1f2c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57874/0 (socket says 172.21.15.40:57874) 2023-06-22T10:54:59.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.873+0000 7f919b7fe700 1 -- 172.21.15.40:0/634400623 learned_addr learned my addr 172.21.15.40:0/634400623 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:54:59.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.873+0000 7f919bfff700 1 --2- 172.21.15.40:0/634400623 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f919c06df20 0x7f919c1f1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:59.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.873+0000 7f91a0f9c700 1 --2- 172.21.15.40:0/634400623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f919c15a130 0x7f919c0c8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:59.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.873+0000 7f919b7fe700 1 -- 172.21.15.40:0/634400623 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f919c06df20 msgr2=0x7f919c1f1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:59.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.873+0000 7f919b7fe700 1 --2- 172.21.15.40:0/634400623 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f919c06df20 0x7f919c1f1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:59.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.873+0000 7f919b7fe700 1 -- 172.21.15.40:0/634400623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f919c15a130 msgr2=0x7f919c0c8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:54:59.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.873+0000 7f919b7fe700 1 --2- 172.21.15.40:0/634400623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f919c15a130 0x7f919c0c8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:54:59.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.873+0000 7f919b7fe700 1 -- 172.21.15.40:0/634400623 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9190009430 con 0x7f919c0b3b60 2023-06-22T10:54:59.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.873+0000 7f919b7fe700 1 --2- 172.21.15.40:0/634400623 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f919c0b3b60 0x7f919c1f2c60 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f9190000c00 tx=0x7f9190004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:59.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.873+0000 7f9198ff9700 1 -- 172.21.15.40:0/634400623 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9190006930 con 0x7f919c0b3b60 2023-06-22T10:54:59.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.874+0000 7f9198ff9700 1 -- 172.21.15.40:0/634400623 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9190020070 con 0x7f919c0b3b60 2023-06-22T10:54:59.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.874+0000 7f91a29ff700 1 -- 172.21.15.40:0/634400623 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f919c1f27a0 con 0x7f919c0b3b60 2023-06-22T10:54:59.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.874+0000 7f9198ff9700 1 -- 172.21.15.40:0/634400623 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9190004280 con 0x7f919c0b3b60 2023-06-22T10:54:59.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.874+0000 7f91a29ff700 1 -- 172.21.15.40:0/634400623 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f919c1f2020 con 0x7f919c0b3b60 2023-06-22T10:54:59.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.875+0000 7f91a29ff700 1 -- 172.21.15.40:0/634400623 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f919c067580 con 0x7f919c0b3b60 2023-06-22T10:54:59.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.876+0000 7f9198ff9700 1 -- 172.21.15.40:0/634400623 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9190022030 con 0x7f919c0b3b60 2023-06-22T10:54:59.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.876+0000 7f9198ff9700 1 --2- 172.21.15.40:0/634400623 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f918806ace0 0x7f918806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:54:59.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.877+0000 7f9198ff9700 1 -- 172.21.15.40:0/634400623 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f919008ac10 con 0x7f919c0b3b60 2023-06-22T10:54:59.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.877+0000 7f919bfff700 1 --2- 172.21.15.40:0/634400623 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f918806ace0 0x7f918806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:54:59.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.877+0000 7f919bfff700 1 --2- 172.21.15.40:0/634400623 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f918806ace0 0x7f918806d190 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f918c000f60 tx=0x7f918c007e70 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:54:59.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:54:59.881+0000 7f9198ff9700 1 -- 172.21.15.40:0/634400623 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9190055aa0 con 0x7f919c0b3b60 2023-06-22T10:55:00.137 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.134+0000 7f91a29ff700 1 -- 172.21.15.40:0/634400623 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f919c071030 con 0x7f919c0b3b60 2023-06-22T10:55:00.138 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.134+0000 7f9198ff9700 1 -- 172.21.15.40:0/634400623 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4664 (secure 0 0 0) 0x7f91900590c0 con 0x7f919c0b3b60 2023-06-22T10:55:00.138 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:55:00.138 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/627935577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":627935577},{"type":"v1","addr":"172.21.15.40:6835","nonce":627935577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3018871402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3018871402},{"type":"v1","addr":"172.21.15.40:6837","nonce":3018871402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/4036649607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":4036649607},{"type":"v1","addr":"172.21.15.45:6834","nonce":4036649607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-22T10:53:31.430326+0000","modified":"2023-06-22T10:53:59.666730+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4303},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4303":{"gid":4303,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/1579627519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":1579627519},{"type":"v1","addr":"172.21.15.45:6835","nonce":1579627519}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-22T10:55:00.140 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.137+0000 7f91a29ff700 1 -- 172.21.15.40:0/634400623 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f918806ace0 msgr2=0x7f918806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:00.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.137+0000 7f91a29ff700 1 --2- 172.21.15.40:0/634400623 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f918806ace0 0x7f918806d190 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f918c000f60 tx=0x7f918c007e70 comp rx=0 tx=0).stop 2023-06-22T10:55:00.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.137+0000 7f91a29ff700 1 -- 172.21.15.40:0/634400623 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f919c0b3b60 msgr2=0x7f919c1f2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:00.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.137+0000 7f91a29ff700 1 --2- 172.21.15.40:0/634400623 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f919c0b3b60 0x7f919c1f2c60 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f9190000c00 tx=0x7f9190004750 comp rx=0 tx=0).stop 2023-06-22T10:55:00.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.137+0000 7f91a29ff700 1 -- 172.21.15.40:0/634400623 shutdown_connections 2023-06-22T10:55:00.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.137+0000 7f91a29ff700 1 --2- 172.21.15.40:0/634400623 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f918806ace0 0x7f918806d190 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:00.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.137+0000 7f91a29ff700 1 --2- 172.21.15.40:0/634400623 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f919c06df20 0x7f919c1f1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:00.141 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.137+0000 7f91a29ff700 1 --2- 172.21.15.40:0/634400623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f919c15a130 0x7f919c0c8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:00.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.137+0000 7f91a29ff700 1 --2- 172.21.15.40:0/634400623 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f919c0b3b60 0x7f919c1f2c60 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:00.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.137+0000 7f91a29ff700 1 -- 172.21.15.40:0/634400623 >> 172.21.15.40:0/634400623 conn(0x7f919c069f30 msgr2=0x7f919c1577a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:00.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.137+0000 7f91a29ff700 1 -- 172.21.15.40:0/634400623 shutdown_connections 2023-06-22T10:55:00.142 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.137+0000 7f91a29ff700 1 -- 172.21.15.40:0/634400623 wait complete. 2023-06-22T10:55:00.142 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 9 2023-06-22T10:55:00.158 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-22T10:55:00.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.355+0000 7f8fb85ff700 1 Processor -- start 2023-06-22T10:55:00.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.355+0000 7f8fb85ff700 1 -- start start 2023-06-22T10:55:00.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.356+0000 7f8fb85ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8fb015c720 0x7f8fb00b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:00.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.357+0000 7f8fb85ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8fb00d2830 0x7f8fb00b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:00.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.357+0000 7f8fb85ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fb00b2130 con 0x7f8fb00b4c60 2023-06-22T10:55:00.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.357+0000 7f8fb85ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fb0160d60 con 0x7f8fb00d2830 2023-06-22T10:55:00.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.357+0000 7f8fb85ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb00b50e0 con 0x7f8fb015c720 2023-06-22T10:55:00.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.357+0000 7f8fb5b9a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8fb00d2830 0x7f8fb00b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:00.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.357+0000 7f8fb6b9c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f8fb00b4c60 0x7f8fb006b4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:35916/0 (socket says 172.21.15.40:35916) 2023-06-22T10:55:00.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.357+0000 7f8fb6b9c700 1 -- 172.21.15.40:0/889210336 learned_addr learned my addr 172.21.15.40:0/889210336 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:55:00.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.357+0000 7f8fb639b700 1 --2- 172.21.15.40:0/889210336 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8fb015c720 0x7f8fb00b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:00.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.357+0000 7f8fb5b9a700 1 -- 172.21.15.40:0/889210336 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8fb015c720 msgr2=0x7f8fb00b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:55:00.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.357+0000 7f8fb5b9a700 1 --2- 172.21.15.40:0/889210336 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8fb015c720 0x7f8fb00b1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:00.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.357+0000 7f8fb5b9a700 1 -- 172.21.15.40:0/889210336 >> v1:172.21.15.40:6789/0 conn(0x7f8fb00b4c60 legacy=0x7f8fb006b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:00.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.357+0000 7f8fb5b9a700 1 -- 172.21.15.40:0/889210336 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb0161180 con 0x7f8fb00d2830 2023-06-22T10:55:00.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.357+0000 7f8fb5399700 1 -- 172.21.15.40:0/889210336 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2815943351 0 0) 0x7f8fb00b2130 con 0x7f8fb00b4c60 2023-06-22T10:55:00.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.358+0000 7f8fb5b9a700 1 --2- 172.21.15.40:0/889210336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fb00d2830 0x7f8fb00b4720 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0009840 tx=0x7f8fa0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e5a826936e62032 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:00.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.358+0000 7f8fb5399700 1 -- 172.21.15.40:0/889210336 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa0011830 con 0x7f8fb00d2830 2023-06-22T10:55:00.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.358+0000 7f8fb5399700 1 -- 172.21.15.40:0/889210336 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa0011990 con 0x7f8fb00d2830 2023-06-22T10:55:00.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.358+0000 7f8fb5399700 1 -- 172.21.15.40:0/889210336 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa0011d20 con 0x7f8fb00d2830 2023-06-22T10:55:00.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.358+0000 7f8fb85ff700 1 -- 172.21.15.40:0/889210336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fb00d2830 msgr2=0x7f8fb00b4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:00.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.358+0000 7f8fb85ff700 1 --2- 172.21.15.40:0/889210336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fb00d2830 0x7f8fb00b4720 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0009840 tx=0x7f8fa0009b50 comp rx=0 tx=0).stop 2023-06-22T10:55:00.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.359+0000 7f8fb85ff700 1 -- 172.21.15.40:0/889210336 shutdown_connections 2023-06-22T10:55:00.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.359+0000 7f8fb85ff700 1 --2- 172.21.15.40:0/889210336 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8fb015c720 0x7f8fb00b1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:00.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.359+0000 7f8fb85ff700 1 --2- 172.21.15.40:0/889210336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fb00d2830 0x7f8fb00b4720 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:00.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.359+0000 7f8fb85ff700 1 -- 172.21.15.40:0/889210336 >> 172.21.15.40:0/889210336 conn(0x7f8fb00cf720 msgr2=0x7f8fb00cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:00.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.359+0000 7f8fb85ff700 1 -- 172.21.15.40:0/889210336 shutdown_connections 2023-06-22T10:55:00.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.359+0000 7f8fb85ff700 1 -- 172.21.15.40:0/889210336 wait complete. 2023-06-22T10:55:00.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.360+0000 7f8fb85ff700 1 Processor -- start 2023-06-22T10:55:00.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.361+0000 7f8fb85ff700 1 -- start start 2023-06-22T10:55:00.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.362+0000 7f8fb85ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8fb00b4c60 0x7f8fb015b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:00.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.362+0000 7f8fb85ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fb00d2830 0x7f8fb014acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:00.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.362+0000 7f8fb85ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fb015c720 0x7f8fb014b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:00.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.362+0000 7f8fb85ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb00cb440 con 0x7f8fb00d2830 2023-06-22T10:55:00.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.362+0000 7f8fb85ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb00ca830 con 0x7f8fb015c720 2023-06-22T10:55:00.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.362+0000 7f8fb85ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb00cab10 con 0x7f8fb00b4c60 2023-06-22T10:55:00.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.362+0000 7f8fb5b9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fb00d2830 0x7f8fb014acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:00.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.362+0000 7f8fb5b9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fb00d2830 0x7f8fb014acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57896/0 (socket says 172.21.15.40:57896) 2023-06-22T10:55:00.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.362+0000 7f8fb5b9a700 1 -- 172.21.15.40:0/1930162213 learned_addr learned my addr 172.21.15.40:0/1930162213 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:55:00.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.362+0000 7f8fb639b700 1 --2- 172.21.15.40:0/1930162213 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8fb00b4c60 0x7f8fb015b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:00.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.362+0000 7f8fb5b9a700 1 -- 172.21.15.40:0/1930162213 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8fb00b4c60 msgr2=0x7f8fb015b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:00.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.362+0000 7f8fb5b9a700 1 --2- 172.21.15.40:0/1930162213 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8fb00b4c60 0x7f8fb015b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:00.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.362+0000 7f8fb5b9a700 1 -- 172.21.15.40:0/1930162213 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fb015c720 msgr2=0x7f8fb014b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:00.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.362+0000 7f8fb5b9a700 1 --2- 172.21.15.40:0/1930162213 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fb015c720 0x7f8fb014b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:00.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.362+0000 7f8fb5b9a700 1 -- 172.21.15.40:0/1930162213 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa00094a0 con 0x7f8fb00d2830 2023-06-22T10:55:00.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.363+0000 7f8fb5b9a700 1 --2- 172.21.15.40:0/1930162213 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fb00d2830 0x7f8fb014acb0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f8fb006b090 tx=0x7f8fa0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:00.368 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.363+0000 7f8fa6ffd700 1 -- 172.21.15.40:0/1930162213 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa00038a0 con 0x7f8fb00d2830 2023-06-22T10:55:00.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.363+0000 7f8fa6ffd700 1 -- 172.21.15.40:0/1930162213 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa001f070 con 0x7f8fb00d2830 2023-06-22T10:55:00.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.363+0000 7f8fa6ffd700 1 -- 172.21.15.40:0/1930162213 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa0003c40 con 0x7f8fb00d2830 2023-06-22T10:55:00.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.363+0000 7f8fb85ff700 1 -- 172.21.15.40:0/1930162213 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fb00cadf0 con 0x7f8fb00d2830 2023-06-22T10:55:00.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.363+0000 7f8fb85ff700 1 -- 172.21.15.40:0/1930162213 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fb015bb40 con 0x7f8fb00d2830 2023-06-22T10:55:00.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.364+0000 7f8fb85ff700 1 -- 172.21.15.40:0/1930162213 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fb015bcd0 con 0x7f8fb00d2830 2023-06-22T10:55:00.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.365+0000 7f8fa6ffd700 1 -- 172.21.15.40:0/1930162213 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8fa0026480 con 0x7f8fb00d2830 2023-06-22T10:55:00.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.366+0000 7f8fa6ffd700 1 --2- 172.21.15.40:0/1930162213 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f8f9406ace0 0x7f8f9406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:00.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.366+0000 7f8fa6ffd700 1 -- 172.21.15.40:0/1930162213 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8fa0021070 con 0x7f8fb00d2830 2023-06-22T10:55:00.370 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.366+0000 7f8fb639b700 1 --2- 172.21.15.40:0/1930162213 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f8f9406ace0 0x7f8f9406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:00.371 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.367+0000 7f8fb639b700 1 --2- 172.21.15.40:0/1930162213 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f8f9406ace0 0x7f8f9406d190 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8fac009770 tx=0x7f8fac008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:00.373 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.370+0000 7f8fa6ffd700 1 -- 172.21.15.40:0/1930162213 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8fa0055fc0 con 0x7f8fb00d2830 2023-06-22T10:55:00.623 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.620+0000 7f8fb85ff700 1 -- 172.21.15.40:0/1930162213 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8fb0067580 con 0x7f8fb00d2830 2023-06-22T10:55:00.624 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.621+0000 7f8fa6ffd700 1 -- 172.21.15.40:0/1930162213 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4664 (secure 0 0 0) 0x7f8fa00595e0 con 0x7f8fb00d2830 2023-06-22T10:55:00.625 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:55:00.625 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/627935577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":627935577},{"type":"v1","addr":"172.21.15.40:6835","nonce":627935577}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/3018871402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6836","nonce":3018871402},{"type":"v1","addr":"172.21.15.40:6837","nonce":3018871402}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/4036649607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":4036649607},{"type":"v1","addr":"172.21.15.45:6834","nonce":4036649607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-22T10:53:31.430326+0000","modified":"2023-06-22T10:53:59.666730+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4303},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4303":{"gid":4303,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6835/1579627519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":1579627519},{"type":"v1","addr":"172.21.15.45:6835","nonce":1579627519}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-22T10:55:00.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.623+0000 7f8fb85ff700 1 -- 172.21.15.40:0/1930162213 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f8f9406ace0 msgr2=0x7f8f9406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:00.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.623+0000 7f8fb85ff700 1 --2- 172.21.15.40:0/1930162213 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f8f9406ace0 0x7f8f9406d190 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8fac009770 tx=0x7f8fac008040 comp rx=0 tx=0).stop 2023-06-22T10:55:00.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.623+0000 7f8fb85ff700 1 -- 172.21.15.40:0/1930162213 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fb00d2830 msgr2=0x7f8fb014acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:00.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.623+0000 7f8fb85ff700 1 --2- 172.21.15.40:0/1930162213 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fb00d2830 0x7f8fb014acb0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f8fb006b090 tx=0x7f8fa0004750 comp rx=0 tx=0).stop 2023-06-22T10:55:00.627 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.623+0000 7f8fb85ff700 1 -- 172.21.15.40:0/1930162213 shutdown_connections 2023-06-22T10:55:00.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.623+0000 7f8fb85ff700 1 --2- 172.21.15.40:0/1930162213 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f8f9406ace0 0x7f8f9406d190 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:00.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.623+0000 7f8fb85ff700 1 --2- 172.21.15.40:0/1930162213 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f8fb00b4c60 0x7f8fb015b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:00.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.623+0000 7f8fb85ff700 1 --2- 172.21.15.40:0/1930162213 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fb015c720 0x7f8fb014b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:00.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.623+0000 7f8fb85ff700 1 --2- 172.21.15.40:0/1930162213 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8fb00d2830 0x7f8fb014acb0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:00.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.624+0000 7f8fb85ff700 1 -- 172.21.15.40:0/1930162213 >> 172.21.15.40:0/1930162213 conn(0x7f8fb00cf720 msgr2=0x7f8fb00b5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:00.628 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.624+0000 7f8fb85ff700 1 -- 172.21.15.40:0/1930162213 shutdown_connections 2023-06-22T10:55:00.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.624+0000 7f8fb85ff700 1 -- 172.21.15.40:0/1930162213 wait complete. 2023-06-22T10:55:00.629 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 9 2023-06-22T10:55:00.645 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-22T10:55:00.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.844+0000 7f520abff700 1 Processor -- start 2023-06-22T10:55:00.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.844+0000 7f520abff700 1 -- start start 2023-06-22T10:55:00.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.845+0000 7f520abff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f52040b3120 0x7f520415cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:00.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.845+0000 7f520abff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f52040add30 0x7f5204159f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:00.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.846+0000 7f520abff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f520415d560 con 0x7f52040b3910 2023-06-22T10:55:00.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.846+0000 7f520abff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5204153bc0 con 0x7f52040add30 2023-06-22T10:55:00.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.846+0000 7f520abff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f520415d840 con 0x7f52040b3120 2023-06-22T10:55:00.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.846+0000 7f5203fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f52040add30 0x7f5204159f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:00.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.846+0000 7f520919c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f52040b3910 0x7f52040b1b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:35926/0 (socket says 172.21.15.40:35926) 2023-06-22T10:55:00.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.846+0000 7f520919c700 1 -- 172.21.15.40:0/309089005 learned_addr learned my addr 172.21.15.40:0/309089005 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:55:00.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.846+0000 7f520899b700 1 --2- 172.21.15.40:0/309089005 >> v2:172.21.15.45:3300/0 conn(0x7f52040b3120 0x7f520415cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:00.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.846+0000 7f52037fe700 1 -- 172.21.15.40:0/309089005 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1117246658 0 0) 0x7f520415d560 con 0x7f52040b3910 2023-06-22T10:55:00.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.846+0000 7f52037fe700 1 -- 172.21.15.40:0/309089005 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51f40035b0 con 0x7f52040b3910 2023-06-22T10:55:00.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.846+0000 7f5203fff700 1 -- 172.21.15.40:0/309089005 >> v2:172.21.15.45:3300/0 conn(0x7f52040b3120 msgr2=0x7f520415cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:55:00.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.846+0000 7f5203fff700 1 --2- 172.21.15.40:0/309089005 >> v2:172.21.15.45:3300/0 conn(0x7f52040b3120 0x7f520415cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:00.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.846+0000 7f5203fff700 1 -- 172.21.15.40:0/309089005 >> v1:172.21.15.40:6789/0 conn(0x7f52040b3910 legacy=0x7f52040b1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:00.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.846+0000 7f5203fff700 1 -- 172.21.15.40:0/309089005 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f520415db20 con 0x7f52040add30 2023-06-22T10:55:00.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.847+0000 7f5203fff700 1 --2- 172.21.15.40:0/309089005 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52040add30 0x7f5204159f80 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f52040b12e0 tx=0x7f51f0009b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75e131bacf8cd237 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:00.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.847+0000 7f52037fe700 1 -- 172.21.15.40:0/309089005 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f0005e30 con 0x7f52040add30 2023-06-22T10:55:00.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.847+0000 7f52037fe700 1 -- 172.21.15.40:0/309089005 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51f0006030 con 0x7f52040add30 2023-06-22T10:55:00.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.847+0000 7f52037fe700 1 -- 172.21.15.40:0/309089005 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f00063c0 con 0x7f52040add30 2023-06-22T10:55:00.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.847+0000 7f520abff700 1 -- 172.21.15.40:0/309089005 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52040add30 msgr2=0x7f5204159f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:00.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.847+0000 7f520abff700 1 --2- 172.21.15.40:0/309089005 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52040add30 0x7f5204159f80 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f52040b12e0 tx=0x7f51f0009b00 comp rx=0 tx=0).stop 2023-06-22T10:55:00.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.848+0000 7f520abff700 1 -- 172.21.15.40:0/309089005 shutdown_connections 2023-06-22T10:55:00.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.848+0000 7f520abff700 1 --2- 172.21.15.40:0/309089005 >> v2:172.21.15.45:3300/0 conn(0x7f52040b3120 0x7f520415cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:00.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.848+0000 7f520abff700 1 --2- 172.21.15.40:0/309089005 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52040add30 0x7f5204159f80 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:00.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.848+0000 7f520abff700 1 -- 172.21.15.40:0/309089005 >> 172.21.15.40:0/309089005 conn(0x7f5204069f30 msgr2=0x7f520406a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:00.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.848+0000 7f520abff700 1 -- 172.21.15.40:0/309089005 shutdown_connections 2023-06-22T10:55:00.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.848+0000 7f520abff700 1 -- 172.21.15.40:0/309089005 wait complete. 2023-06-22T10:55:00.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.849+0000 7f520abff700 1 Processor -- start 2023-06-22T10:55:00.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.850+0000 7f520abff700 1 -- start start 2023-06-22T10:55:00.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.851+0000 7f520abff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52040add30 0x7f5204140490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:00.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.851+0000 7f520abff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f52040b3120 0x7f52041e5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:00.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.851+0000 7f520abff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52040b3910 0x7f5204070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:00.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.851+0000 7f520abff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52041e6b10 con 0x7f52040b3910 2023-06-22T10:55:00.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.851+0000 7f520abff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52041e6270 con 0x7f52040add30 2023-06-22T10:55:00.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.851+0000 7f520abff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52041e6550 con 0x7f52040b3120 2023-06-22T10:55:00.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.851+0000 7f520919c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52040b3910 0x7f5204070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:00.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.851+0000 7f520919c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52040b3910 0x7f5204070450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57924/0 (socket says 172.21.15.40:57924) 2023-06-22T10:55:00.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.851+0000 7f520919c700 1 -- 172.21.15.40:0/239922755 learned_addr learned my addr 172.21.15.40:0/239922755 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:55:00.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.851+0000 7f520899b700 1 --2- 172.21.15.40:0/239922755 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52040add30 0x7f5204140490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:00.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.851+0000 7f5203fff700 1 --2- 172.21.15.40:0/239922755 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f52040b3120 0x7f52041e5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:00.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.851+0000 7f520919c700 1 -- 172.21.15.40:0/239922755 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f52040b3120 msgr2=0x7f52041e5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:00.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.851+0000 7f520919c700 1 --2- 172.21.15.40:0/239922755 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f52040b3120 0x7f52041e5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:00.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.851+0000 7f520919c700 1 -- 172.21.15.40:0/239922755 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52040add30 msgr2=0x7f5204140490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:00.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.851+0000 7f520919c700 1 --2- 172.21.15.40:0/239922755 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52040add30 0x7f5204140490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:00.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.851+0000 7f520919c700 1 -- 172.21.15.40:0/239922755 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f0009430 con 0x7f52040b3910 2023-06-22T10:55:00.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.851+0000 7f5203fff700 1 --2- 172.21.15.40:0/239922755 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f52040b3120 0x7f52041e5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:55:00.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.852+0000 7f520919c700 1 --2- 172.21.15.40:0/239922755 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52040b3910 0x7f5204070450 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f51fc00cb40 tx=0x7f51fc00ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:00.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.852+0000 7f52017fa700 1 -- 172.21.15.40:0/239922755 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51fc00aaa0 con 0x7f52040b3910 2023-06-22T10:55:00.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.852+0000 7f52017fa700 1 -- 172.21.15.40:0/239922755 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51fc00ac00 con 0x7f52040b3910 2023-06-22T10:55:00.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.852+0000 7f52017fa700 1 -- 172.21.15.40:0/239922755 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51fc012400 con 0x7f52040b3910 2023-06-22T10:55:00.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.852+0000 7f520abff700 1 -- 172.21.15.40:0/239922755 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52041e6830 con 0x7f52040b3910 2023-06-22T10:55:00.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.852+0000 7f520abff700 1 -- 172.21.15.40:0/239922755 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52041409d0 con 0x7f52040b3910 2023-06-22T10:55:00.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.853+0000 7f520abff700 1 -- 172.21.15.40:0/239922755 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52040cc970 con 0x7f52040b3910 2023-06-22T10:55:00.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.854+0000 7f52017fa700 1 -- 172.21.15.40:0/239922755 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f51fc01b3b0 con 0x7f52040b3910 2023-06-22T10:55:00.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.855+0000 7f52017fa700 1 --2- 172.21.15.40:0/239922755 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f51e806ace0 0x7f51e806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:00.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.855+0000 7f52017fa700 1 -- 172.21.15.40:0/239922755 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f51fc089580 con 0x7f52040b3910 2023-06-22T10:55:00.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.856+0000 7f520899b700 1 --2- 172.21.15.40:0/239922755 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f51e806ace0 0x7f51e806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:00.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.856+0000 7f520899b700 1 --2- 172.21.15.40:0/239922755 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f51e806ace0 0x7f51e806d190 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f51f8009be0 tx=0x7f51f8009210 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:00.869 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:00.859+0000 7f52017fa700 1 -- 172.21.15.40:0/239922755 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f52040cc970 con 0x7f52040b3910 2023-06-22T10:55:01.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.068+0000 7f520abff700 1 -- 172.21.15.40:0/239922755 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f52040cc970 con 0x7f52040b3910 2023-06-22T10:55:01.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.070+0000 7f52017fa700 1 -- 172.21.15.40:0/239922755 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20132 (secure 0 0 0) 0x7f52040cc970 con 0x7f52040b3910 2023-06-22T10:55:01.073 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:55:01.074 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":30,"fsid":"475560bc-1a7c-4a75-b3b6-6fc6b20bdc52","created":"2023-06-22T10:53:03.784568+0000","modified":"2023-06-22T10:54:12.717204+0000","last_up_change":"2023-06-22T10:53:17.830348+0000","last_in_change":"2023-06-22T10:53:07.329974+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-22T10:53:17.182228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-22T10:53:23.874432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-22T10:53:29.812963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-22T10:53:30.404021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-22T10:53:33.982289+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"918db6b4-053a-46ba-976d-6e1a0104017f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6809","nonce":2400162888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6811","nonce":2400162888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6815","nonce":2400162888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6813","nonce":2400162888}]},"public_addr":"172.21.15.40:6809/2400162888","cluster_addr":"172.21.15.40:6811/2400162888","heartbeat_back_addr":"172.21.15.40:6815/2400162888","heartbeat_front_addr":"172.21.15.40:6813/2400162888","state":["exists","up"]},{"osd":1,"uuid":"0c146e2b-1725-4dae-9b5c-38795943b9d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6801","nonce":230885800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6803","nonce":230885800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6807","nonce":230885800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6805","nonce":230885800}]},"public_addr":"172.21.15.40:6801/230885800","cluster_addr":"172.21.15.40:6803/230885800","heartbeat_back_addr":"172.21.15.40:6807/230885800","heartbeat_front_addr":"172.21.15.40:6805/230885800","state":["exists","up"]},{"osd":2,"uuid":"0b3727fd-f281-46d5-a675-86c8c5ab269e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6817","nonce":2681404929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6819","nonce":2681404929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6823","nonce":2681404929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6821","nonce":2681404929}]},"public_addr":"172.21.15.40:6817/2681404929","cluster_addr":"172.21.15.40:6819/2681404929","heartbeat_back_addr":"172.21.15.40:6823/2681404929","heartbeat_front_addr":"172.21.15.40:6821/2681404929","state":["exists","up"]},{"osd":3,"uuid":"2969c698-7039-4bbb-beda-f756f7a368a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6825","nonce":111110981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6827","nonce":111110981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6831","nonce":111110981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6829","nonce":111110981}]},"public_addr":"172.21.15.40:6825/111110981","cluster_addr":"172.21.15.40:6827/111110981","heartbeat_back_addr":"172.21.15.40:6831/111110981","heartbeat_front_addr":"172.21.15.40:6829/111110981","state":["exists","up"]},{"osd":4,"uuid":"3bb1d9c8-8e42-4a6b-998d-04834f34be5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6801","nonce":3625455711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6803","nonce":3625455711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6807","nonce":3625455711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6805","nonce":3625455711}]},"public_addr":"172.21.15.45:6801/3625455711","cluster_addr":"172.21.15.45:6803/3625455711","heartbeat_back_addr":"172.21.15.45:6807/3625455711","heartbeat_front_addr":"172.21.15.45:6805/3625455711","state":["exists","up"]},{"osd":5,"uuid":"f9854ee4-302c-41be-977b-bedda090a3d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6817","nonce":3354411217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6819","nonce":3354411217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6823","nonce":3354411217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6821","nonce":3354411217}]},"public_addr":"172.21.15.45:6817/3354411217","cluster_addr":"172.21.15.45:6819/3354411217","heartbeat_back_addr":"172.21.15.45:6823/3354411217","heartbeat_front_addr":"172.21.15.45:6821/3354411217","state":["exists","up"]},{"osd":6,"uuid":"bbdb1989-f6ac-4954-9b85-b8b540d683c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6809","nonce":320111074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6811","nonce":320111074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6815","nonce":320111074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6813","nonce":320111074}]},"public_addr":"172.21.15.45:6809/320111074","cluster_addr":"172.21.15.45:6811/320111074","heartbeat_back_addr":"172.21.15.45:6815/320111074","heartbeat_front_addr":"172.21.15.45:6813/320111074","state":["exists","up"]},{"osd":7,"uuid":"823d44e3-58f1-4d1d-8263-a4e4a69d4327","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6825","nonce":643617680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6827","nonce":643617680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6831","nonce":643617680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6829","nonce":643617680}]},"public_addr":"172.21.15.45:6825/643617680","cluster_addr":"172.21.15.45:6827/643617680","heartbeat_back_addr":"172.21.15.45:6831/643617680","heartbeat_front_addr":"172.21.15.45:6829/643617680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.731262+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.873226+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.898936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.666578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.645990+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.953699+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.642823+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.693395+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1b","mappings":[{"from":3,"to":2}]},{"pgid":"4.2a","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-22T10:55:01.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.072+0000 7f520abff700 1 -- 172.21.15.40:0/239922755 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f51e806ace0 msgr2=0x7f51e806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:01.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.072+0000 7f520abff700 1 --2- 172.21.15.40:0/239922755 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f51e806ace0 0x7f51e806d190 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f51f8009be0 tx=0x7f51f8009210 comp rx=0 tx=0).stop 2023-06-22T10:55:01.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.072+0000 7f520abff700 1 -- 172.21.15.40:0/239922755 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52040b3910 msgr2=0x7f5204070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:01.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.072+0000 7f520abff700 1 --2- 172.21.15.40:0/239922755 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52040b3910 0x7f5204070450 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f51fc00cb40 tx=0x7f51fc00ce50 comp rx=0 tx=0).stop 2023-06-22T10:55:01.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.072+0000 7f520abff700 1 -- 172.21.15.40:0/239922755 shutdown_connections 2023-06-22T10:55:01.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.072+0000 7f520abff700 1 --2- 172.21.15.40:0/239922755 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f51e806ace0 0x7f51e806d190 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:01.076 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.072+0000 7f520abff700 1 --2- 172.21.15.40:0/239922755 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52040b3910 0x7f5204070450 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:01.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.072+0000 7f520abff700 1 --2- 172.21.15.40:0/239922755 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52040add30 0x7f5204140490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:01.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.072+0000 7f520abff700 1 --2- 172.21.15.40:0/239922755 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f52040b3120 0x7f52041e5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:01.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.072+0000 7f520abff700 1 -- 172.21.15.40:0/239922755 >> 172.21.15.40:0/239922755 conn(0x7f5204069f30 msgr2=0x7f52040aec20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:01.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.072+0000 7f520abff700 1 -- 172.21.15.40:0/239922755 shutdown_connections 2023-06-22T10:55:01.077 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.072+0000 7f520abff700 1 -- 172.21.15.40:0/239922755 wait complete. 2023-06-22T10:55:01.093 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-06-22T10:55:01.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.293+0000 7f71021ff700 1 Processor -- start 2023-06-22T10:55:01.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.293+0000 7f71021ff700 1 -- start start 2023-06-22T10:55:01.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.294+0000 7f71021ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f70fc0adbe0 0x7f70fc0ceff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:01.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.295+0000 7f71021ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f70fc06a640 0x7f70fc0b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:01.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.295+0000 7f71021ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70fc0adfb0 con 0x7f70fc0caa80 2023-06-22T10:55:01.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.295+0000 7f71021ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70fc0714b0 con 0x7f70fc0adbe0 2023-06-22T10:55:01.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.295+0000 7f71021ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc070ef0 con 0x7f70fc06a640 2023-06-22T10:55:01.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.295+0000 7f70fb7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f70fc0adbe0 0x7f70fc0ceff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:01.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.295+0000 7f70faffd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f70fc0caa80 0x7f70fc069f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:35932/0 (socket says 172.21.15.40:35932) 2023-06-22T10:55:01.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.295+0000 7f70faffd700 1 -- 172.21.15.40:0/2795282876 learned_addr learned my addr 172.21.15.40:0/2795282876 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:55:01.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.295+0000 7f70fbfff700 1 --2- 172.21.15.40:0/2795282876 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f70fc06a640 0x7f70fc0b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:01.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.295+0000 7f70fa7fc700 1 -- 172.21.15.40:0/2795282876 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 283119654 0 0) 0x7f70f0001110 con 0x7f70fc0caa80 2023-06-22T10:55:01.300 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.295+0000 7f70fb7fe700 1 -- 172.21.15.40:0/2795282876 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f70fc06a640 msgr2=0x7f70fc0b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:55:01.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.295+0000 7f70fb7fe700 1 --2- 172.21.15.40:0/2795282876 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f70fc06a640 0x7f70fc0b1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:01.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.295+0000 7f70fb7fe700 1 -- 172.21.15.40:0/2795282876 >> v1:172.21.15.40:6789/0 conn(0x7f70fc0caa80 legacy=0x7f70fc069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:01.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.295+0000 7f70fb7fe700 1 -- 172.21.15.40:0/2795282876 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70fc0711d0 con 0x7f70fc0adbe0 2023-06-22T10:55:01.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.296+0000 7f70fb7fe700 1 --2- 172.21.15.40:0/2795282876 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70fc0adbe0 0x7f70fc0ceff0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f70ec009840 tx=0x7f70ec009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31e711a82ad4c90c server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:01.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.296+0000 7f70fa7fc700 1 -- 172.21.15.40:0/2795282876 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ec011830 con 0x7f70fc0adbe0 2023-06-22T10:55:01.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.296+0000 7f70fa7fc700 1 -- 172.21.15.40:0/2795282876 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70ec011990 con 0x7f70fc0adbe0 2023-06-22T10:55:01.301 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.296+0000 7f70fa7fc700 1 -- 172.21.15.40:0/2795282876 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ec011d20 con 0x7f70fc0adbe0 2023-06-22T10:55:01.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.296+0000 7f71021ff700 1 -- 172.21.15.40:0/2795282876 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70fc0adbe0 msgr2=0x7f70fc0ceff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:01.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.296+0000 7f71021ff700 1 --2- 172.21.15.40:0/2795282876 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70fc0adbe0 0x7f70fc0ceff0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f70ec009840 tx=0x7f70ec009b50 comp rx=0 tx=0).stop 2023-06-22T10:55:01.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.296+0000 7f71021ff700 1 -- 172.21.15.40:0/2795282876 shutdown_connections 2023-06-22T10:55:01.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.296+0000 7f71021ff700 1 --2- 172.21.15.40:0/2795282876 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f70fc06a640 0x7f70fc0b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:01.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.296+0000 7f71021ff700 1 --2- 172.21.15.40:0/2795282876 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70fc0adbe0 0x7f70fc0ceff0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:01.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.297+0000 7f71021ff700 1 -- 172.21.15.40:0/2795282876 >> 172.21.15.40:0/2795282876 conn(0x7f70fc0b0ff0 msgr2=0x7f70fc0ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:01.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.297+0000 7f71021ff700 1 -- 172.21.15.40:0/2795282876 shutdown_connections 2023-06-22T10:55:01.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.297+0000 7f71021ff700 1 -- 172.21.15.40:0/2795282876 wait complete. 2023-06-22T10:55:01.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.298+0000 7f71021ff700 1 Processor -- start 2023-06-22T10:55:01.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.299+0000 7f71021ff700 1 -- start start 2023-06-22T10:55:01.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.299+0000 7f71021ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70fc06a640 0x7f70fc0c5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:01.304 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.299+0000 7f71021ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70fc0adbe0 0x7f70fc14be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:01.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.299+0000 7f71021ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f70fc0caa80 0x7f70fc15b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:01.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.299+0000 7f71021ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc0c5ee0 con 0x7f70fc06a640 2023-06-22T10:55:01.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.299+0000 7f71021ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc0c61c0 con 0x7f70fc0adbe0 2023-06-22T10:55:01.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.299+0000 7f71021ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc0c64a0 con 0x7f70fc0caa80 2023-06-22T10:55:01.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.300+0000 7f70fb7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70fc06a640 0x7f70fc0c5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:01.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.300+0000 7f70fb7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70fc06a640 0x7f70fc0c5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57950/0 (socket says 172.21.15.40:57950) 2023-06-22T10:55:01.305 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.300+0000 7f70fb7fe700 1 -- 172.21.15.40:0/3414898211 learned_addr learned my addr 172.21.15.40:0/3414898211 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:55:01.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.300+0000 7f70fbfff700 1 --2- 172.21.15.40:0/3414898211 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f70fc0caa80 0x7f70fc15b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:01.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.300+0000 7f70faffd700 1 --2- 172.21.15.40:0/3414898211 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70fc0adbe0 0x7f70fc14be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:01.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.300+0000 7f70fb7fe700 1 -- 172.21.15.40:0/3414898211 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f70fc0caa80 msgr2=0x7f70fc15b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:01.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.300+0000 7f70fb7fe700 1 --2- 172.21.15.40:0/3414898211 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f70fc0caa80 0x7f70fc15b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:01.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.300+0000 7f70fb7fe700 1 -- 172.21.15.40:0/3414898211 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70fc0adbe0 msgr2=0x7f70fc14be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:01.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.300+0000 7f70fb7fe700 1 --2- 172.21.15.40:0/3414898211 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70fc0adbe0 0x7f70fc14be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:01.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.300+0000 7f70fb7fe700 1 -- 172.21.15.40:0/3414898211 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70ec0094a0 con 0x7f70fc06a640 2023-06-22T10:55:01.306 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.300+0000 7f70fbfff700 1 --2- 172.21.15.40:0/3414898211 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f70fc0caa80 0x7f70fc15b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:55:01.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.300+0000 7f70faffd700 1 --2- 172.21.15.40:0/3414898211 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70fc0adbe0 0x7f70fc14be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:55:01.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.300+0000 7f70fb7fe700 1 --2- 172.21.15.40:0/3414898211 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70fc06a640 0x7f70fc0c5900 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f70ec009fd0 tx=0x7f70ec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:01.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.301+0000 7f70e3fff700 1 -- 172.21.15.40:0/3414898211 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ec0038a0 con 0x7f70fc06a640 2023-06-22T10:55:01.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.301+0000 7f70e3fff700 1 -- 172.21.15.40:0/3414898211 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70ec01f070 con 0x7f70fc06a640 2023-06-22T10:55:01.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.301+0000 7f71021ff700 1 -- 172.21.15.40:0/3414898211 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70fc0c6780 con 0x7f70fc06a640 2023-06-22T10:55:01.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.301+0000 7f70e3fff700 1 -- 172.21.15.40:0/3414898211 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ec003c40 con 0x7f70fc06a640 2023-06-22T10:55:01.307 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.301+0000 7f71021ff700 1 -- 172.21.15.40:0/3414898211 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70fc15bbb0 con 0x7f70fc06a640 2023-06-22T10:55:01.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.302+0000 7f71021ff700 1 -- 172.21.15.40:0/3414898211 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70fc067580 con 0x7f70fc06a640 2023-06-22T10:55:01.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.303+0000 7f70e3fff700 1 -- 172.21.15.40:0/3414898211 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f70ec026480 con 0x7f70fc06a640 2023-06-22T10:55:01.308 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.304+0000 7f70e3fff700 1 --2- 172.21.15.40:0/3414898211 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f70e806ace0 0x7f70e806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:01.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.304+0000 7f70e3fff700 1 -- 172.21.15.40:0/3414898211 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f70ec021070 con 0x7f70fc06a640 2023-06-22T10:55:01.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.304+0000 7f70faffd700 1 --2- 172.21.15.40:0/3414898211 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f70e806ace0 0x7f70e806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:01.309 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.304+0000 7f70faffd700 1 --2- 172.21.15.40:0/3414898211 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f70e806ace0 0x7f70e806d190 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f70fc156730 tx=0x7f70f0007d30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:01.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.308+0000 7f70e3fff700 1 -- 172.21.15.40:0/3414898211 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f70ec055ec0 con 0x7f70fc06a640 2023-06-22T10:55:01.566 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.562+0000 7f71021ff700 1 -- 172.21.15.40:0/3414898211 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f70fc0af390 con 0x7f70fc06a640 2023-06-22T10:55:01.566 INFO:tasks.ceph.mon.a.smithi040.stderr:2023-06-22T10:55:01.563+0000 7f89fa1f4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-06-22T10:55:01.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.570+0000 7f70e3fff700 1 -- 172.21.15.40:0/3414898211 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7f70ec0594e0 con 0x7f70fc06a640 2023-06-22T10:55:01.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.572+0000 7f71021ff700 1 -- 172.21.15.40:0/3414898211 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f70e806ace0 msgr2=0x7f70e806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:01.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.572+0000 7f71021ff700 1 --2- 172.21.15.40:0/3414898211 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f70e806ace0 0x7f70e806d190 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f70fc156730 tx=0x7f70f0007d30 comp rx=0 tx=0).stop 2023-06-22T10:55:01.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.572+0000 7f71021ff700 1 -- 172.21.15.40:0/3414898211 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70fc06a640 msgr2=0x7f70fc0c5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:01.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.572+0000 7f71021ff700 1 --2- 172.21.15.40:0/3414898211 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70fc06a640 0x7f70fc0c5900 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f70ec009fd0 tx=0x7f70ec004750 comp rx=0 tx=0).stop 2023-06-22T10:55:01.576 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.573+0000 7f71021ff700 1 -- 172.21.15.40:0/3414898211 shutdown_connections 2023-06-22T10:55:01.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.573+0000 7f71021ff700 1 --2- 172.21.15.40:0/3414898211 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f70e806ace0 0x7f70e806d190 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:01.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.573+0000 7f71021ff700 1 --2- 172.21.15.40:0/3414898211 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f70fc0caa80 0x7f70fc15b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:01.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.573+0000 7f71021ff700 1 --2- 172.21.15.40:0/3414898211 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70fc06a640 0x7f70fc0c5900 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:01.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.573+0000 7f71021ff700 1 --2- 172.21.15.40:0/3414898211 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70fc0adbe0 0x7f70fc14be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:01.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.573+0000 7f71021ff700 1 -- 172.21.15.40:0/3414898211 >> 172.21.15.40:0/3414898211 conn(0x7f70fc0b0ff0 msgr2=0x7f70fc0ad150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:01.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.573+0000 7f71021ff700 1 -- 172.21.15.40:0/3414898211 shutdown_connections 2023-06-22T10:55:01.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.573+0000 7f71021ff700 1 -- 172.21.15.40:0/3414898211 wait complete. 2023-06-22T10:55:01.578 INFO:teuthology.orchestra.run.smithi040.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-06-22T10:55:01.584 INFO:tasks.ceph.mds.d.smithi045.stderr: -6761> 2023-06-22T10:53:36.830+0000 7f966dff1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-22T10:55:01.594 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-06-22T10:55:01.641 INFO:tasks.ceph.mds.d.smithi045.stdout:starting mds.d at 2023-06-22T10:55:01.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.793+0000 7fa166fff700 1 Processor -- start 2023-06-22T10:55:01.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.793+0000 7fa166fff700 1 -- start start 2023-06-22T10:55:01.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.794+0000 7fa166fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa1600d2130 0x7fa1600cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:01.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.795+0000 7fa166fff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1600d1be0 con 0x7fa1600cd6e0 2023-06-22T10:55:01.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.795+0000 7fa166fff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1600d1360 con 0x7fa1600b45d0 2023-06-22T10:55:01.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.795+0000 7fa166fff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1600d17f0 con 0x7fa1600d2130 2023-06-22T10:55:01.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.795+0000 7fa16559c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa1600cd6e0 0x7fa1600b59a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:35942/0 (socket says 172.21.15.40:35942) 2023-06-22T10:55:01.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.795+0000 7fa16559c700 1 -- 172.21.15.40:0/1894532002 learned_addr learned my addr 172.21.15.40:0/1894532002 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:55:01.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.795+0000 7fa15ffff700 1 --2- 172.21.15.40:0/1894532002 >> v2:172.21.15.40:3300/0 conn(0x7fa1600d2130 0x7fa1600cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:01.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.795+0000 7fa15f7fe700 1 -- 172.21.15.40:0/1894532002 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1803783535 0 0) 0x7fa1600d1be0 con 0x7fa1600cd6e0 2023-06-22T10:55:01.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.795+0000 7fa15f7fe700 1 -- 172.21.15.40:0/1894532002 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1500035b0 con 0x7fa1600cd6e0 2023-06-22T10:55:01.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.795+0000 7fa15ffff700 1 -- 172.21.15.40:0/1894532002 >> v1:172.21.15.45:6789/0 conn(0x7fa1600b45d0 legacy=0x7fa1600b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:01.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.795+0000 7fa15ffff700 1 -- 172.21.15.40:0/1894532002 >> v1:172.21.15.40:6789/0 conn(0x7fa1600cd6e0 legacy=0x7fa1600b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:01.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.795+0000 7fa15ffff700 1 -- 172.21.15.40:0/1894532002 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1600cef40 con 0x7fa1600d2130 2023-06-22T10:55:01.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.796+0000 7fa15ffff700 1 --2- 172.21.15.40:0/1894532002 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1600d2130 0x7fa1600cd1a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fa14c009840 tx=0x7fa14c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=238acc434ca5fc1f server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:01.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.796+0000 7fa15f7fe700 1 -- 172.21.15.40:0/1894532002 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14c011830 con 0x7fa1600d2130 2023-06-22T10:55:01.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.796+0000 7fa15f7fe700 1 -- 172.21.15.40:0/1894532002 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa14c011990 con 0x7fa1600d2130 2023-06-22T10:55:01.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.796+0000 7fa15f7fe700 1 -- 172.21.15.40:0/1894532002 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14c011d20 con 0x7fa1600d2130 2023-06-22T10:55:01.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.796+0000 7fa166fff700 1 -- 172.21.15.40:0/1894532002 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1600d2130 msgr2=0x7fa1600cd1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:01.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.796+0000 7fa166fff700 1 --2- 172.21.15.40:0/1894532002 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1600d2130 0x7fa1600cd1a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fa14c009840 tx=0x7fa14c009b50 comp rx=0 tx=0).stop 2023-06-22T10:55:01.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.797+0000 7fa166fff700 1 -- 172.21.15.40:0/1894532002 shutdown_connections 2023-06-22T10:55:01.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.797+0000 7fa166fff700 1 --2- 172.21.15.40:0/1894532002 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1600d2130 0x7fa1600cd1a0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:01.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.797+0000 7fa166fff700 1 -- 172.21.15.40:0/1894532002 >> 172.21.15.40:0/1894532002 conn(0x7fa1600cf5d0 msgr2=0x7fa1600cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:01.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.797+0000 7fa166fff700 1 -- 172.21.15.40:0/1894532002 shutdown_connections 2023-06-22T10:55:01.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.797+0000 7fa166fff700 1 -- 172.21.15.40:0/1894532002 wait complete. 2023-06-22T10:55:01.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.798+0000 7fa166fff700 1 Processor -- start 2023-06-22T10:55:01.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.798+0000 7fa166fff700 1 -- start start 2023-06-22T10:55:01.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.799+0000 7fa166fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa1600b45d0 0x7fa16015f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:01.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.799+0000 7fa166fff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa1600cd6e0 0x7fa1601f2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:01.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.799+0000 7fa166fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1600d2130 0x7fa1601ef0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:01.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.799+0000 7fa166fff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1601f2270 con 0x7fa1600d2130 2023-06-22T10:55:01.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.799+0000 7fa166fff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1600cd360 con 0x7fa1600b45d0 2023-06-22T10:55:01.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.799+0000 7fa166fff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1601f61a0 con 0x7fa1600cd6e0 2023-06-22T10:55:01.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.800+0000 7fa16559c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1600d2130 0x7fa1601ef0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:01.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.800+0000 7fa16559c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1600d2130 0x7fa1601ef0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57970/0 (socket says 172.21.15.40:57970) 2023-06-22T10:55:01.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.800+0000 7fa16559c700 1 -- 172.21.15.40:0/529095744 learned_addr learned my addr 172.21.15.40:0/529095744 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:55:01.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.800+0000 7fa164d9b700 1 --2- 172.21.15.40:0/529095744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa1600b45d0 0x7fa16015f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:01.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.800+0000 7fa15ffff700 1 --2- 172.21.15.40:0/529095744 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa1600cd6e0 0x7fa1601f2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:01.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.800+0000 7fa16559c700 1 -- 172.21.15.40:0/529095744 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa1600cd6e0 msgr2=0x7fa1601f2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:01.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.800+0000 7fa16559c700 1 --2- 172.21.15.40:0/529095744 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa1600cd6e0 0x7fa1601f2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:01.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.800+0000 7fa16559c700 1 -- 172.21.15.40:0/529095744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa1600b45d0 msgr2=0x7fa16015f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:01.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.800+0000 7fa16559c700 1 --2- 172.21.15.40:0/529095744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa1600b45d0 0x7fa16015f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:01.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.800+0000 7fa16559c700 1 -- 172.21.15.40:0/529095744 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa14c0094a0 con 0x7fa1600d2130 2023-06-22T10:55:01.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.800+0000 7fa16559c700 1 --2- 172.21.15.40:0/529095744 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1600d2130 0x7fa1601ef0d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fa15800cae0 tx=0x7fa15800cdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:01.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.801+0000 7fa15d7fa700 1 -- 172.21.15.40:0/529095744 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15800a9e0 con 0x7fa1600d2130 2023-06-22T10:55:01.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.801+0000 7fa15d7fa700 1 -- 172.21.15.40:0/529095744 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa15800ab40 con 0x7fa1600d2130 2023-06-22T10:55:01.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.801+0000 7fa166fff700 1 -- 172.21.15.40:0/529095744 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1601f5be0 con 0x7fa1600d2130 2023-06-22T10:55:01.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.801+0000 7fa15d7fa700 1 -- 172.21.15.40:0/529095744 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa158012400 con 0x7fa1600d2130 2023-06-22T10:55:01.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.801+0000 7fa166fff700 1 -- 172.21.15.40:0/529095744 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1601f1e90 con 0x7fa1600d2130 2023-06-22T10:55:01.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.802+0000 7fa166fff700 1 -- 172.21.15.40:0/529095744 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1601f23b0 con 0x7fa1600d2130 2023-06-22T10:55:01.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.803+0000 7fa15d7fa700 1 -- 172.21.15.40:0/529095744 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa15801b3b0 con 0x7fa1600d2130 2023-06-22T10:55:01.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.804+0000 7fa15d7fa700 1 --2- 172.21.15.40:0/529095744 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fa14406ace0 0x7fa14406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:01.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.804+0000 7fa15d7fa700 1 -- 172.21.15.40:0/529095744 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6957+0+0 (secure 0 0 0) 0x7fa158089470 con 0x7fa1600d2130 2023-06-22T10:55:01.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.804+0000 7fa164d9b700 1 --2- 172.21.15.40:0/529095744 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fa14406ace0 0x7fa14406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:01.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.805+0000 7fa164d9b700 1 --2- 172.21.15.40:0/529095744 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fa14406ace0 0x7fa14406d190 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa154007fd0 tx=0x7fa154009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:01.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:01.808+0000 7fa15d7fa700 1 -- 172.21.15.40:0/529095744 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa158054190 con 0x7fa1600d2130 2023-06-22T10:55:02.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.066+0000 7fa166fff700 1 -- 172.21.15.40:0/529095744 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa160067580 con 0x7fa1600d2130 2023-06-22T10:55:02.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.570+0000 7fa15d7fa700 1 -- 172.21.15.40:0/529095744 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa1580577b0 con 0x7fa1600d2130 2023-06-22T10:55:02.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.573+0000 7fa166fff700 1 -- 172.21.15.40:0/529095744 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fa14406ace0 msgr2=0x7fa14406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:02.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.573+0000 7fa166fff700 1 --2- 172.21.15.40:0/529095744 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fa14406ace0 0x7fa14406d190 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa154007fd0 tx=0x7fa154009040 comp rx=0 tx=0).stop 2023-06-22T10:55:02.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.573+0000 7fa166fff700 1 -- 172.21.15.40:0/529095744 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1600d2130 msgr2=0x7fa1601ef0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:02.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.573+0000 7fa166fff700 1 --2- 172.21.15.40:0/529095744 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1600d2130 0x7fa1601ef0d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fa15800cae0 tx=0x7fa15800cdf0 comp rx=0 tx=0).stop 2023-06-22T10:55:02.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.573+0000 7fa166fff700 1 -- 172.21.15.40:0/529095744 shutdown_connections 2023-06-22T10:55:02.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.573+0000 7fa166fff700 1 --2- 172.21.15.40:0/529095744 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fa14406ace0 0x7fa14406d190 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:02.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.573+0000 7fa166fff700 1 --2- 172.21.15.40:0/529095744 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1600d2130 0x7fa1601ef0d0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:02.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.573+0000 7fa166fff700 1 --2- 172.21.15.40:0/529095744 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa1600b45d0 0x7fa16015f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:02.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.573+0000 7fa166fff700 1 --2- 172.21.15.40:0/529095744 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa1600cd6e0 0x7fa1601f2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:02.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.573+0000 7fa166fff700 1 -- 172.21.15.40:0/529095744 >> 172.21.15.40:0/529095744 conn(0x7fa1600cf5d0 msgr2=0x7fa1600b7990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:02.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.573+0000 7fa166fff700 1 -- 172.21.15.40:0/529095744 shutdown_connections 2023-06-22T10:55:02.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.574+0000 7fa166fff700 1 -- 172.21.15.40:0/529095744 wait complete. 2023-06-22T10:55:02.598 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-06-22T10:55:02.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.805+0000 7f03af9ff700 1 Processor -- start 2023-06-22T10:55:02.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.805+0000 7f03af9ff700 1 -- start start 2023-06-22T10:55:02.810 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.806+0000 7f03af9ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f03a815c560 0x7f03a8160a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:02.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.806+0000 7f03af9ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f03a80cd2d0 0x7f03a80b5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:02.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.806+0000 7f03af9ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03a80d0f40 con 0x7f03a80cf690 2023-06-22T10:55:02.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.806+0000 7f03af9ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03a815c930 con 0x7f03a80cd2d0 2023-06-22T10:55:02.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.806+0000 7f03af9ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03a8160f70 con 0x7f03a815c560 2023-06-22T10:55:02.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.806+0000 7f03acf9a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f03a80cd2d0 0x7f03a80b5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:02.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.806+0000 7f03acf9a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f03a80cd2d0 0x7f03a80b5ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57976/0 (socket says 172.21.15.40:57976) 2023-06-22T10:55:02.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.806+0000 7f03acf9a700 1 -- 172.21.15.40:0/1336487389 learned_addr learned my addr 172.21.15.40:0/1336487389 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:55:02.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.806+0000 7f03ad79b700 1 --2- 172.21.15.40:0/1336487389 >> v2:172.21.15.45:3300/0 conn(0x7f03a815c560 0x7f03a8160a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:02.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.807+0000 7f03acf9a700 1 -- 172.21.15.40:0/1336487389 >> v2:172.21.15.45:3300/0 conn(0x7f03a815c560 msgr2=0x7f03a8160a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:55:02.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.807+0000 7f03acf9a700 1 --2- 172.21.15.40:0/1336487389 >> v2:172.21.15.45:3300/0 conn(0x7f03a815c560 0x7f03a8160a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:02.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.807+0000 7f03acf9a700 1 -- 172.21.15.40:0/1336487389 >> v1:172.21.15.45:6789/0 conn(0x7f03a80cf690 legacy=0x7f03a80d13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:02.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.807+0000 7f03acf9a700 1 -- 172.21.15.40:0/1336487389 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a80cd760 con 0x7f03a80cd2d0 2023-06-22T10:55:02.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.807+0000 7f03acf9a700 1 --2- 172.21.15.40:0/1336487389 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03a80cd2d0 0x7f03a80b5ad0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f03a80b5150 tx=0x7f0398009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d0f9b61630734bd server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:02.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.807+0000 7f039ffff700 1 -- 172.21.15.40:0/1336487389 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0398011830 con 0x7f03a80cd2d0 2023-06-22T10:55:02.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.807+0000 7f039ffff700 1 -- 172.21.15.40:0/1336487389 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0398011990 con 0x7f03a80cd2d0 2023-06-22T10:55:02.813 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.807+0000 7f039ffff700 1 -- 172.21.15.40:0/1336487389 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0398011d20 con 0x7f03a80cd2d0 2023-06-22T10:55:02.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.808+0000 7f03af9ff700 1 -- 172.21.15.40:0/1336487389 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03a80cd2d0 msgr2=0x7f03a80b5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:02.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.808+0000 7f03af9ff700 1 --2- 172.21.15.40:0/1336487389 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03a80cd2d0 0x7f03a80b5ad0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f03a80b5150 tx=0x7f0398009bd0 comp rx=0 tx=0).stop 2023-06-22T10:55:02.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.808+0000 7f03af9ff700 1 -- 172.21.15.40:0/1336487389 shutdown_connections 2023-06-22T10:55:02.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.808+0000 7f03af9ff700 1 --2- 172.21.15.40:0/1336487389 >> v2:172.21.15.45:3300/0 conn(0x7f03a815c560 0x7f03a8160a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:02.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.808+0000 7f03af9ff700 1 --2- 172.21.15.40:0/1336487389 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03a80cd2d0 0x7f03a80b5ad0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:02.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.808+0000 7f03af9ff700 1 -- 172.21.15.40:0/1336487389 >> 172.21.15.40:0/1336487389 conn(0x7f03a8071660 msgr2=0x7f03a8071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:02.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.808+0000 7f03af9ff700 1 -- 172.21.15.40:0/1336487389 shutdown_connections 2023-06-22T10:55:02.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.808+0000 7f03af9ff700 1 -- 172.21.15.40:0/1336487389 wait complete. 2023-06-22T10:55:02.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.810+0000 7f03af9ff700 1 Processor -- start 2023-06-22T10:55:02.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.810+0000 7f03af9ff700 1 -- start start 2023-06-22T10:55:02.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.811+0000 7f03af9ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03a80cd2d0 0x7f03a80b8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:02.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.811+0000 7f03af9ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03a80cf690 0x7f03a80b5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:02.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.811+0000 7f03af9ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f03a815c560 0x7f03a80b5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:02.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.811+0000 7f03af9ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a80c8460 con 0x7f03a80cf690 2023-06-22T10:55:02.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.811+0000 7f03af9ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a80c8740 con 0x7f03a80cd2d0 2023-06-22T10:55:02.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.811+0000 7f03af9ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03a80c8a20 con 0x7f03a815c560 2023-06-22T10:55:02.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.811+0000 7f03acf9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03a80cf690 0x7f03a80b5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:02.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.811+0000 7f03acf9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03a80cf690 0x7f03a80b5ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57984/0 (socket says 172.21.15.40:57984) 2023-06-22T10:55:02.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.811+0000 7f03acf9a700 1 -- 172.21.15.40:0/804223627 learned_addr learned my addr 172.21.15.40:0/804223627 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:55:02.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.812+0000 7f03ad79b700 1 --2- 172.21.15.40:0/804223627 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03a80cd2d0 0x7f03a80b8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:02.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.812+0000 7f03adf9c700 1 --2- 172.21.15.40:0/804223627 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f03a815c560 0x7f03a80b5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:02.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.812+0000 7f03acf9a700 1 -- 172.21.15.40:0/804223627 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f03a815c560 msgr2=0x7f03a80b5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:02.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.812+0000 7f03acf9a700 1 --2- 172.21.15.40:0/804223627 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f03a815c560 0x7f03a80b5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:02.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.812+0000 7f03acf9a700 1 -- 172.21.15.40:0/804223627 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03a80cd2d0 msgr2=0x7f03a80b8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:02.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.812+0000 7f03acf9a700 1 --2- 172.21.15.40:0/804223627 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03a80cd2d0 0x7f03a80b8370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:02.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.812+0000 7f03acf9a700 1 -- 172.21.15.40:0/804223627 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0398009550 con 0x7f03a80cf690 2023-06-22T10:55:02.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.812+0000 7f03adf9c700 1 --2- 172.21.15.40:0/804223627 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f03a815c560 0x7f03a80b5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-22T10:55:02.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.812+0000 7f03ad79b700 1 --2- 172.21.15.40:0/804223627 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03a80cd2d0 0x7f03a80b8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:55:02.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.812+0000 7f03acf9a700 1 --2- 172.21.15.40:0/804223627 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03a80cf690 0x7f03a80b5ab0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0398009c10 tx=0x7f0398004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:02.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.812+0000 7f039dffb700 1 -- 172.21.15.40:0/804223627 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0398004570 con 0x7f03a80cf690 2023-06-22T10:55:02.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.812+0000 7f039dffb700 1 -- 172.21.15.40:0/804223627 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f039801f070 con 0x7f03a80cf690 2023-06-22T10:55:02.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.812+0000 7f03af9ff700 1 -- 172.21.15.40:0/804223627 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03a80c8d00 con 0x7f03a80cf690 2023-06-22T10:55:02.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.812+0000 7f039dffb700 1 -- 172.21.15.40:0/804223627 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03980038e0 con 0x7f03a80cf690 2023-06-22T10:55:02.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.812+0000 7f03af9ff700 1 -- 172.21.15.40:0/804223627 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03a80b88b0 con 0x7f03a80cf690 2023-06-22T10:55:02.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.813+0000 7f03af9ff700 1 -- 172.21.15.40:0/804223627 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03a80b8a40 con 0x7f03a80cf690 2023-06-22T10:55:02.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.814+0000 7f039dffb700 1 -- 172.21.15.40:0/804223627 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0398021030 con 0x7f03a80cf690 2023-06-22T10:55:02.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.815+0000 7f039dffb700 1 --2- 172.21.15.40:0/804223627 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f038c06ace0 0x7f038c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:02.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.815+0000 7f039dffb700 1 -- 172.21.15.40:0/804223627 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6957+0+0 (secure 0 0 0) 0x7f039808aca0 con 0x7f03a80cf690 2023-06-22T10:55:02.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.816+0000 7f03ad79b700 1 --2- 172.21.15.40:0/804223627 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f038c06ace0 0x7f038c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:02.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.816+0000 7f03ad79b700 1 --2- 172.21.15.40:0/804223627 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f038c06ace0 0x7f038c06d190 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f03a4009b90 tx=0x7f03a4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:02.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:02.820+0000 7f039dffb700 1 -- 172.21.15.40:0/804223627 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f03a80b8a40 con 0x7f03a80cf690 2023-06-22T10:55:03.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:03.028+0000 7f03af9ff700 1 -- 172.21.15.40:0/804223627 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f03a80b8a40 con 0x7f03a80cf690 2023-06-22T10:55:03.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:03.920+0000 7f039dffb700 1 -- 172.21.15.40:0/804223627 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v32) v1 ==== 181+0+0 (secure 0 0 0) 0x7f03a80b8a40 con 0x7f03a80cf690 2023-06-22T10:55:03.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:03.925+0000 7f03af9ff700 1 -- 172.21.15.40:0/804223627 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f038c06ace0 msgr2=0x7f038c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:03.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:03.925+0000 7f03af9ff700 1 --2- 172.21.15.40:0/804223627 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f038c06ace0 0x7f038c06d190 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f03a4009b90 tx=0x7f03a4008040 comp rx=0 tx=0).stop 2023-06-22T10:55:03.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:03.925+0000 7f03af9ff700 1 -- 172.21.15.40:0/804223627 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03a80cf690 msgr2=0x7f03a80b5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:03.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:03.925+0000 7f03af9ff700 1 --2- 172.21.15.40:0/804223627 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03a80cf690 0x7f03a80b5ab0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0398009c10 tx=0x7f0398004750 comp rx=0 tx=0).stop 2023-06-22T10:55:03.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:03.925+0000 7f03af9ff700 1 -- 172.21.15.40:0/804223627 shutdown_connections 2023-06-22T10:55:03.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:03.925+0000 7f03af9ff700 1 --2- 172.21.15.40:0/804223627 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f038c06ace0 0x7f038c06d190 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:03.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:03.925+0000 7f03af9ff700 1 --2- 172.21.15.40:0/804223627 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f03a815c560 0x7f03a80b5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:03.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:03.925+0000 7f03af9ff700 1 --2- 172.21.15.40:0/804223627 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03a80cd2d0 0x7f03a80b8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:03.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:03.925+0000 7f03af9ff700 1 --2- 172.21.15.40:0/804223627 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03a80cf690 0x7f03a80b5ab0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:03.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:03.925+0000 7f03af9ff700 1 -- 172.21.15.40:0/804223627 >> 172.21.15.40:0/804223627 conn(0x7f03a8071660 msgr2=0x7f03a80d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:03.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:03.926+0000 7f03af9ff700 1 -- 172.21.15.40:0/804223627 shutdown_connections 2023-06-22T10:55:03.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:03.926+0000 7f03af9ff700 1 -- 172.21.15.40:0/804223627 wait complete. 2023-06-22T10:55:03.931 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_metadata' removed 2023-06-22T10:55:03.952 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-06-22T10:55:04.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.167+0000 7fe4b0bff700 1 Processor -- start 2023-06-22T10:55:04.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.167+0000 7fe4b0bff700 1 -- start start 2023-06-22T10:55:04.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.168+0000 7fe4b0bff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe4ac15c3e0 0x7fe4ac0b5a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:04.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.168+0000 7fe4b0bff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe4ac06bda0 0x7fe4ac0d1910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:04.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.168+0000 7fe4b0bff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4ac0b5f90 con 0x7fe4ac0d1e50 2023-06-22T10:55:04.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.168+0000 7fe4b0bff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4ac0cda60 con 0x7fe4ac06bda0 2023-06-22T10:55:04.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.168+0000 7fe4b0bff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4ac0d11e0 con 0x7fe4ac15c3e0 2023-06-22T10:55:04.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.168+0000 7fe4a9d9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe4ac06bda0 0x7fe4ac0d1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:04.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.168+0000 7fe4a9d9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe4ac06bda0 0x7fe4ac0d1910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57986/0 (socket says 172.21.15.40:57986) 2023-06-22T10:55:04.173 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.168+0000 7fe4a9d9b700 1 -- 172.21.15.40:0/3718455077 learned_addr learned my addr 172.21.15.40:0/3718455077 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:55:04.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.169+0000 7fe4aa59c700 1 --2- 172.21.15.40:0/3718455077 >> v2:172.21.15.45:3300/0 conn(0x7fe4ac15c3e0 0x7fe4ac0b5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:04.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.169+0000 7fe4a9d9b700 1 -- 172.21.15.40:0/3718455077 >> v2:172.21.15.45:3300/0 conn(0x7fe4ac15c3e0 msgr2=0x7fe4ac0b5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:55:04.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.169+0000 7fe4a9d9b700 1 --2- 172.21.15.40:0/3718455077 >> v2:172.21.15.45:3300/0 conn(0x7fe4ac15c3e0 0x7fe4ac0b5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:04.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.169+0000 7fe4a9d9b700 1 -- 172.21.15.40:0/3718455077 >> v1:172.21.15.45:6789/0 conn(0x7fe4ac0d1e50 legacy=0x7fe4ac0b4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:55:04.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.169+0000 7fe4a9d9b700 1 -- 172.21.15.40:0/3718455077 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4ac0cd250 con 0x7fe4ac06bda0 2023-06-22T10:55:04.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.169+0000 7fe4aa59c700 1 --2- 172.21.15.40:0/3718455077 >> v2:172.21.15.45:3300/0 conn(0x7fe4ac15c3e0 0x7fe4ac0b5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-22T10:55:04.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.169+0000 7fe4a9d9b700 1 --2- 172.21.15.40:0/3718455077 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4ac06bda0 0x7fe4ac0d1910 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac08ab70 tx=0x7fe4a0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c694aba2fad1624d server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:04.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.169+0000 7fe4a959a700 1 -- 172.21.15.40:0/3718455077 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a0004230 con 0x7fe4ac06bda0 2023-06-22T10:55:04.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.169+0000 7fe4a959a700 1 -- 172.21.15.40:0/3718455077 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4a0004390 con 0x7fe4ac06bda0 2023-06-22T10:55:04.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.169+0000 7fe4a959a700 1 -- 172.21.15.40:0/3718455077 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a00036a0 con 0x7fe4ac06bda0 2023-06-22T10:55:04.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.170+0000 7fe4b0bff700 1 -- 172.21.15.40:0/3718455077 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4ac06bda0 msgr2=0x7fe4ac0d1910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:04.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.170+0000 7fe4b0bff700 1 --2- 172.21.15.40:0/3718455077 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4ac06bda0 0x7fe4ac0d1910 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac08ab70 tx=0x7fe4a0009bd0 comp rx=0 tx=0).stop 2023-06-22T10:55:04.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.170+0000 7fe4b0bff700 1 -- 172.21.15.40:0/3718455077 shutdown_connections 2023-06-22T10:55:04.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.170+0000 7fe4b0bff700 1 --2- 172.21.15.40:0/3718455077 >> v2:172.21.15.45:3300/0 conn(0x7fe4ac15c3e0 0x7fe4ac0b5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:04.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.170+0000 7fe4b0bff700 1 --2- 172.21.15.40:0/3718455077 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4ac06bda0 0x7fe4ac0d1910 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:04.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.170+0000 7fe4b0bff700 1 -- 172.21.15.40:0/3718455077 >> 172.21.15.40:0/3718455077 conn(0x7fe4ac06b290 msgr2=0x7fe4ac06b690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:04.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.170+0000 7fe4b0bff700 1 -- 172.21.15.40:0/3718455077 shutdown_connections 2023-06-22T10:55:04.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.170+0000 7fe4b0bff700 1 -- 172.21.15.40:0/3718455077 wait complete. 2023-06-22T10:55:04.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.172+0000 7fe4b0bff700 1 Processor -- start 2023-06-22T10:55:04.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.172+0000 7fe4b0bff700 1 -- start start 2023-06-22T10:55:04.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.173+0000 7fe4b0bff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe4ac06bda0 0x7fe4ac0c8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:04.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.173+0000 7fe4b0bff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe4ac0d1e50 0x7fe4ac15c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:04.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.173+0000 7fe4b0bff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4ac15c3e0 0x7fe4ac0cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:04.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.173+0000 7fe4b0bff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ac15a790 con 0x7fe4ac15c3e0 2023-06-22T10:55:04.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.173+0000 7fe4b0bff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ac1f50c0 con 0x7fe4ac06bda0 2023-06-22T10:55:04.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.173+0000 7fe4b0bff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ac1f53a0 con 0x7fe4ac0d1e50 2023-06-22T10:55:04.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.173+0000 7fe4aad9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4ac15c3e0 0x7fe4ac0cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:04.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.173+0000 7fe4aad9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4ac15c3e0 0x7fe4ac0cbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57992/0 (socket says 172.21.15.40:57992) 2023-06-22T10:55:04.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.173+0000 7fe4aad9d700 1 -- 172.21.15.40:0/2652367437 learned_addr learned my addr 172.21.15.40:0/2652367437 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:55:04.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.173+0000 7fe4aa59c700 1 --2- 172.21.15.40:0/2652367437 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe4ac06bda0 0x7fe4ac0c8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:04.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.173+0000 7fe4a9d9b700 1 --2- 172.21.15.40:0/2652367437 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe4ac0d1e50 0x7fe4ac15c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:04.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.173+0000 7fe4aad9d700 1 -- 172.21.15.40:0/2652367437 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe4ac0d1e50 msgr2=0x7fe4ac15c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:04.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.173+0000 7fe4aad9d700 1 --2- 172.21.15.40:0/2652367437 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe4ac0d1e50 0x7fe4ac15c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:04.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.173+0000 7fe4aad9d700 1 -- 172.21.15.40:0/2652367437 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe4ac06bda0 msgr2=0x7fe4ac0c8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:04.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.173+0000 7fe4aad9d700 1 --2- 172.21.15.40:0/2652367437 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe4ac06bda0 0x7fe4ac0c8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:04.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.173+0000 7fe4aad9d700 1 -- 172.21.15.40:0/2652367437 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a0009550 con 0x7fe4ac15c3e0 2023-06-22T10:55:04.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.174+0000 7fe4aad9d700 1 --2- 172.21.15.40:0/2652367437 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4ac15c3e0 0x7fe4ac0cbea0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe4a400cc10 tx=0x7fe4a400cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:04.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.174+0000 7fe49affd700 1 -- 172.21.15.40:0/2652367437 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a400aa60 con 0x7fe4ac15c3e0 2023-06-22T10:55:04.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.174+0000 7fe49affd700 1 -- 172.21.15.40:0/2652367437 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4a400abc0 con 0x7fe4ac15c3e0 2023-06-22T10:55:04.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.174+0000 7fe49affd700 1 -- 172.21.15.40:0/2652367437 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a4012420 con 0x7fe4ac15c3e0 2023-06-22T10:55:04.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.174+0000 7fe4b0bff700 1 -- 172.21.15.40:0/2652367437 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4ac1f5680 con 0x7fe4ac15c3e0 2023-06-22T10:55:04.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.174+0000 7fe4b0bff700 1 -- 172.21.15.40:0/2652367437 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4ac1f5c40 con 0x7fe4ac15c3e0 2023-06-22T10:55:04.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.175+0000 7fe4b0bff700 1 -- 172.21.15.40:0/2652367437 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4ac067580 con 0x7fe4ac15c3e0 2023-06-22T10:55:04.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.176+0000 7fe49affd700 1 -- 172.21.15.40:0/2652367437 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe4a4012580 con 0x7fe4ac15c3e0 2023-06-22T10:55:04.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.177+0000 7fe49affd700 1 --2- 172.21.15.40:0/2652367437 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe48c06ace0 0x7fe48c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:04.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.177+0000 7fe49affd700 1 -- 172.21.15.40:0/2652367437 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6519+0+0 (secure 0 0 0) 0x7fe4a4089a10 con 0x7fe4ac15c3e0 2023-06-22T10:55:04.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.177+0000 7fe4aa59c700 1 --2- 172.21.15.40:0/2652367437 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe48c06ace0 0x7fe48c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:04.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.178+0000 7fe4aa59c700 1 --2- 172.21.15.40:0/2652367437 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe48c06ace0 0x7fe48c06d190 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe49c006fd0 tx=0x7fe49c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:04.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.182+0000 7fe49affd700 1 -- 172.21.15.40:0/2652367437 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe4a4054850 con 0x7fe4ac15c3e0 2023-06-22T10:55:04.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.392+0000 7fe4b0bff700 1 -- 172.21.15.40:0/2652367437 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe4ac0d39c0 con 0x7fe4ac15c3e0 2023-06-22T10:55:04.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.921+0000 7fe49affd700 1 -- 172.21.15.40:0/2652367437 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v33) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe4a4057e70 con 0x7fe4ac15c3e0 2023-06-22T10:55:04.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.926+0000 7fe4b0bff700 1 -- 172.21.15.40:0/2652367437 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe48c06ace0 msgr2=0x7fe48c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:04.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.926+0000 7fe4b0bff700 1 --2- 172.21.15.40:0/2652367437 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe48c06ace0 0x7fe48c06d190 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe49c006fd0 tx=0x7fe49c008040 comp rx=0 tx=0).stop 2023-06-22T10:55:04.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.926+0000 7fe4b0bff700 1 -- 172.21.15.40:0/2652367437 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4ac15c3e0 msgr2=0x7fe4ac0cbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:04.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.926+0000 7fe4b0bff700 1 --2- 172.21.15.40:0/2652367437 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4ac15c3e0 0x7fe4ac0cbea0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe4a400cc10 tx=0x7fe4a400cf20 comp rx=0 tx=0).stop 2023-06-22T10:55:04.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.926+0000 7fe4b0bff700 1 -- 172.21.15.40:0/2652367437 shutdown_connections 2023-06-22T10:55:04.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.926+0000 7fe4b0bff700 1 --2- 172.21.15.40:0/2652367437 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe48c06ace0 0x7fe48c06d190 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:04.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.926+0000 7fe4b0bff700 1 --2- 172.21.15.40:0/2652367437 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4ac15c3e0 0x7fe4ac0cbea0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:04.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.926+0000 7fe4b0bff700 1 --2- 172.21.15.40:0/2652367437 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe4ac06bda0 0x7fe4ac0c8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:04.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.926+0000 7fe4b0bff700 1 --2- 172.21.15.40:0/2652367437 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe4ac0d1e50 0x7fe4ac15c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:04.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.926+0000 7fe4b0bff700 1 -- 172.21.15.40:0/2652367437 >> 172.21.15.40:0/2652367437 conn(0x7fe4ac06b290 msgr2=0x7fe4ac0b6120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:04.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.927+0000 7fe4b0bff700 1 -- 172.21.15.40:0/2652367437 shutdown_connections 2023-06-22T10:55:04.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:04.927+0000 7fe4b0bff700 1 -- 172.21.15.40:0/2652367437 wait complete. 2023-06-22T10:55:04.931 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_data' removed 2023-06-22T10:55:04.953 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-06-22T10:55:05.169 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.160+0000 7fa34c9ff700 1 Processor -- start 2023-06-22T10:55:05.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.160+0000 7fa34c9ff700 1 -- start start 2023-06-22T10:55:05.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.161+0000 7fa34c9ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa3480cd2d0 0x7fa3480b5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:05.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.161+0000 7fa34c9ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa3480cf690 0x7fa3480cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:05.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.161+0000 7fa34c9ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3480d0f40 con 0x7fa34815c560 2023-06-22T10:55:05.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.161+0000 7fa34c9ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3480d0040 con 0x7fa3480cf690 2023-06-22T10:55:05.170 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.161+0000 7fa34c9ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa34815c930 con 0x7fa3480cd2d0 2023-06-22T10:55:05.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.162+0000 7fa346d9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa3480cf690 0x7fa3480cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:05.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.162+0000 7fa33ffff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa3480cd2d0 0x7fa3480b5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:05.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.162+0000 7fa346d9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa3480cf690 0x7fa3480cfb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.40:34526/0 (socket says 172.21.15.40:34526) 2023-06-22T10:55:05.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.162+0000 7fa346d9d700 1 -- 172.21.15.40:0/3480101047 learned_addr learned my addr 172.21.15.40:0/3480101047 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:55:05.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.162+0000 7fa33ffff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa3480cd2d0 0x7fa3480b5ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3301/0 says I am v2:172.21.15.40:42896/0 (socket says 172.21.15.40:42896) 2023-06-22T10:55:05.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.162+0000 7fa346d9d700 1 -- 172.21.15.40:0/3480101047 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa3480cd2d0 msgr2=0x7fa3480b5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:55:05.171 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.162+0000 7fa346d9d700 1 --2- 172.21.15.40:0/3480101047 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa3480cd2d0 0x7fa3480b5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:05.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.162+0000 7fa346d9d700 1 -- 172.21.15.40:0/3480101047 >> v1:172.21.15.45:6789/0 conn(0x7fa34815c560 legacy=0x7fa348160a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:05.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.162+0000 7fa346d9d700 1 -- 172.21.15.40:0/3480101047 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3480cd760 con 0x7fa3480cf690 2023-06-22T10:55:05.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.163+0000 7fa346d9d700 1 --2- 172.21.15.40:0/3480101047 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3480cf690 0x7fa3480cfb00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa340009e50 tx=0x7fa34000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1baea179dd1c7950 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:05.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.164+0000 7fa345d9b700 1 -- 172.21.15.40:0/3480101047 <== mon.1 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34000e070 con 0x7fa3480cf690 2023-06-22T10:55:05.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.164+0000 7fa345d9b700 1 -- 172.21.15.40:0/3480101047 <== mon.1 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa34000b910 con 0x7fa3480cf690 2023-06-22T10:55:05.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.164+0000 7fa345d9b700 1 -- 172.21.15.40:0/3480101047 <== mon.1 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34000bcc0 con 0x7fa3480cf690 2023-06-22T10:55:05.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.166+0000 7fa34c9ff700 1 -- 172.21.15.40:0/3480101047 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3480cf690 msgr2=0x7fa3480cfb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:05.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.166+0000 7fa34c9ff700 1 --2- 172.21.15.40:0/3480101047 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3480cf690 0x7fa3480cfb00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa340009e50 tx=0x7fa34000b330 comp rx=0 tx=0).stop 2023-06-22T10:55:05.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.170+0000 7fa34c9ff700 1 -- 172.21.15.40:0/3480101047 shutdown_connections 2023-06-22T10:55:05.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.170+0000 7fa34c9ff700 1 --2- 172.21.15.40:0/3480101047 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3480cf690 0x7fa3480cfb00 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:05.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.170+0000 7fa34c9ff700 1 --2- 172.21.15.40:0/3480101047 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa3480cd2d0 0x7fa3480b5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:05.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.170+0000 7fa34c9ff700 1 -- 172.21.15.40:0/3480101047 >> 172.21.15.40:0/3480101047 conn(0x7fa348071660 msgr2=0x7fa348071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:05.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.173+0000 7fa34c9ff700 1 -- 172.21.15.40:0/3480101047 shutdown_connections 2023-06-22T10:55:05.177 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.174+0000 7fa34c9ff700 1 -- 172.21.15.40:0/3480101047 wait complete. 2023-06-22T10:55:05.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.176+0000 7fa34c9ff700 1 Processor -- start 2023-06-22T10:55:05.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.176+0000 7fa34c9ff700 1 -- start start 2023-06-22T10:55:05.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.178+0000 7fa34c9ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa3480cd2d0 0x7fa3480b7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:05.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.178+0000 7fa34c9ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3480cf690 0x7fa3480cbf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:05.181 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.178+0000 7fa34c9ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa34815c560 0x7fa3480cc460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:05.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.178+0000 7fa34c9ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3480b83e0 con 0x7fa3480cf690 2023-06-22T10:55:05.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.178+0000 7fa34c9ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa34815d980 con 0x7fa34815c560 2023-06-22T10:55:05.182 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.178+0000 7fa34c9ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa34815dc60 con 0x7fa3480cd2d0 2023-06-22T10:55:05.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.178+0000 7fa33ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3480cf690 0x7fa3480cbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:05.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.178+0000 7fa34659c700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa3480cd2d0 0x7fa3480b7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:05.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.178+0000 7fa34659c700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa3480cd2d0 0x7fa3480b7ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3301/0 says I am v2:172.21.15.40:42900/0 (socket says 172.21.15.40:42900) 2023-06-22T10:55:05.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.178+0000 7fa34659c700 1 -- 172.21.15.40:0/1241350631 learned_addr learned my addr 172.21.15.40:0/1241350631 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:55:05.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.179+0000 7fa346d9d700 1 --2- 172.21.15.40:0/1241350631 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa34815c560 0x7fa3480cc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:05.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.179+0000 7fa346d9d700 1 -- 172.21.15.40:0/1241350631 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa3480cd2d0 msgr2=0x7fa3480b7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:05.183 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.179+0000 7fa346d9d700 1 --2- 172.21.15.40:0/1241350631 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa3480cd2d0 0x7fa3480b7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:05.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.179+0000 7fa346d9d700 1 -- 172.21.15.40:0/1241350631 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3480cf690 msgr2=0x7fa3480cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:05.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.179+0000 7fa346d9d700 1 --2- 172.21.15.40:0/1241350631 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3480cf690 0x7fa3480cbf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:05.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.179+0000 7fa346d9d700 1 -- 172.21.15.40:0/1241350631 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa340009b30 con 0x7fa34815c560 2023-06-22T10:55:05.184 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.180+0000 7fa346d9d700 1 --2- 172.21.15.40:0/1241350631 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa34815c560 0x7fa3480cc460 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa340015000 tx=0x7fa340004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:05.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.180+0000 7fa33effd700 1 -- 172.21.15.40:0/1241350631 <== mon.1 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa340004780 con 0x7fa34815c560 2023-06-22T10:55:05.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.180+0000 7fa33effd700 1 -- 172.21.15.40:0/1241350631 <== mon.1 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3400092e0 con 0x7fa34815c560 2023-06-22T10:55:05.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.180+0000 7fa33effd700 1 -- 172.21.15.40:0/1241350631 <== mon.1 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34001c680 con 0x7fa34815c560 2023-06-22T10:55:05.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.180+0000 7fa34c9ff700 1 -- 172.21.15.40:0/1241350631 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa34815df40 con 0x7fa34815c560 2023-06-22T10:55:05.185 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.180+0000 7fa34c9ff700 1 -- 172.21.15.40:0/1241350631 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa34815e500 con 0x7fa34815c560 2023-06-22T10:55:05.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.182+0000 7fa34c9ff700 1 -- 172.21.15.40:0/1241350631 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa348066ac0 con 0x7fa34815c560 2023-06-22T10:55:05.186 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.183+0000 7fa33effd700 1 -- 172.21.15.40:0/1241350631 <== mon.1 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa34001c7e0 con 0x7fa34815c560 2023-06-22T10:55:05.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.184+0000 7fa33effd700 1 --2- 172.21.15.40:0/1241350631 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fa32806ace0 0x7fa32806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:05.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.185+0000 7fa33effd700 1 -- 172.21.15.40:0/1241350631 <== mon.1 v2:172.21.15.45:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6047+0+0 (secure 0 0 0) 0x7fa34008ac00 con 0x7fa34815c560 2023-06-22T10:55:05.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.185+0000 7fa34659c700 1 --2- 172.21.15.40:0/1241350631 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fa32806ace0 0x7fa32806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:05.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.185+0000 7fa34659c700 1 --2- 172.21.15.40:0/1241350631 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fa32806ace0 0x7fa32806d190 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa338001880 tx=0x7fa338009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:05.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.189+0000 7fa33effd700 1 -- 172.21.15.40:0/1241350631 <== mon.1 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa340055dd0 con 0x7fa34815c560 2023-06-22T10:55:05.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.397+0000 7fa34c9ff700 1 -- 172.21.15.40:0/1241350631 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa34815dda0 con 0x7fa34815c560 2023-06-22T10:55:05.941 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.938+0000 7fa33effd700 1 -- 172.21.15.40:0/1241350631 <== mon.1 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v34) v1 ==== 178+0+0 (secure 0 0 0) 0x7fa34815dda0 con 0x7fa34815c560 2023-06-22T10:55:05.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.942+0000 7fa34c9ff700 1 -- 172.21.15.40:0/1241350631 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fa32806ace0 msgr2=0x7fa32806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:05.945 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.942+0000 7fa34c9ff700 1 --2- 172.21.15.40:0/1241350631 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fa32806ace0 0x7fa32806d190 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa338001880 tx=0x7fa338009040 comp rx=0 tx=0).stop 2023-06-22T10:55:05.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.942+0000 7fa34c9ff700 1 -- 172.21.15.40:0/1241350631 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa34815c560 msgr2=0x7fa3480cc460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:05.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.942+0000 7fa34c9ff700 1 --2- 172.21.15.40:0/1241350631 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa34815c560 0x7fa3480cc460 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa340015000 tx=0x7fa340004ad0 comp rx=0 tx=0).stop 2023-06-22T10:55:05.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.942+0000 7fa34c9ff700 1 -- 172.21.15.40:0/1241350631 shutdown_connections 2023-06-22T10:55:05.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.942+0000 7fa34c9ff700 1 --2- 172.21.15.40:0/1241350631 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fa32806ace0 0x7fa32806d190 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:05.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.942+0000 7fa34c9ff700 1 --2- 172.21.15.40:0/1241350631 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa3480cd2d0 0x7fa3480b7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:05.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.942+0000 7fa34c9ff700 1 --2- 172.21.15.40:0/1241350631 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa34815c560 0x7fa3480cc460 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:05.946 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.942+0000 7fa34c9ff700 1 --2- 172.21.15.40:0/1241350631 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3480cf690 0x7fa3480cbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:05.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.942+0000 7fa34c9ff700 1 -- 172.21.15.40:0/1241350631 >> 172.21.15.40:0/1241350631 conn(0x7fa348071660 msgr2=0x7fa3480d13d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:05.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.942+0000 7fa34c9ff700 1 -- 172.21.15.40:0/1241350631 shutdown_connections 2023-06-22T10:55:05.947 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:05.942+0000 7fa34c9ff700 1 -- 172.21.15.40:0/1241350631 wait complete. 2023-06-22T10:55:05.947 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_data_ec' removed 2023-06-22T10:55:05.966 INFO:tasks.ceph.mds.a:Restarting daemon 2023-06-22T10:55:05.966 INFO:tasks.ceph.mds.a:Stopping old one... 2023-06-22T10:55:05.967 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-06-22T10:55:05.967 INFO:teuthology.orchestra.run:waiting for 300 2023-06-22T10:55:05.967 INFO:tasks.ceph.mds.c:Restarting daemon 2023-06-22T10:55:05.967 INFO:tasks.ceph.mds.c:Stopping old one... 2023-06-22T10:55:05.968 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-06-22T10:55:05.968 INFO:teuthology.orchestra.run:waiting for 300 2023-06-22T10:55:05.968 INFO:tasks.ceph.mds.b:Restarting daemon 2023-06-22T10:55:05.968 INFO:tasks.ceph.mds.b:Stopping old one... 2023-06-22T10:55:05.968 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-06-22T10:55:05.969 INFO:teuthology.orchestra.run:waiting for 300 2023-06-22T10:55:05.969 INFO:tasks.ceph.mds.d:Restarting daemon 2023-06-22T10:55:05.969 INFO:tasks.ceph.mds.d:Stopping old one... 2023-06-22T10:55:05.969 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-06-22T10:55:05.969 INFO:teuthology.orchestra.run:waiting for 300 2023-06-22T10:55:05.987 INFO:tasks.ceph.mds.a:Stopped 2023-06-22T10:55:05.988 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-06-22T10:55:05.989 INFO:tasks.ceph.mds.c:Stopped 2023-06-22T10:55:05.990 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-06-22T10:55:05.992 INFO:tasks.ceph.mds.b:Stopped 2023-06-22T10:55:05.992 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-06-22T10:55:05.994 INFO:tasks.ceph.mds.d:Stopped 2023-06-22T10:55:05.995 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-06-22T10:55:06.033 INFO:tasks.ceph.mds.a:Started 2023-06-22T10:55:06.034 DEBUG:teuthology.parallel:result is None 2023-06-22T10:55:06.036 INFO:tasks.ceph.mds.c:Started 2023-06-22T10:55:06.036 DEBUG:teuthology.parallel:result is None 2023-06-22T10:55:06.038 INFO:tasks.ceph.mds.b:Started 2023-06-22T10:55:06.039 DEBUG:teuthology.parallel:result is None 2023-06-22T10:55:06.041 INFO:tasks.ceph.mds.d:Started 2023-06-22T10:55:06.042 DEBUG:teuthology.parallel:result is None 2023-06-22T10:55:06.043 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-06-22T10:55:06.191 INFO:tasks.ceph.mds.a.smithi040.stdout:starting mds.a at 2023-06-22T10:55:06.191 INFO:tasks.ceph.mds.c.smithi040.stdout:starting mds.c at 2023-06-22T10:55:06.193 INFO:tasks.ceph.mds.b.smithi045.stdout:starting mds.b at 2023-06-22T10:55:06.194 INFO:tasks.ceph.mds.d.smithi045.stdout:starting mds.d at 2023-06-22T10:55:06.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.258+0000 7fa9ecdff700 1 Processor -- start 2023-06-22T10:55:06.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.258+0000 7fa9ecdff700 1 -- start start 2023-06-22T10:55:06.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.259+0000 7fa9ecdff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa9e80adbe0 0x7fa9e80ceff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:06.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.259+0000 7fa9ecdff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa9e806a640 0x7fa9e80b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:06.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.259+0000 7fa9ecdff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9e80adfb0 con 0x7fa9e80caa80 2023-06-22T10:55:06.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.259+0000 7fa9ecdff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9e80714b0 con 0x7fa9e80adbe0 2023-06-22T10:55:06.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.259+0000 7fa9ecdff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e8070ef0 con 0x7fa9e806a640 2023-06-22T10:55:06.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.259+0000 7fa9e5d9b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa9e80caa80 0x7fa9e8069f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:35962/0 (socket says 172.21.15.40:35962) 2023-06-22T10:55:06.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.259+0000 7fa9e5d9b700 1 -- 172.21.15.40:0/2844014285 learned_addr learned my addr 172.21.15.40:0/2844014285 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:55:06.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.260+0000 7fa9e6d9d700 1 --2- 172.21.15.40:0/2844014285 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa9e806a640 0x7fa9e80b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:06.267 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.260+0000 7fa9e659c700 1 --2- 172.21.15.40:0/2844014285 >> v2:172.21.15.45:3300/0 conn(0x7fa9e80adbe0 0x7fa9e80ceff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:06.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.260+0000 7fa9e559a700 1 -- 172.21.15.40:0/2844014285 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2827947118 0 0) 0x7fa9dc001110 con 0x7fa9e80caa80 2023-06-22T10:55:06.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.260+0000 7fa9e559a700 1 -- 172.21.15.40:0/2844014285 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9d00035b0 con 0x7fa9e80caa80 2023-06-22T10:55:06.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.260+0000 7fa9e659c700 1 -- 172.21.15.40:0/2844014285 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa9e806a640 msgr2=0x7fa9e80b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:55:06.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.260+0000 7fa9e659c700 1 --2- 172.21.15.40:0/2844014285 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa9e806a640 0x7fa9e80b1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:06.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.260+0000 7fa9e659c700 1 -- 172.21.15.40:0/2844014285 >> v1:172.21.15.40:6789/0 conn(0x7fa9e80caa80 legacy=0x7fa9e8069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:06.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.260+0000 7fa9e659c700 1 -- 172.21.15.40:0/2844014285 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e80711d0 con 0x7fa9e80adbe0 2023-06-22T10:55:06.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.260+0000 7fa9e6d9d700 1 --2- 172.21.15.40:0/2844014285 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa9e806a640 0x7fa9e80b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-22T10:55:06.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.260+0000 7fa9e659c700 1 --2- 172.21.15.40:0/2844014285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9e80adbe0 0x7fa9e80ceff0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa9d8009840 tx=0x7fa9d8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7c2de419613313d server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:06.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.261+0000 7fa9e559a700 1 -- 172.21.15.40:0/2844014285 <== mon.1 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d8011830 con 0x7fa9e80adbe0 2023-06-22T10:55:06.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.261+0000 7fa9e559a700 1 -- 172.21.15.40:0/2844014285 <== mon.1 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9d8011990 con 0x7fa9e80adbe0 2023-06-22T10:55:06.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.261+0000 7fa9e559a700 1 -- 172.21.15.40:0/2844014285 <== mon.1 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d8011d20 con 0x7fa9e80adbe0 2023-06-22T10:55:06.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.261+0000 7fa9ecdff700 1 -- 172.21.15.40:0/2844014285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9e80adbe0 msgr2=0x7fa9e80ceff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:06.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.261+0000 7fa9ecdff700 1 --2- 172.21.15.40:0/2844014285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9e80adbe0 0x7fa9e80ceff0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa9d8009840 tx=0x7fa9d8009b50 comp rx=0 tx=0).stop 2023-06-22T10:55:06.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.261+0000 7fa9ecdff700 1 -- 172.21.15.40:0/2844014285 shutdown_connections 2023-06-22T10:55:06.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.261+0000 7fa9ecdff700 1 --2- 172.21.15.40:0/2844014285 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa9e806a640 0x7fa9e80b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:06.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.261+0000 7fa9ecdff700 1 --2- 172.21.15.40:0/2844014285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9e80adbe0 0x7fa9e80ceff0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:06.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.261+0000 7fa9ecdff700 1 -- 172.21.15.40:0/2844014285 >> 172.21.15.40:0/2844014285 conn(0x7fa9e80b0ff0 msgr2=0x7fa9e80ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:06.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.261+0000 7fa9ecdff700 1 -- 172.21.15.40:0/2844014285 shutdown_connections 2023-06-22T10:55:06.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.261+0000 7fa9ecdff700 1 -- 172.21.15.40:0/2844014285 wait complete. 2023-06-22T10:55:06.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.263+0000 7fa9ecdff700 1 Processor -- start 2023-06-22T10:55:06.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.263+0000 7fa9ecdff700 1 -- start start 2023-06-22T10:55:06.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.264+0000 7fa9ecdff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa9e806a640 0x7fa9e8145bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:06.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.264+0000 7fa9ecdff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9e80adbe0 0x7fa9e80c5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:06.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.264+0000 7fa9ecdff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa9e80caa80 0x7fa9e80c5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:06.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.264+0000 7fa9ecdff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e815b970 con 0x7fa9e806a640 2023-06-22T10:55:06.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.264+0000 7fa9ecdff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e80c6430 con 0x7fa9e80adbe0 2023-06-22T10:55:06.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.264+0000 7fa9ecdff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e80c6710 con 0x7fa9e80caa80 2023-06-22T10:55:06.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.264+0000 7fa9e659c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa9e806a640 0x7fa9e8145bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:06.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.264+0000 7fa9e659c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa9e806a640 0x7fa9e8145bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58058/0 (socket says 172.21.15.40:58058) 2023-06-22T10:55:06.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.264+0000 7fa9e659c700 1 -- 172.21.15.40:0/1215964400 learned_addr learned my addr 172.21.15.40:0/1215964400 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:55:06.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.265+0000 7fa9e5d9b700 1 --2- 172.21.15.40:0/1215964400 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9e80adbe0 0x7fa9e80c5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:06.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.265+0000 7fa9e6d9d700 1 --2- 172.21.15.40:0/1215964400 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa9e80caa80 0x7fa9e80c5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:06.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.265+0000 7fa9e659c700 1 -- 172.21.15.40:0/1215964400 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa9e80caa80 msgr2=0x7fa9e80c5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:06.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.265+0000 7fa9e659c700 1 --2- 172.21.15.40:0/1215964400 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa9e80caa80 0x7fa9e80c5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:06.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.265+0000 7fa9e659c700 1 -- 172.21.15.40:0/1215964400 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9e80adbe0 msgr2=0x7fa9e80c5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:06.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.265+0000 7fa9e659c700 1 --2- 172.21.15.40:0/1215964400 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9e80adbe0 0x7fa9e80c5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:06.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.265+0000 7fa9e659c700 1 -- 172.21.15.40:0/1215964400 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e0009a70 con 0x7fa9e806a640 2023-06-22T10:55:06.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.265+0000 7fa9e6d9d700 1 --2- 172.21.15.40:0/1215964400 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa9e80caa80 0x7fa9e80c5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:55:06.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.265+0000 7fa9e659c700 1 --2- 172.21.15.40:0/1215964400 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa9e806a640 0x7fa9e8145bd0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa9d80090b0 tx=0x7fa9d8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:06.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.265+0000 7fa9d6ffd700 1 -- 172.21.15.40:0/1215964400 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d80036a0 con 0x7fa9e806a640 2023-06-22T10:55:06.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.265+0000 7fa9d6ffd700 1 -- 172.21.15.40:0/1215964400 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9d801f070 con 0x7fa9e806a640 2023-06-22T10:55:06.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.265+0000 7fa9d6ffd700 1 -- 172.21.15.40:0/1215964400 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d8003a60 con 0x7fa9e806a640 2023-06-22T10:55:06.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.265+0000 7fa9ecdff700 1 -- 172.21.15.40:0/1215964400 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9d80094a0 con 0x7fa9e806a640 2023-06-22T10:55:06.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.266+0000 7fa9ecdff700 1 -- 172.21.15.40:0/1215964400 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9e80c6cd0 con 0x7fa9e806a640 2023-06-22T10:55:06.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.267+0000 7fa9ecdff700 1 -- 172.21.15.40:0/1215964400 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9e806d4b0 con 0x7fa9e806a640 2023-06-22T10:55:06.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.267+0000 7fa9d6ffd700 1 -- 172.21.15.40:0/1215964400 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa9d8003bc0 con 0x7fa9e806a640 2023-06-22T10:55:06.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.268+0000 7fa9d6ffd700 1 --2- 172.21.15.40:0/1215964400 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fa9c806ace0 0x7fa9c806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:06.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.268+0000 7fa9d6ffd700 1 -- 172.21.15.40:0/1215964400 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fa9d8021070 con 0x7fa9e806a640 2023-06-22T10:55:06.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.268+0000 7fa9e5d9b700 1 --2- 172.21.15.40:0/1215964400 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fa9c806ace0 0x7fa9c806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:06.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.269+0000 7fa9e5d9b700 1 --2- 172.21.15.40:0/1215964400 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fa9c806ace0 0x7fa9c806d190 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc007fd0 tx=0x7fa9dc007c40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:06.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.273+0000 7fa9d6ffd700 1 -- 172.21.15.40:0/1215964400 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa9d8055d90 con 0x7fa9e806a640 2023-06-22T10:55:06.496 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.493+0000 7fa9ecdff700 1 -- 172.21.15.40:0/1215964400 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fa9e8067580 con 0x7fa9e806a640 2023-06-22T10:55:06.952 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.949+0000 7fa9d6ffd700 1 -- 172.21.15.40:0/1215964400 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v36) v1 ==== 97+0+0 (secure 0 0 0) 0x7fa9d8015080 con 0x7fa9e806a640 2023-06-22T10:55:06.956 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.953+0000 7fa9ecdff700 1 -- 172.21.15.40:0/1215964400 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fa9c806ace0 msgr2=0x7fa9c806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:06.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.953+0000 7fa9ecdff700 1 --2- 172.21.15.40:0/1215964400 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fa9c806ace0 0x7fa9c806d190 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc007fd0 tx=0x7fa9dc007c40 comp rx=0 tx=0).stop 2023-06-22T10:55:06.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.953+0000 7fa9ecdff700 1 -- 172.21.15.40:0/1215964400 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa9e806a640 msgr2=0x7fa9e8145bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:06.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.953+0000 7fa9ecdff700 1 --2- 172.21.15.40:0/1215964400 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa9e806a640 0x7fa9e8145bd0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa9d80090b0 tx=0x7fa9d8004750 comp rx=0 tx=0).stop 2023-06-22T10:55:06.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.953+0000 7fa9ecdff700 1 -- 172.21.15.40:0/1215964400 shutdown_connections 2023-06-22T10:55:06.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.953+0000 7fa9ecdff700 1 --2- 172.21.15.40:0/1215964400 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fa9c806ace0 0x7fa9c806d190 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:06.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.953+0000 7fa9ecdff700 1 --2- 172.21.15.40:0/1215964400 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa9e80caa80 0x7fa9e80c5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:06.957 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.953+0000 7fa9ecdff700 1 --2- 172.21.15.40:0/1215964400 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa9e806a640 0x7fa9e8145bd0 secure :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa9d80090b0 tx=0x7fa9d8004750 comp rx=0 tx=0).stop 2023-06-22T10:55:06.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.953+0000 7fa9ecdff700 1 --2- 172.21.15.40:0/1215964400 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9e80adbe0 0x7fa9e80c5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:06.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.953+0000 7fa9ecdff700 1 -- 172.21.15.40:0/1215964400 >> 172.21.15.40:0/1215964400 conn(0x7fa9e80b0ff0 msgr2=0x7fa9e80ad150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:06.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.953+0000 7fa9ecdff700 1 -- 172.21.15.40:0/1215964400 shutdown_connections 2023-06-22T10:55:06.958 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:06.954+0000 7fa9ecdff700 1 -- 172.21.15.40:0/1215964400 wait complete. 2023-06-22T10:55:06.961 INFO:teuthology.orchestra.run.smithi040.stderr: removed all blocklist entries 2023-06-22T10:55:06.981 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-06-22T10:55:07.190 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.187+0000 7fbbad5ff700 1 Processor -- start 2023-06-22T10:55:07.191 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.187+0000 7fbbad5ff700 1 -- start start 2023-06-22T10:55:07.192 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.189+0000 7fbbad5ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fbba815c720 0x7fbba80b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:07.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.189+0000 7fbbad5ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbba80b2130 con 0x7fbba80d2830 2023-06-22T10:55:07.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.189+0000 7fbbad5ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbba8161180 con 0x7fbba80b4e30 2023-06-22T10:55:07.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.189+0000 7fbbad5ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbba8160d60 con 0x7fbba815c720 2023-06-22T10:55:07.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.189+0000 7fbb9ffff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fbba80d2830 0x7fbba80b4720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:35968/0 (socket says 172.21.15.40:35968) 2023-06-22T10:55:07.193 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.189+0000 7fbb9ffff700 1 -- 172.21.15.40:0/911029044 learned_addr learned my addr 172.21.15.40:0/911029044 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:55:07.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.190+0000 7fbba6ffd700 1 --2- 172.21.15.40:0/911029044 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fbba815c720 0x7fbba80b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:07.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.190+0000 7fbba67fc700 1 -- 172.21.15.40:0/911029044 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 829726884 0 0) 0x7fbba80b2130 con 0x7fbba80d2830 2023-06-22T10:55:07.194 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.190+0000 7fbba67fc700 1 -- 172.21.15.40:0/911029044 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb940035b0 con 0x7fbba80d2830 2023-06-22T10:55:07.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.190+0000 7fbba67fc700 1 -- 172.21.15.40:0/911029044 <== mon.1 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1802685330 0 0) 0x7fbba8161180 con 0x7fbba80b4e30 2023-06-22T10:55:07.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.190+0000 7fbba67fc700 1 -- 172.21.15.40:0/911029044 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbba80b2130 con 0x7fbba80b4e30 2023-06-22T10:55:07.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.190+0000 7fbba67fc700 1 -- 172.21.15.40:0/911029044 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1992996377 0 0) 0x7fbb940035b0 con 0x7fbba80d2830 2023-06-22T10:55:07.196 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.190+0000 7fbba67fc700 1 -- 172.21.15.40:0/911029044 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fbba815c720 msgr2=0x7fbba80b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:55:07.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.190+0000 7fbba67fc700 1 --2- 172.21.15.40:0/911029044 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fbba815c720 0x7fbba80b1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:07.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.190+0000 7fbba67fc700 1 -- 172.21.15.40:0/911029044 >> v1:172.21.15.45:6789/0 conn(0x7fbba80b4e30 legacy=0x7fbba80d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:07.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.190+0000 7fbba67fc700 1 -- 172.21.15.40:0/911029044 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba81603c0 con 0x7fbba80d2830 2023-06-22T10:55:07.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.190+0000 7fbba67fc700 1 -- 172.21.15.40:0/911029044 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1490606486 0 0) 0x7fbb90001670 con 0x7fbba80d2830 2023-06-22T10:55:07.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.190+0000 7fbba67fc700 1 -- 172.21.15.40:0/911029044 >> v1:172.21.15.40:6789/0 conn(0x7fbba80d2830 legacy=0x7fbba80b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:07.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.190+0000 7fbba67fc700 1 --2- 172.21.15.40:0/911029044 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb94003bc0 0x7fbb94003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:07.197 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.190+0000 7fbba67fc700 1 --2- 172.21.15.40:0/911029044 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fbba815c720 0x7fbb94004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:07.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.190+0000 7fbba67fc700 1 --2- 172.21.15.40:0/911029044 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb94004d90 0x7fbb94005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:07.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.190+0000 7fbba67fc700 1 -- 172.21.15.40:0/911029044 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba8160d60 con 0x7fbb94004d90 2023-06-22T10:55:07.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.190+0000 7fbba67fc700 1 -- 172.21.15.40:0/911029044 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9400bbf0 con 0x7fbb94003bc0 2023-06-22T10:55:07.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.190+0000 7fbba67fc700 1 -- 172.21.15.40:0/911029044 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9400bdb0 con 0x7fbba815c720 2023-06-22T10:55:07.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.191+0000 7fbba77fe700 1 --2- 172.21.15.40:0/911029044 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb94004d90 0x7fbb94005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:07.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.191+0000 7fbb9ffff700 1 --2- 172.21.15.40:0/911029044 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fbba815c720 0x7fbb94004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:07.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.191+0000 7fbba6ffd700 1 --2- 172.21.15.40:0/911029044 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb94003bc0 0x7fbb94003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:07.198 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.191+0000 7fbba77fe700 1 -- 172.21.15.40:0/911029044 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fbba815c720 msgr2=0x7fbb94004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:55:07.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.191+0000 7fbba77fe700 1 --2- 172.21.15.40:0/911029044 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fbba815c720 0x7fbb94004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:07.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.191+0000 7fbba77fe700 1 -- 172.21.15.40:0/911029044 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb94003bc0 msgr2=0x7fbb94003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:55:07.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.191+0000 7fbba77fe700 1 --2- 172.21.15.40:0/911029044 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb94003bc0 0x7fbb94003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:07.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.191+0000 7fbba77fe700 1 -- 172.21.15.40:0/911029044 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb940035b0 con 0x7fbb94004d90 2023-06-22T10:55:07.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.191+0000 7fbba77fe700 1 --2- 172.21.15.40:0/911029044 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb94004d90 0x7fbb94005200 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fbba0002230 tx=0x7fbb94005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3673fb1e1707abd3 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:07.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.191+0000 7fbba67fc700 1 -- 172.21.15.40:0/911029044 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba0001f30 con 0x7fbb94004d90 2023-06-22T10:55:07.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.192+0000 7fbba67fc700 1 -- 172.21.15.40:0/911029044 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbba000ce60 con 0x7fbb94004d90 2023-06-22T10:55:07.199 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.192+0000 7fbba67fc700 1 -- 172.21.15.40:0/911029044 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba0003c40 con 0x7fbb94004d90 2023-06-22T10:55:07.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.192+0000 7fbbad5ff700 1 -- 172.21.15.40:0/911029044 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb94004d90 msgr2=0x7fbb94005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:07.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.192+0000 7fbbad5ff700 1 --2- 172.21.15.40:0/911029044 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb94004d90 0x7fbb94005200 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fbba0002230 tx=0x7fbb94005880 comp rx=0 tx=0).stop 2023-06-22T10:55:07.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.192+0000 7fbba77fe700 1 -- 172.21.15.40:0/911029044 reap_dead start 2023-06-22T10:55:07.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.192+0000 7fbbad5ff700 1 -- 172.21.15.40:0/911029044 shutdown_connections 2023-06-22T10:55:07.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.192+0000 7fbbad5ff700 1 -- 172.21.15.40:0/911029044 >> 172.21.15.40:0/911029044 conn(0x7fbba80cf720 msgr2=0x7fbba80cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:07.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.192+0000 7fbbad5ff700 1 -- 172.21.15.40:0/911029044 shutdown_connections 2023-06-22T10:55:07.200 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.192+0000 7fbbad5ff700 1 -- 172.21.15.40:0/911029044 wait complete. 2023-06-22T10:55:07.202 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.194+0000 7fbbad5ff700 1 Processor -- start 2023-06-22T10:55:07.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.194+0000 7fbbad5ff700 1 -- start start 2023-06-22T10:55:07.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.195+0000 7fbbad5ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb94004d90 0x7fbba80b1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:07.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.195+0000 7fbbad5ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbba815f600 0x7fbba81f2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:07.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.195+0000 7fbbad5ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fbba80cb940 0x7fbba80cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:07.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.195+0000 7fbbad5ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba80cd930 con 0x7fbba815f600 2023-06-22T10:55:07.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.195+0000 7fbbad5ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba80cc300 con 0x7fbb94004d90 2023-06-22T10:55:07.203 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.195+0000 7fbbad5ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbba815fff0 con 0x7fbba80cb940 2023-06-22T10:55:07.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.195+0000 7fbb9ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbba815f600 0x7fbba81f2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:07.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.195+0000 7fbb9ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbba815f600 0x7fbba81f2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58076/0 (socket says 172.21.15.40:58076) 2023-06-22T10:55:07.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.195+0000 7fbb9ffff700 1 -- 172.21.15.40:0/1738264456 learned_addr learned my addr 172.21.15.40:0/1738264456 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:55:07.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.196+0000 7fbba6ffd700 1 --2- 172.21.15.40:0/1738264456 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb94004d90 0x7fbba80b1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:07.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.196+0000 7fbba77fe700 1 --2- 172.21.15.40:0/1738264456 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fbba80cb940 0x7fbba80cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:07.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.196+0000 7fbb9ffff700 1 -- 172.21.15.40:0/1738264456 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fbba80cb940 msgr2=0x7fbba80cbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:07.204 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.196+0000 7fbb9ffff700 1 --2- 172.21.15.40:0/1738264456 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fbba80cb940 0x7fbba80cbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:07.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.196+0000 7fbb9ffff700 1 -- 172.21.15.40:0/1738264456 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb94004d90 msgr2=0x7fbba80b1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:07.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.196+0000 7fbb9ffff700 1 --2- 172.21.15.40:0/1738264456 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb94004d90 0x7fbba80b1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:07.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.196+0000 7fbb9ffff700 1 -- 172.21.15.40:0/1738264456 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba80ce100 con 0x7fbba815f600 2023-06-22T10:55:07.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.196+0000 7fbba6ffd700 1 --2- 172.21.15.40:0/1738264456 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb94004d90 0x7fbba80b1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-22T10:55:07.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.196+0000 7fbba77fe700 1 --2- 172.21.15.40:0/1738264456 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fbba80cb940 0x7fbba80cbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-22T10:55:07.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.196+0000 7fbb9ffff700 1 --2- 172.21.15.40:0/1738264456 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbba815f600 0x7fbba81f2d30 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fbb90000fd0 tx=0x7fbb90007570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:07.205 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.196+0000 7fbb9f7fe700 1 -- 172.21.15.40:0/1738264456 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb90011580 con 0x7fbba815f600 2023-06-22T10:55:07.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.196+0000 7fbb9f7fe700 1 -- 172.21.15.40:0/1738264456 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb900116e0 con 0x7fbba815f600 2023-06-22T10:55:07.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.196+0000 7fbb9f7fe700 1 -- 172.21.15.40:0/1738264456 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb90011a90 con 0x7fbba815f600 2023-06-22T10:55:07.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.196+0000 7fbbad5ff700 1 -- 172.21.15.40:0/1738264456 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbba80cdb40 con 0x7fbba815f600 2023-06-22T10:55:07.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.196+0000 7fbbad5ff700 1 -- 172.21.15.40:0/1738264456 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbba80c9f10 con 0x7fbba815f600 2023-06-22T10:55:07.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.197+0000 7fbbad5ff700 1 -- 172.21.15.40:0/1738264456 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbba80c9d50 con 0x7fbba815f600 2023-06-22T10:55:07.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.198+0000 7fbb9f7fe700 1 -- 172.21.15.40:0/1738264456 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbb90011bf0 con 0x7fbba815f600 2023-06-22T10:55:07.206 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.199+0000 7fbb9f7fe700 1 --2- 172.21.15.40:0/1738264456 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fbb8806ace0 0x7fbb8806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:07.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.199+0000 7fbb9f7fe700 1 -- 172.21.15.40:0/1738264456 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fbb900890e0 con 0x7fbba815f600 2023-06-22T10:55:07.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.199+0000 7fbba6ffd700 1 --2- 172.21.15.40:0/1738264456 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fbb8806ace0 0x7fbb8806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:07.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.200+0000 7fbba6ffd700 1 --2- 172.21.15.40:0/1738264456 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fbb8806ace0 0x7fbb8806d190 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fbba81f5800 tx=0x7fbb98008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:07.207 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.204+0000 7fbb9f7fe700 1 -- 172.21.15.40:0/1738264456 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbb90054390 con 0x7fbba815f600 2023-06-22T10:55:07.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.490+0000 7fbbad5ff700 1 -- 172.21.15.40:0/1738264456 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fbba80ce0e0 con 0x7fbba815f600 2023-06-22T10:55:07.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.490+0000 7fbb9f7fe700 1 -- 172.21.15.40:0/1738264456 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fbb900579b0 con 0x7fbba815f600 2023-06-22T10:55:07.494 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:55:07.495 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-06-22T10:55:07.495 INFO:teuthology.orchestra.run.smithi040.stdout: "auth_dump": [ 2023-06-22T10:55:07.495 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-06-22T10:55:07.495 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mds.a", 2023-06-22T10:55:07.496 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDsJ5RknprOBBAA7eak8Y+1FYXPowwQpqW1kA==", 2023-06-22T10:55:07.496 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-06-22T10:55:07.496 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-06-22T10:55:07.496 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow *", 2023-06-22T10:55:07.497 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow *", 2023-06-22T10:55:07.497 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-06-22T10:55:07.497 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-06-22T10:55:07.497 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-06-22T10:55:07.498 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-06-22T10:55:07.498 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mds.b", 2023-06-22T10:55:07.498 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDsJ5RkRHn9HBAAOQ9h7xL+lVv84QVO6CYPEg==", 2023-06-22T10:55:07.498 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-06-22T10:55:07.498 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-06-22T10:55:07.498 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow *", 2023-06-22T10:55:07.499 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow *", 2023-06-22T10:55:07.499 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-06-22T10:55:07.499 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-06-22T10:55:07.499 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-06-22T10:55:07.499 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-06-22T10:55:07.499 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mds.c", 2023-06-22T10:55:07.499 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDsJ5Rky/KVEBAAKG4b2cl7qpCEtMueOIk/FA==", 2023-06-22T10:55:07.499 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-06-22T10:55:07.500 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-06-22T10:55:07.500 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow *", 2023-06-22T10:55:07.500 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow *", 2023-06-22T10:55:07.500 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-06-22T10:55:07.500 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-06-22T10:55:07.500 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-06-22T10:55:07.500 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-06-22T10:55:07.501 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mds.d", 2023-06-22T10:55:07.501 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDsJ5Rk+yDhKBAA0p6Uhfgn+CPz3qU2h75ENg==", 2023-06-22T10:55:07.501 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-06-22T10:55:07.501 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-06-22T10:55:07.501 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow *", 2023-06-22T10:55:07.501 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow *", 2023-06-22T10:55:07.501 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-06-22T10:55:07.501 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-06-22T10:55:07.502 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-06-22T10:55:07.502 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-06-22T10:55:07.502 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.0", 2023-06-22T10:55:07.502 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDwJ5RkNrnFKRAAi5GAWzeXUP4qI7iKTymEWw==", 2023-06-22T10:55:07.502 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-06-22T10:55:07.502 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-06-22T10:55:07.502 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-06-22T10:55:07.503 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-06-22T10:55:07.503 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-06-22T10:55:07.503 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-06-22T10:55:07.503 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-06-22T10:55:07.503 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.1", 2023-06-22T10:55:07.503 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDzJ5Rk+sSVLRAAmHofmM8Zp6o8rGbJvzipyg==", 2023-06-22T10:55:07.503 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-06-22T10:55:07.503 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-06-22T10:55:07.504 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-06-22T10:55:07.504 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-06-22T10:55:07.504 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-06-22T10:55:07.504 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-06-22T10:55:07.504 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-06-22T10:55:07.504 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.2", 2023-06-22T10:55:07.504 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQD2J5RkshSaMRAA3VMwM6/DoTIHos1lG046lA==", 2023-06-22T10:55:07.504 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-06-22T10:55:07.505 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-06-22T10:55:07.505 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-06-22T10:55:07.505 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-06-22T10:55:07.505 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-06-22T10:55:07.505 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-06-22T10:55:07.505 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-06-22T10:55:07.505 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.3", 2023-06-22T10:55:07.506 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQD5J5Rkzh7kNRAAYMwi645C8i/1HeVuEpVqQA==", 2023-06-22T10:55:07.506 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-06-22T10:55:07.506 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-06-22T10:55:07.506 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-06-22T10:55:07.506 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-06-22T10:55:07.506 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-06-22T10:55:07.506 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-06-22T10:55:07.506 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-06-22T10:55:07.507 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.4", 2023-06-22T10:55:07.507 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQD+J5RkZDrYHBAAKNxebfeSVk7ix+jX5HUP2A==", 2023-06-22T10:55:07.507 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-06-22T10:55:07.507 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-06-22T10:55:07.507 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-06-22T10:55:07.507 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-06-22T10:55:07.507 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-06-22T10:55:07.507 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-06-22T10:55:07.508 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-06-22T10:55:07.508 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.5", 2023-06-22T10:55:07.508 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQABKJRkc+GbIBAA1e0Y9bWsTzCbBLpHruTelQ==", 2023-06-22T10:55:07.508 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-06-22T10:55:07.508 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-06-22T10:55:07.508 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-06-22T10:55:07.508 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-06-22T10:55:07.509 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-06-22T10:55:07.509 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-06-22T10:55:07.509 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-06-22T10:55:07.509 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.6", 2023-06-22T10:55:07.509 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQAEKJRkci+jJBAAsCxNAtk/rnjdtPaiqqnLBQ==", 2023-06-22T10:55:07.509 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-06-22T10:55:07.509 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-06-22T10:55:07.509 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-06-22T10:55:07.510 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-06-22T10:55:07.510 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-06-22T10:55:07.510 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-06-22T10:55:07.510 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-06-22T10:55:07.510 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.7", 2023-06-22T10:55:07.510 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQAHKJRknQv6KBAA8i5HfnAIg48v0QF4mbeFbg==", 2023-06-22T10:55:07.510 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-06-22T10:55:07.510 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2023-06-22T10:55:07.511 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2023-06-22T10:55:07.511 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-06-22T10:55:07.511 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-06-22T10:55:07.511 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-06-22T10:55:07.511 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-06-22T10:55:07.512 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.0", 2023-06-22T10:55:07.512 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDsJ5RkbRd/MxAAyagIUs2XwHNsZXz9Qj2VYA==", 2023-06-22T10:55:07.512 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-06-22T10:55:07.512 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-06-22T10:55:07.512 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow r", 2023-06-22T10:55:07.512 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow rw", 2023-06-22T10:55:07.512 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow rwx" 2023-06-22T10:55:07.512 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-06-22T10:55:07.513 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-06-22T10:55:07.513 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-06-22T10:55:07.513 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.1", 2023-06-22T10:55:07.513 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDtJ5Rksxc4BxAAa5tBILwcRq61/4BzAbwJvg==", 2023-06-22T10:55:07.513 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-06-22T10:55:07.513 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-06-22T10:55:07.513 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow r", 2023-06-22T10:55:07.513 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow rw", 2023-06-22T10:55:07.514 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow rwx" 2023-06-22T10:55:07.514 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-06-22T10:55:07.514 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-06-22T10:55:07.514 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-06-22T10:55:07.514 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.2", 2023-06-22T10:55:07.514 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDsJ5Rkmw8tOxAAYuXx3UIIu22JlChCySc7gg==", 2023-06-22T10:55:07.514 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-06-22T10:55:07.515 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-06-22T10:55:07.515 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow r", 2023-06-22T10:55:07.515 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow rw", 2023-06-22T10:55:07.515 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow rwx" 2023-06-22T10:55:07.515 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-06-22T10:55:07.515 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-06-22T10:55:07.515 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-06-22T10:55:07.515 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.3", 2023-06-22T10:55:07.516 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDtJ5RkaEHeDhAA6qGF/d7CpTSdCX1hNTtbwQ==", 2023-06-22T10:55:07.516 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-06-22T10:55:07.516 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2023-06-22T10:55:07.516 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow r", 2023-06-22T10:55:07.516 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow rw", 2023-06-22T10:55:07.516 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow rwx" 2023-06-22T10:55:07.516 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-06-22T10:55:07.516 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-06-22T10:55:07.517 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-06-22T10:55:07.517 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.admin", 2023-06-22T10:55:07.517 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg==", 2023-06-22T10:55:07.517 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-06-22T10:55:07.517 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow *", 2023-06-22T10:55:07.517 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow *", 2023-06-22T10:55:07.517 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow *", 2023-06-22T10:55:07.517 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-06-22T10:55:07.518 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-06-22T10:55:07.518 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-06-22T10:55:07.518 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-06-22T10:55:07.518 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.bootstrap-mds", 2023-06-22T10:55:07.518 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQAPKJRkXyHKLhAAdXrG+R6JNcS8JgE5oGp5JQ==", 2023-06-22T10:55:07.518 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-06-22T10:55:07.518 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile bootstrap-mds" 2023-06-22T10:55:07.518 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-06-22T10:55:07.519 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-06-22T10:55:07.519 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-06-22T10:55:07.519 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.bootstrap-mgr", 2023-06-22T10:55:07.519 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQAPKJRkhyvKLhAAyqlWj00TYnj8FnclIMDcdw==", 2023-06-22T10:55:07.519 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-06-22T10:55:07.519 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile bootstrap-mgr" 2023-06-22T10:55:07.519 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-06-22T10:55:07.519 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-06-22T10:55:07.520 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-06-22T10:55:07.520 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.bootstrap-osd", 2023-06-22T10:55:07.520 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQAPKJRkfzXKLhAAiopiwPcZJf4azHBbz3KV2g==", 2023-06-22T10:55:07.520 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-06-22T10:55:07.520 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile bootstrap-osd" 2023-06-22T10:55:07.520 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-06-22T10:55:07.520 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-06-22T10:55:07.521 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-06-22T10:55:07.521 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.bootstrap-rbd", 2023-06-22T10:55:07.521 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQAPKJRkKT7KLhAAsGjZIBwnV5/RSw8nvaA5jQ==", 2023-06-22T10:55:07.521 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-06-22T10:55:07.521 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile bootstrap-rbd" 2023-06-22T10:55:07.521 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-06-22T10:55:07.521 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-06-22T10:55:07.521 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-06-22T10:55:07.522 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-06-22T10:55:07.522 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQAPKJRkrEbKLhAAllgZcSD4okYyrMpCkyUnag==", 2023-06-22T10:55:07.522 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-06-22T10:55:07.522 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-06-22T10:55:07.522 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-06-22T10:55:07.522 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-06-22T10:55:07.522 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-06-22T10:55:07.522 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.bootstrap-rgw", 2023-06-22T10:55:07.523 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQAPKJRklE/KLhAAm4CwNxhA9hG7zMh8xAtArQ==", 2023-06-22T10:55:07.523 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-06-22T10:55:07.523 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile bootstrap-rgw" 2023-06-22T10:55:07.523 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-06-22T10:55:07.523 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-06-22T10:55:07.523 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-06-22T10:55:07.523 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mgr.x", 2023-06-22T10:55:07.524 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDrJ5RkE9SaOBAAxeVErdKoeQGcSL+D99zG3w==", 2023-06-22T10:55:07.524 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-06-22T10:55:07.524 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow *", 2023-06-22T10:55:07.524 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile mgr", 2023-06-22T10:55:07.524 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-06-22T10:55:07.524 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-06-22T10:55:07.524 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-06-22T10:55:07.524 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-06-22T10:55:07.525 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mgr.y", 2023-06-22T10:55:07.525 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQDrJ5RklswiMBAAKAaOShJ0Skwj4qmYxDc9ug==", 2023-06-22T10:55:07.525 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2023-06-22T10:55:07.525 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow *", 2023-06-22T10:55:07.525 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile mgr", 2023-06-22T10:55:07.525 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2023-06-22T10:55:07.525 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-06-22T10:55:07.526 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-06-22T10:55:07.526 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2023-06-22T10:55:07.526 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-06-22T10:55:07.527 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.493+0000 7fbbad5ff700 1 -- 172.21.15.40:0/1738264456 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fbb8806ace0 msgr2=0x7fbb8806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:07.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.493+0000 7fbbad5ff700 1 --2- 172.21.15.40:0/1738264456 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fbb8806ace0 0x7fbb8806d190 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fbba81f5800 tx=0x7fbb98008040 comp rx=0 tx=0).stop 2023-06-22T10:55:07.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.493+0000 7fbbad5ff700 1 -- 172.21.15.40:0/1738264456 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbba815f600 msgr2=0x7fbba81f2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:07.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.493+0000 7fbbad5ff700 1 --2- 172.21.15.40:0/1738264456 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbba815f600 0x7fbba81f2d30 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fbb90000fd0 tx=0x7fbb90007570 comp rx=0 tx=0).stop 2023-06-22T10:55:07.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.493+0000 7fbbad5ff700 1 -- 172.21.15.40:0/1738264456 shutdown_connections 2023-06-22T10:55:07.528 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.493+0000 7fbbad5ff700 1 --2- 172.21.15.40:0/1738264456 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fbb8806ace0 0x7fbb8806d190 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:07.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.493+0000 7fbbad5ff700 1 --2- 172.21.15.40:0/1738264456 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fbba80cb940 0x7fbba80cbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:07.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.493+0000 7fbbad5ff700 1 --2- 172.21.15.40:0/1738264456 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb94004d90 0x7fbba80b1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:07.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.493+0000 7fbbad5ff700 1 --2- 172.21.15.40:0/1738264456 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbba815f600 0x7fbba81f2d30 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:07.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.493+0000 7fbbad5ff700 1 -- 172.21.15.40:0/1738264456 >> 172.21.15.40:0/1738264456 conn(0x7fbba80cf720 msgr2=0x7fbba806b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:07.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.493+0000 7fbbad5ff700 1 -- 172.21.15.40:0/1738264456 shutdown_connections 2023-06-22T10:55:07.529 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.493+0000 7fbbad5ff700 1 -- 172.21.15.40:0/1738264456 wait complete. 2023-06-22T10:55:07.530 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-06-22T10:55:07.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.729+0000 7f29bb9ff700 1 Processor -- start 2023-06-22T10:55:07.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.729+0000 7f29bb9ff700 1 -- start start 2023-06-22T10:55:07.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.730+0000 7f29bb9ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f29b415c720 0x7f29b40b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:07.736 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.730+0000 7f29bb9ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29b40b2130 con 0x7f29b40d2830 2023-06-22T10:55:07.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.730+0000 7f29bb9ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29b4161180 con 0x7f29b40b4e30 2023-06-22T10:55:07.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.730+0000 7f29bb9ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29b4160d60 con 0x7f29b415c720 2023-06-22T10:55:07.737 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.731+0000 7f29b8f9a700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f29b40d2830 0x7f29b40b4720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:35976/0 (socket says 172.21.15.40:35976) 2023-06-22T10:55:07.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.731+0000 7f29b8f9a700 1 -- 172.21.15.40:0/4089729235 learned_addr learned my addr 172.21.15.40:0/4089729235 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:55:07.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.731+0000 7f29b979b700 1 --2- 172.21.15.40:0/4089729235 >> v2:172.21.15.40:3300/0 conn(0x7f29b415c720 0x7f29b40b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:07.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.731+0000 7f29b979b700 1 -- 172.21.15.40:0/4089729235 >> v1:172.21.15.45:6789/0 conn(0x7f29b40b4e30 legacy=0x7f29b40d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:07.738 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.731+0000 7f29b979b700 1 -- 172.21.15.40:0/4089729235 >> v1:172.21.15.40:6789/0 conn(0x7f29b40d2830 legacy=0x7f29b40b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:07.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.731+0000 7f29b979b700 1 -- 172.21.15.40:0/4089729235 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b41603c0 con 0x7f29b415c720 2023-06-22T10:55:07.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.731+0000 7f29b979b700 1 --2- 172.21.15.40:0/4089729235 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29b415c720 0x7f29b40b1870 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f29b0009870 tx=0x7f29b0009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b3adb2b5d2bf0d7 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:07.739 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.732+0000 7f29abfff700 1 -- 172.21.15.40:0/4089729235 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b0011830 con 0x7f29b415c720 2023-06-22T10:55:07.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.732+0000 7f29abfff700 1 -- 172.21.15.40:0/4089729235 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b0011990 con 0x7f29b415c720 2023-06-22T10:55:07.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.732+0000 7f29abfff700 1 -- 172.21.15.40:0/4089729235 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b0011d20 con 0x7f29b415c720 2023-06-22T10:55:07.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.732+0000 7f29bb9ff700 1 -- 172.21.15.40:0/4089729235 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29b415c720 msgr2=0x7f29b40b1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:07.740 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.732+0000 7f29bb9ff700 1 --2- 172.21.15.40:0/4089729235 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29b415c720 0x7f29b40b1870 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f29b0009870 tx=0x7f29b0009b80 comp rx=0 tx=0).stop 2023-06-22T10:55:07.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.732+0000 7f29bb9ff700 1 -- 172.21.15.40:0/4089729235 shutdown_connections 2023-06-22T10:55:07.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.732+0000 7f29bb9ff700 1 --2- 172.21.15.40:0/4089729235 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29b415c720 0x7f29b40b1870 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:07.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.732+0000 7f29bb9ff700 1 -- 172.21.15.40:0/4089729235 >> 172.21.15.40:0/4089729235 conn(0x7f29b40cf720 msgr2=0x7f29b40cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:07.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.732+0000 7f29bb9ff700 1 -- 172.21.15.40:0/4089729235 shutdown_connections 2023-06-22T10:55:07.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.733+0000 7f29bb9ff700 1 -- 172.21.15.40:0/4089729235 wait complete. 2023-06-22T10:55:07.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.734+0000 7f29bb9ff700 1 Processor -- start 2023-06-22T10:55:07.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.734+0000 7f29bb9ff700 1 -- start start 2023-06-22T10:55:07.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.735+0000 7f29bb9ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29b40b4e30 0x7f29b40cc440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:07.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.735+0000 7f29bb9ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29b40d2830 0x7f29b40aaaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:07.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.735+0000 7f29bb9ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f29b415c720 0x7f29b40aafe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:07.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.735+0000 7f29bb9ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b40aa4b0 con 0x7f29b40b4e30 2023-06-22T10:55:07.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.735+0000 7f29bb9ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b40a95e0 con 0x7f29b40d2830 2023-06-22T10:55:07.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.735+0000 7f29bb9ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29b40a9830 con 0x7f29b415c720 2023-06-22T10:55:07.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.735+0000 7f29b979b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29b40b4e30 0x7f29b40cc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:07.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.735+0000 7f29b979b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29b40b4e30 0x7f29b40cc440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58094/0 (socket says 172.21.15.40:58094) 2023-06-22T10:55:07.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.735+0000 7f29b979b700 1 -- 172.21.15.40:0/2128077318 learned_addr learned my addr 172.21.15.40:0/2128077318 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:55:07.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.736+0000 7f29b8f9a700 1 --2- 172.21.15.40:0/2128077318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29b40d2830 0x7f29b40aaaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:07.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.736+0000 7f29b9f9c700 1 --2- 172.21.15.40:0/2128077318 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f29b415c720 0x7f29b40aafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:07.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.736+0000 7f29b979b700 1 -- 172.21.15.40:0/2128077318 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f29b415c720 msgr2=0x7f29b40aafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:07.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.736+0000 7f29b979b700 1 --2- 172.21.15.40:0/2128077318 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f29b415c720 0x7f29b40aafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:07.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.736+0000 7f29b979b700 1 -- 172.21.15.40:0/2128077318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29b40d2830 msgr2=0x7f29b40aaaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:07.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.736+0000 7f29b979b700 1 --2- 172.21.15.40:0/2128077318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29b40d2830 0x7f29b40aaaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:07.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.736+0000 7f29b979b700 1 -- 172.21.15.40:0/2128077318 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b00094a0 con 0x7f29b40b4e30 2023-06-22T10:55:07.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.736+0000 7f29b8f9a700 1 --2- 172.21.15.40:0/2128077318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29b40d2830 0x7f29b40aaaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:55:07.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.736+0000 7f29b979b700 1 --2- 172.21.15.40:0/2128077318 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29b40b4e30 0x7f29b40cc440 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f29b0000c00 tx=0x7f29b0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:07.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.736+0000 7f29a9ffb700 1 -- 172.21.15.40:0/2128077318 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b00038a0 con 0x7f29b40b4e30 2023-06-22T10:55:07.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.736+0000 7f29a9ffb700 1 -- 172.21.15.40:0/2128077318 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b001e070 con 0x7f29b40b4e30 2023-06-22T10:55:07.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.736+0000 7f29a9ffb700 1 -- 172.21.15.40:0/2128077318 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b0003c60 con 0x7f29b40b4e30 2023-06-22T10:55:07.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.737+0000 7f29bb9ff700 1 -- 172.21.15.40:0/2128077318 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29b40a9b10 con 0x7f29b40b4e30 2023-06-22T10:55:07.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.737+0000 7f29bb9ff700 1 -- 172.21.15.40:0/2128077318 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29b40aa0d0 con 0x7f29b40b4e30 2023-06-22T10:55:07.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.738+0000 7f29bb9ff700 1 -- 172.21.15.40:0/2128077318 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29b4067580 con 0x7f29b40b4e30 2023-06-22T10:55:07.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.739+0000 7f29a9ffb700 1 -- 172.21.15.40:0/2128077318 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f29b002d450 con 0x7f29b40b4e30 2023-06-22T10:55:07.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.739+0000 7f29a9ffb700 1 --2- 172.21.15.40:0/2128077318 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f299806ace0 0x7f299806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:07.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.740+0000 7f29a9ffb700 1 -- 172.21.15.40:0/2128077318 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f29b008a440 con 0x7f29b40b4e30 2023-06-22T10:55:07.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.740+0000 7f29b8f9a700 1 --2- 172.21.15.40:0/2128077318 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f299806ace0 0x7f299806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:07.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.740+0000 7f29b8f9a700 1 --2- 172.21.15.40:0/2128077318 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f299806ace0 0x7f299806d190 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f29a4007fd0 tx=0x7f29a4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:07.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:07.744+0000 7f29a9ffb700 1 -- 172.21.15.40:0/2128077318 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f29b00556f0 con 0x7f29b40b4e30 2023-06-22T10:55:08.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.037+0000 7f29bb9ff700 1 -- 172.21.15.40:0/2128077318 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f29b406c2b0 con 0x7f29b40b4e30 2023-06-22T10:55:08.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.043+0000 7f29a9ffb700 1 -- 172.21.15.40:0/2128077318 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f29b0058d10 con 0x7f29b40b4e30 2023-06-22T10:55:08.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.045+0000 7f29bb9ff700 1 -- 172.21.15.40:0/2128077318 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f299806ace0 msgr2=0x7f299806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:08.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.045+0000 7f29bb9ff700 1 --2- 172.21.15.40:0/2128077318 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f299806ace0 0x7f299806d190 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f29a4007fd0 tx=0x7f29a4009040 comp rx=0 tx=0).stop 2023-06-22T10:55:08.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.045+0000 7f29bb9ff700 1 -- 172.21.15.40:0/2128077318 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29b40b4e30 msgr2=0x7f29b40cc440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:08.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.045+0000 7f29bb9ff700 1 --2- 172.21.15.40:0/2128077318 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29b40b4e30 0x7f29b40cc440 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f29b0000c00 tx=0x7f29b0004750 comp rx=0 tx=0).stop 2023-06-22T10:55:08.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.045+0000 7f29bb9ff700 1 -- 172.21.15.40:0/2128077318 shutdown_connections 2023-06-22T10:55:08.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.045+0000 7f29bb9ff700 1 --2- 172.21.15.40:0/2128077318 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f299806ace0 0x7f299806d190 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:08.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.045+0000 7f29bb9ff700 1 --2- 172.21.15.40:0/2128077318 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f29b415c720 0x7f29b40aafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:08.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.045+0000 7f29bb9ff700 1 --2- 172.21.15.40:0/2128077318 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f29b40b4e30 0x7f29b40cc440 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:08.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.045+0000 7f29bb9ff700 1 --2- 172.21.15.40:0/2128077318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29b40d2830 0x7f29b40aaaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:08.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.045+0000 7f29bb9ff700 1 -- 172.21.15.40:0/2128077318 >> 172.21.15.40:0/2128077318 conn(0x7f29b40cf720 msgr2=0x7f29b40d0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:08.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.045+0000 7f29bb9ff700 1 -- 172.21.15.40:0/2128077318 shutdown_connections 2023-06-22T10:55:08.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.046+0000 7f29bb9ff700 1 -- 172.21.15.40:0/2128077318 wait complete. 2023-06-22T10:55:08.066 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-06-22T10:55:08.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.267+0000 7fd6611ff700 1 Processor -- start 2023-06-22T10:55:08.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.267+0000 7fd6611ff700 1 -- start start 2023-06-22T10:55:08.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.268+0000 7fd6611ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd65c0d2830 0x7fd65c0b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:08.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.268+0000 7fd6611ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd65c0b4c60 0x7fd65c0d0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:08.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.268+0000 7fd6611ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd65c0b2130 con 0x7fd65c15c720 2023-06-22T10:55:08.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.268+0000 7fd6611ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd65c160d60 con 0x7fd65c0b4c60 2023-06-22T10:55:08.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.268+0000 7fd6611ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd65c0b50e0 con 0x7fd65c0d2830 2023-06-22T10:55:08.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.268+0000 7fd65ad9d700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd65c15c720 0x7fd65c0b1870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:35990/0 (socket says 172.21.15.40:35990) 2023-06-22T10:55:08.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.268+0000 7fd65ad9d700 1 -- 172.21.15.40:0/3823714534 learned_addr learned my addr 172.21.15.40:0/3823714534 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:55:08.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.268+0000 7fd65b59e700 1 --2- 172.21.15.40:0/3823714534 >> v2:172.21.15.45:3300/0 conn(0x7fd65c0b4c60 0x7fd65c0d0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:08.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.268+0000 7fd65a59c700 1 --2- 172.21.15.40:0/3823714534 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd65c0d2830 0x7fd65c0b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:08.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.269+0000 7fd659d9b700 1 -- 172.21.15.40:0/3823714534 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3507154565 0 0) 0x7fd65c0b2130 con 0x7fd65c15c720 2023-06-22T10:55:08.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.269+0000 7fd659d9b700 1 -- 172.21.15.40:0/3823714534 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6440035b0 con 0x7fd65c15c720 2023-06-22T10:55:08.274 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.269+0000 7fd659d9b700 1 -- 172.21.15.40:0/3823714534 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3768655416 0 0) 0x7fd6440035b0 con 0x7fd65c15c720 2023-06-22T10:55:08.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.269+0000 7fd65b59e700 1 -- 172.21.15.40:0/3823714534 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd65c0d2830 msgr2=0x7fd65c0b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:55:08.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.269+0000 7fd65b59e700 1 --2- 172.21.15.40:0/3823714534 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd65c0d2830 0x7fd65c0b4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:08.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.269+0000 7fd65b59e700 1 -- 172.21.15.40:0/3823714534 >> v1:172.21.15.40:6789/0 conn(0x7fd65c15c720 legacy=0x7fd65c0b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:08.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.269+0000 7fd65b59e700 1 -- 172.21.15.40:0/3823714534 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd65c161180 con 0x7fd65c0b4c60 2023-06-22T10:55:08.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.269+0000 7fd65a59c700 1 --2- 172.21.15.40:0/3823714534 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd65c0d2830 0x7fd65c0b4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-22T10:55:08.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.269+0000 7fd65b59e700 1 --2- 172.21.15.40:0/3823714534 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd65c0b4c60 0x7fd65c0d0d00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd654009d90 tx=0x7fd65400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eac8f15e319ca223 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:08.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.270+0000 7fd659d9b700 1 -- 172.21.15.40:0/3823714534 <== mon.1 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd65400e070 con 0x7fd65c0b4c60 2023-06-22T10:55:08.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.270+0000 7fd659d9b700 1 -- 172.21.15.40:0/3823714534 <== mon.1 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd654003a20 con 0x7fd65c0b4c60 2023-06-22T10:55:08.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.270+0000 7fd659d9b700 1 -- 172.21.15.40:0/3823714534 <== mon.1 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd64c001670 con 0x7fd65c0b4c60 2023-06-22T10:55:08.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.270+0000 7fd6611ff700 1 -- 172.21.15.40:0/3823714534 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd65c0b4c60 msgr2=0x7fd65c0d0d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:08.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.270+0000 7fd6611ff700 1 --2- 172.21.15.40:0/3823714534 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd65c0b4c60 0x7fd65c0d0d00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd654009d90 tx=0x7fd65400b330 comp rx=0 tx=0).stop 2023-06-22T10:55:08.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.270+0000 7fd6611ff700 1 -- 172.21.15.40:0/3823714534 shutdown_connections 2023-06-22T10:55:08.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.270+0000 7fd6611ff700 1 --2- 172.21.15.40:0/3823714534 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd65c0b4c60 0x7fd65c0d0d00 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:08.276 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.270+0000 7fd6611ff700 1 --2- 172.21.15.40:0/3823714534 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd65c0d2830 0x7fd65c0b4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:08.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.270+0000 7fd6611ff700 1 -- 172.21.15.40:0/3823714534 >> 172.21.15.40:0/3823714534 conn(0x7fd65c0cf720 msgr2=0x7fd65c0cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:08.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.270+0000 7fd6611ff700 1 -- 172.21.15.40:0/3823714534 shutdown_connections 2023-06-22T10:55:08.277 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.270+0000 7fd6611ff700 1 -- 172.21.15.40:0/3823714534 wait complete. 2023-06-22T10:55:08.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.273+0000 7fd6611ff700 1 Processor -- start 2023-06-22T10:55:08.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.273+0000 7fd6611ff700 1 -- start start 2023-06-22T10:55:08.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.274+0000 7fd6611ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd65c0b4c60 0x7fd65c0b6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:08.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.274+0000 7fd6611ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd65c0d2830 0x7fd65c159050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:08.279 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.274+0000 7fd6611ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd65c15c720 0x7fd65c1f3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:08.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.274+0000 7fd6611ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd65c0b7250 con 0x7fd65c0d2830 2023-06-22T10:55:08.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.274+0000 7fd6611ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd65c15e610 con 0x7fd65c0b4c60 2023-06-22T10:55:08.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.274+0000 7fd6611ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd65c0b8960 con 0x7fd65c15c720 2023-06-22T10:55:08.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.274+0000 7fd65a59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd65c0d2830 0x7fd65c159050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:08.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.274+0000 7fd65a59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd65c0d2830 0x7fd65c159050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58102/0 (socket says 172.21.15.40:58102) 2023-06-22T10:55:08.280 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.275+0000 7fd65a59c700 1 -- 172.21.15.40:0/2582497990 learned_addr learned my addr 172.21.15.40:0/2582497990 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:55:08.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.275+0000 7fd65ad9d700 1 --2- 172.21.15.40:0/2582497990 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd65c0b4c60 0x7fd65c0b6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:08.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.275+0000 7fd65b59e700 1 --2- 172.21.15.40:0/2582497990 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd65c15c720 0x7fd65c1f3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:08.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.275+0000 7fd65a59c700 1 -- 172.21.15.40:0/2582497990 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd65c15c720 msgr2=0x7fd65c1f3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:08.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.275+0000 7fd65a59c700 1 --2- 172.21.15.40:0/2582497990 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd65c15c720 0x7fd65c1f3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:08.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.275+0000 7fd65a59c700 1 -- 172.21.15.40:0/2582497990 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd65c0b4c60 msgr2=0x7fd65c0b6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:08.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.275+0000 7fd65a59c700 1 --2- 172.21.15.40:0/2582497990 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd65c0b4c60 0x7fd65c0b6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:08.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.275+0000 7fd65a59c700 1 -- 172.21.15.40:0/2582497990 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6500094a0 con 0x7fd65c0d2830 2023-06-22T10:55:08.281 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.275+0000 7fd65a59c700 1 --2- 172.21.15.40:0/2582497990 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd65c0d2830 0x7fd65c159050 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fd65000ebe0 tx=0x7fd65000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:08.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.275+0000 7fd6437fe700 1 -- 172.21.15.40:0/2582497990 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd650009760 con 0x7fd65c0d2830 2023-06-22T10:55:08.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.275+0000 7fd6437fe700 1 -- 172.21.15.40:0/2582497990 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd65000c850 con 0x7fd65c0d2830 2023-06-22T10:55:08.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.276+0000 7fd6611ff700 1 -- 172.21.15.40:0/2582497990 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd654009a70 con 0x7fd65c0d2830 2023-06-22T10:55:08.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.276+0000 7fd6437fe700 1 -- 172.21.15.40:0/2582497990 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd65000cbe0 con 0x7fd65c0d2830 2023-06-22T10:55:08.282 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.276+0000 7fd6611ff700 1 -- 172.21.15.40:0/2582497990 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd65c15dfc0 con 0x7fd65c0d2830 2023-06-22T10:55:08.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.277+0000 7fd6611ff700 1 -- 172.21.15.40:0/2582497990 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd65c15fff0 con 0x7fd65c0d2830 2023-06-22T10:55:08.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.278+0000 7fd6437fe700 1 -- 172.21.15.40:0/2582497990 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd65000cd40 con 0x7fd65c0d2830 2023-06-22T10:55:08.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.278+0000 7fd6437fe700 1 --2- 172.21.15.40:0/2582497990 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fd64806ace0 0x7fd64806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:08.283 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.279+0000 7fd6437fe700 1 -- 172.21.15.40:0/2582497990 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fd6500891c0 con 0x7fd65c0d2830 2023-06-22T10:55:08.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.279+0000 7fd65ad9d700 1 --2- 172.21.15.40:0/2582497990 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fd64806ace0 0x7fd64806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:08.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.279+0000 7fd65ad9d700 1 --2- 172.21.15.40:0/2582497990 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fd64806ace0 0x7fd64806d190 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd64c001eb0 tx=0x7fd64c001730 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:08.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.283+0000 7fd6437fe700 1 -- 172.21.15.40:0/2582497990 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd650054510 con 0x7fd65c0d2830 2023-06-22T10:55:08.570 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.567+0000 7fd6611ff700 1 -- 172.21.15.40:0/2582497990 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fd65c15e780 con 0x7fd65c0d2830 2023-06-22T10:55:08.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.571+0000 7fd6437fe700 1 -- 172.21.15.40:0/2582497990 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd650057b30 con 0x7fd65c0d2830 2023-06-22T10:55:08.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.573+0000 7fd6611ff700 1 -- 172.21.15.40:0/2582497990 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fd64806ace0 msgr2=0x7fd64806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:08.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.573+0000 7fd6611ff700 1 --2- 172.21.15.40:0/2582497990 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fd64806ace0 0x7fd64806d190 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd64c001eb0 tx=0x7fd64c001730 comp rx=0 tx=0).stop 2023-06-22T10:55:08.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.573+0000 7fd6611ff700 1 -- 172.21.15.40:0/2582497990 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd65c0d2830 msgr2=0x7fd65c159050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:08.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.573+0000 7fd6611ff700 1 --2- 172.21.15.40:0/2582497990 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd65c0d2830 0x7fd65c159050 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fd65000ebe0 tx=0x7fd65000eef0 comp rx=0 tx=0).stop 2023-06-22T10:55:08.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.573+0000 7fd6611ff700 1 -- 172.21.15.40:0/2582497990 shutdown_connections 2023-06-22T10:55:08.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.573+0000 7fd6611ff700 1 --2- 172.21.15.40:0/2582497990 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fd64806ace0 0x7fd64806d190 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:08.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.573+0000 7fd6611ff700 1 --2- 172.21.15.40:0/2582497990 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd65c15c720 0x7fd65c1f3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:08.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.573+0000 7fd6611ff700 1 --2- 172.21.15.40:0/2582497990 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd65c0b4c60 0x7fd65c0b6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:08.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.573+0000 7fd6611ff700 1 --2- 172.21.15.40:0/2582497990 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd65c0d2830 0x7fd65c159050 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:08.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.573+0000 7fd6611ff700 1 -- 172.21.15.40:0/2582497990 >> 172.21.15.40:0/2582497990 conn(0x7fd65c0cf720 msgr2=0x7fd65c0cbd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:08.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.574+0000 7fd6611ff700 1 -- 172.21.15.40:0/2582497990 shutdown_connections 2023-06-22T10:55:08.578 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.574+0000 7fd6611ff700 1 -- 172.21.15.40:0/2582497990 wait complete. 2023-06-22T10:55:08.595 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-06-22T10:55:08.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.793+0000 7f3c969ff700 1 Processor -- start 2023-06-22T10:55:08.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.793+0000 7f3c969ff700 1 -- start start 2023-06-22T10:55:08.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.794+0000 7f3c969ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3c9015c720 0x7f3c900b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:08.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.794+0000 7f3c969ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3c900d2830 0x7f3c900b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:08.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.794+0000 7f3c969ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c900b50a0 con 0x7f3c900b4c60 2023-06-22T10:55:08.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.794+0000 7f3c969ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c90160d60 con 0x7f3c900d2830 2023-06-22T10:55:08.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.794+0000 7f3c969ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c900b2130 con 0x7f3c9015c720 2023-06-22T10:55:08.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.794+0000 7f3c8f7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3c900d2830 0x7f3c900b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:08.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.794+0000 7f3c94f9c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f3c900b4c60 0x7f3c9006b4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:42104/0 (socket says 172.21.15.40:42104) 2023-06-22T10:55:08.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.794+0000 7f3c94f9c700 1 -- 172.21.15.40:0/2854120777 learned_addr learned my addr 172.21.15.40:0/2854120777 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:55:08.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.794+0000 7f3c8ffff700 1 --2- 172.21.15.40:0/2854120777 >> v2:172.21.15.45:3300/0 conn(0x7f3c9015c720 0x7f3c900b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:08.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.795+0000 7f3c8f7fe700 1 -- 172.21.15.40:0/2854120777 >> v2:172.21.15.45:3300/0 conn(0x7f3c9015c720 msgr2=0x7f3c900b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:55:08.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.795+0000 7f3c8f7fe700 1 --2- 172.21.15.40:0/2854120777 >> v2:172.21.15.45:3300/0 conn(0x7f3c9015c720 0x7f3c900b1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:08.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.795+0000 7f3c8f7fe700 1 -- 172.21.15.40:0/2854120777 >> v1:172.21.15.40:6789/0 conn(0x7f3c900b4c60 legacy=0x7f3c9006b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:08.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.795+0000 7f3c8f7fe700 1 -- 172.21.15.40:0/2854120777 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c90161180 con 0x7f3c900d2830 2023-06-22T10:55:08.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.795+0000 7f3c8effd700 1 -- 172.21.15.40:0/2854120777 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4223041657 0 0) 0x7f3c900b50a0 con 0x7f3c900b4c60 2023-06-22T10:55:08.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.795+0000 7f3c8f7fe700 1 --2- 172.21.15.40:0/2854120777 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c900d2830 0x7f3c900b4720 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f3c84009840 tx=0x7f3c84009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=749ce7e6000738c server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:08.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.795+0000 7f3c8effd700 1 -- 172.21.15.40:0/2854120777 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c84011830 con 0x7f3c900d2830 2023-06-22T10:55:08.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.795+0000 7f3c8effd700 1 -- 172.21.15.40:0/2854120777 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c84011990 con 0x7f3c900d2830 2023-06-22T10:55:08.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.795+0000 7f3c8effd700 1 -- 172.21.15.40:0/2854120777 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c84011d20 con 0x7f3c900d2830 2023-06-22T10:55:08.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.796+0000 7f3c969ff700 1 -- 172.21.15.40:0/2854120777 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c900d2830 msgr2=0x7f3c900b4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:08.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.796+0000 7f3c969ff700 1 --2- 172.21.15.40:0/2854120777 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c900d2830 0x7f3c900b4720 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f3c84009840 tx=0x7f3c84009b50 comp rx=0 tx=0).stop 2023-06-22T10:55:08.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.796+0000 7f3c969ff700 1 -- 172.21.15.40:0/2854120777 shutdown_connections 2023-06-22T10:55:08.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.796+0000 7f3c969ff700 1 --2- 172.21.15.40:0/2854120777 >> v2:172.21.15.45:3300/0 conn(0x7f3c9015c720 0x7f3c900b1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:08.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.796+0000 7f3c969ff700 1 --2- 172.21.15.40:0/2854120777 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c900d2830 0x7f3c900b4720 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:08.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.796+0000 7f3c969ff700 1 -- 172.21.15.40:0/2854120777 >> 172.21.15.40:0/2854120777 conn(0x7f3c900cf720 msgr2=0x7f3c900cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:08.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.796+0000 7f3c969ff700 1 -- 172.21.15.40:0/2854120777 shutdown_connections 2023-06-22T10:55:08.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.796+0000 7f3c969ff700 1 -- 172.21.15.40:0/2854120777 wait complete. 2023-06-22T10:55:08.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.798+0000 7f3c969ff700 1 Processor -- start 2023-06-22T10:55:08.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.798+0000 7f3c969ff700 1 -- start start 2023-06-22T10:55:08.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.799+0000 7f3c969ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c900b4c60 0x7f3c900a95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:08.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.799+0000 7f3c969ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f3c900d2830 0x7f3c901f1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:08.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.799+0000 7f3c969ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c9015c720 0x7f3c90158fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:08.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.799+0000 7f3c969ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c900b6ef0 con 0x7f3c9015c720 2023-06-22T10:55:08.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.799+0000 7f3c969ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c900b6b80 con 0x7f3c900b4c60 2023-06-22T10:55:08.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.799+0000 7f3c969ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c900b1790 con 0x7f3c900d2830 2023-06-22T10:55:08.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.799+0000 7f3c94f9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c9015c720 0x7f3c90158fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:08.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.799+0000 7f3c94f9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c9015c720 0x7f3c90158fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58554/0 (socket says 172.21.15.40:58554) 2023-06-22T10:55:08.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.799+0000 7f3c94f9c700 1 -- 172.21.15.40:0/1525033520 learned_addr learned my addr 172.21.15.40:0/1525033520 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:55:08.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.799+0000 7f3c8f7fe700 1 --2- 172.21.15.40:0/1525033520 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f3c900d2830 0x7f3c901f1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:08.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.799+0000 7f3c8ffff700 1 --2- 172.21.15.40:0/1525033520 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c900b4c60 0x7f3c900a95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:08.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.800+0000 7f3c94f9c700 1 -- 172.21.15.40:0/1525033520 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f3c900d2830 msgr2=0x7f3c901f1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:08.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.800+0000 7f3c94f9c700 1 --2- 172.21.15.40:0/1525033520 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f3c900d2830 0x7f3c901f1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:08.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.800+0000 7f3c94f9c700 1 -- 172.21.15.40:0/1525033520 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c900b4c60 msgr2=0x7f3c900a95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:08.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.800+0000 7f3c94f9c700 1 --2- 172.21.15.40:0/1525033520 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c900b4c60 0x7f3c900a95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:08.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.800+0000 7f3c94f9c700 1 -- 172.21.15.40:0/1525033520 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c840094a0 con 0x7f3c9015c720 2023-06-22T10:55:08.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.800+0000 7f3c8f7fe700 1 --2- 172.21.15.40:0/1525033520 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f3c900d2830 0x7f3c901f1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:55:08.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.800+0000 7f3c8ffff700 1 --2- 172.21.15.40:0/1525033520 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c900b4c60 0x7f3c900a95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:55:08.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.800+0000 7f3c94f9c700 1 --2- 172.21.15.40:0/1525033520 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c9015c720 0x7f3c90158fe0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f3c8800cb60 tx=0x7f3c8800cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:08.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.800+0000 7f3c8cff9700 1 -- 172.21.15.40:0/1525033520 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c8800ab50 con 0x7f3c9015c720 2023-06-22T10:55:08.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.800+0000 7f3c8cff9700 1 -- 172.21.15.40:0/1525033520 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c8800acb0 con 0x7f3c9015c720 2023-06-22T10:55:08.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.800+0000 7f3c969ff700 1 -- 172.21.15.40:0/1525033520 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c900b1a70 con 0x7f3c9015c720 2023-06-22T10:55:08.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.800+0000 7f3c8cff9700 1 -- 172.21.15.40:0/1525033520 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c88007310 con 0x7f3c9015c720 2023-06-22T10:55:08.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.800+0000 7f3c969ff700 1 -- 172.21.15.40:0/1525033520 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c900b83a0 con 0x7f3c9015c720 2023-06-22T10:55:08.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.801+0000 7f3c969ff700 1 -- 172.21.15.40:0/1525033520 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c900b7030 con 0x7f3c9015c720 2023-06-22T10:55:08.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.802+0000 7f3c8cff9700 1 -- 172.21.15.40:0/1525033520 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3c88007470 con 0x7f3c9015c720 2023-06-22T10:55:08.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.803+0000 7f3c8cff9700 1 --2- 172.21.15.40:0/1525033520 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f3c7c06ace0 0x7f3c7c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:08.808 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.803+0000 7f3c8cff9700 1 -- 172.21.15.40:0/1525033520 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f3c88089090 con 0x7f3c9015c720 2023-06-22T10:55:08.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.803+0000 7f3c8ffff700 1 --2- 172.21.15.40:0/1525033520 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f3c7c06ace0 0x7f3c7c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:08.809 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.804+0000 7f3c8ffff700 1 --2- 172.21.15.40:0/1525033520 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f3c7c06ace0 0x7f3c7c06d190 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3c80009c30 tx=0x7f3c80008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:08.811 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:08.808+0000 7f3c8cff9700 1 -- 172.21.15.40:0/1525033520 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3c900b7030 con 0x7f3c9015c720 2023-06-22T10:55:09.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.095+0000 7f3c969ff700 1 -- 172.21.15.40:0/1525033520 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f3c900b7030 con 0x7f3c9015c720 2023-06-22T10:55:09.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.100+0000 7f3c8cff9700 1 -- 172.21.15.40:0/1525033520 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f3c900b7030 con 0x7f3c9015c720 2023-06-22T10:55:09.106 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.102+0000 7f3c969ff700 1 -- 172.21.15.40:0/1525033520 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f3c7c06ace0 msgr2=0x7f3c7c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:09.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.102+0000 7f3c969ff700 1 --2- 172.21.15.40:0/1525033520 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f3c7c06ace0 0x7f3c7c06d190 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3c80009c30 tx=0x7f3c80008040 comp rx=0 tx=0).stop 2023-06-22T10:55:09.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.102+0000 7f3c969ff700 1 -- 172.21.15.40:0/1525033520 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c9015c720 msgr2=0x7f3c90158fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:09.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.102+0000 7f3c969ff700 1 --2- 172.21.15.40:0/1525033520 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c9015c720 0x7f3c90158fe0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f3c8800cb60 tx=0x7f3c8800cf20 comp rx=0 tx=0).stop 2023-06-22T10:55:09.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.103+0000 7f3c969ff700 1 -- 172.21.15.40:0/1525033520 shutdown_connections 2023-06-22T10:55:09.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.103+0000 7f3c969ff700 1 --2- 172.21.15.40:0/1525033520 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f3c7c06ace0 0x7f3c7c06d190 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:09.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.103+0000 7f3c969ff700 1 --2- 172.21.15.40:0/1525033520 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3c9015c720 0x7f3c90158fe0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:09.107 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.103+0000 7f3c969ff700 1 --2- 172.21.15.40:0/1525033520 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c900b4c60 0x7f3c900a95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:09.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.103+0000 7f3c969ff700 1 --2- 172.21.15.40:0/1525033520 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f3c900d2830 0x7f3c901f1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:09.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.103+0000 7f3c969ff700 1 -- 172.21.15.40:0/1525033520 >> 172.21.15.40:0/1525033520 conn(0x7f3c900cf720 msgr2=0x7f3c900cbd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:09.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.103+0000 7f3c969ff700 1 -- 172.21.15.40:0/1525033520 shutdown_connections 2023-06-22T10:55:09.108 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.103+0000 7f3c969ff700 1 -- 172.21.15.40:0/1525033520 wait complete. 2023-06-22T10:55:09.123 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-06-22T10:55:09.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.323+0000 7fee3b3ff700 1 Processor -- start 2023-06-22T10:55:09.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.323+0000 7fee3b3ff700 1 -- start start 2023-06-22T10:55:09.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.324+0000 7fee3b3ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fee340b05a0 0x7fee340af1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:09.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.324+0000 7fee3b3ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee340ca310 con 0x7fee3415c3f0 2023-06-22T10:55:09.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.324+0000 7fee3b3ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee340ccbe0 con 0x7fee340af710 2023-06-22T10:55:09.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.324+0000 7fee3b3ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee340ccec0 con 0x7fee340b05a0 2023-06-22T10:55:09.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.324+0000 7fee3919b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fee3415c3f0 0x7fee340afe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:42112/0 (socket says 172.21.15.40:42112) 2023-06-22T10:55:09.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.324+0000 7fee3919b700 1 -- 172.21.15.40:0/2440442657 learned_addr learned my addr 172.21.15.40:0/2440442657 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:55:09.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.324+0000 7fee3899a700 1 --2- 172.21.15.40:0/2440442657 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fee340b05a0 0x7fee340af1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:09.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.325+0000 7fee2bfff700 1 -- 172.21.15.40:0/2440442657 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4084691195 0 0) 0x7fee340ca310 con 0x7fee3415c3f0 2023-06-22T10:55:09.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.325+0000 7fee2bfff700 1 -- 172.21.15.40:0/2440442657 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee200035b0 con 0x7fee3415c3f0 2023-06-22T10:55:09.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.325+0000 7fee2bfff700 1 -- 172.21.15.40:0/2440442657 <== mon.1 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1539086051 0 0) 0x7fee340ccbe0 con 0x7fee340af710 2023-06-22T10:55:09.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.325+0000 7fee2bfff700 1 -- 172.21.15.40:0/2440442657 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee340ca310 con 0x7fee340af710 2023-06-22T10:55:09.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.325+0000 7fee2bfff700 1 -- 172.21.15.40:0/2440442657 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 730259669 0 0) 0x7fee200035b0 con 0x7fee3415c3f0 2023-06-22T10:55:09.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.325+0000 7fee3899a700 1 -- 172.21.15.40:0/2440442657 >> v1:172.21.15.45:6789/0 conn(0x7fee340af710 legacy=0x7fee340ca7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:09.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.325+0000 7fee3899a700 1 -- 172.21.15.40:0/2440442657 >> v1:172.21.15.40:6789/0 conn(0x7fee3415c3f0 legacy=0x7fee340afe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:09.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.325+0000 7fee3899a700 1 -- 172.21.15.40:0/2440442657 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee340cd1a0 con 0x7fee340b05a0 2023-06-22T10:55:09.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.325+0000 7fee3899a700 1 --2- 172.21.15.40:0/2440442657 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fee340b05a0 0x7fee340af1d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fee24009870 tx=0x7fee24009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3fb8efaa0e4394e server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:09.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.326+0000 7fee2bfff700 1 -- 172.21.15.40:0/2440442657 <== mon.2 v2:172.21.15.45:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee300017f0 con 0x7fee340b05a0 2023-06-22T10:55:09.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.326+0000 7fee2bfff700 1 -- 172.21.15.40:0/2440442657 <== mon.2 v2:172.21.15.45:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee24004030 con 0x7fee340b05a0 2023-06-22T10:55:09.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.326+0000 7fee2bfff700 1 -- 172.21.15.40:0/2440442657 <== mon.2 v2:172.21.15.45:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee240043c0 con 0x7fee340b05a0 2023-06-22T10:55:09.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.326+0000 7fee3b3ff700 1 -- 172.21.15.40:0/2440442657 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fee340b05a0 msgr2=0x7fee340af1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:09.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.326+0000 7fee3b3ff700 1 --2- 172.21.15.40:0/2440442657 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fee340b05a0 0x7fee340af1d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fee24009870 tx=0x7fee24009b80 comp rx=0 tx=0).stop 2023-06-22T10:55:09.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.326+0000 7fee3b3ff700 1 -- 172.21.15.40:0/2440442657 shutdown_connections 2023-06-22T10:55:09.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.326+0000 7fee3b3ff700 1 --2- 172.21.15.40:0/2440442657 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fee340b05a0 0x7fee340af1d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:09.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.326+0000 7fee3b3ff700 1 -- 172.21.15.40:0/2440442657 >> 172.21.15.40:0/2440442657 conn(0x7fee3406b960 msgr2=0x7fee34098a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:09.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.326+0000 7fee3b3ff700 1 -- 172.21.15.40:0/2440442657 shutdown_connections 2023-06-22T10:55:09.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.326+0000 7fee3b3ff700 1 -- 172.21.15.40:0/2440442657 wait complete. 2023-06-22T10:55:09.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.328+0000 7fee3b3ff700 1 Processor -- start 2023-06-22T10:55:09.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.328+0000 7fee3b3ff700 1 -- start start 2023-06-22T10:55:09.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.329+0000 7fee3b3ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee340af710 0x7fee3414d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:09.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.329+0000 7fee3b3ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fee340b05a0 0x7fee340b26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:09.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.329+0000 7fee3b3ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fee3415c3f0 0x7fee341f4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:09.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.329+0000 7fee3b3ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee341f1740 con 0x7fee340b05a0 2023-06-22T10:55:09.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.329+0000 7fee3b3ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee3414dbf0 con 0x7fee340af710 2023-06-22T10:55:09.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.329+0000 7fee3b3ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee340ac540 con 0x7fee3415c3f0 2023-06-22T10:55:09.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.329+0000 7fee3899a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fee340b05a0 0x7fee340b26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:09.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.329+0000 7fee3899a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fee340b05a0 0x7fee340b26e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58566/0 (socket says 172.21.15.40:58566) 2023-06-22T10:55:09.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.329+0000 7fee3899a700 1 -- 172.21.15.40:0/1304287148 learned_addr learned my addr 172.21.15.40:0/1304287148 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:55:09.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.330+0000 7fee3919b700 1 --2- 172.21.15.40:0/1304287148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee340af710 0x7fee3414d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:09.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.330+0000 7fee3999c700 1 --2- 172.21.15.40:0/1304287148 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fee3415c3f0 0x7fee341f4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:09.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.330+0000 7fee3899a700 1 -- 172.21.15.40:0/1304287148 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fee3415c3f0 msgr2=0x7fee341f4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:09.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.330+0000 7fee3899a700 1 --2- 172.21.15.40:0/1304287148 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fee3415c3f0 0x7fee341f4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:09.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.330+0000 7fee3899a700 1 -- 172.21.15.40:0/1304287148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee340af710 msgr2=0x7fee3414d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:09.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.330+0000 7fee3899a700 1 --2- 172.21.15.40:0/1304287148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee340af710 0x7fee3414d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:09.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.330+0000 7fee3899a700 1 -- 172.21.15.40:0/1304287148 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee240094a0 con 0x7fee340b05a0 2023-06-22T10:55:09.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.330+0000 7fee3899a700 1 --2- 172.21.15.40:0/1304287148 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fee340b05a0 0x7fee340b26e0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fee240097c0 tx=0x7fee24004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:09.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.330+0000 7fee29ffb700 1 -- 172.21.15.40:0/1304287148 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee24011630 con 0x7fee340b05a0 2023-06-22T10:55:09.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.331+0000 7fee29ffb700 1 -- 172.21.15.40:0/1304287148 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee2401f070 con 0x7fee340b05a0 2023-06-22T10:55:09.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.331+0000 7fee29ffb700 1 -- 172.21.15.40:0/1304287148 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee240119d0 con 0x7fee340b05a0 2023-06-22T10:55:09.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.331+0000 7fee3b3ff700 1 -- 172.21.15.40:0/1304287148 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee340ac820 con 0x7fee340b05a0 2023-06-22T10:55:09.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.331+0000 7fee3b3ff700 1 -- 172.21.15.40:0/1304287148 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee340acde0 con 0x7fee340b05a0 2023-06-22T10:55:09.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.332+0000 7fee3b3ff700 1 -- 172.21.15.40:0/1304287148 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee34067580 con 0x7fee340b05a0 2023-06-22T10:55:09.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.333+0000 7fee29ffb700 1 -- 172.21.15.40:0/1304287148 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fee24011b30 con 0x7fee340b05a0 2023-06-22T10:55:09.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.333+0000 7fee29ffb700 1 --2- 172.21.15.40:0/1304287148 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fee1806ace0 0x7fee1806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:09.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.334+0000 7fee29ffb700 1 -- 172.21.15.40:0/1304287148 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fee24021070 con 0x7fee340b05a0 2023-06-22T10:55:09.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.334+0000 7fee3919b700 1 --2- 172.21.15.40:0/1304287148 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fee1806ace0 0x7fee1806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:09.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.334+0000 7fee3919b700 1 --2- 172.21.15.40:0/1304287148 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fee1806ace0 0x7fee1806d190 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fee34158150 tx=0x7fee30009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:09.341 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.338+0000 7fee29ffb700 1 -- 172.21.15.40:0/1304287148 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fee24055bf0 con 0x7fee340b05a0 2023-06-22T10:55:09.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.626+0000 7fee3b3ff700 1 -- 172.21.15.40:0/1304287148 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fee34098d10 con 0x7fee340b05a0 2023-06-22T10:55:09.633 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.630+0000 7fee29ffb700 1 -- 172.21.15.40:0/1304287148 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fee24059210 con 0x7fee340b05a0 2023-06-22T10:55:09.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.633+0000 7fee3b3ff700 1 -- 172.21.15.40:0/1304287148 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fee1806ace0 msgr2=0x7fee1806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:09.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.633+0000 7fee3b3ff700 1 --2- 172.21.15.40:0/1304287148 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fee1806ace0 0x7fee1806d190 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fee34158150 tx=0x7fee30009040 comp rx=0 tx=0).stop 2023-06-22T10:55:09.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.633+0000 7fee3b3ff700 1 -- 172.21.15.40:0/1304287148 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fee340b05a0 msgr2=0x7fee340b26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:09.636 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.633+0000 7fee3b3ff700 1 --2- 172.21.15.40:0/1304287148 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fee340b05a0 0x7fee340b26e0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fee240097c0 tx=0x7fee24004750 comp rx=0 tx=0).stop 2023-06-22T10:55:09.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.633+0000 7fee3b3ff700 1 -- 172.21.15.40:0/1304287148 shutdown_connections 2023-06-22T10:55:09.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.633+0000 7fee3b3ff700 1 --2- 172.21.15.40:0/1304287148 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fee1806ace0 0x7fee1806d190 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:09.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.633+0000 7fee3b3ff700 1 --2- 172.21.15.40:0/1304287148 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fee3415c3f0 0x7fee341f4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:09.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.633+0000 7fee3b3ff700 1 --2- 172.21.15.40:0/1304287148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee340af710 0x7fee3414d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:09.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.633+0000 7fee3b3ff700 1 --2- 172.21.15.40:0/1304287148 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fee340b05a0 0x7fee340b26e0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:09.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.633+0000 7fee3b3ff700 1 -- 172.21.15.40:0/1304287148 >> 172.21.15.40:0/1304287148 conn(0x7fee3406b960 msgr2=0x7fee340cbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:09.637 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.633+0000 7fee3b3ff700 1 -- 172.21.15.40:0/1304287148 shutdown_connections 2023-06-22T10:55:09.638 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.633+0000 7fee3b3ff700 1 -- 172.21.15.40:0/1304287148 wait complete. 2023-06-22T10:55:09.653 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-06-22T10:55:09.855 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.852+0000 7fa2fddff700 1 Processor -- start 2023-06-22T10:55:09.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.852+0000 7fa2fddff700 1 -- start start 2023-06-22T10:55:09.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.853+0000 7fa2fddff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa2f80d2830 0x7fa2f80b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:09.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.853+0000 7fa2fddff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa2f80b4c60 0x7fa2f80d0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:09.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.854+0000 7fa2fddff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2f80b50a0 con 0x7fa2f815c720 2023-06-22T10:55:09.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.854+0000 7fa2fddff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2f8160d60 con 0x7fa2f80d2830 2023-06-22T10:55:09.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.854+0000 7fa2fddff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2f80b2130 con 0x7fa2f80b4c60 2023-06-22T10:55:09.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.854+0000 7fa2f77fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa2f815c720 0x7fa2f80b1870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:42120/0 (socket says 172.21.15.40:42120) 2023-06-22T10:55:09.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.854+0000 7fa2f77fe700 1 -- 172.21.15.40:0/4244898561 learned_addr learned my addr 172.21.15.40:0/4244898561 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:55:09.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.854+0000 7fa2f6ffd700 1 --2- 172.21.15.40:0/4244898561 >> v2:172.21.15.40:3300/0 conn(0x7fa2f80d2830 0x7fa2f80b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:09.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.854+0000 7fa2f7fff700 1 --2- 172.21.15.40:0/4244898561 >> v2:172.21.15.45:3300/0 conn(0x7fa2f80b4c60 0x7fa2f80d0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:09.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.854+0000 7fa2f67fc700 1 -- 172.21.15.40:0/4244898561 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1307473006 0 0) 0x7fa2f80b50a0 con 0x7fa2f815c720 2023-06-22T10:55:09.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.854+0000 7fa2f67fc700 1 -- 172.21.15.40:0/4244898561 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2e00035b0 con 0x7fa2f815c720 2023-06-22T10:55:09.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.854+0000 7fa2f6ffd700 1 -- 172.21.15.40:0/4244898561 >> v2:172.21.15.45:3300/0 conn(0x7fa2f80b4c60 msgr2=0x7fa2f80d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:55:09.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.854+0000 7fa2f6ffd700 1 --2- 172.21.15.40:0/4244898561 >> v2:172.21.15.45:3300/0 conn(0x7fa2f80b4c60 0x7fa2f80d0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:09.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.854+0000 7fa2f6ffd700 1 -- 172.21.15.40:0/4244898561 >> v1:172.21.15.40:6789/0 conn(0x7fa2f815c720 legacy=0x7fa2f80b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:09.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.854+0000 7fa2f6ffd700 1 -- 172.21.15.40:0/4244898561 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f8161180 con 0x7fa2f80d2830 2023-06-22T10:55:09.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.855+0000 7fa2f6ffd700 1 --2- 172.21.15.40:0/4244898561 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2f80d2830 0x7fa2f80b4720 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec009840 tx=0x7fa2ec009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0fa7fbf37cb631e server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:09.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.855+0000 7fa2f67fc700 1 -- 172.21.15.40:0/4244898561 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec011830 con 0x7fa2f80d2830 2023-06-22T10:55:09.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.855+0000 7fa2f67fc700 1 -- 172.21.15.40:0/4244898561 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2ec011990 con 0x7fa2f80d2830 2023-06-22T10:55:09.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.855+0000 7fa2f67fc700 1 -- 172.21.15.40:0/4244898561 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec011d20 con 0x7fa2f80d2830 2023-06-22T10:55:09.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.855+0000 7fa2fddff700 1 -- 172.21.15.40:0/4244898561 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2f80d2830 msgr2=0x7fa2f80b4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:09.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.855+0000 7fa2fddff700 1 --2- 172.21.15.40:0/4244898561 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2f80d2830 0x7fa2f80b4720 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec009840 tx=0x7fa2ec009b50 comp rx=0 tx=0).stop 2023-06-22T10:55:09.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.856+0000 7fa2fddff700 1 -- 172.21.15.40:0/4244898561 shutdown_connections 2023-06-22T10:55:09.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.856+0000 7fa2fddff700 1 --2- 172.21.15.40:0/4244898561 >> v2:172.21.15.45:3300/0 conn(0x7fa2f80b4c60 0x7fa2f80d0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:09.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.856+0000 7fa2fddff700 1 --2- 172.21.15.40:0/4244898561 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2f80d2830 0x7fa2f80b4720 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:09.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.856+0000 7fa2fddff700 1 -- 172.21.15.40:0/4244898561 >> 172.21.15.40:0/4244898561 conn(0x7fa2f80cf720 msgr2=0x7fa2f80cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:09.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.856+0000 7fa2fddff700 1 -- 172.21.15.40:0/4244898561 shutdown_connections 2023-06-22T10:55:09.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.856+0000 7fa2fddff700 1 -- 172.21.15.40:0/4244898561 wait complete. 2023-06-22T10:55:09.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.857+0000 7fa2fddff700 1 Processor -- start 2023-06-22T10:55:09.863 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.858+0000 7fa2fddff700 1 -- start start 2023-06-22T10:55:09.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.858+0000 7fa2fddff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2f80b4c60 0x7fa2f80b69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:09.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.859+0000 7fa2fddff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa2f80d2830 0x7fa2f80b6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:09.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.859+0000 7fa2fddff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2f815c720 0x7fa2f80b7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:09.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.859+0000 7fa2fddff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f80b7470 con 0x7fa2f815c720 2023-06-22T10:55:09.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.859+0000 7fa2fddff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f80c9d70 con 0x7fa2f80b4c60 2023-06-22T10:55:09.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.859+0000 7fa2fddff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f80ca050 con 0x7fa2f80d2830 2023-06-22T10:55:09.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.859+0000 7fa2f7fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2f815c720 0x7fa2f80b7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:09.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.859+0000 7fa2f7fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2f815c720 0x7fa2f80b7730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58576/0 (socket says 172.21.15.40:58576) 2023-06-22T10:55:09.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.859+0000 7fa2f7fff700 1 -- 172.21.15.40:0/3393884570 learned_addr learned my addr 172.21.15.40:0/3393884570 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:55:09.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.859+0000 7fa2f77fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2f80b4c60 0x7fa2f80b69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:09.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.859+0000 7fa2f6ffd700 1 --2- 172.21.15.40:0/3393884570 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa2f80d2830 0x7fa2f80b6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:09.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.859+0000 7fa2f7fff700 1 -- 172.21.15.40:0/3393884570 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa2f80d2830 msgr2=0x7fa2f80b6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:09.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.859+0000 7fa2f7fff700 1 --2- 172.21.15.40:0/3393884570 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa2f80d2830 0x7fa2f80b6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:09.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.859+0000 7fa2f7fff700 1 -- 172.21.15.40:0/3393884570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2f80b4c60 msgr2=0x7fa2f80b69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:09.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.859+0000 7fa2f7fff700 1 --2- 172.21.15.40:0/3393884570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2f80b4c60 0x7fa2f80b69f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:09.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.859+0000 7fa2f7fff700 1 -- 172.21.15.40:0/3393884570 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2ec0094a0 con 0x7fa2f815c720 2023-06-22T10:55:09.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.859+0000 7fa2f6ffd700 1 --2- 172.21.15.40:0/3393884570 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa2f80d2830 0x7fa2f80b6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:55:09.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.860+0000 7fa2f7fff700 1 --2- 172.21.15.40:0/3393884570 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2f815c720 0x7fa2f80b7730 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fa2f000efc0 tx=0x7fa2f000c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:09.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.860+0000 7fa2dffff700 1 -- 172.21.15.40:0/3393884570 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f000cb80 con 0x7fa2f815c720 2023-06-22T10:55:09.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.860+0000 7fa2dffff700 1 -- 172.21.15.40:0/3393884570 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2f000f040 con 0x7fa2f815c720 2023-06-22T10:55:09.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.860+0000 7fa2dffff700 1 -- 172.21.15.40:0/3393884570 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f0014480 con 0x7fa2f815c720 2023-06-22T10:55:09.866 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.860+0000 7fa2fddff700 1 -- 172.21.15.40:0/3393884570 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2f80ca330 con 0x7fa2f815c720 2023-06-22T10:55:09.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.860+0000 7fa2fddff700 1 -- 172.21.15.40:0/3393884570 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2f80ca8f0 con 0x7fa2f815c720 2023-06-22T10:55:09.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.861+0000 7fa2fddff700 1 -- 172.21.15.40:0/3393884570 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2f8067580 con 0x7fa2f815c720 2023-06-22T10:55:09.867 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.862+0000 7fa2dffff700 1 -- 172.21.15.40:0/3393884570 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa2f00145e0 con 0x7fa2f815c720 2023-06-22T10:55:09.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.864+0000 7fa2dffff700 1 --2- 172.21.15.40:0/3393884570 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fa2e406ace0 0x7fa2e406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:09.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.864+0000 7fa2dffff700 1 -- 172.21.15.40:0/3393884570 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fa2f0089aa0 con 0x7fa2f815c720 2023-06-22T10:55:09.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.864+0000 7fa2f77fe700 1 --2- 172.21.15.40:0/3393884570 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fa2e406ace0 0x7fa2e406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:09.868 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.864+0000 7fa2f77fe700 1 --2- 172.21.15.40:0/3393884570 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fa2e406ace0 0x7fa2e406d190 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa2e8007fd0 tx=0x7fa2e8007dc0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:09.871 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:09.868+0000 7fa2dffff700 1 -- 172.21.15.40:0/3393884570 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa2f0054d50 con 0x7fa2f815c720 2023-06-22T10:55:10.168 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.165+0000 7fa2fddff700 1 -- 172.21.15.40:0/3393884570 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fa2f80caae0 con 0x7fa2f815c720 2023-06-22T10:55:10.172 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.169+0000 7fa2dffff700 1 -- 172.21.15.40:0/3393884570 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7fa2f0058370 con 0x7fa2f815c720 2023-06-22T10:55:10.174 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.171+0000 7fa2fddff700 1 -- 172.21.15.40:0/3393884570 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fa2e406ace0 msgr2=0x7fa2e406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:10.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.171+0000 7fa2fddff700 1 --2- 172.21.15.40:0/3393884570 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fa2e406ace0 0x7fa2e406d190 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa2e8007fd0 tx=0x7fa2e8007dc0 comp rx=0 tx=0).stop 2023-06-22T10:55:10.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.171+0000 7fa2fddff700 1 -- 172.21.15.40:0/3393884570 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2f815c720 msgr2=0x7fa2f80b7730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:10.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.171+0000 7fa2fddff700 1 --2- 172.21.15.40:0/3393884570 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2f815c720 0x7fa2f80b7730 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fa2f000efc0 tx=0x7fa2f000c0c0 comp rx=0 tx=0).stop 2023-06-22T10:55:10.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.171+0000 7fa2fddff700 1 -- 172.21.15.40:0/3393884570 shutdown_connections 2023-06-22T10:55:10.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.171+0000 7fa2fddff700 1 --2- 172.21.15.40:0/3393884570 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fa2e406ace0 0x7fa2e406d190 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:10.175 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.171+0000 7fa2fddff700 1 --2- 172.21.15.40:0/3393884570 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2f815c720 0x7fa2f80b7730 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:10.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.171+0000 7fa2fddff700 1 --2- 172.21.15.40:0/3393884570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2f80b4c60 0x7fa2f80b69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:10.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.171+0000 7fa2fddff700 1 --2- 172.21.15.40:0/3393884570 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa2f80d2830 0x7fa2f80b6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:10.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.171+0000 7fa2fddff700 1 -- 172.21.15.40:0/3393884570 >> 172.21.15.40:0/3393884570 conn(0x7fa2f80cf720 msgr2=0x7fa2f80d1570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:10.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.171+0000 7fa2fddff700 1 -- 172.21.15.40:0/3393884570 shutdown_connections 2023-06-22T10:55:10.176 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.171+0000 7fa2fddff700 1 -- 172.21.15.40:0/3393884570 wait complete. 2023-06-22T10:55:10.192 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-06-22T10:55:10.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.390+0000 7f9b0c1ff700 1 Processor -- start 2023-06-22T10:55:10.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.391+0000 7f9b0c1ff700 1 -- start start 2023-06-22T10:55:10.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.392+0000 7f9b0c1ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9b040d2830 0x7f9b040b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:10.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.392+0000 7f9b0c1ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b040b2130 con 0x7f9b040b4c60 2023-06-22T10:55:10.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.392+0000 7f9b0c1ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b04161180 con 0x7f9b0415c720 2023-06-22T10:55:10.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.392+0000 7f9b0c1ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b04160d60 con 0x7f9b040d2830 2023-06-22T10:55:10.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.392+0000 7f9b0a79c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f9b040b4c60 0x7f9b040d0d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:42130/0 (socket says 172.21.15.40:42130) 2023-06-22T10:55:10.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.392+0000 7f9b0a79c700 1 -- 172.21.15.40:0/2205736273 learned_addr learned my addr 172.21.15.40:0/2205736273 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:55:10.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.392+0000 7f9b0979a700 1 --2- 172.21.15.40:0/2205736273 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9b040d2830 0x7f9b040b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:10.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.393+0000 7f9b08f99700 1 -- 172.21.15.40:0/2205736273 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 916431965 0 0) 0x7f9b040b2130 con 0x7f9b040b4c60 2023-06-22T10:55:10.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.393+0000 7f9b08f99700 1 -- 172.21.15.40:0/2205736273 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9af00035b0 con 0x7f9b040b4c60 2023-06-22T10:55:10.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.393+0000 7f9b08f99700 1 -- 172.21.15.40:0/2205736273 <== mon.1 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1181935803 0 0) 0x7f9b04161180 con 0x7f9b0415c720 2023-06-22T10:55:10.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.393+0000 7f9b08f99700 1 -- 172.21.15.40:0/2205736273 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b040b2130 con 0x7f9b0415c720 2023-06-22T10:55:10.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.393+0000 7f9b08f99700 1 -- 172.21.15.40:0/2205736273 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1340729651 0 0) 0x7f9af00035b0 con 0x7f9b040b4c60 2023-06-22T10:55:10.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.393+0000 7f9b0979a700 1 -- 172.21.15.40:0/2205736273 >> v1:172.21.15.45:6789/0 conn(0x7f9b0415c720 legacy=0x7f9b040b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:10.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.393+0000 7f9b0979a700 1 -- 172.21.15.40:0/2205736273 >> v1:172.21.15.40:6789/0 conn(0x7f9b040b4c60 legacy=0x7f9b040d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:10.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.393+0000 7f9b0979a700 1 -- 172.21.15.40:0/2205736273 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b041603c0 con 0x7f9b040d2830 2023-06-22T10:55:10.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.393+0000 7f9b0979a700 1 --2- 172.21.15.40:0/2205736273 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9b040d2830 0x7f9b040b4720 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9af4009870 tx=0x7f9af4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45bafd32d7a121d server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:10.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.393+0000 7f9b08f99700 1 -- 172.21.15.40:0/2205736273 <== mon.2 v2:172.21.15.45:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9afc0019f0 con 0x7f9b040d2830 2023-06-22T10:55:10.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.394+0000 7f9b08f99700 1 -- 172.21.15.40:0/2205736273 <== mon.2 v2:172.21.15.45:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af4004030 con 0x7f9b040d2830 2023-06-22T10:55:10.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.394+0000 7f9b08f99700 1 -- 172.21.15.40:0/2205736273 <== mon.2 v2:172.21.15.45:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af40043c0 con 0x7f9b040d2830 2023-06-22T10:55:10.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.394+0000 7f9b0c1ff700 1 -- 172.21.15.40:0/2205736273 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9b040d2830 msgr2=0x7f9b040b4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:10.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.394+0000 7f9b0c1ff700 1 --2- 172.21.15.40:0/2205736273 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9b040d2830 0x7f9b040b4720 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9af4009870 tx=0x7f9af4009b80 comp rx=0 tx=0).stop 2023-06-22T10:55:10.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.394+0000 7f9b0c1ff700 1 -- 172.21.15.40:0/2205736273 shutdown_connections 2023-06-22T10:55:10.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.394+0000 7f9b0c1ff700 1 --2- 172.21.15.40:0/2205736273 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9b040d2830 0x7f9b040b4720 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:10.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.394+0000 7f9b0c1ff700 1 -- 172.21.15.40:0/2205736273 >> 172.21.15.40:0/2205736273 conn(0x7f9b040cf720 msgr2=0x7f9b040cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:10.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.394+0000 7f9b0c1ff700 1 -- 172.21.15.40:0/2205736273 shutdown_connections 2023-06-22T10:55:10.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.394+0000 7f9b0c1ff700 1 -- 172.21.15.40:0/2205736273 wait complete. 2023-06-22T10:55:10.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.396+0000 7f9b0c1ff700 1 Processor -- start 2023-06-22T10:55:10.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.396+0000 7f9b0c1ff700 1 -- start start 2023-06-22T10:55:10.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.397+0000 7f9b0c1ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9b040b4c60 0x7f9b041562e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:10.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.397+0000 7f9b0c1ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b040d2830 0x7f9b040b69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:10.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.397+0000 7f9b0c1ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b0415c720 0x7f9b040cb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:10.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.397+0000 7f9b0c1ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0415df80 con 0x7f9b040d2830 2023-06-22T10:55:10.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.397+0000 7f9b0c1ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0415e260 con 0x7f9b0415c720 2023-06-22T10:55:10.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.397+0000 7f9b0c1ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0415e540 con 0x7f9b040b4c60 2023-06-22T10:55:10.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.397+0000 7f9b0979a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b040d2830 0x7f9b040b69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:10.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.397+0000 7f9b0979a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b040d2830 0x7f9b040b69c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58590/0 (socket says 172.21.15.40:58590) 2023-06-22T10:55:10.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.397+0000 7f9b0979a700 1 -- 172.21.15.40:0/1988093607 learned_addr learned my addr 172.21.15.40:0/1988093607 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:55:10.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.397+0000 7f9b0a79c700 1 --2- 172.21.15.40:0/1988093607 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b0415c720 0x7f9b040cb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:10.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.397+0000 7f9b09f9b700 1 --2- 172.21.15.40:0/1988093607 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9b040b4c60 0x7f9b041562e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:10.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.398+0000 7f9b0979a700 1 -- 172.21.15.40:0/1988093607 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9b040b4c60 msgr2=0x7f9b041562e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:10.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.398+0000 7f9b0979a700 1 --2- 172.21.15.40:0/1988093607 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9b040b4c60 0x7f9b041562e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:10.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.398+0000 7f9b0979a700 1 -- 172.21.15.40:0/1988093607 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b0415c720 msgr2=0x7f9b040cb2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:10.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.398+0000 7f9b0979a700 1 --2- 172.21.15.40:0/1988093607 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b0415c720 0x7f9b040cb2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:10.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.398+0000 7f9b0979a700 1 -- 172.21.15.40:0/1988093607 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af40094a0 con 0x7f9b040d2830 2023-06-22T10:55:10.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.398+0000 7f9b09f9b700 1 --2- 172.21.15.40:0/1988093607 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9b040b4c60 0x7f9b041562e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:55:10.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.398+0000 7f9b0979a700 1 --2- 172.21.15.40:0/1988093607 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b040d2830 0x7f9b040b69c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f9af40097c0 tx=0x7f9af4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:10.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.398+0000 7f9afa7fc700 1 -- 172.21.15.40:0/1988093607 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af4004570 con 0x7f9b040d2830 2023-06-22T10:55:10.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.398+0000 7f9afa7fc700 1 -- 172.21.15.40:0/1988093607 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af401f070 con 0x7f9b040d2830 2023-06-22T10:55:10.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.398+0000 7f9afa7fc700 1 -- 172.21.15.40:0/1988093607 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af4011870 con 0x7f9b040d2830 2023-06-22T10:55:10.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.398+0000 7f9b0c1ff700 1 -- 172.21.15.40:0/1988093607 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b0415e820 con 0x7f9b040d2830 2023-06-22T10:55:10.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.398+0000 7f9b0c1ff700 1 -- 172.21.15.40:0/1988093607 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b040b5c20 con 0x7f9b040d2830 2023-06-22T10:55:10.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.399+0000 7f9b0c1ff700 1 -- 172.21.15.40:0/1988093607 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b040b5e10 con 0x7f9b040d2830 2023-06-22T10:55:10.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.400+0000 7f9afa7fc700 1 -- 172.21.15.40:0/1988093607 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9af40119d0 con 0x7f9b040d2830 2023-06-22T10:55:10.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.401+0000 7f9afa7fc700 1 --2- 172.21.15.40:0/1988093607 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f9ae806acb0 0x7f9ae806d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:10.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.401+0000 7f9afa7fc700 1 -- 172.21.15.40:0/1988093607 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f9af4021070 con 0x7f9b040d2830 2023-06-22T10:55:10.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.402+0000 7f9b09f9b700 1 --2- 172.21.15.40:0/1988093607 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f9ae806acb0 0x7f9ae806d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:10.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.402+0000 7f9b09f9b700 1 --2- 172.21.15.40:0/1988093607 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f9ae806acb0 0x7f9ae806d160 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9b000011e0 tx=0x7f9b00009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:10.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.406+0000 7f9afa7fc700 1 -- 172.21.15.40:0/1988093607 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9b040b5e10 con 0x7f9b040d2830 2023-06-22T10:55:10.697 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.694+0000 7f9b0c1ff700 1 -- 172.21.15.40:0/1988093607 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f9b040b5e10 con 0x7f9b040d2830 2023-06-22T10:55:10.701 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.698+0000 7f9afa7fc700 1 -- 172.21.15.40:0/1988093607 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f9b040b5e10 con 0x7f9b040d2830 2023-06-22T10:55:10.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.700+0000 7f9b0c1ff700 1 -- 172.21.15.40:0/1988093607 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f9ae806acb0 msgr2=0x7f9ae806d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:10.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.700+0000 7f9b0c1ff700 1 --2- 172.21.15.40:0/1988093607 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f9ae806acb0 0x7f9ae806d160 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9b000011e0 tx=0x7f9b00009040 comp rx=0 tx=0).stop 2023-06-22T10:55:10.706 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.700+0000 7f9b0c1ff700 1 -- 172.21.15.40:0/1988093607 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b040d2830 msgr2=0x7f9b040b69c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:10.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.700+0000 7f9b0c1ff700 1 --2- 172.21.15.40:0/1988093607 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b040d2830 0x7f9b040b69c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f9af40097c0 tx=0x7f9af4004750 comp rx=0 tx=0).stop 2023-06-22T10:55:10.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.700+0000 7f9b0c1ff700 1 -- 172.21.15.40:0/1988093607 shutdown_connections 2023-06-22T10:55:10.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.700+0000 7f9b0c1ff700 1 --2- 172.21.15.40:0/1988093607 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f9ae806acb0 0x7f9ae806d160 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:10.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.700+0000 7f9b0c1ff700 1 --2- 172.21.15.40:0/1988093607 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f9b040b4c60 0x7f9b041562e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:10.707 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.700+0000 7f9b0c1ff700 1 --2- 172.21.15.40:0/1988093607 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b0415c720 0x7f9b040cb2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:10.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.700+0000 7f9b0c1ff700 1 --2- 172.21.15.40:0/1988093607 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9b040d2830 0x7f9b040b69c0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:10.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.700+0000 7f9b0c1ff700 1 -- 172.21.15.40:0/1988093607 >> 172.21.15.40:0/1988093607 conn(0x7f9b040cf720 msgr2=0x7f9b040d0ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:10.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.701+0000 7f9b0c1ff700 1 -- 172.21.15.40:0/1988093607 shutdown_connections 2023-06-22T10:55:10.708 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.701+0000 7f9b0c1ff700 1 -- 172.21.15.40:0/1988093607 wait complete. 2023-06-22T10:55:10.722 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-22T10:55:10.923 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.920+0000 7f1bd2fff700 1 Processor -- start 2023-06-22T10:55:10.924 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.920+0000 7f1bd2fff700 1 -- start start 2023-06-22T10:55:10.925 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.921+0000 7f1bd2fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1bcc15c720 0x7f1bcc0b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:10.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.921+0000 7f1bd2fff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1bcc0d2830 0x7f1bcc0b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:10.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.921+0000 7f1bd2fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1bcc0b4c60 0x7f1bcc06b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:10.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.921+0000 7f1bd2fff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bcc160d60 con 0x7f1bcc0b4c60 2023-06-22T10:55:10.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.921+0000 7f1bd2fff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bcc0b50e0 con 0x7f1bcc15c720 2023-06-22T10:55:10.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.921+0000 7f1bd2fff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bcc0b2130 con 0x7f1bcc0d2830 2023-06-22T10:55:10.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.922+0000 7f1bd159c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1bcc0b4c60 0x7f1bcc06b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:10.926 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.922+0000 7f1bd159c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1bcc0b4c60 0x7f1bcc06b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58606/0 (socket says 172.21.15.40:58606) 2023-06-22T10:55:10.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.922+0000 7f1bd159c700 1 -- 172.21.15.40:0/749851931 learned_addr learned my addr 172.21.15.40:0/749851931 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:55:10.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.922+0000 7f1bd0d9b700 1 --2- 172.21.15.40:0/749851931 >> v2:172.21.15.45:3300/0 conn(0x7f1bcc15c720 0x7f1bcc0b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:10.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.922+0000 7f1bcbfff700 1 --2- 172.21.15.40:0/749851931 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1bcc0d2830 0x7f1bcc0b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:10.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.922+0000 7f1bd159c700 1 -- 172.21.15.40:0/749851931 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1bcc0d2830 msgr2=0x7f1bcc0b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:55:10.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.922+0000 7f1bd159c700 1 --2- 172.21.15.40:0/749851931 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1bcc0d2830 0x7f1bcc0b4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:10.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.922+0000 7f1bd159c700 1 -- 172.21.15.40:0/749851931 >> v2:172.21.15.45:3300/0 conn(0x7f1bcc15c720 msgr2=0x7f1bcc0b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:55:10.927 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.922+0000 7f1bd159c700 1 --2- 172.21.15.40:0/749851931 >> v2:172.21.15.45:3300/0 conn(0x7f1bcc15c720 0x7f1bcc0b1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:10.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.922+0000 7f1bd159c700 1 -- 172.21.15.40:0/749851931 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bcc161180 con 0x7f1bcc0b4c60 2023-06-22T10:55:10.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.922+0000 7f1bd0d9b700 1 --2- 172.21.15.40:0/749851931 >> v2:172.21.15.45:3300/0 conn(0x7f1bcc15c720 0x7f1bcc0b1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-22T10:55:10.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.922+0000 7f1bcbfff700 1 --2- 172.21.15.40:0/749851931 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1bcc0d2830 0x7f1bcc0b4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-22T10:55:10.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.922+0000 7f1bd159c700 1 --2- 172.21.15.40:0/749851931 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1bcc0b4c60 0x7f1bcc06b4d0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc0d0820 tx=0x7f1bc400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e02b162cd8db286 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:10.929 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.923+0000 7f1bcb7fe700 1 -- 172.21.15.40:0/749851931 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc400e070 con 0x7f1bcc0b4c60 2023-06-22T10:55:10.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.923+0000 7f1bcb7fe700 1 -- 172.21.15.40:0/749851931 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc400b9c0 con 0x7f1bcc0b4c60 2023-06-22T10:55:10.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.923+0000 7f1bcb7fe700 1 -- 172.21.15.40:0/749851931 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc400bd70 con 0x7f1bcc0b4c60 2023-06-22T10:55:10.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.923+0000 7f1bd2fff700 1 -- 172.21.15.40:0/749851931 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1bcc0b4c60 msgr2=0x7f1bcc06b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:10.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.923+0000 7f1bd2fff700 1 --2- 172.21.15.40:0/749851931 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1bcc0b4c60 0x7f1bcc06b4d0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc0d0820 tx=0x7f1bc400b330 comp rx=0 tx=0).stop 2023-06-22T10:55:10.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.923+0000 7f1bd2fff700 1 -- 172.21.15.40:0/749851931 shutdown_connections 2023-06-22T10:55:10.930 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.923+0000 7f1bd2fff700 1 --2- 172.21.15.40:0/749851931 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1bcc0b4c60 0x7f1bcc06b4d0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:10.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.923+0000 7f1bd2fff700 1 --2- 172.21.15.40:0/749851931 >> v2:172.21.15.45:3300/0 conn(0x7f1bcc15c720 0x7f1bcc0b1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:10.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.923+0000 7f1bd2fff700 1 --2- 172.21.15.40:0/749851931 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1bcc0d2830 0x7f1bcc0b4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:10.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.923+0000 7f1bd2fff700 1 -- 172.21.15.40:0/749851931 >> 172.21.15.40:0/749851931 conn(0x7f1bcc0cf720 msgr2=0x7f1bcc0cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:10.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.923+0000 7f1bd2fff700 1 -- 172.21.15.40:0/749851931 shutdown_connections 2023-06-22T10:55:10.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.923+0000 7f1bd2fff700 1 -- 172.21.15.40:0/749851931 wait complete. 2023-06-22T10:55:10.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.925+0000 7f1bd2fff700 1 Processor -- start 2023-06-22T10:55:10.931 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.925+0000 7f1bd2fff700 1 -- start start 2023-06-22T10:55:10.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.926+0000 7f1bd2fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bcc0b4c60 0x7f1bcc0b8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:10.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.926+0000 7f1bd2fff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1bcc0d2830 0x7f1bcc0c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:10.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.926+0000 7f1bd2fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1bcc15c720 0x7f1bcc1f4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:10.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.926+0000 7f1bd2fff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bcc1f1de0 con 0x7f1bcc15c720 2023-06-22T10:55:10.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.926+0000 7f1bd2fff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bcc0c9190 con 0x7f1bcc0b4c60 2023-06-22T10:55:10.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.926+0000 7f1bd2fff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bcc1f54a0 con 0x7f1bcc0d2830 2023-06-22T10:55:10.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.926+0000 7f1bd159c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1bcc15c720 0x7f1bcc1f4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:10.932 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.926+0000 7f1bd159c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1bcc15c720 0x7f1bcc1f4f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58620/0 (socket says 172.21.15.40:58620) 2023-06-22T10:55:10.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.926+0000 7f1bd159c700 1 -- 172.21.15.40:0/881782955 learned_addr learned my addr 172.21.15.40:0/881782955 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:55:10.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.927+0000 7f1bd0d9b700 1 --2- 172.21.15.40:0/881782955 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bcc0b4c60 0x7f1bcc0b8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:10.933 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.927+0000 7f1bcbfff700 1 --2- 172.21.15.40:0/881782955 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1bcc0d2830 0x7f1bcc0c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:10.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.927+0000 7f1bd159c700 1 -- 172.21.15.40:0/881782955 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1bcc0d2830 msgr2=0x7f1bcc0c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:10.934 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.927+0000 7f1bd159c700 1 --2- 172.21.15.40:0/881782955 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1bcc0d2830 0x7f1bcc0c8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:10.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.927+0000 7f1bd159c700 1 -- 172.21.15.40:0/881782955 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bcc0b4c60 msgr2=0x7f1bcc0b8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:10.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.927+0000 7f1bd159c700 1 --2- 172.21.15.40:0/881782955 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bcc0b4c60 0x7f1bcc0b8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:10.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.927+0000 7f1bd159c700 1 -- 172.21.15.40:0/881782955 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc4009b30 con 0x7f1bcc15c720 2023-06-22T10:55:10.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.927+0000 7f1bd159c700 1 --2- 172.21.15.40:0/881782955 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1bcc15c720 0x7f1bcc1f4f60 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f1bc400b370 tx=0x7f1bc4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:10.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.927+0000 7f1bc97fa700 1 -- 172.21.15.40:0/881782955 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc4004310 con 0x7f1bcc15c720 2023-06-22T10:55:10.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.927+0000 7f1bc97fa700 1 -- 172.21.15.40:0/881782955 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc4004470 con 0x7f1bcc15c720 2023-06-22T10:55:10.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.927+0000 7f1bd2fff700 1 -- 172.21.15.40:0/881782955 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bcc1f5740 con 0x7f1bcc15c720 2023-06-22T10:55:10.935 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.927+0000 7f1bc97fa700 1 -- 172.21.15.40:0/881782955 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc4004820 con 0x7f1bcc15c720 2023-06-22T10:55:10.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.928+0000 7f1bd2fff700 1 -- 172.21.15.40:0/881782955 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bcc1f5d00 con 0x7f1bcc15c720 2023-06-22T10:55:10.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.929+0000 7f1bd2fff700 1 -- 172.21.15.40:0/881782955 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bcc1f1f20 con 0x7f1bcc15c720 2023-06-22T10:55:10.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.929+0000 7f1bc97fa700 1 -- 172.21.15.40:0/881782955 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1bc401b430 con 0x7f1bcc15c720 2023-06-22T10:55:10.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.930+0000 7f1bc97fa700 1 --2- 172.21.15.40:0/881782955 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f1bb006ace0 0x7f1bb006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:10.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.931+0000 7f1bc97fa700 1 -- 172.21.15.40:0/881782955 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f1bc408a5a0 con 0x7f1bcc15c720 2023-06-22T10:55:10.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.931+0000 7f1bd0d9b700 1 --2- 172.21.15.40:0/881782955 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f1bb006ace0 0x7f1bb006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:10.936 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.931+0000 7f1bd0d9b700 1 --2- 172.21.15.40:0/881782955 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f1bb006ace0 0x7f1bb006d190 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0006fd0 tx=0x7f1bc0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:10.937 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:10.934+0000 7f1bc97fa700 1 -- 172.21.15.40:0/881782955 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1bc4055850 con 0x7f1bcc15c720 2023-06-22T10:55:11.145 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.142+0000 7f1bd2fff700 1 -- 172.21.15.40:0/881782955 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1bcc160930 con 0x7f1bcc15c720 2023-06-22T10:55:11.146 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.143+0000 7f1bc97fa700 1 -- 172.21.15.40:0/881782955 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+14760 (secure 0 0 0) 0x7f1bc4058e70 con 0x7f1bcc15c720 2023-06-22T10:55:11.147 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:55:11.147 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":38,"fsid":"475560bc-1a7c-4a75-b3b6-6fc6b20bdc52","created":"2023-06-22T10:53:03.784568+0000","modified":"2023-06-22T10:55:06.955070+0000","last_up_change":"2023-06-22T10:53:17.830348+0000","last_in_change":"2023-06-22T10:53:07.329974+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-22T10:53:17.182228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-22T10:53:23.874432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"918db6b4-053a-46ba-976d-6e1a0104017f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6809","nonce":2400162888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6811","nonce":2400162888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6815","nonce":2400162888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6813","nonce":2400162888}]},"public_addr":"172.21.15.40:6809/2400162888","cluster_addr":"172.21.15.40:6811/2400162888","heartbeat_back_addr":"172.21.15.40:6815/2400162888","heartbeat_front_addr":"172.21.15.40:6813/2400162888","state":["exists","up"]},{"osd":1,"uuid":"0c146e2b-1725-4dae-9b5c-38795943b9d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6801","nonce":230885800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6803","nonce":230885800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6807","nonce":230885800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6805","nonce":230885800}]},"public_addr":"172.21.15.40:6801/230885800","cluster_addr":"172.21.15.40:6803/230885800","heartbeat_back_addr":"172.21.15.40:6807/230885800","heartbeat_front_addr":"172.21.15.40:6805/230885800","state":["exists","up"]},{"osd":2,"uuid":"0b3727fd-f281-46d5-a675-86c8c5ab269e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6817","nonce":2681404929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6819","nonce":2681404929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6823","nonce":2681404929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6821","nonce":2681404929}]},"public_addr":"172.21.15.40:6817/2681404929","cluster_addr":"172.21.15.40:6819/2681404929","heartbeat_back_addr":"172.21.15.40:6823/2681404929","heartbeat_front_addr":"172.21.15.40:6821/2681404929","state":["exists","up"]},{"osd":3,"uuid":"2969c698-7039-4bbb-beda-f756f7a368a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6825","nonce":111110981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6827","nonce":111110981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6831","nonce":111110981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6829","nonce":111110981}]},"public_addr":"172.21.15.40:6825/111110981","cluster_addr":"172.21.15.40:6827/111110981","heartbeat_back_addr":"172.21.15.40:6831/111110981","heartbeat_front_addr":"172.21.15.40:6829/111110981","state":["exists","up"]},{"osd":4,"uuid":"3bb1d9c8-8e42-4a6b-998d-04834f34be5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6801","nonce":3625455711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6803","nonce":3625455711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6807","nonce":3625455711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6805","nonce":3625455711}]},"public_addr":"172.21.15.45:6801/3625455711","cluster_addr":"172.21.15.45:6803/3625455711","heartbeat_back_addr":"172.21.15.45:6807/3625455711","heartbeat_front_addr":"172.21.15.45:6805/3625455711","state":["exists","up"]},{"osd":5,"uuid":"f9854ee4-302c-41be-977b-bedda090a3d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6817","nonce":3354411217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6819","nonce":3354411217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6823","nonce":3354411217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6821","nonce":3354411217}]},"public_addr":"172.21.15.45:6817/3354411217","cluster_addr":"172.21.15.45:6819/3354411217","heartbeat_back_addr":"172.21.15.45:6823/3354411217","heartbeat_front_addr":"172.21.15.45:6821/3354411217","state":["exists","up"]},{"osd":6,"uuid":"bbdb1989-f6ac-4954-9b85-b8b540d683c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6809","nonce":320111074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6811","nonce":320111074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6815","nonce":320111074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6813","nonce":320111074}]},"public_addr":"172.21.15.45:6809/320111074","cluster_addr":"172.21.15.45:6811/320111074","heartbeat_back_addr":"172.21.15.45:6815/320111074","heartbeat_front_addr":"172.21.15.45:6813/320111074","state":["exists","up"]},{"osd":7,"uuid":"823d44e3-58f1-4d1d-8263-a4e4a69d4327","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6825","nonce":643617680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6827","nonce":643617680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6831","nonce":643617680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6829","nonce":643617680}]},"public_addr":"172.21.15.45:6825/643617680","cluster_addr":"172.21.15.45:6827/643617680","heartbeat_back_addr":"172.21.15.45:6831/643617680","heartbeat_front_addr":"172.21.15.45:6829/643617680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.731262+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.873226+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.898936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.666578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.645990+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.953699+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.642823+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.693395+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-22T10:55:11.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.146+0000 7f1bd2fff700 1 -- 172.21.15.40:0/881782955 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f1bb006ace0 msgr2=0x7f1bb006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:11.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.146+0000 7f1bd2fff700 1 --2- 172.21.15.40:0/881782955 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f1bb006ace0 0x7f1bb006d190 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0006fd0 tx=0x7f1bc0008040 comp rx=0 tx=0).stop 2023-06-22T10:55:11.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.146+0000 7f1bd2fff700 1 -- 172.21.15.40:0/881782955 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1bcc15c720 msgr2=0x7f1bcc1f4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:11.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.146+0000 7f1bd2fff700 1 --2- 172.21.15.40:0/881782955 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1bcc15c720 0x7f1bcc1f4f60 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f1bc400b370 tx=0x7f1bc4004ad0 comp rx=0 tx=0).stop 2023-06-22T10:55:11.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.146+0000 7f1bd2fff700 1 -- 172.21.15.40:0/881782955 shutdown_connections 2023-06-22T10:55:11.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.146+0000 7f1bd2fff700 1 --2- 172.21.15.40:0/881782955 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f1bb006ace0 0x7f1bb006d190 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:11.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.146+0000 7f1bd2fff700 1 --2- 172.21.15.40:0/881782955 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1bcc15c720 0x7f1bcc1f4f60 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:11.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.146+0000 7f1bd2fff700 1 --2- 172.21.15.40:0/881782955 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bcc0b4c60 0x7f1bcc0b8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:11.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.146+0000 7f1bd2fff700 1 --2- 172.21.15.40:0/881782955 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1bcc0d2830 0x7f1bcc0c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:11.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.146+0000 7f1bd2fff700 1 -- 172.21.15.40:0/881782955 >> 172.21.15.40:0/881782955 conn(0x7f1bcc0cf720 msgr2=0x7f1bcc0d0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:11.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.146+0000 7f1bd2fff700 1 -- 172.21.15.40:0/881782955 shutdown_connections 2023-06-22T10:55:11.151 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.146+0000 7f1bd2fff700 1 -- 172.21.15.40:0/881782955 wait complete. 2023-06-22T10:55:11.168 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-22T10:53:17.182228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-22T10:53:23.874432+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-22T10:55:11.169 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-22T10:55:11.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.370+0000 7f56d97ff700 1 Processor -- start 2023-06-22T10:55:11.374 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.370+0000 7f56d97ff700 1 -- start start 2023-06-22T10:55:11.375 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.371+0000 7f56d97ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f56d40b45d0 0x7f56d40b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:11.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.371+0000 7f56d97ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f56d40d2130 0x7f56d40cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:11.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.371+0000 7f56d97ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f56d40cd6e0 0x7f56d40b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:11.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.371+0000 7f56d97ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56d40d17f0 con 0x7f56d40b45d0 2023-06-22T10:55:11.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.371+0000 7f56d97ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56d40d1be0 con 0x7f56d40cd6e0 2023-06-22T10:55:11.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.371+0000 7f56d97ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56d40d1360 con 0x7f56d40d2130 2023-06-22T10:55:11.376 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.372+0000 7f56d2ffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f56d40b45d0 0x7f56d40b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:11.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.372+0000 7f56d2ffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f56d40b45d0 0x7f56d40b49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58630/0 (socket says 172.21.15.40:58630) 2023-06-22T10:55:11.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.372+0000 7f56d2ffd700 1 -- 172.21.15.40:0/2231650698 learned_addr learned my addr 172.21.15.40:0/2231650698 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:55:11.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.372+0000 7f56d27fc700 1 --2- 172.21.15.40:0/2231650698 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f56d40d2130 0x7f56d40cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:11.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.372+0000 7f56d37fe700 1 --2- 172.21.15.40:0/2231650698 >> v2:172.21.15.45:3300/0 conn(0x7f56d40cd6e0 0x7f56d40b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:11.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.372+0000 7f56d2ffd700 1 -- 172.21.15.40:0/2231650698 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f56d40d2130 msgr2=0x7f56d40cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:55:11.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.372+0000 7f56d2ffd700 1 --2- 172.21.15.40:0/2231650698 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f56d40d2130 0x7f56d40cd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:11.377 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.372+0000 7f56d2ffd700 1 -- 172.21.15.40:0/2231650698 >> v2:172.21.15.45:3300/0 conn(0x7f56d40cd6e0 msgr2=0x7f56d40b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:55:11.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.372+0000 7f56d2ffd700 1 --2- 172.21.15.40:0/2231650698 >> v2:172.21.15.45:3300/0 conn(0x7f56d40cd6e0 0x7f56d40b59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:11.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.372+0000 7f56d2ffd700 1 -- 172.21.15.40:0/2231650698 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d40b4ee0 con 0x7f56d40b45d0 2023-06-22T10:55:11.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.372+0000 7f56d37fe700 1 --2- 172.21.15.40:0/2231650698 >> v2:172.21.15.45:3300/0 conn(0x7f56d40cd6e0 0x7f56d40b59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-22T10:55:11.378 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.372+0000 7f56d2ffd700 1 --2- 172.21.15.40:0/2231650698 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56d40b45d0 0x7f56d40b49a0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f56d406cc90 tx=0x7f56c4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7473cdeeec1853e server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:11.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.373+0000 7f56d1ffb700 1 -- 172.21.15.40:0/2231650698 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c400b870 con 0x7f56d40b45d0 2023-06-22T10:55:11.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.373+0000 7f56d1ffb700 1 -- 172.21.15.40:0/2231650698 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56c400b9d0 con 0x7f56d40b45d0 2023-06-22T10:55:11.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.373+0000 7f56d1ffb700 1 -- 172.21.15.40:0/2231650698 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c400bd60 con 0x7f56d40b45d0 2023-06-22T10:55:11.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.373+0000 7f56d97ff700 1 -- 172.21.15.40:0/2231650698 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56d40b45d0 msgr2=0x7f56d40b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:11.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.373+0000 7f56d97ff700 1 --2- 172.21.15.40:0/2231650698 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56d40b45d0 0x7f56d40b49a0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f56d406cc90 tx=0x7f56c4009bd0 comp rx=0 tx=0).stop 2023-06-22T10:55:11.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.373+0000 7f56d97ff700 1 -- 172.21.15.40:0/2231650698 shutdown_connections 2023-06-22T10:55:11.380 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.373+0000 7f56d97ff700 1 --2- 172.21.15.40:0/2231650698 >> v2:172.21.15.45:3300/0 conn(0x7f56d40cd6e0 0x7f56d40b59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:11.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.373+0000 7f56d97ff700 1 --2- 172.21.15.40:0/2231650698 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56d40b45d0 0x7f56d40b49a0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:11.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.373+0000 7f56d97ff700 1 --2- 172.21.15.40:0/2231650698 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f56d40d2130 0x7f56d40cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:11.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.373+0000 7f56d97ff700 1 -- 172.21.15.40:0/2231650698 >> 172.21.15.40:0/2231650698 conn(0x7f56d40cf5d0 msgr2=0x7f56d40cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:11.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.374+0000 7f56d97ff700 1 -- 172.21.15.40:0/2231650698 shutdown_connections 2023-06-22T10:55:11.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.374+0000 7f56d97ff700 1 -- 172.21.15.40:0/2231650698 wait complete. 2023-06-22T10:55:11.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.375+0000 7f56d97ff700 1 Processor -- start 2023-06-22T10:55:11.381 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.375+0000 7f56d97ff700 1 -- start start 2023-06-22T10:55:11.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.376+0000 7f56d97ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56d40b45d0 0x7f56d40c8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:11.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.376+0000 7f56d97ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56d40cd6e0 0x7f56d41e81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:11.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.376+0000 7f56d97ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f56d40d2130 0x7f56d41f1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:11.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.376+0000 7f56d97ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d40caf20 con 0x7f56d40cd6e0 2023-06-22T10:55:11.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.376+0000 7f56d97ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d40cb170 con 0x7f56d40b45d0 2023-06-22T10:55:11.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.376+0000 7f56d97ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56d40cb450 con 0x7f56d40d2130 2023-06-22T10:55:11.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.376+0000 7f56d27fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56d40cd6e0 0x7f56d41e81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:11.382 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.377+0000 7f56d27fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56d40cd6e0 0x7f56d41e81c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58640/0 (socket says 172.21.15.40:58640) 2023-06-22T10:55:11.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.377+0000 7f56d27fc700 1 -- 172.21.15.40:0/3054247511 learned_addr learned my addr 172.21.15.40:0/3054247511 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:55:11.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.377+0000 7f56d2ffd700 1 --2- 172.21.15.40:0/3054247511 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56d40b45d0 0x7f56d40c8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:11.383 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.377+0000 7f56d37fe700 1 --2- 172.21.15.40:0/3054247511 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f56d40d2130 0x7f56d41f1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:11.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.377+0000 7f56d27fc700 1 -- 172.21.15.40:0/3054247511 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f56d40d2130 msgr2=0x7f56d41f1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:11.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.377+0000 7f56d27fc700 1 --2- 172.21.15.40:0/3054247511 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f56d40d2130 0x7f56d41f1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:11.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.377+0000 7f56d27fc700 1 -- 172.21.15.40:0/3054247511 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56d40b45d0 msgr2=0x7f56d40c8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:11.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.377+0000 7f56d27fc700 1 --2- 172.21.15.40:0/3054247511 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56d40b45d0 0x7f56d40c8dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:11.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.377+0000 7f56d27fc700 1 -- 172.21.15.40:0/3054247511 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56c4009550 con 0x7f56d40cd6e0 2023-06-22T10:55:11.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.377+0000 7f56d27fc700 1 --2- 172.21.15.40:0/3054247511 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56d40cd6e0 0x7f56d41e81c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f56c800e810 tx=0x7f56c800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:11.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.377+0000 7f56bb7fe700 1 -- 172.21.15.40:0/3054247511 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c800c070 con 0x7f56d40cd6e0 2023-06-22T10:55:11.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.378+0000 7f56bb7fe700 1 -- 172.21.15.40:0/3054247511 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56c8013610 con 0x7f56d40cd6e0 2023-06-22T10:55:11.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.378+0000 7f56d97ff700 1 -- 172.21.15.40:0/3054247511 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56d40cb730 con 0x7f56d40cd6e0 2023-06-22T10:55:11.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.378+0000 7f56bb7fe700 1 -- 172.21.15.40:0/3054247511 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c80139c0 con 0x7f56d40cd6e0 2023-06-22T10:55:11.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.378+0000 7f56d97ff700 1 -- 172.21.15.40:0/3054247511 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56d40cbcf0 con 0x7f56d40cd6e0 2023-06-22T10:55:11.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.379+0000 7f56d97ff700 1 -- 172.21.15.40:0/3054247511 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56d4159a70 con 0x7f56d40cd6e0 2023-06-22T10:55:11.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.380+0000 7f56bb7fe700 1 -- 172.21.15.40:0/3054247511 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f56c8013b20 con 0x7f56d40cd6e0 2023-06-22T10:55:11.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.381+0000 7f56bb7fe700 1 --2- 172.21.15.40:0/3054247511 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f56c006ace0 0x7f56c006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:11.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.381+0000 7f56bb7fe700 1 -- 172.21.15.40:0/3054247511 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f56c8089080 con 0x7f56d40cd6e0 2023-06-22T10:55:11.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.381+0000 7f56d2ffd700 1 --2- 172.21.15.40:0/3054247511 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f56c006ace0 0x7f56c006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:11.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.382+0000 7f56d2ffd700 1 --2- 172.21.15.40:0/3054247511 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f56c006ace0 0x7f56c006d190 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f56c4014040 tx=0x7f56c4008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:11.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.385+0000 7f56bb7fe700 1 -- 172.21.15.40:0/3054247511 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f56c80542b0 con 0x7f56d40cd6e0 2023-06-22T10:55:11.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.589+0000 7f56d97ff700 1 -- 172.21.15.40:0/3054247511 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f56d4067580 con 0x7f56d40cd6e0 2023-06-22T10:55:11.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.590+0000 7f56bb7fe700 1 -- 172.21.15.40:0/3054247511 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7f56c80578d0 con 0x7f56d40cd6e0 2023-06-22T10:55:11.594 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2023-06-22T10:55:11.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.592+0000 7f56d97ff700 1 -- 172.21.15.40:0/3054247511 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f56c006ace0 msgr2=0x7f56c006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:11.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.592+0000 7f56d97ff700 1 --2- 172.21.15.40:0/3054247511 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f56c006ace0 0x7f56c006d190 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f56c4014040 tx=0x7f56c4008030 comp rx=0 tx=0).stop 2023-06-22T10:55:11.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.592+0000 7f56d97ff700 1 -- 172.21.15.40:0/3054247511 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56d40cd6e0 msgr2=0x7f56d41e81c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:11.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.592+0000 7f56d97ff700 1 --2- 172.21.15.40:0/3054247511 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56d40cd6e0 0x7f56d41e81c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f56c800e810 tx=0x7f56c800eb20 comp rx=0 tx=0).stop 2023-06-22T10:55:11.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.592+0000 7f56d97ff700 1 -- 172.21.15.40:0/3054247511 shutdown_connections 2023-06-22T10:55:11.596 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.592+0000 7f56d97ff700 1 --2- 172.21.15.40:0/3054247511 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f56c006ace0 0x7f56c006d190 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:11.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.592+0000 7f56d97ff700 1 --2- 172.21.15.40:0/3054247511 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f56d40d2130 0x7f56d41f1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:11.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.592+0000 7f56d97ff700 1 --2- 172.21.15.40:0/3054247511 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56d40b45d0 0x7f56d40c8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:11.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.592+0000 7f56d97ff700 1 --2- 172.21.15.40:0/3054247511 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f56d40cd6e0 0x7f56d41e81c0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:11.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.592+0000 7f56d97ff700 1 -- 172.21.15.40:0/3054247511 >> 172.21.15.40:0/3054247511 conn(0x7f56d40cf5d0 msgr2=0x7f56d4159e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:11.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.592+0000 7f56d97ff700 1 -- 172.21.15.40:0/3054247511 shutdown_connections 2023-06-22T10:55:11.597 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.592+0000 7f56d97ff700 1 -- 172.21.15.40:0/3054247511 wait complete. 2023-06-22T10:55:11.613 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-22T10:55:11.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.813+0000 7fa2833ff700 1 Processor -- start 2023-06-22T10:55:11.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.814+0000 7fa2833ff700 1 -- start start 2023-06-22T10:55:11.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.815+0000 7fa2833ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa27c0d2130 0x7fa27c0cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:11.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.815+0000 7fa2833ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa27c0cd6e0 0x7fa27c0b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:11.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.815+0000 7fa2833ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa27c0d1be0 con 0x7fa27c0b45d0 2023-06-22T10:55:11.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.815+0000 7fa2833ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa27c0d17f0 con 0x7fa27c0d2130 2023-06-22T10:55:11.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.815+0000 7fa2833ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa27c0d1360 con 0x7fa27c0cd6e0 2023-06-22T10:55:11.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.815+0000 7fa28099a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa27c0d2130 0x7fa27c0cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:11.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.815+0000 7fa28099a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa27c0d2130 0x7fa27c0cd1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.40:53052/0 (socket says 172.21.15.40:53052) 2023-06-22T10:55:11.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.815+0000 7fa28099a700 1 -- 172.21.15.40:0/410293823 learned_addr learned my addr 172.21.15.40:0/410293823 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:55:11.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.815+0000 7fa28119b700 1 --1- 172.21.15.40:0/410293823 >> v1:172.21.15.45:6789/0 conn(0x7fa27c0b45d0 0x7fa27c0b49a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.40:41548/0 (socket says 172.21.15.40:41548) 2023-06-22T10:55:11.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.815+0000 7fa28199c700 1 --2- 172.21.15.40:0/410293823 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa27c0cd6e0 0x7fa27c0b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:11.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.816+0000 7fa28099a700 1 -- 172.21.15.40:0/410293823 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa27c0cd6e0 msgr2=0x7fa27c0b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:55:11.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.816+0000 7fa28099a700 1 --2- 172.21.15.40:0/410293823 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa27c0cd6e0 0x7fa27c0b59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:11.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.816+0000 7fa28099a700 1 -- 172.21.15.40:0/410293823 >> v1:172.21.15.45:6789/0 conn(0x7fa27c0b45d0 legacy=0x7fa27c0b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:11.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.816+0000 7fa28099a700 1 -- 172.21.15.40:0/410293823 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa27c0cef40 con 0x7fa27c0d2130 2023-06-22T10:55:11.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.816+0000 7fa273fff700 1 -- 172.21.15.40:0/410293823 <== mon.1 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3693976807 0 0) 0x7fa27c0d1be0 con 0x7fa27c0b45d0 2023-06-22T10:55:11.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.816+0000 7fa28099a700 1 --2- 172.21.15.40:0/410293823 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa27c0d2130 0x7fa27c0cd1a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa26c0098f0 tx=0x7fa26c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9b3b57523d06024 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:11.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.816+0000 7fa273fff700 1 -- 172.21.15.40:0/410293823 <== mon.1 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26c011830 con 0x7fa27c0d2130 2023-06-22T10:55:11.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.816+0000 7fa273fff700 1 -- 172.21.15.40:0/410293823 <== mon.1 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa26c011990 con 0x7fa27c0d2130 2023-06-22T10:55:11.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.816+0000 7fa273fff700 1 -- 172.21.15.40:0/410293823 <== mon.1 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26c011d20 con 0x7fa27c0d2130 2023-06-22T10:55:11.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.817+0000 7fa2833ff700 1 -- 172.21.15.40:0/410293823 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa27c0d2130 msgr2=0x7fa27c0cd1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:11.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.817+0000 7fa2833ff700 1 --2- 172.21.15.40:0/410293823 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa27c0d2130 0x7fa27c0cd1a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa26c0098f0 tx=0x7fa26c009c00 comp rx=0 tx=0).stop 2023-06-22T10:55:11.822 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.817+0000 7fa2833ff700 1 -- 172.21.15.40:0/410293823 shutdown_connections 2023-06-22T10:55:11.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.817+0000 7fa2833ff700 1 --2- 172.21.15.40:0/410293823 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa27c0cd6e0 0x7fa27c0b59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:11.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.817+0000 7fa2833ff700 1 --2- 172.21.15.40:0/410293823 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa27c0d2130 0x7fa27c0cd1a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:11.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.817+0000 7fa2833ff700 1 -- 172.21.15.40:0/410293823 >> 172.21.15.40:0/410293823 conn(0x7fa27c0cf5d0 msgr2=0x7fa27c0cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:11.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.817+0000 7fa2833ff700 1 -- 172.21.15.40:0/410293823 shutdown_connections 2023-06-22T10:55:11.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.817+0000 7fa2833ff700 1 -- 172.21.15.40:0/410293823 wait complete. 2023-06-22T10:55:11.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.819+0000 7fa2833ff700 1 Processor -- start 2023-06-22T10:55:11.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.819+0000 7fa2833ff700 1 -- start start 2023-06-22T10:55:11.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.820+0000 7fa2833ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa27c0b45d0 0x7fa27c154000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:11.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.820+0000 7fa2833ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa27c0cd6e0 0x7fa27c156f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:11.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.820+0000 7fa2833ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa27c0d2130 0x7fa27c157480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:11.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.820+0000 7fa2833ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa27c15f9a0 con 0x7fa27c0cd6e0 2023-06-22T10:55:11.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.820+0000 7fa2833ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa27c0cb440 con 0x7fa27c0b45d0 2023-06-22T10:55:11.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.820+0000 7fa2833ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa27c0cb720 con 0x7fa27c0d2130 2023-06-22T10:55:11.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.820+0000 7fa28099a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa27c0cd6e0 0x7fa27c156f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:11.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.820+0000 7fa28099a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa27c0cd6e0 0x7fa27c156f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58644/0 (socket says 172.21.15.40:58644) 2023-06-22T10:55:11.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.820+0000 7fa28099a700 1 -- 172.21.15.40:0/1742331426 learned_addr learned my addr 172.21.15.40:0/1742331426 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:55:11.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.820+0000 7fa28119b700 1 --2- 172.21.15.40:0/1742331426 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa27c0b45d0 0x7fa27c154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:11.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.820+0000 7fa28199c700 1 --2- 172.21.15.40:0/1742331426 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa27c0d2130 0x7fa27c157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:11.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.821+0000 7fa28099a700 1 -- 172.21.15.40:0/1742331426 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa27c0d2130 msgr2=0x7fa27c157480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:11.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.821+0000 7fa28099a700 1 --2- 172.21.15.40:0/1742331426 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa27c0d2130 0x7fa27c157480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:11.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.821+0000 7fa28099a700 1 -- 172.21.15.40:0/1742331426 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa27c0b45d0 msgr2=0x7fa27c154000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:11.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.821+0000 7fa28099a700 1 --2- 172.21.15.40:0/1742331426 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa27c0b45d0 0x7fa27c154000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:11.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.821+0000 7fa28099a700 1 -- 172.21.15.40:0/1742331426 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa26c009550 con 0x7fa27c0cd6e0 2023-06-22T10:55:11.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.821+0000 7fa28099a700 1 --2- 172.21.15.40:0/1742331426 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa27c0cd6e0 0x7fa27c156f40 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fa27c06a0c0 tx=0x7fa26c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:11.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.821+0000 7fa271ffb700 1 -- 172.21.15.40:0/1742331426 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26c004510 con 0x7fa27c0cd6e0 2023-06-22T10:55:11.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.821+0000 7fa271ffb700 1 -- 172.21.15.40:0/1742331426 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa26c0036a0 con 0x7fa27c0cd6e0 2023-06-22T10:55:11.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.821+0000 7fa271ffb700 1 -- 172.21.15.40:0/1742331426 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26c003a10 con 0x7fa27c0cd6e0 2023-06-22T10:55:11.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.821+0000 7fa2833ff700 1 -- 172.21.15.40:0/1742331426 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa27c0cba00 con 0x7fa27c0cd6e0 2023-06-22T10:55:11.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.821+0000 7fa2833ff700 1 -- 172.21.15.40:0/1742331426 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa27c154540 con 0x7fa27c0cd6e0 2023-06-22T10:55:11.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.822+0000 7fa2833ff700 1 -- 172.21.15.40:0/1742331426 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa27c0b4390 con 0x7fa27c0cd6e0 2023-06-22T10:55:11.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.823+0000 7fa271ffb700 1 -- 172.21.15.40:0/1742331426 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa26c003b70 con 0x7fa27c0cd6e0 2023-06-22T10:55:11.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.824+0000 7fa271ffb700 1 --2- 172.21.15.40:0/1742331426 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fa26006ace0 0x7fa26006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:11.829 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.824+0000 7fa271ffb700 1 -- 172.21.15.40:0/1742331426 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fa26c08a880 con 0x7fa27c0cd6e0 2023-06-22T10:55:11.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.824+0000 7fa28119b700 1 --2- 172.21.15.40:0/1742331426 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fa26006ace0 0x7fa26006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:11.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.825+0000 7fa28119b700 1 --2- 172.21.15.40:0/1742331426 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fa26006ace0 0x7fa26006d190 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa278000f60 tx=0x7fa278007e70 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:11.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:11.829+0000 7fa271ffb700 1 -- 172.21.15.40:0/1742331426 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa26c055ab0 con 0x7fa27c0cd6e0 2023-06-22T10:55:12.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.033+0000 7fa2833ff700 1 -- 172.21.15.40:0/1742331426 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa27c067580 con 0x7fa27c0cd6e0 2023-06-22T10:55:12.037 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.034+0000 7fa271ffb700 1 -- 172.21.15.40:0/1742331426 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v38) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa26c0590d0 con 0x7fa27c0cd6e0 2023-06-22T10:55:12.038 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 8 2023-06-22T10:55:12.039 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.036+0000 7fa2833ff700 1 -- 172.21.15.40:0/1742331426 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fa26006ace0 msgr2=0x7fa26006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:12.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.036+0000 7fa2833ff700 1 --2- 172.21.15.40:0/1742331426 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fa26006ace0 0x7fa26006d190 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa278000f60 tx=0x7fa278007e70 comp rx=0 tx=0).stop 2023-06-22T10:55:12.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.036+0000 7fa2833ff700 1 -- 172.21.15.40:0/1742331426 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa27c0cd6e0 msgr2=0x7fa27c156f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:12.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.036+0000 7fa2833ff700 1 --2- 172.21.15.40:0/1742331426 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa27c0cd6e0 0x7fa27c156f40 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fa27c06a0c0 tx=0x7fa26c004750 comp rx=0 tx=0).stop 2023-06-22T10:55:12.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.036+0000 7fa2833ff700 1 -- 172.21.15.40:0/1742331426 shutdown_connections 2023-06-22T10:55:12.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.036+0000 7fa2833ff700 1 --2- 172.21.15.40:0/1742331426 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fa26006ace0 0x7fa26006d190 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:12.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.036+0000 7fa2833ff700 1 --2- 172.21.15.40:0/1742331426 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fa27c0d2130 0x7fa27c157480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:12.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.036+0000 7fa2833ff700 1 --2- 172.21.15.40:0/1742331426 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa27c0b45d0 0x7fa27c154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:12.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.036+0000 7fa2833ff700 1 --2- 172.21.15.40:0/1742331426 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa27c0cd6e0 0x7fa27c156f40 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:12.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.036+0000 7fa2833ff700 1 -- 172.21.15.40:0/1742331426 >> 172.21.15.40:0/1742331426 conn(0x7fa27c0cf5d0 msgr2=0x7fa27c0b3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:12.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.036+0000 7fa2833ff700 1 -- 172.21.15.40:0/1742331426 shutdown_connections 2023-06-22T10:55:12.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.036+0000 7fa2833ff700 1 -- 172.21.15.40:0/1742331426 wait complete. 2023-06-22T10:55:12.057 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-06-22T10:55:12.260 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.257+0000 7f1a327ff700 1 Processor -- start 2023-06-22T10:55:12.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.257+0000 7f1a327ff700 1 -- start start 2023-06-22T10:55:12.261 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.258+0000 7f1a327ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1a2c0ce8f0 0x7f1a2c0cc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:12.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.258+0000 7f1a327ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1a2c0cefc0 0x7f1a2c0cf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:12.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.258+0000 7f1a327ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a2c0cd2e0 con 0x7f1a2c15c310 2023-06-22T10:55:12.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.258+0000 7f1a327ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a2c0cc970 con 0x7f1a2c0ce8f0 2023-06-22T10:55:12.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.258+0000 7f1a327ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2c0cf980 con 0x7f1a2c0cefc0 2023-06-22T10:55:12.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.258+0000 7f1a23fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1a2c0ce8f0 0x7f1a2c0cc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:12.262 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.258+0000 7f1a23fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1a2c0ce8f0 0x7f1a2c0cc430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58652/0 (socket says 172.21.15.40:58652) 2023-06-22T10:55:12.263 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.258+0000 7f1a23fff700 1 -- 172.21.15.40:0/2079759250 learned_addr learned my addr 172.21.15.40:0/2079759250 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:55:12.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.259+0000 7f1a30d9c700 1 --2- 172.21.15.40:0/2079759250 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1a2c0cefc0 0x7f1a2c0cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:12.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.259+0000 7f1a23fff700 1 -- 172.21.15.40:0/2079759250 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1a2c0cefc0 msgr2=0x7f1a2c0cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:55:12.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.259+0000 7f1a23fff700 1 --2- 172.21.15.40:0/2079759250 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1a2c0cefc0 0x7f1a2c0cf440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:12.264 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.259+0000 7f1a23fff700 1 -- 172.21.15.40:0/2079759250 >> v1:172.21.15.45:6789/0 conn(0x7f1a2c15c310 legacy=0x7f1a2c15c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:12.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.259+0000 7f1a23fff700 1 -- 172.21.15.40:0/2079759250 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a2c0cccd0 con 0x7f1a2c0ce8f0 2023-06-22T10:55:12.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.259+0000 7f1a23fff700 1 --2- 172.21.15.40:0/2079759250 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a2c0ce8f0 0x7f1a2c0cc430 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f1a140098f0 tx=0x7f1a14009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc080ed0f9ec097a server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:12.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.259+0000 7f1a2b7fe700 1 -- 172.21.15.40:0/2079759250 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1400b8a0 con 0x7f1a2c0ce8f0 2023-06-22T10:55:12.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.260+0000 7f1a2b7fe700 1 -- 172.21.15.40:0/2079759250 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a1400ba00 con 0x7f1a2c0ce8f0 2023-06-22T10:55:12.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.260+0000 7f1a2b7fe700 1 -- 172.21.15.40:0/2079759250 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1400bd90 con 0x7f1a2c0ce8f0 2023-06-22T10:55:12.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.260+0000 7f1a327ff700 1 -- 172.21.15.40:0/2079759250 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a2c0ce8f0 msgr2=0x7f1a2c0cc430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:12.265 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.260+0000 7f1a327ff700 1 --2- 172.21.15.40:0/2079759250 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a2c0ce8f0 0x7f1a2c0cc430 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f1a140098f0 tx=0x7f1a14009c00 comp rx=0 tx=0).stop 2023-06-22T10:55:12.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.260+0000 7f1a327ff700 1 -- 172.21.15.40:0/2079759250 shutdown_connections 2023-06-22T10:55:12.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.260+0000 7f1a327ff700 1 --2- 172.21.15.40:0/2079759250 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1a2c0cefc0 0x7f1a2c0cf440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:12.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.260+0000 7f1a327ff700 1 --2- 172.21.15.40:0/2079759250 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a2c0ce8f0 0x7f1a2c0cc430 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:12.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.260+0000 7f1a327ff700 1 -- 172.21.15.40:0/2079759250 >> 172.21.15.40:0/2079759250 conn(0x7f1a2c0b0b70 msgr2=0x7f1a2c0b0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:12.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.260+0000 7f1a327ff700 1 -- 172.21.15.40:0/2079759250 shutdown_connections 2023-06-22T10:55:12.266 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.260+0000 7f1a327ff700 1 -- 172.21.15.40:0/2079759250 wait complete. 2023-06-22T10:55:12.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.262+0000 7f1a327ff700 1 Processor -- start 2023-06-22T10:55:12.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.262+0000 7f1a327ff700 1 -- start start 2023-06-22T10:55:12.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.263+0000 7f1a327ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a2c0ce8f0 0x7f1a2c155800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:12.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.263+0000 7f1a327ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a2c0cefc0 0x7f1a2c0b1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:12.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.263+0000 7f1a327ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1a2c15c310 0x7f1a2c15dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:12.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.263+0000 7f1a327ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2c0c3780 con 0x7f1a2c0cefc0 2023-06-22T10:55:12.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.263+0000 7f1a327ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2c0c3ba0 con 0x7f1a2c0ce8f0 2023-06-22T10:55:12.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.263+0000 7f1a327ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2c0b23d0 con 0x7f1a2c15c310 2023-06-22T10:55:12.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.263+0000 7f1a23fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a2c0cefc0 0x7f1a2c0b1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:12.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.263+0000 7f1a23fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a2c0cefc0 0x7f1a2c0b1e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58664/0 (socket says 172.21.15.40:58664) 2023-06-22T10:55:12.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.263+0000 7f1a23fff700 1 -- 172.21.15.40:0/3544891475 learned_addr learned my addr 172.21.15.40:0/3544891475 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:55:12.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.263+0000 7f1a2bfff700 1 --2- 172.21.15.40:0/3544891475 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a2c0ce8f0 0x7f1a2c155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:12.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.263+0000 7f1a30d9c700 1 --2- 172.21.15.40:0/3544891475 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1a2c15c310 0x7f1a2c15dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:12.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.264+0000 7f1a23fff700 1 -- 172.21.15.40:0/3544891475 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1a2c15c310 msgr2=0x7f1a2c15dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:12.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.264+0000 7f1a23fff700 1 --2- 172.21.15.40:0/3544891475 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1a2c15c310 0x7f1a2c15dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:12.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.264+0000 7f1a23fff700 1 -- 172.21.15.40:0/3544891475 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a2c0ce8f0 msgr2=0x7f1a2c155800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:12.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.264+0000 7f1a23fff700 1 --2- 172.21.15.40:0/3544891475 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a2c0ce8f0 0x7f1a2c155800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:12.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.264+0000 7f1a23fff700 1 -- 172.21.15.40:0/3544891475 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a14009550 con 0x7f1a2c0cefc0 2023-06-22T10:55:12.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.264+0000 7f1a30d9c700 1 --2- 172.21.15.40:0/3544891475 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1a2c15c310 0x7f1a2c15dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:55:12.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.264+0000 7f1a23fff700 1 --2- 172.21.15.40:0/3544891475 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a2c0cefc0 0x7f1a2c0b1e90 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f1a14000c00 tx=0x7f1a14004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:12.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.264+0000 7f1a297fa700 1 -- 172.21.15.40:0/3544891475 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a14004380 con 0x7f1a2c0cefc0 2023-06-22T10:55:12.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.264+0000 7f1a297fa700 1 -- 172.21.15.40:0/3544891475 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a1401f070 con 0x7f1a2c0cefc0 2023-06-22T10:55:12.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.264+0000 7f1a297fa700 1 -- 172.21.15.40:0/3544891475 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a140036a0 con 0x7f1a2c0cefc0 2023-06-22T10:55:12.271 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.264+0000 7f1a327ff700 1 -- 172.21.15.40:0/3544891475 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a2c0c2b90 con 0x7f1a2c0cefc0 2023-06-22T10:55:12.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.264+0000 7f1a327ff700 1 -- 172.21.15.40:0/3544891475 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a2c0c30c0 con 0x7f1a2c0cefc0 2023-06-22T10:55:12.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.265+0000 7f1a327ff700 1 -- 172.21.15.40:0/3544891475 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a2c0c38c0 con 0x7f1a2c0cefc0 2023-06-22T10:55:12.272 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.266+0000 7f1a297fa700 1 -- 172.21.15.40:0/3544891475 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1a14021030 con 0x7f1a2c0cefc0 2023-06-22T10:55:12.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.267+0000 7f1a297fa700 1 --2- 172.21.15.40:0/3544891475 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f1a0c06ace0 0x7f1a0c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:12.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.267+0000 7f1a297fa700 1 -- 172.21.15.40:0/3544891475 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f1a1408a570 con 0x7f1a2c0cefc0 2023-06-22T10:55:12.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.268+0000 7f1a2bfff700 1 --2- 172.21.15.40:0/3544891475 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f1a0c06ace0 0x7f1a0c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:12.273 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.268+0000 7f1a2bfff700 1 --2- 172.21.15.40:0/3544891475 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f1a0c06ace0 0x7f1a0c06d190 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c15ef70 tx=0x7f1a1c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:12.275 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.272+0000 7f1a297fa700 1 -- 172.21.15.40:0/3544891475 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1a2c0c38c0 con 0x7f1a2c0cefc0 2023-06-22T10:55:12.483 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.480+0000 7f1a327ff700 1 -- 172.21.15.40:0/3544891475 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f1a2c0c38c0 con 0x7f1a2c0cefc0 2023-06-22T10:55:12.484 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.480+0000 7f1a297fa700 1 -- 172.21.15.40:0/3544891475 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v38) v1 ==== 84+0+126 (secure 0 0 0) 0x7f1a2c0c38c0 con 0x7f1a2c0cefc0 2023-06-22T10:55:12.484 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:55:12.484 INFO:teuthology.orchestra.run.smithi040.stdout:[ 2023-06-22T10:55:12.484 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-06-22T10:55:12.485 INFO:teuthology.orchestra.run.smithi040.stdout: "poolnum": 1, 2023-06-22T10:55:12.485 INFO:teuthology.orchestra.run.smithi040.stdout: "poolname": ".mgr" 2023-06-22T10:55:12.485 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2023-06-22T10:55:12.485 INFO:teuthology.orchestra.run.smithi040.stdout: { 2023-06-22T10:55:12.485 INFO:teuthology.orchestra.run.smithi040.stdout: "poolnum": 2, 2023-06-22T10:55:12.486 INFO:teuthology.orchestra.run.smithi040.stdout: "poolname": "rbd" 2023-06-22T10:55:12.486 INFO:teuthology.orchestra.run.smithi040.stdout: } 2023-06-22T10:55:12.486 INFO:teuthology.orchestra.run.smithi040.stdout:] 2023-06-22T10:55:12.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.483+0000 7f1a327ff700 1 -- 172.21.15.40:0/3544891475 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f1a0c06ace0 msgr2=0x7f1a0c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:12.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.483+0000 7f1a327ff700 1 --2- 172.21.15.40:0/3544891475 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f1a0c06ace0 0x7f1a0c06d190 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c15ef70 tx=0x7f1a1c009040 comp rx=0 tx=0).stop 2023-06-22T10:55:12.487 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.483+0000 7f1a327ff700 1 -- 172.21.15.40:0/3544891475 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a2c0cefc0 msgr2=0x7f1a2c0b1e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:12.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.483+0000 7f1a327ff700 1 --2- 172.21.15.40:0/3544891475 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a2c0cefc0 0x7f1a2c0b1e90 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f1a14000c00 tx=0x7f1a14004750 comp rx=0 tx=0).stop 2023-06-22T10:55:12.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.483+0000 7f1a327ff700 1 -- 172.21.15.40:0/3544891475 shutdown_connections 2023-06-22T10:55:12.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.483+0000 7f1a327ff700 1 --2- 172.21.15.40:0/3544891475 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f1a0c06ace0 0x7f1a0c06d190 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:12.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.483+0000 7f1a327ff700 1 --2- 172.21.15.40:0/3544891475 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1a2c15c310 0x7f1a2c15dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:12.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.483+0000 7f1a327ff700 1 --2- 172.21.15.40:0/3544891475 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a2c0ce8f0 0x7f1a2c155800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:12.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.483+0000 7f1a327ff700 1 --2- 172.21.15.40:0/3544891475 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a2c0cefc0 0x7f1a2c0b1e90 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:12.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.483+0000 7f1a327ff700 1 -- 172.21.15.40:0/3544891475 >> 172.21.15.40:0/3544891475 conn(0x7f1a2c0b0b70 msgr2=0x7f1a2c06cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:12.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.483+0000 7f1a327ff700 1 -- 172.21.15.40:0/3544891475 shutdown_connections 2023-06-22T10:55:12.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.483+0000 7f1a327ff700 1 -- 172.21.15.40:0/3544891475 wait complete. 2023-06-22T10:55:12.503 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-06-22T10:55:12.504 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-06-22T10:55:12.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.705+0000 7ff31d5ff700 1 Processor -- start 2023-06-22T10:55:12.709 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.706+0000 7ff31d5ff700 1 -- start start 2023-06-22T10:55:12.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.707+0000 7ff31d5ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff31815c3e0 0x7ff3180b5a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:12.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.708+0000 7ff31d5ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3180b5f90 con 0x7ff3180d2020 2023-06-22T10:55:12.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.708+0000 7ff31d5ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3180cd250 con 0x7ff31806bda0 2023-06-22T10:55:12.711 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.708+0000 7ff31d5ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3180cda60 con 0x7ff31815c3e0 2023-06-22T10:55:12.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.708+0000 7ff3177fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff3180d2020 0x7ff3180cee50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:42140/0 (socket says 172.21.15.40:42140) 2023-06-22T10:55:12.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.708+0000 7ff3177fe700 1 -- 172.21.15.40:0/1383428173 learned_addr learned my addr 172.21.15.40:0/1383428173 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:55:12.712 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.708+0000 7ff316ffd700 1 --2- 172.21.15.40:0/1383428173 >> v2:172.21.15.45:3300/0 conn(0x7ff31815c3e0 0x7ff3180b5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:12.713 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.708+0000 7ff315ffb700 1 -- 172.21.15.40:0/1383428173 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2841962930 0 0) 0x7ff3180b5f90 con 0x7ff3180d2020 2023-06-22T10:55:12.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.708+0000 7ff315ffb700 1 -- 172.21.15.40:0/1383428173 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3000035b0 con 0x7ff3180d2020 2023-06-22T10:55:12.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.708+0000 7ff316ffd700 1 -- 172.21.15.40:0/1383428173 >> v1:172.21.15.45:6789/0 conn(0x7ff31806bda0 legacy=0x7ff3180d1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:12.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.708+0000 7ff315ffb700 1 -- 172.21.15.40:0/1383428173 <== mon.1 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1628050201 0 0) 0x7ff3180cd250 con 0x7ff31806bda0 2023-06-22T10:55:12.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.708+0000 7ff316ffd700 1 -- 172.21.15.40:0/1383428173 >> v1:172.21.15.40:6789/0 conn(0x7ff3180d2020 legacy=0x7ff3180cee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:12.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.708+0000 7ff316ffd700 1 -- 172.21.15.40:0/1383428173 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3180d1480 con 0x7ff31815c3e0 2023-06-22T10:55:12.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.709+0000 7ff316ffd700 1 --2- 172.21.15.40:0/1383428173 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff31815c3e0 0x7ff3180b5a50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff308009840 tx=0x7ff308009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=999d74ad7a3aebc4 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:12.714 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.709+0000 7ff315ffb700 1 -- 172.21.15.40:0/1383428173 <== mon.1 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff308011830 con 0x7ff31815c3e0 2023-06-22T10:55:12.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.709+0000 7ff315ffb700 1 -- 172.21.15.40:0/1383428173 <== mon.1 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff308011990 con 0x7ff31815c3e0 2023-06-22T10:55:12.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.709+0000 7ff315ffb700 1 -- 172.21.15.40:0/1383428173 <== mon.1 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff308011d20 con 0x7ff31815c3e0 2023-06-22T10:55:12.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.709+0000 7ff31d5ff700 1 -- 172.21.15.40:0/1383428173 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff31815c3e0 msgr2=0x7ff3180b5a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:12.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.709+0000 7ff31d5ff700 1 --2- 172.21.15.40:0/1383428173 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff31815c3e0 0x7ff3180b5a50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff308009840 tx=0x7ff308009b50 comp rx=0 tx=0).stop 2023-06-22T10:55:12.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.710+0000 7ff31d5ff700 1 -- 172.21.15.40:0/1383428173 shutdown_connections 2023-06-22T10:55:12.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.710+0000 7ff31d5ff700 1 --2- 172.21.15.40:0/1383428173 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff31815c3e0 0x7ff3180b5a50 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:12.715 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.710+0000 7ff31d5ff700 1 -- 172.21.15.40:0/1383428173 >> 172.21.15.40:0/1383428173 conn(0x7ff31806b290 msgr2=0x7ff31806b690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:12.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.710+0000 7ff31d5ff700 1 -- 172.21.15.40:0/1383428173 shutdown_connections 2023-06-22T10:55:12.716 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.710+0000 7ff31d5ff700 1 -- 172.21.15.40:0/1383428173 wait complete. 2023-06-22T10:55:12.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.711+0000 7ff31d5ff700 1 Processor -- start 2023-06-22T10:55:12.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.711+0000 7ff31d5ff700 1 -- start start 2023-06-22T10:55:12.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.712+0000 7ff31d5ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff31806bda0 0x7ff318155f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:12.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.712+0000 7ff31d5ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3180d2020 0x7ff318156ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:12.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.712+0000 7ff31d5ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff31815c3e0 0x7ff3181571e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:12.718 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.712+0000 7ff31d5ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3181f2520 con 0x7ff3180d2020 2023-06-22T10:55:12.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.712+0000 7ff31d5ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3181f6230 con 0x7ff31806bda0 2023-06-22T10:55:12.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.712+0000 7ff31d5ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3181f1c40 con 0x7ff31815c3e0 2023-06-22T10:55:12.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.713+0000 7ff3167fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3180d2020 0x7ff318156ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:12.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.713+0000 7ff316ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff31806bda0 0x7ff318155f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:12.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.713+0000 7ff3167fc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3180d2020 0x7ff318156ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58672/0 (socket says 172.21.15.40:58672) 2023-06-22T10:55:12.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.713+0000 7ff3167fc700 1 -- 172.21.15.40:0/1798083648 learned_addr learned my addr 172.21.15.40:0/1798083648 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:55:12.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.713+0000 7ff3177fe700 1 --2- 172.21.15.40:0/1798083648 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff31815c3e0 0x7ff3181571e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:12.719 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.713+0000 7ff3167fc700 1 -- 172.21.15.40:0/1798083648 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff31815c3e0 msgr2=0x7ff3181571e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:12.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.713+0000 7ff3167fc700 1 --2- 172.21.15.40:0/1798083648 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff31815c3e0 0x7ff3181571e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:12.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.713+0000 7ff3167fc700 1 -- 172.21.15.40:0/1798083648 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff31806bda0 msgr2=0x7ff318155f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:12.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.713+0000 7ff3167fc700 1 --2- 172.21.15.40:0/1798083648 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff31806bda0 0x7ff318155f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:12.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.713+0000 7ff3167fc700 1 -- 172.21.15.40:0/1798083648 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3080094a0 con 0x7ff3180d2020 2023-06-22T10:55:12.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.713+0000 7ff3177fe700 1 --2- 172.21.15.40:0/1798083648 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff31815c3e0 0x7ff3181571e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:55:12.720 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.713+0000 7ff3167fc700 1 --2- 172.21.15.40:0/1798083648 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3180d2020 0x7ff318156ca0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7ff30c00c750 tx=0x7ff30c00ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:12.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.714+0000 7ff2ff7fe700 1 -- 172.21.15.40:0/1798083648 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff30c0054e0 con 0x7ff3180d2020 2023-06-22T10:55:12.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.714+0000 7ff2ff7fe700 1 -- 172.21.15.40:0/1798083648 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff30c003680 con 0x7ff3180d2020 2023-06-22T10:55:12.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.714+0000 7ff2ff7fe700 1 -- 172.21.15.40:0/1798083648 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff30c003a30 con 0x7ff3180d2020 2023-06-22T10:55:12.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.714+0000 7ff31d5ff700 1 -- 172.21.15.40:0/1798083648 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3181f5f50 con 0x7ff3180d2020 2023-06-22T10:55:12.721 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.714+0000 7ff31d5ff700 1 -- 172.21.15.40:0/1798083648 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3181f2140 con 0x7ff3180d2020 2023-06-22T10:55:12.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.715+0000 7ff31d5ff700 1 -- 172.21.15.40:0/1798083648 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3181f2660 con 0x7ff3180d2020 2023-06-22T10:55:12.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.716+0000 7ff2ff7fe700 1 -- 172.21.15.40:0/1798083648 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff30c003b90 con 0x7ff3180d2020 2023-06-22T10:55:12.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.717+0000 7ff2ff7fe700 1 --2- 172.21.15.40:0/1798083648 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7ff30406ace0 0x7ff30406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:12.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.717+0000 7ff2ff7fe700 1 -- 172.21.15.40:0/1798083648 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5530+0+0 (secure 0 0 0) 0x7ff30c088620 con 0x7ff3180d2020 2023-06-22T10:55:12.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.717+0000 7ff316ffd700 1 --2- 172.21.15.40:0/1798083648 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7ff30406ace0 0x7ff30406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:12.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.718+0000 7ff316ffd700 1 --2- 172.21.15.40:0/1798083648 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7ff30406ace0 0x7ff30406d190 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff308009fd0 tx=0x7ff30801c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:12.725 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.721+0000 7ff2ff7fe700 1 -- 172.21.15.40:0/1798083648 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff3181f2660 con 0x7ff3180d2020 2023-06-22T10:55:12.928 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:12.925+0000 7ff31d5ff700 1 -- 172.21.15.40:0/1798083648 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff3181f2660 con 0x7ff3180d2020 2023-06-22T10:55:13.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.115+0000 7ff2ff7fe700 1 -- 172.21.15.40:0/1798083648 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v39) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff3181f2660 con 0x7ff3180d2020 2023-06-22T10:55:13.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.119+0000 7ff31d5ff700 1 -- 172.21.15.40:0/1798083648 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7ff30406ace0 msgr2=0x7ff30406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:13.122 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.119+0000 7ff31d5ff700 1 --2- 172.21.15.40:0/1798083648 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7ff30406ace0 0x7ff30406d190 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff308009fd0 tx=0x7ff30801c040 comp rx=0 tx=0).stop 2023-06-22T10:55:13.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.119+0000 7ff31d5ff700 1 -- 172.21.15.40:0/1798083648 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3180d2020 msgr2=0x7ff318156ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:13.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.119+0000 7ff31d5ff700 1 --2- 172.21.15.40:0/1798083648 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3180d2020 0x7ff318156ca0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7ff30c00c750 tx=0x7ff30c00ca60 comp rx=0 tx=0).stop 2023-06-22T10:55:13.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.120+0000 7ff31d5ff700 1 -- 172.21.15.40:0/1798083648 shutdown_connections 2023-06-22T10:55:13.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.120+0000 7ff31d5ff700 1 --2- 172.21.15.40:0/1798083648 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7ff30406ace0 0x7ff30406d190 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:13.123 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.120+0000 7ff31d5ff700 1 --2- 172.21.15.40:0/1798083648 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7ff31815c3e0 0x7ff3181571e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:13.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.120+0000 7ff31d5ff700 1 --2- 172.21.15.40:0/1798083648 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff31806bda0 0x7ff318155f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:13.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.120+0000 7ff31d5ff700 1 --2- 172.21.15.40:0/1798083648 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3180d2020 0x7ff318156ca0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:13.124 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.120+0000 7ff31d5ff700 1 -- 172.21.15.40:0/1798083648 >> 172.21.15.40:0/1798083648 conn(0x7ff31806b290 msgr2=0x7ff318159ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:13.126 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.122+0000 7ff31d5ff700 1 -- 172.21.15.40:0/1798083648 shutdown_connections 2023-06-22T10:55:13.127 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.124+0000 7ff31d5ff700 1 -- 172.21.15.40:0/1798083648 wait complete. 2023-06-22T10:55:13.128 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_metadata' created 2023-06-22T10:55:13.145 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-06-22T10:55:13.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.350+0000 7f14993ff700 1 Processor -- start 2023-06-22T10:55:13.354 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.351+0000 7f14993ff700 1 -- start start 2023-06-22T10:55:13.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.352+0000 7f14993ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f14940d2050 0x7f14940d1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:13.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.352+0000 7f14993ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f14940d1b00 0x7f14940d25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:13.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.352+0000 7f14993ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1494160b00 con 0x7f149415fe30 2023-06-22T10:55:13.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.352+0000 7f14993ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1494160da0 con 0x7f14940d2050 2023-06-22T10:55:13.355 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.352+0000 7f14993ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1494160910 con 0x7f14940d1b00 2023-06-22T10:55:13.356 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.352+0000 7f1492ffd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f149415fe30 0x7f1494160200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:42154/0 (socket says 172.21.15.40:42154) 2023-06-22T10:55:13.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.352+0000 7f1492ffd700 1 -- 172.21.15.40:0/1079914759 learned_addr learned my addr 172.21.15.40:0/1079914759 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:55:13.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.352+0000 7f14927fc700 1 --2- 172.21.15.40:0/1079914759 >> v2:172.21.15.40:3300/0 conn(0x7f14940d2050 0x7f14940d1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:13.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.352+0000 7f14937fe700 1 --2- 172.21.15.40:0/1079914759 >> v2:172.21.15.45:3300/0 conn(0x7f14940d1b00 0x7f14940d25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:13.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.352+0000 7f14927fc700 1 -- 172.21.15.40:0/1079914759 >> v2:172.21.15.45:3300/0 conn(0x7f14940d1b00 msgr2=0x7f14940d25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:55:13.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.352+0000 7f14927fc700 1 --2- 172.21.15.40:0/1079914759 >> v2:172.21.15.45:3300/0 conn(0x7f14940d1b00 0x7f14940d25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:13.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.352+0000 7f14927fc700 1 -- 172.21.15.40:0/1079914759 >> v1:172.21.15.40:6789/0 conn(0x7f149415fe30 legacy=0x7f1494160200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:13.357 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.353+0000 7f14927fc700 1 -- 172.21.15.40:0/1079914759 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14940cd2f0 con 0x7f14940d2050 2023-06-22T10:55:13.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.353+0000 7f14927fc700 1 --2- 172.21.15.40:0/1079914759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f14940d2050 0x7f14940d1480 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f14940cd150 tx=0x7f1488009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5f9bebec6d05c99 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:13.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.353+0000 7f1491ffb700 1 -- 172.21.15.40:0/1079914759 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1488011830 con 0x7f14940d2050 2023-06-22T10:55:13.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.353+0000 7f1491ffb700 1 -- 172.21.15.40:0/1079914759 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1488011990 con 0x7f14940d2050 2023-06-22T10:55:13.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.353+0000 7f1491ffb700 1 -- 172.21.15.40:0/1079914759 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1488011d20 con 0x7f14940d2050 2023-06-22T10:55:13.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.353+0000 7f14993ff700 1 -- 172.21.15.40:0/1079914759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f14940d2050 msgr2=0x7f14940d1480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:13.358 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.354+0000 7f14993ff700 1 --2- 172.21.15.40:0/1079914759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f14940d2050 0x7f14940d1480 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f14940cd150 tx=0x7f1488009b20 comp rx=0 tx=0).stop 2023-06-22T10:55:13.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.354+0000 7f14993ff700 1 -- 172.21.15.40:0/1079914759 shutdown_connections 2023-06-22T10:55:13.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.354+0000 7f14993ff700 1 --2- 172.21.15.40:0/1079914759 >> v2:172.21.15.45:3300/0 conn(0x7f14940d1b00 0x7f14940d25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:13.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.354+0000 7f14993ff700 1 --2- 172.21.15.40:0/1079914759 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f14940d2050 0x7f14940d1480 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:13.359 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.354+0000 7f14993ff700 1 -- 172.21.15.40:0/1079914759 >> 172.21.15.40:0/1079914759 conn(0x7f1494071660 msgr2=0x7f1494071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:13.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.354+0000 7f14993ff700 1 -- 172.21.15.40:0/1079914759 shutdown_connections 2023-06-22T10:55:13.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.354+0000 7f14993ff700 1 -- 172.21.15.40:0/1079914759 wait complete. 2023-06-22T10:55:13.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.355+0000 7f14993ff700 1 Processor -- start 2023-06-22T10:55:13.360 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.356+0000 7f14993ff700 1 -- start start 2023-06-22T10:55:13.361 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.356+0000 7f14993ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f14940d1b00 0x7f14940cf030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:13.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.357+0000 7f14993ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14940d2050 0x7f1494153f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:13.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.357+0000 7f14993ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f149415fe30 0x7f1494154440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:13.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.357+0000 7f14993ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1494154980 con 0x7f149415fe30 2023-06-22T10:55:13.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.357+0000 7f14993ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14941f2900 con 0x7f14940d2050 2023-06-22T10:55:13.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.357+0000 7f14993ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14941f2be0 con 0x7f14940d1b00 2023-06-22T10:55:13.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.357+0000 7f14937fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f149415fe30 0x7f1494154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:13.362 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.357+0000 7f14937fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f149415fe30 0x7f1494154440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58698/0 (socket says 172.21.15.40:58698) 2023-06-22T10:55:13.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.357+0000 7f14937fe700 1 -- 172.21.15.40:0/4093438885 learned_addr learned my addr 172.21.15.40:0/4093438885 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:55:13.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.357+0000 7f1492ffd700 1 --2- 172.21.15.40:0/4093438885 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f14940d1b00 0x7f14940cf030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:13.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.357+0000 7f14927fc700 1 --2- 172.21.15.40:0/4093438885 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14940d2050 0x7f1494153f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:13.363 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.357+0000 7f14937fe700 1 -- 172.21.15.40:0/4093438885 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f14940d1b00 msgr2=0x7f14940cf030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:13.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.357+0000 7f14937fe700 1 --2- 172.21.15.40:0/4093438885 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f14940d1b00 0x7f14940cf030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:13.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.357+0000 7f14937fe700 1 -- 172.21.15.40:0/4093438885 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14940d2050 msgr2=0x7f1494153f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:13.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.357+0000 7f14937fe700 1 --2- 172.21.15.40:0/4093438885 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14940d2050 0x7f1494153f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:13.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.357+0000 7f14937fe700 1 -- 172.21.15.40:0/4093438885 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14880094a0 con 0x7f149415fe30 2023-06-22T10:55:13.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.358+0000 7f14937fe700 1 --2- 172.21.15.40:0/4093438885 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f149415fe30 0x7f1494154440 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f148c007e60 tx=0x7f148c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:13.364 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.358+0000 7f147b7fe700 1 -- 172.21.15.40:0/4093438885 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148c00ed30 con 0x7f149415fe30 2023-06-22T10:55:13.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.358+0000 7f147b7fe700 1 -- 172.21.15.40:0/4093438885 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f148c014420 con 0x7f149415fe30 2023-06-22T10:55:13.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.358+0000 7f14993ff700 1 -- 172.21.15.40:0/4093438885 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14941f2ec0 con 0x7f149415fe30 2023-06-22T10:55:13.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.358+0000 7f147b7fe700 1 -- 172.21.15.40:0/4093438885 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148c0147d0 con 0x7f149415fe30 2023-06-22T10:55:13.365 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.358+0000 7f14993ff700 1 -- 172.21.15.40:0/4093438885 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14941f3480 con 0x7f149415fe30 2023-06-22T10:55:13.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.359+0000 7f14993ff700 1 -- 172.21.15.40:0/4093438885 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1494067580 con 0x7f149415fe30 2023-06-22T10:55:13.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.360+0000 7f147b7fe700 1 -- 172.21.15.40:0/4093438885 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f148c014930 con 0x7f149415fe30 2023-06-22T10:55:13.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.361+0000 7f147b7fe700 1 --2- 172.21.15.40:0/4093438885 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f148006ace0 0x7f148006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:13.366 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.361+0000 7f147b7fe700 1 -- 172.21.15.40:0/4093438885 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5900+0+0 (secure 0 0 0) 0x7f148c089a20 con 0x7f149415fe30 2023-06-22T10:55:13.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.361+0000 7f1492ffd700 1 --2- 172.21.15.40:0/4093438885 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f148006ace0 0x7f148006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:13.367 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.362+0000 7f1492ffd700 1 --2- 172.21.15.40:0/4093438885 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f148006ace0 0x7f148006d190 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1484005910 tx=0x7f1484009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:13.369 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.366+0000 7f147b7fe700 1 -- 172.21.15.40:0/4093438885 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f148c054c10 con 0x7f149415fe30 2023-06-22T10:55:13.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:13.572+0000 7f14993ff700 1 -- 172.21.15.40:0/4093438885 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f149406a2f0 con 0x7f149415fe30 2023-06-22T10:55:14.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.128+0000 7f147b7fe700 1 -- 172.21.15.40:0/4093438885 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v40) v1 ==== 170+0+0 (secure 0 0 0) 0x7f148c058230 con 0x7f149415fe30 2023-06-22T10:55:14.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.143+0000 7f14993ff700 1 -- 172.21.15.40:0/4093438885 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f148006ace0 msgr2=0x7f148006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:14.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.143+0000 7f14993ff700 1 --2- 172.21.15.40:0/4093438885 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f148006ace0 0x7f148006d190 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1484005910 tx=0x7f1484009040 comp rx=0 tx=0).stop 2023-06-22T10:55:14.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.143+0000 7f14993ff700 1 -- 172.21.15.40:0/4093438885 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f149415fe30 msgr2=0x7f1494154440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:14.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.143+0000 7f14993ff700 1 --2- 172.21.15.40:0/4093438885 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f149415fe30 0x7f1494154440 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f148c007e60 tx=0x7f148c00e3c0 comp rx=0 tx=0).stop 2023-06-22T10:55:14.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.145+0000 7f14993ff700 1 -- 172.21.15.40:0/4093438885 shutdown_connections 2023-06-22T10:55:14.149 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.145+0000 7f14993ff700 1 --2- 172.21.15.40:0/4093438885 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f148006ace0 0x7f148006d190 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:14.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.145+0000 7f14993ff700 1 --2- 172.21.15.40:0/4093438885 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f14940d1b00 0x7f14940cf030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:14.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.145+0000 7f14993ff700 1 --2- 172.21.15.40:0/4093438885 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f149415fe30 0x7f1494154440 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:14.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.145+0000 7f14993ff700 1 --2- 172.21.15.40:0/4093438885 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14940d2050 0x7f1494153f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:14.150 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.145+0000 7f14993ff700 1 -- 172.21.15.40:0/4093438885 >> 172.21.15.40:0/4093438885 conn(0x7f1494071660 msgr2=0x7f14940d1310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:14.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.145+0000 7f14993ff700 1 -- 172.21.15.40:0/4093438885 shutdown_connections 2023-06-22T10:55:14.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.145+0000 7f14993ff700 1 -- 172.21.15.40:0/4093438885 wait complete. 2023-06-22T10:55:14.160 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_data' created 2023-06-22T10:55:14.172 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-06-22T10:55:14.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.382+0000 7f24cd9ff700 1 Processor -- start 2023-06-22T10:55:14.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.382+0000 7f24cd9ff700 1 -- start start 2023-06-22T10:55:14.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.383+0000 7f24cd9ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f24c80b59a0 0x7f24c80b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:14.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.383+0000 7f24cd9ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24c80d1be0 con 0x7f24c80d2130 2023-06-22T10:55:14.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.383+0000 7f24cd9ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24c80d1360 con 0x7f24c80b45d0 2023-06-22T10:55:14.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.383+0000 7f24cd9ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24c80d17f0 con 0x7f24c80b59a0 2023-06-22T10:55:14.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.383+0000 7f24bffff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f24c80d2130 0x7f24c80cd1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:42166/0 (socket says 172.21.15.40:42166) 2023-06-22T10:55:14.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.383+0000 7f24bffff700 1 -- 172.21.15.40:0/1320965544 learned_addr learned my addr 172.21.15.40:0/1320965544 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:55:14.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.384+0000 7f24c77fe700 1 --2- 172.21.15.40:0/1320965544 >> v2:172.21.15.45:3300/0 conn(0x7f24c80b59a0 0x7f24c80b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:14.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.384+0000 7f24c67fc700 1 -- 172.21.15.40:0/1320965544 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 106602837 0 0) 0x7f24c80d1be0 con 0x7f24c80d2130 2023-06-22T10:55:14.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.384+0000 7f24c67fc700 1 -- 172.21.15.40:0/1320965544 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24b40035b0 con 0x7f24c80d2130 2023-06-22T10:55:14.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.384+0000 7f24c77fe700 1 -- 172.21.15.40:0/1320965544 >> v1:172.21.15.45:6789/0 conn(0x7f24c80b45d0 legacy=0x7f24c80b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:14.401 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.384+0000 7f24c67fc700 1 -- 172.21.15.40:0/1320965544 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1989309402 0 0) 0x7f24b40035b0 con 0x7f24c80d2130 2023-06-22T10:55:14.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.384+0000 7f24c77fe700 1 -- 172.21.15.40:0/1320965544 >> v1:172.21.15.40:6789/0 conn(0x7f24c80d2130 legacy=0x7f24c80cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:14.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.384+0000 7f24c77fe700 1 -- 172.21.15.40:0/1320965544 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c80cef40 con 0x7f24c80b59a0 2023-06-22T10:55:14.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.385+0000 7f24c77fe700 1 --2- 172.21.15.40:0/1320965544 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24c80b59a0 0x7f24c80b5e40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f24c0009d90 tx=0x7f24c000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31f9ef22579e7e09 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:14.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.385+0000 7f24c67fc700 1 -- 172.21.15.40:0/1320965544 <== mon.1 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c000e070 con 0x7f24c80b59a0 2023-06-22T10:55:14.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.385+0000 7f24c67fc700 1 -- 172.21.15.40:0/1320965544 <== mon.1 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24c0003a20 con 0x7f24c80b59a0 2023-06-22T10:55:14.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.385+0000 7f24c67fc700 1 -- 172.21.15.40:0/1320965544 <== mon.1 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b0001670 con 0x7f24c80b59a0 2023-06-22T10:55:14.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.385+0000 7f24cd9ff700 1 -- 172.21.15.40:0/1320965544 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24c80b59a0 msgr2=0x7f24c80b5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:14.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.385+0000 7f24cd9ff700 1 --2- 172.21.15.40:0/1320965544 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24c80b59a0 0x7f24c80b5e40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f24c0009d90 tx=0x7f24c000b330 comp rx=0 tx=0).stop 2023-06-22T10:55:14.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.385+0000 7f24cd9ff700 1 -- 172.21.15.40:0/1320965544 shutdown_connections 2023-06-22T10:55:14.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.385+0000 7f24cd9ff700 1 --2- 172.21.15.40:0/1320965544 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24c80b59a0 0x7f24c80b5e40 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:14.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.385+0000 7f24cd9ff700 1 -- 172.21.15.40:0/1320965544 >> 172.21.15.40:0/1320965544 conn(0x7f24c80cf5d0 msgr2=0x7f24c80cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:14.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.386+0000 7f24cd9ff700 1 -- 172.21.15.40:0/1320965544 shutdown_connections 2023-06-22T10:55:14.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.386+0000 7f24cd9ff700 1 -- 172.21.15.40:0/1320965544 wait complete. 2023-06-22T10:55:14.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.387+0000 7f24cd9ff700 1 Processor -- start 2023-06-22T10:55:14.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.387+0000 7f24cd9ff700 1 -- start start 2023-06-22T10:55:14.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.388+0000 7f24cd9ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24c80b45d0 0x7f24c80b11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:14.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.388+0000 7f24cd9ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f24c80b59a0 0x7f24c815c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:14.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.388+0000 7f24cd9ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f24c80d2130 0x7f24c81f5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:14.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.388+0000 7f24cd9ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c815e8d0 con 0x7f24c80d2130 2023-06-22T10:55:14.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.388+0000 7f24cd9ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c815cd60 con 0x7f24c80b45d0 2023-06-22T10:55:14.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.388+0000 7f24cd9ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24c815d040 con 0x7f24c80b59a0 2023-06-22T10:55:14.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.389+0000 7f24c77fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f24c80d2130 0x7f24c81f5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:14.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.389+0000 7f24c77fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f24c80d2130 0x7f24c81f5880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58712/0 (socket says 172.21.15.40:58712) 2023-06-22T10:55:14.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.389+0000 7f24c77fe700 1 -- 172.21.15.40:0/1989867204 learned_addr learned my addr 172.21.15.40:0/1989867204 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:55:14.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.389+0000 7f24bffff700 1 --2- 172.21.15.40:0/1989867204 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f24c80b59a0 0x7f24c815c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:14.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.389+0000 7f24c6ffd700 1 --2- 172.21.15.40:0/1989867204 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24c80b45d0 0x7f24c80b11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:14.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.389+0000 7f24c77fe700 1 -- 172.21.15.40:0/1989867204 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f24c80b59a0 msgr2=0x7f24c815c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:14.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.389+0000 7f24c77fe700 1 --2- 172.21.15.40:0/1989867204 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f24c80b59a0 0x7f24c815c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:14.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.389+0000 7f24c77fe700 1 -- 172.21.15.40:0/1989867204 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24c80b45d0 msgr2=0x7f24c80b11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:14.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.389+0000 7f24c77fe700 1 --2- 172.21.15.40:0/1989867204 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24c80b45d0 0x7f24c80b11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:14.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.389+0000 7f24c77fe700 1 -- 172.21.15.40:0/1989867204 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c0009a70 con 0x7f24c80d2130 2023-06-22T10:55:14.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.389+0000 7f24c77fe700 1 --2- 172.21.15.40:0/1989867204 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f24c80d2130 0x7f24c81f5880 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f24c000b370 tx=0x7f24c0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:14.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.390+0000 7f24c4ff9700 1 -- 172.21.15.40:0/1989867204 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c0009450 con 0x7f24c80d2130 2023-06-22T10:55:14.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.390+0000 7f24c4ff9700 1 -- 172.21.15.40:0/1989867204 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24c0004560 con 0x7f24c80d2130 2023-06-22T10:55:14.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.390+0000 7f24cd9ff700 1 -- 172.21.15.40:0/1989867204 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24c815d320 con 0x7f24c80d2130 2023-06-22T10:55:14.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.390+0000 7f24c4ff9700 1 -- 172.21.15.40:0/1989867204 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c0004910 con 0x7f24c80d2130 2023-06-22T10:55:14.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.390+0000 7f24cd9ff700 1 -- 172.21.15.40:0/1989867204 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24c81f5dc0 con 0x7f24c80d2130 2023-06-22T10:55:14.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.391+0000 7f24cd9ff700 1 -- 172.21.15.40:0/1989867204 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24c815d560 con 0x7f24c80d2130 2023-06-22T10:55:14.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.392+0000 7f24c4ff9700 1 -- 172.21.15.40:0/1989867204 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f24c0027450 con 0x7f24c80d2130 2023-06-22T10:55:14.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.393+0000 7f24c4ff9700 1 --2- 172.21.15.40:0/1989867204 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f24a806ace0 0x7f24a806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:14.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.393+0000 7f24c4ff9700 1 -- 172.21.15.40:0/1989867204 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6282+0+0 (secure 0 0 0) 0x7f24c008b3a0 con 0x7f24c80d2130 2023-06-22T10:55:14.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.393+0000 7f24c6ffd700 1 --2- 172.21.15.40:0/1989867204 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f24a806ace0 0x7f24a806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:14.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.394+0000 7f24c6ffd700 1 --2- 172.21.15.40:0/1989867204 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f24a806ace0 0x7f24a806d190 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f24b8007fd0 tx=0x7f24b8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:14.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.397+0000 7f24c4ff9700 1 -- 172.21.15.40:0/1989867204 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f24c0059df0 con 0x7f24c80d2130 2023-06-22T10:55:14.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:14.649+0000 7f24cd9ff700 1 -- 172.21.15.40:0/1989867204 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f24c81f51c0 con 0x7f24c80d2130 2023-06-22T10:55:15.132 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.128+0000 7f24c4ff9700 1 -- 172.21.15.40:0/1989867204 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f24c81f51c0 con 0x7f24c80d2130 2023-06-22T10:55:15.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.139+0000 7f24cd9ff700 1 -- 172.21.15.40:0/1989867204 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f24a806ace0 msgr2=0x7f24a806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:15.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.139+0000 7f24cd9ff700 1 --2- 172.21.15.40:0/1989867204 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f24a806ace0 0x7f24a806d190 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f24b8007fd0 tx=0x7f24b8009040 comp rx=0 tx=0).stop 2023-06-22T10:55:15.143 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.139+0000 7f24cd9ff700 1 -- 172.21.15.40:0/1989867204 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f24c80d2130 msgr2=0x7f24c81f5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:15.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.139+0000 7f24cd9ff700 1 --2- 172.21.15.40:0/1989867204 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f24c80d2130 0x7f24c81f5880 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f24c000b370 tx=0x7f24c0004ad0 comp rx=0 tx=0).stop 2023-06-22T10:55:15.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.140+0000 7f24cd9ff700 1 -- 172.21.15.40:0/1989867204 shutdown_connections 2023-06-22T10:55:15.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.140+0000 7f24cd9ff700 1 --2- 172.21.15.40:0/1989867204 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f24a806ace0 0x7f24a806d190 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:15.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.140+0000 7f24cd9ff700 1 --2- 172.21.15.40:0/1989867204 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f24c80d2130 0x7f24c81f5880 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:15.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.140+0000 7f24cd9ff700 1 --2- 172.21.15.40:0/1989867204 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24c80b45d0 0x7f24c80b11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:15.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.140+0000 7f24cd9ff700 1 --2- 172.21.15.40:0/1989867204 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f24c80b59a0 0x7f24c815c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:15.144 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.140+0000 7f24cd9ff700 1 -- 172.21.15.40:0/1989867204 >> 172.21.15.40:0/1989867204 conn(0x7f24c80cf5d0 msgr2=0x7f24c815b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:15.147 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.142+0000 7f24cd9ff700 1 -- 172.21.15.40:0/1989867204 shutdown_connections 2023-06-22T10:55:15.148 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.144+0000 7f24cd9ff700 1 -- 172.21.15.40:0/1989867204 wait complete. 2023-06-22T10:55:15.156 INFO:teuthology.orchestra.run.smithi040.stderr:new fs with metadata pool 6 and data pool 7 2023-06-22T10:55:15.180 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-22T10:55:15.384 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.381+0000 7fc35bdff700 1 Processor -- start 2023-06-22T10:55:15.385 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.381+0000 7fc35bdff700 1 -- start start 2023-06-22T10:55:15.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.382+0000 7fc35bdff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc3540b4e30 0x7fc354167410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:15.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.382+0000 7fc35bdff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3540b2130 con 0x7fc3540d2830 2023-06-22T10:55:15.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.382+0000 7fc35bdff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc354161180 con 0x7fc35415c720 2023-06-22T10:55:15.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.382+0000 7fc35bdff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc354160d60 con 0x7fc3540b4e30 2023-06-22T10:55:15.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.383+0000 7fc35939a700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc3540d2830 0x7fc3540b4720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:42176/0 (socket says 172.21.15.40:42176) 2023-06-22T10:55:15.386 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.383+0000 7fc35939a700 1 -- 172.21.15.40:0/1159508898 learned_addr learned my addr 172.21.15.40:0/1159508898 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:55:15.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.383+0000 7fc35a39c700 1 --2- 172.21.15.40:0/1159508898 >> v2:172.21.15.45:3300/0 conn(0x7fc3540b4e30 0x7fc354167410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:15.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.383+0000 7fc358b99700 1 -- 172.21.15.40:0/1159508898 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 91598120 0 0) 0x7fc3540b2130 con 0x7fc3540d2830 2023-06-22T10:55:15.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.383+0000 7fc358b99700 1 -- 172.21.15.40:0/1159508898 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3400035b0 con 0x7fc3540d2830 2023-06-22T10:55:15.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.383+0000 7fc358b99700 1 -- 172.21.15.40:0/1159508898 <== mon.1 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3960192874 0 0) 0x7fc354161180 con 0x7fc35415c720 2023-06-22T10:55:15.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.383+0000 7fc358b99700 1 -- 172.21.15.40:0/1159508898 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3540b2130 con 0x7fc35415c720 2023-06-22T10:55:15.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.383+0000 7fc35a39c700 1 -- 172.21.15.40:0/1159508898 >> v1:172.21.15.45:6789/0 conn(0x7fc35415c720 legacy=0x7fc3540b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:15.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.383+0000 7fc35a39c700 1 -- 172.21.15.40:0/1159508898 >> v1:172.21.15.40:6789/0 conn(0x7fc3540d2830 legacy=0x7fc3540b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:15.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.383+0000 7fc35a39c700 1 -- 172.21.15.40:0/1159508898 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3541603c0 con 0x7fc3540b4e30 2023-06-22T10:55:15.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.384+0000 7fc35a39c700 1 --2- 172.21.15.40:0/1159508898 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3540b4e30 0x7fc354167410 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc34c009dc0 tx=0x7fc34c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6897b3efdcef4542 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:15.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.384+0000 7fc358b99700 1 -- 172.21.15.40:0/1159508898 <== mon.1 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34c00e070 con 0x7fc3540b4e30 2023-06-22T10:55:15.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.384+0000 7fc358b99700 1 -- 172.21.15.40:0/1159508898 <== mon.1 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc34c00bae0 con 0x7fc3540b4e30 2023-06-22T10:55:15.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.384+0000 7fc358b99700 1 -- 172.21.15.40:0/1159508898 <== mon.1 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34c00be90 con 0x7fc3540b4e30 2023-06-22T10:55:15.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.385+0000 7fc35bdff700 1 -- 172.21.15.40:0/1159508898 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3540b4e30 msgr2=0x7fc354167410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:15.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.385+0000 7fc35bdff700 1 --2- 172.21.15.40:0/1159508898 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3540b4e30 0x7fc354167410 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc34c009dc0 tx=0x7fc34c00b330 comp rx=0 tx=0).stop 2023-06-22T10:55:15.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.385+0000 7fc35bdff700 1 -- 172.21.15.40:0/1159508898 shutdown_connections 2023-06-22T10:55:15.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.385+0000 7fc35bdff700 1 --2- 172.21.15.40:0/1159508898 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3540b4e30 0x7fc354167410 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:15.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.385+0000 7fc35bdff700 1 -- 172.21.15.40:0/1159508898 >> 172.21.15.40:0/1159508898 conn(0x7fc3540cf720 msgr2=0x7fc3540cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:15.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.385+0000 7fc35bdff700 1 -- 172.21.15.40:0/1159508898 shutdown_connections 2023-06-22T10:55:15.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.385+0000 7fc35bdff700 1 -- 172.21.15.40:0/1159508898 wait complete. 2023-06-22T10:55:15.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.387+0000 7fc35bdff700 1 Processor -- start 2023-06-22T10:55:15.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.387+0000 7fc35bdff700 1 -- start start 2023-06-22T10:55:15.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.389+0000 7fc35bdff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3540b4e30 0x7fc354154ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:15.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.389+0000 7fc35bdff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fc3540d2830 0x7fc3540b7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:15.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.389+0000 7fc35bdff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc35415c720 0x7fc3540b84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:15.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.389+0000 7fc35bdff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3540b1dc0 con 0x7fc3540b4e30 2023-06-22T10:55:15.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.389+0000 7fc35bdff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3540cc6d0 con 0x7fc35415c720 2023-06-22T10:55:15.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.389+0000 7fc35bdff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3540c9d70 con 0x7fc3540d2830 2023-06-22T10:55:15.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.389+0000 7fc359b9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3540b4e30 0x7fc354154ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:15.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.389+0000 7fc359b9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3540b4e30 0x7fc354154ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58720/0 (socket says 172.21.15.40:58720) 2023-06-22T10:55:15.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.389+0000 7fc359b9b700 1 -- 172.21.15.40:0/1992147547 learned_addr learned my addr 172.21.15.40:0/1992147547 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:55:15.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.389+0000 7fc35939a700 1 --2- 172.21.15.40:0/1992147547 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fc3540d2830 0x7fc3540b7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:15.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.389+0000 7fc35a39c700 1 --2- 172.21.15.40:0/1992147547 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc35415c720 0x7fc3540b84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:15.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.389+0000 7fc359b9b700 1 -- 172.21.15.40:0/1992147547 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fc3540d2830 msgr2=0x7fc3540b7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:15.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.389+0000 7fc359b9b700 1 --2- 172.21.15.40:0/1992147547 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fc3540d2830 0x7fc3540b7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:15.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.389+0000 7fc359b9b700 1 -- 172.21.15.40:0/1992147547 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc35415c720 msgr2=0x7fc3540b84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:15.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.389+0000 7fc359b9b700 1 --2- 172.21.15.40:0/1992147547 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc35415c720 0x7fc3540b84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:15.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.389+0000 7fc359b9b700 1 -- 172.21.15.40:0/1992147547 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc34c009a70 con 0x7fc3540b4e30 2023-06-22T10:55:15.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.390+0000 7fc359b9b700 1 --2- 172.21.15.40:0/1992147547 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3540b4e30 0x7fc354154ae0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fc35000c460 tx=0x7fc35000c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:15.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.390+0000 7fc34a7fc700 1 -- 172.21.15.40:0/1992147547 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3500052d0 con 0x7fc3540b4e30 2023-06-22T10:55:15.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.390+0000 7fc34a7fc700 1 -- 172.21.15.40:0/1992147547 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc350005430 con 0x7fc3540b4e30 2023-06-22T10:55:15.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.390+0000 7fc35bdff700 1 -- 172.21.15.40:0/1992147547 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3540ca050 con 0x7fc3540b4e30 2023-06-22T10:55:15.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.390+0000 7fc34a7fc700 1 -- 172.21.15.40:0/1992147547 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc350003880 con 0x7fc3540b4e30 2023-06-22T10:55:15.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.390+0000 7fc35bdff700 1 -- 172.21.15.40:0/1992147547 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3540ca610 con 0x7fc3540b4e30 2023-06-22T10:55:15.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.391+0000 7fc35bdff700 1 -- 172.21.15.40:0/1992147547 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc354067580 con 0x7fc3540b4e30 2023-06-22T10:55:15.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.392+0000 7fc34a7fc700 1 -- 172.21.15.40:0/1992147547 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc3500039e0 con 0x7fc3540b4e30 2023-06-22T10:55:15.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.393+0000 7fc34a7fc700 1 --2- 172.21.15.40:0/1992147547 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fc33806ace0 0x7fc33806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:15.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.393+0000 7fc34a7fc700 1 -- 172.21.15.40:0/1992147547 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fc350088950 con 0x7fc3540b4e30 2023-06-22T10:55:15.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.393+0000 7fc35939a700 1 --2- 172.21.15.40:0/1992147547 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fc33806ace0 0x7fc33806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:15.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.394+0000 7fc35939a700 1 --2- 172.21.15.40:0/1992147547 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fc33806ace0 0x7fc33806d190 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc354155020 tx=0x7fc344009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:15.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.397+0000 7fc34a7fc700 1 -- 172.21.15.40:0/1992147547 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc350053960 con 0x7fc3540b4e30 2023-06-22T10:55:15.609 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.606+0000 7fc35bdff700 1 -- 172.21.15.40:0/1992147547 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc3540ca7d0 con 0x7fc3540b4e30 2023-06-22T10:55:15.610 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.607+0000 7fc34a7fc700 1 -- 172.21.15.40:0/1992147547 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+18429 (secure 0 0 0) 0x7fc350056f80 con 0x7fc3540b4e30 2023-06-22T10:55:15.611 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:55:15.611 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":41,"fsid":"475560bc-1a7c-4a75-b3b6-6fc6b20bdc52","created":"2023-06-22T10:53:03.784568+0000","modified":"2023-06-22T10:55:14.651424+0000","last_up_change":"2023-06-22T10:53:17.830348+0000","last_in_change":"2023-06-22T10:53:07.329974+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-22T10:53:17.182228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-22T10:53:23.874432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-06-22T10:55:12.966650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-06-22T10:55:13.613417+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"918db6b4-053a-46ba-976d-6e1a0104017f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6809","nonce":2400162888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6811","nonce":2400162888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6815","nonce":2400162888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6813","nonce":2400162888}]},"public_addr":"172.21.15.40:6809/2400162888","cluster_addr":"172.21.15.40:6811/2400162888","heartbeat_back_addr":"172.21.15.40:6815/2400162888","heartbeat_front_addr":"172.21.15.40:6813/2400162888","state":["exists","up"]},{"osd":1,"uuid":"0c146e2b-1725-4dae-9b5c-38795943b9d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6801","nonce":230885800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6803","nonce":230885800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6807","nonce":230885800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6805","nonce":230885800}]},"public_addr":"172.21.15.40:6801/230885800","cluster_addr":"172.21.15.40:6803/230885800","heartbeat_back_addr":"172.21.15.40:6807/230885800","heartbeat_front_addr":"172.21.15.40:6805/230885800","state":["exists","up"]},{"osd":2,"uuid":"0b3727fd-f281-46d5-a675-86c8c5ab269e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6817","nonce":2681404929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6819","nonce":2681404929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6823","nonce":2681404929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6821","nonce":2681404929}]},"public_addr":"172.21.15.40:6817/2681404929","cluster_addr":"172.21.15.40:6819/2681404929","heartbeat_back_addr":"172.21.15.40:6823/2681404929","heartbeat_front_addr":"172.21.15.40:6821/2681404929","state":["exists","up"]},{"osd":3,"uuid":"2969c698-7039-4bbb-beda-f756f7a368a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6825","nonce":111110981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6827","nonce":111110981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6831","nonce":111110981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6829","nonce":111110981}]},"public_addr":"172.21.15.40:6825/111110981","cluster_addr":"172.21.15.40:6827/111110981","heartbeat_back_addr":"172.21.15.40:6831/111110981","heartbeat_front_addr":"172.21.15.40:6829/111110981","state":["exists","up"]},{"osd":4,"uuid":"3bb1d9c8-8e42-4a6b-998d-04834f34be5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6801","nonce":3625455711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6803","nonce":3625455711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6807","nonce":3625455711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6805","nonce":3625455711}]},"public_addr":"172.21.15.45:6801/3625455711","cluster_addr":"172.21.15.45:6803/3625455711","heartbeat_back_addr":"172.21.15.45:6807/3625455711","heartbeat_front_addr":"172.21.15.45:6805/3625455711","state":["exists","up"]},{"osd":5,"uuid":"f9854ee4-302c-41be-977b-bedda090a3d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6817","nonce":3354411217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6819","nonce":3354411217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6823","nonce":3354411217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6821","nonce":3354411217}]},"public_addr":"172.21.15.45:6817/3354411217","cluster_addr":"172.21.15.45:6819/3354411217","heartbeat_back_addr":"172.21.15.45:6823/3354411217","heartbeat_front_addr":"172.21.15.45:6821/3354411217","state":["exists","up"]},{"osd":6,"uuid":"bbdb1989-f6ac-4954-9b85-b8b540d683c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6809","nonce":320111074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6811","nonce":320111074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6815","nonce":320111074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6813","nonce":320111074}]},"public_addr":"172.21.15.45:6809/320111074","cluster_addr":"172.21.15.45:6811/320111074","heartbeat_back_addr":"172.21.15.45:6815/320111074","heartbeat_front_addr":"172.21.15.45:6813/320111074","state":["exists","up"]},{"osd":7,"uuid":"823d44e3-58f1-4d1d-8263-a4e4a69d4327","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6825","nonce":643617680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6827","nonce":643617680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6831","nonce":643617680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6829","nonce":643617680}]},"public_addr":"172.21.15.45:6825/643617680","cluster_addr":"172.21.15.45:6827/643617680","heartbeat_back_addr":"172.21.15.45:6831/643617680","heartbeat_front_addr":"172.21.15.45:6829/643617680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.731262+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.873226+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.898936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.666578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.645990+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.953699+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.642823+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.693395+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-22T10:55:15.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.609+0000 7fc35bdff700 1 -- 172.21.15.40:0/1992147547 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fc33806ace0 msgr2=0x7fc33806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:15.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.609+0000 7fc35bdff700 1 --2- 172.21.15.40:0/1992147547 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fc33806ace0 0x7fc33806d190 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc354155020 tx=0x7fc344009040 comp rx=0 tx=0).stop 2023-06-22T10:55:15.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.609+0000 7fc35bdff700 1 -- 172.21.15.40:0/1992147547 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3540b4e30 msgr2=0x7fc354154ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:15.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.609+0000 7fc35bdff700 1 --2- 172.21.15.40:0/1992147547 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3540b4e30 0x7fc354154ae0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fc35000c460 tx=0x7fc35000c820 comp rx=0 tx=0).stop 2023-06-22T10:55:15.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.610+0000 7fc35bdff700 1 -- 172.21.15.40:0/1992147547 shutdown_connections 2023-06-22T10:55:15.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.610+0000 7fc35bdff700 1 --2- 172.21.15.40:0/1992147547 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fc33806ace0 0x7fc33806d190 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:15.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.610+0000 7fc35bdff700 1 --2- 172.21.15.40:0/1992147547 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc35415c720 0x7fc3540b84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:15.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.610+0000 7fc35bdff700 1 --2- 172.21.15.40:0/1992147547 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3540b4e30 0x7fc354154ae0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:15.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.610+0000 7fc35bdff700 1 --2- 172.21.15.40:0/1992147547 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fc3540d2830 0x7fc3540b7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:15.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.610+0000 7fc35bdff700 1 -- 172.21.15.40:0/1992147547 >> 172.21.15.40:0/1992147547 conn(0x7fc3540cf720 msgr2=0x7fc35406b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:15.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.610+0000 7fc35bdff700 1 -- 172.21.15.40:0/1992147547 shutdown_connections 2023-06-22T10:55:15.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.610+0000 7fc35bdff700 1 -- 172.21.15.40:0/1992147547 wait complete. 2023-06-22T10:55:15.631 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-22T10:55:15.831 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.828+0000 7f85ec7ff700 1 Processor -- start 2023-06-22T10:55:15.832 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.828+0000 7f85ec7ff700 1 -- start start 2023-06-22T10:55:15.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.829+0000 7f85ec7ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f85e40cd3b0 0x7f85e4160a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:15.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.829+0000 7f85ec7ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85e415ce60 con 0x7f85e40cd780 2023-06-22T10:55:15.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.829+0000 7f85ec7ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85e40ce6a0 con 0x7f85e415d2f0 2023-06-22T10:55:15.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.829+0000 7f85ec7ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e40ce940 con 0x7f85e40cd3b0 2023-06-22T10:55:15.833 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.830+0000 7f85e9d9a700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f85e40cd780 0x7f85e40d0210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:42180/0 (socket says 172.21.15.40:42180) 2023-06-22T10:55:15.834 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.830+0000 7f85e9d9a700 1 -- 172.21.15.40:0/3785429778 learned_addr learned my addr 172.21.15.40:0/3785429778 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:55:15.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.830+0000 7f85ea59b700 1 --2- 172.21.15.40:0/3785429778 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f85e40cd3b0 0x7f85e4160a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:15.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.830+0000 7f85e9599700 1 -- 172.21.15.40:0/3785429778 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2895015118 0 0) 0x7f85e415ce60 con 0x7f85e40cd780 2023-06-22T10:55:15.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.830+0000 7f85e9599700 1 -- 172.21.15.40:0/3785429778 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85d00035b0 con 0x7f85e40cd780 2023-06-22T10:55:15.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.830+0000 7f85e9599700 1 -- 172.21.15.40:0/3785429778 <== mon.1 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1585456061 0 0) 0x7f85e40ce6a0 con 0x7f85e415d2f0 2023-06-22T10:55:15.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.830+0000 7f85e9599700 1 -- 172.21.15.40:0/3785429778 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85e415ce60 con 0x7f85e415d2f0 2023-06-22T10:55:15.835 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.830+0000 7f85ea59b700 1 -- 172.21.15.40:0/3785429778 >> v1:172.21.15.45:6789/0 conn(0x7f85e415d2f0 legacy=0x7f85e415ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:15.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.830+0000 7f85e9599700 1 -- 172.21.15.40:0/3785429778 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1769470239 0 0) 0x7f85d00035b0 con 0x7f85e40cd780 2023-06-22T10:55:15.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.830+0000 7f85ea59b700 1 -- 172.21.15.40:0/3785429778 >> v1:172.21.15.40:6789/0 conn(0x7f85e40cd780 legacy=0x7f85e40d0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:15.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.830+0000 7f85ea59b700 1 -- 172.21.15.40:0/3785429778 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e415caf0 con 0x7f85e40cd3b0 2023-06-22T10:55:15.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.831+0000 7f85ea59b700 1 --2- 172.21.15.40:0/3785429778 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f85e40cd3b0 0x7f85e4160a70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f85e0009850 tx=0x7f85e0009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=484ae8e5bad61397 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:15.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.831+0000 7f85e9599700 1 -- 172.21.15.40:0/3785429778 <== mon.2 v2:172.21.15.45:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d4001670 con 0x7f85e40cd3b0 2023-06-22T10:55:15.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.831+0000 7f85e9599700 1 -- 172.21.15.40:0/3785429778 <== mon.2 v2:172.21.15.45:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e0005c30 con 0x7f85e40cd3b0 2023-06-22T10:55:15.836 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.831+0000 7f85e9599700 1 -- 172.21.15.40:0/3785429778 <== mon.2 v2:172.21.15.45:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e0004030 con 0x7f85e40cd3b0 2023-06-22T10:55:15.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.832+0000 7f85ec7ff700 1 -- 172.21.15.40:0/3785429778 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f85e40cd3b0 msgr2=0x7f85e4160a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:15.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.832+0000 7f85ec7ff700 1 --2- 172.21.15.40:0/3785429778 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f85e40cd3b0 0x7f85e4160a70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f85e0009850 tx=0x7f85e0009b60 comp rx=0 tx=0).stop 2023-06-22T10:55:15.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.832+0000 7f85ec7ff700 1 -- 172.21.15.40:0/3785429778 shutdown_connections 2023-06-22T10:55:15.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.832+0000 7f85ec7ff700 1 --2- 172.21.15.40:0/3785429778 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f85e40cd3b0 0x7f85e4160a70 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:15.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.832+0000 7f85ec7ff700 1 -- 172.21.15.40:0/3785429778 >> 172.21.15.40:0/3785429778 conn(0x7f85e406e630 msgr2=0x7f85e406ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:15.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.832+0000 7f85ec7ff700 1 -- 172.21.15.40:0/3785429778 shutdown_connections 2023-06-22T10:55:15.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.832+0000 7f85ec7ff700 1 -- 172.21.15.40:0/3785429778 wait complete. 2023-06-22T10:55:15.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.834+0000 7f85ec7ff700 1 Processor -- start 2023-06-22T10:55:15.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.834+0000 7f85ec7ff700 1 -- start start 2023-06-22T10:55:15.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.835+0000 7f85ec7ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85e40cd3b0 0x7f85e4148970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:15.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.835+0000 7f85ec7ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85e40cd780 0x7f85e4153f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:15.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.835+0000 7f85ec7ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f85e415d2f0 0x7f85e41544a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:15.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.835+0000 7f85ec7ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e414c4f0 con 0x7f85e40cd3b0 2023-06-22T10:55:15.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.835+0000 7f85ec7ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e4148eb0 con 0x7f85e40cd780 2023-06-22T10:55:15.840 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.835+0000 7f85ec7ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e4149fd0 con 0x7f85e415d2f0 2023-06-22T10:55:15.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.835+0000 7f85ea59b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85e40cd3b0 0x7f85e4148970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:15.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.835+0000 7f85ea59b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85e40cd3b0 0x7f85e4148970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58734/0 (socket says 172.21.15.40:58734) 2023-06-22T10:55:15.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.835+0000 7f85ea59b700 1 -- 172.21.15.40:0/2163633864 learned_addr learned my addr 172.21.15.40:0/2163633864 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:55:15.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.835+0000 7f85e9d9a700 1 --2- 172.21.15.40:0/2163633864 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85e40cd780 0x7f85e4153f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:15.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.835+0000 7f85ead9c700 1 --2- 172.21.15.40:0/2163633864 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f85e415d2f0 0x7f85e41544a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:15.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.836+0000 7f85ea59b700 1 -- 172.21.15.40:0/2163633864 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f85e415d2f0 msgr2=0x7f85e41544a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:15.841 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.836+0000 7f85ea59b700 1 --2- 172.21.15.40:0/2163633864 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f85e415d2f0 0x7f85e41544a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:15.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.836+0000 7f85ea59b700 1 -- 172.21.15.40:0/2163633864 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85e40cd780 msgr2=0x7f85e4153f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:15.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.836+0000 7f85ea59b700 1 --2- 172.21.15.40:0/2163633864 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85e40cd780 0x7f85e4153f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:15.842 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.836+0000 7f85ea59b700 1 -- 172.21.15.40:0/2163633864 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e0009430 con 0x7f85e40cd3b0 2023-06-22T10:55:15.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.836+0000 7f85ea59b700 1 --2- 172.21.15.40:0/2163633864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85e40cd3b0 0x7f85e4148970 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f85e40b3590 tx=0x7f85e0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:15.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.836+0000 7f85daffd700 1 -- 172.21.15.40:0/2163633864 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e0003ab0 con 0x7f85e40cd3b0 2023-06-22T10:55:15.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.836+0000 7f85daffd700 1 -- 172.21.15.40:0/2163633864 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e0003c10 con 0x7f85e40cd3b0 2023-06-22T10:55:15.843 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.836+0000 7f85daffd700 1 -- 172.21.15.40:0/2163633864 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e001d430 con 0x7f85e40cd3b0 2023-06-22T10:55:15.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.836+0000 7f85ec7ff700 1 -- 172.21.15.40:0/2163633864 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85e40b66d0 con 0x7f85e40cd3b0 2023-06-22T10:55:15.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.836+0000 7f85ec7ff700 1 -- 172.21.15.40:0/2163633864 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85e4149980 con 0x7f85e40cd3b0 2023-06-22T10:55:15.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.837+0000 7f85ec7ff700 1 -- 172.21.15.40:0/2163633864 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85e40cdbb0 con 0x7f85e40cd3b0 2023-06-22T10:55:15.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.838+0000 7f85daffd700 1 -- 172.21.15.40:0/2163633864 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f85e001d590 con 0x7f85e40cd3b0 2023-06-22T10:55:15.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.839+0000 7f85daffd700 1 --2- 172.21.15.40:0/2163633864 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f85c806ace0 0x7f85c806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:15.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.839+0000 7f85daffd700 1 -- 172.21.15.40:0/2163633864 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f85e008a790 con 0x7f85e40cd3b0 2023-06-22T10:55:15.844 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.840+0000 7f85e9d9a700 1 --2- 172.21.15.40:0/2163633864 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f85c806ace0 0x7f85c806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:15.845 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.840+0000 7f85e9d9a700 1 --2- 172.21.15.40:0/2163633864 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f85c806ace0 0x7f85c806d190 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f85e4151cd0 tx=0x7f85d4000f10 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:15.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:15.844+0000 7f85daffd700 1 -- 172.21.15.40:0/2163633864 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f85e00556f0 con 0x7f85e40cd3b0 2023-06-22T10:55:16.054 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.051+0000 7f85ec7ff700 1 -- 172.21.15.40:0/2163633864 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85e4067580 con 0x7f85e40cd3b0 2023-06-22T10:55:16.055 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.052+0000 7f85daffd700 1 -- 172.21.15.40:0/2163633864 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+18429 (secure 0 0 0) 0x7f85e0058d10 con 0x7f85e40cd3b0 2023-06-22T10:55:16.056 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:55:16.056 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":41,"fsid":"475560bc-1a7c-4a75-b3b6-6fc6b20bdc52","created":"2023-06-22T10:53:03.784568+0000","modified":"2023-06-22T10:55:14.651424+0000","last_up_change":"2023-06-22T10:53:17.830348+0000","last_in_change":"2023-06-22T10:53:07.329974+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-22T10:53:17.182228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-22T10:53:23.874432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-06-22T10:55:12.966650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-06-22T10:55:13.613417+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"918db6b4-053a-46ba-976d-6e1a0104017f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6809","nonce":2400162888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6811","nonce":2400162888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6815","nonce":2400162888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6813","nonce":2400162888}]},"public_addr":"172.21.15.40:6809/2400162888","cluster_addr":"172.21.15.40:6811/2400162888","heartbeat_back_addr":"172.21.15.40:6815/2400162888","heartbeat_front_addr":"172.21.15.40:6813/2400162888","state":["exists","up"]},{"osd":1,"uuid":"0c146e2b-1725-4dae-9b5c-38795943b9d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6801","nonce":230885800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6803","nonce":230885800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6807","nonce":230885800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6805","nonce":230885800}]},"public_addr":"172.21.15.40:6801/230885800","cluster_addr":"172.21.15.40:6803/230885800","heartbeat_back_addr":"172.21.15.40:6807/230885800","heartbeat_front_addr":"172.21.15.40:6805/230885800","state":["exists","up"]},{"osd":2,"uuid":"0b3727fd-f281-46d5-a675-86c8c5ab269e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6817","nonce":2681404929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6819","nonce":2681404929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6823","nonce":2681404929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6821","nonce":2681404929}]},"public_addr":"172.21.15.40:6817/2681404929","cluster_addr":"172.21.15.40:6819/2681404929","heartbeat_back_addr":"172.21.15.40:6823/2681404929","heartbeat_front_addr":"172.21.15.40:6821/2681404929","state":["exists","up"]},{"osd":3,"uuid":"2969c698-7039-4bbb-beda-f756f7a368a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6825","nonce":111110981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6827","nonce":111110981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6831","nonce":111110981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6829","nonce":111110981}]},"public_addr":"172.21.15.40:6825/111110981","cluster_addr":"172.21.15.40:6827/111110981","heartbeat_back_addr":"172.21.15.40:6831/111110981","heartbeat_front_addr":"172.21.15.40:6829/111110981","state":["exists","up"]},{"osd":4,"uuid":"3bb1d9c8-8e42-4a6b-998d-04834f34be5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6801","nonce":3625455711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6803","nonce":3625455711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6807","nonce":3625455711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6805","nonce":3625455711}]},"public_addr":"172.21.15.45:6801/3625455711","cluster_addr":"172.21.15.45:6803/3625455711","heartbeat_back_addr":"172.21.15.45:6807/3625455711","heartbeat_front_addr":"172.21.15.45:6805/3625455711","state":["exists","up"]},{"osd":5,"uuid":"f9854ee4-302c-41be-977b-bedda090a3d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6817","nonce":3354411217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6819","nonce":3354411217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6823","nonce":3354411217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6821","nonce":3354411217}]},"public_addr":"172.21.15.45:6817/3354411217","cluster_addr":"172.21.15.45:6819/3354411217","heartbeat_back_addr":"172.21.15.45:6823/3354411217","heartbeat_front_addr":"172.21.15.45:6821/3354411217","state":["exists","up"]},{"osd":6,"uuid":"bbdb1989-f6ac-4954-9b85-b8b540d683c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6809","nonce":320111074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6811","nonce":320111074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6815","nonce":320111074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6813","nonce":320111074}]},"public_addr":"172.21.15.45:6809/320111074","cluster_addr":"172.21.15.45:6811/320111074","heartbeat_back_addr":"172.21.15.45:6815/320111074","heartbeat_front_addr":"172.21.15.45:6813/320111074","state":["exists","up"]},{"osd":7,"uuid":"823d44e3-58f1-4d1d-8263-a4e4a69d4327","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6825","nonce":643617680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6827","nonce":643617680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6831","nonce":643617680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6829","nonce":643617680}]},"public_addr":"172.21.15.45:6825/643617680","cluster_addr":"172.21.15.45:6827/643617680","heartbeat_back_addr":"172.21.15.45:6831/643617680","heartbeat_front_addr":"172.21.15.45:6829/643617680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.731262+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.873226+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.898936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.666578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.645990+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.953699+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.642823+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.693395+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-22T10:55:16.058 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.055+0000 7f85ec7ff700 1 -- 172.21.15.40:0/2163633864 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f85c806ace0 msgr2=0x7f85c806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:16.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.055+0000 7f85ec7ff700 1 --2- 172.21.15.40:0/2163633864 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f85c806ace0 0x7f85c806d190 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f85e4151cd0 tx=0x7f85d4000f10 comp rx=0 tx=0).stop 2023-06-22T10:55:16.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.055+0000 7f85ec7ff700 1 -- 172.21.15.40:0/2163633864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85e40cd3b0 msgr2=0x7f85e4148970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:16.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.055+0000 7f85ec7ff700 1 --2- 172.21.15.40:0/2163633864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85e40cd3b0 0x7f85e4148970 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f85e40b3590 tx=0x7f85e0004750 comp rx=0 tx=0).stop 2023-06-22T10:55:16.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.055+0000 7f85ec7ff700 1 -- 172.21.15.40:0/2163633864 shutdown_connections 2023-06-22T10:55:16.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.055+0000 7f85ec7ff700 1 --2- 172.21.15.40:0/2163633864 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f85c806ace0 0x7f85c806d190 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:16.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.055+0000 7f85ec7ff700 1 --2- 172.21.15.40:0/2163633864 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f85e415d2f0 0x7f85e41544a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:16.059 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.055+0000 7f85ec7ff700 1 --2- 172.21.15.40:0/2163633864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85e40cd3b0 0x7f85e4148970 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:16.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.055+0000 7f85ec7ff700 1 --2- 172.21.15.40:0/2163633864 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85e40cd780 0x7f85e4153f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:16.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.055+0000 7f85ec7ff700 1 -- 172.21.15.40:0/2163633864 >> 172.21.15.40:0/2163633864 conn(0x7f85e406e630 msgr2=0x7f85e40cafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:16.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.055+0000 7f85ec7ff700 1 -- 172.21.15.40:0/2163633864 shutdown_connections 2023-06-22T10:55:16.060 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.055+0000 7f85ec7ff700 1 -- 172.21.15.40:0/2163633864 wait complete. 2023-06-22T10:55:16.076 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-06-22T10:55:16.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.280+0000 7f271f1ff700 1 Processor -- start 2023-06-22T10:55:16.284 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.281+0000 7f271f1ff700 1 -- start start 2023-06-22T10:55:16.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.282+0000 7f271f1ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f27180c8df0 0x7f27180703b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:16.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.282+0000 7f271f1ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f27180708f0 0x7f27180cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:16.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.283+0000 7f271f1ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27180cf460 con 0x7f2718153730 2023-06-22T10:55:16.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.283+0000 7f271f1ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27180c5000 con 0x7f27180708f0 2023-06-22T10:55:16.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.283+0000 7f271f1ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2718070d60 con 0x7f27180c8df0 2023-06-22T10:55:16.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.283+0000 7f271d79c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f27180708f0 0x7f27180cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:16.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.283+0000 7f2717fff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f27180c8df0 0x7f27180703b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:16.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.283+0000 7f2717fff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f27180c8df0 0x7f27180703b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3301/0 says I am v2:172.21.15.40:48398/0 (socket says 172.21.15.40:48398) 2023-06-22T10:55:16.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.283+0000 7f271d79c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f27180708f0 0x7f27180cd740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.40:53174/0 (socket says 172.21.15.40:53174) 2023-06-22T10:55:16.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.283+0000 7f2717fff700 1 -- 172.21.15.40:0/3381147612 learned_addr learned my addr 172.21.15.40:0/3381147612 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:55:16.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.284+0000 7f271d79c700 1 -- 172.21.15.40:0/3381147612 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f27180c8df0 msgr2=0x7f27180703b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:55:16.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.284+0000 7f271d79c700 1 --2- 172.21.15.40:0/3381147612 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f27180c8df0 0x7f27180703b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:16.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.284+0000 7f271d79c700 1 -- 172.21.15.40:0/3381147612 >> v1:172.21.15.45:6789/0 conn(0x7f2718153730 legacy=0x7f27180c3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:16.288 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.284+0000 7f271d79c700 1 -- 172.21.15.40:0/3381147612 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27180ccfa0 con 0x7f27180708f0 2023-06-22T10:55:16.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.284+0000 7f2717fff700 1 --2- 172.21.15.40:0/3381147612 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f27180c8df0 0x7f27180703b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-22T10:55:16.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.284+0000 7f271d79c700 1 --2- 172.21.15.40:0/3381147612 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27180708f0 0x7f27180cd740 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2710009dc0 tx=0x7f271000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e854aca0fcd409fd server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:16.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.284+0000 7f27177fe700 1 -- 172.21.15.40:0/3381147612 <== mon.1 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271000e070 con 0x7f27180708f0 2023-06-22T10:55:16.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.285+0000 7f27177fe700 1 -- 172.21.15.40:0/3381147612 <== mon.1 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f271000bae0 con 0x7f27180708f0 2023-06-22T10:55:16.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.285+0000 7f27177fe700 1 -- 172.21.15.40:0/3381147612 <== mon.1 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271000be90 con 0x7f27180708f0 2023-06-22T10:55:16.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.285+0000 7f271f1ff700 1 -- 172.21.15.40:0/3381147612 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27180708f0 msgr2=0x7f27180cd740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:16.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.285+0000 7f271f1ff700 1 --2- 172.21.15.40:0/3381147612 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27180708f0 0x7f27180cd740 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2710009dc0 tx=0x7f271000b330 comp rx=0 tx=0).stop 2023-06-22T10:55:16.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.285+0000 7f271f1ff700 1 -- 172.21.15.40:0/3381147612 shutdown_connections 2023-06-22T10:55:16.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.285+0000 7f271f1ff700 1 --2- 172.21.15.40:0/3381147612 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f27180708f0 0x7f27180cd740 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:16.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.285+0000 7f271f1ff700 1 --2- 172.21.15.40:0/3381147612 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f27180c8df0 0x7f27180703b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:16.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.285+0000 7f271f1ff700 1 -- 172.21.15.40:0/3381147612 >> 172.21.15.40:0/3381147612 conn(0x7f27180b1030 msgr2=0x7f27180ce7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:16.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.285+0000 7f271f1ff700 1 -- 172.21.15.40:0/3381147612 shutdown_connections 2023-06-22T10:55:16.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.285+0000 7f271f1ff700 1 -- 172.21.15.40:0/3381147612 wait complete. 2023-06-22T10:55:16.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.288+0000 7f271f1ff700 1 Processor -- start 2023-06-22T10:55:16.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.288+0000 7f271f1ff700 1 -- start start 2023-06-22T10:55:16.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.289+0000 7f271f1ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27180708f0 0x7f2718143310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:16.293 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.289+0000 7f271f1ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f27180c8df0 0x7f2718151600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:16.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.289+0000 7f271f1ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2718153730 0x7f27180af780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:16.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.289+0000 7f271f1ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2718151170 con 0x7f27180708f0 2023-06-22T10:55:16.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.289+0000 7f271f1ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2718150280 con 0x7f2718153730 2023-06-22T10:55:16.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.289+0000 7f271f1ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2718150560 con 0x7f27180c8df0 2023-06-22T10:55:16.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.290+0000 7f271cf9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27180708f0 0x7f2718143310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:16.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.290+0000 7f271cf9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27180708f0 0x7f2718143310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58748/0 (socket says 172.21.15.40:58748) 2023-06-22T10:55:16.294 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.290+0000 7f271cf9b700 1 -- 172.21.15.40:0/1046707652 learned_addr learned my addr 172.21.15.40:0/1046707652 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:55:16.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.290+0000 7f2717fff700 1 --2- 172.21.15.40:0/1046707652 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f27180c8df0 0x7f2718151600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:16.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.290+0000 7f271d79c700 1 --2- 172.21.15.40:0/1046707652 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2718153730 0x7f27180af780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:16.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.290+0000 7f271cf9b700 1 -- 172.21.15.40:0/1046707652 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f27180c8df0 msgr2=0x7f2718151600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:16.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.290+0000 7f271cf9b700 1 --2- 172.21.15.40:0/1046707652 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f27180c8df0 0x7f2718151600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:16.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.290+0000 7f271cf9b700 1 -- 172.21.15.40:0/1046707652 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2718153730 msgr2=0x7f27180af780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:16.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.290+0000 7f271cf9b700 1 --2- 172.21.15.40:0/1046707652 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2718153730 0x7f27180af780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:16.295 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.290+0000 7f271cf9b700 1 -- 172.21.15.40:0/1046707652 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2704009550 con 0x7f27180708f0 2023-06-22T10:55:16.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.290+0000 7f271cf9b700 1 --2- 172.21.15.40:0/1046707652 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27180708f0 0x7f2718143310 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f270c00c450 tx=0x7f270c00c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:16.296 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.291+0000 7f27157fa700 1 -- 172.21.15.40:0/1046707652 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270c0052d0 con 0x7f27180708f0 2023-06-22T10:55:16.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.291+0000 7f27157fa700 1 -- 172.21.15.40:0/1046707652 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f270c005430 con 0x7f27180708f0 2023-06-22T10:55:16.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.291+0000 7f27157fa700 1 -- 172.21.15.40:0/1046707652 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270c0038c0 con 0x7f27180708f0 2023-06-22T10:55:16.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.291+0000 7f271f1ff700 1 -- 172.21.15.40:0/1046707652 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2710009a70 con 0x7f27180708f0 2023-06-22T10:55:16.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.291+0000 7f271f1ff700 1 -- 172.21.15.40:0/1046707652 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2718150b20 con 0x7f27180708f0 2023-06-22T10:55:16.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.292+0000 7f271f1ff700 1 -- 172.21.15.40:0/1046707652 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2718067580 con 0x7f27180708f0 2023-06-22T10:55:16.297 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.293+0000 7f27157fa700 1 -- 172.21.15.40:0/1046707652 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f270c003a20 con 0x7f27180708f0 2023-06-22T10:55:16.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.295+0000 7f27157fa700 1 --2- 172.21.15.40:0/1046707652 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f26fc06ace0 0x7f26fc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:16.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.295+0000 7f27157fa700 1 -- 172.21.15.40:0/1046707652 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f270c088980 con 0x7f27180708f0 2023-06-22T10:55:16.298 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.295+0000 7f2717fff700 1 --2- 172.21.15.40:0/1046707652 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f26fc06ace0 0x7f26fc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:16.299 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.296+0000 7f2717fff700 1 --2- 172.21.15.40:0/1046707652 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f26fc06ace0 0x7f26fc06d190 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f271814eab0 tx=0x7f27040092c0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:16.302 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.299+0000 7f27157fa700 1 -- 172.21.15.40:0/1046707652 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f270c053850 con 0x7f27180708f0 2023-06-22T10:55:16.552 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:16.549+0000 7f271f1ff700 1 -- 172.21.15.40:0/1046707652 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f27180cc0d0 con 0x7f27180708f0 2023-06-22T10:55:17.154 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.151+0000 7f27157fa700 1 -- 172.21.15.40:0/1046707652 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) v1 ==== 118+0+0 (secure 0 0 0) 0x7f270c00ce60 con 0x7f27180708f0 2023-06-22T10:55:17.157 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.154+0000 7f271f1ff700 1 -- 172.21.15.40:0/1046707652 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f26fc06ace0 msgr2=0x7f26fc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:17.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.154+0000 7f271f1ff700 1 --2- 172.21.15.40:0/1046707652 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f26fc06ace0 0x7f26fc06d190 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f271814eab0 tx=0x7f27040092c0 comp rx=0 tx=0).stop 2023-06-22T10:55:17.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.154+0000 7f271f1ff700 1 -- 172.21.15.40:0/1046707652 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27180708f0 msgr2=0x7f2718143310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:17.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.154+0000 7f271f1ff700 1 --2- 172.21.15.40:0/1046707652 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27180708f0 0x7f2718143310 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f270c00c450 tx=0x7f270c00c760 comp rx=0 tx=0).stop 2023-06-22T10:55:17.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.154+0000 7f271f1ff700 1 -- 172.21.15.40:0/1046707652 shutdown_connections 2023-06-22T10:55:17.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.154+0000 7f271f1ff700 1 --2- 172.21.15.40:0/1046707652 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f26fc06ace0 0x7f26fc06d190 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:17.158 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.154+0000 7f271f1ff700 1 --2- 172.21.15.40:0/1046707652 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2718153730 0x7f27180af780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:17.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.154+0000 7f271f1ff700 1 --2- 172.21.15.40:0/1046707652 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f27180708f0 0x7f2718143310 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:17.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.154+0000 7f271f1ff700 1 --2- 172.21.15.40:0/1046707652 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f27180c8df0 0x7f2718151600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:17.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.154+0000 7f271f1ff700 1 -- 172.21.15.40:0/1046707652 >> 172.21.15.40:0/1046707652 conn(0x7f27180b1030 msgr2=0x7f27180ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:17.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.154+0000 7f271f1ff700 1 -- 172.21.15.40:0/1046707652 shutdown_connections 2023-06-22T10:55:17.159 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.154+0000 7f271f1ff700 1 -- 172.21.15.40:0/1046707652 wait complete. 2023-06-22T10:55:17.178 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-06-22T10:55:17.179 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-06-22T10:55:17.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.384+0000 7f52703ff700 1 Processor -- start 2023-06-22T10:55:17.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.384+0000 7f52703ff700 1 -- start start 2023-06-22T10:55:17.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.386+0000 7f52703ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f52680b45d0 0x7f52680b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:17.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.386+0000 7f52703ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f52680d2130 0x7f52680cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:17.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.386+0000 7f52703ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52680d1be0 con 0x7f52680cd6e0 2023-06-22T10:55:17.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.386+0000 7f52703ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52680d17f0 con 0x7f52680d2130 2023-06-22T10:55:17.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.386+0000 7f52703ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52680d1360 con 0x7f52680b45d0 2023-06-22T10:55:17.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.386+0000 7f526e99c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f52680cd6e0 0x7f52680b59a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:42188/0 (socket says 172.21.15.40:42188) 2023-06-22T10:55:17.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.386+0000 7f526e99c700 1 -- 172.21.15.40:0/477556408 learned_addr learned my addr 172.21.15.40:0/477556408 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:55:17.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.386+0000 7f526e19b700 1 --2- 172.21.15.40:0/477556408 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f52680b45d0 0x7f52680b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:17.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.386+0000 7f526d99a700 1 --2- 172.21.15.40:0/477556408 >> v2:172.21.15.45:3300/0 conn(0x7f52680d2130 0x7f52680cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:17.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.386+0000 7f526d199700 1 -- 172.21.15.40:0/477556408 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1105907757 0 0) 0x7f52680d1be0 con 0x7f52680cd6e0 2023-06-22T10:55:17.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.387+0000 7f526d199700 1 -- 172.21.15.40:0/477556408 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52540035b0 con 0x7f52680cd6e0 2023-06-22T10:55:17.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.387+0000 7f526e19b700 1 -- 172.21.15.40:0/477556408 >> v2:172.21.15.45:3300/0 conn(0x7f52680d2130 msgr2=0x7f52680cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:55:17.395 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.387+0000 7f526e19b700 1 --2- 172.21.15.40:0/477556408 >> v2:172.21.15.45:3300/0 conn(0x7f52680d2130 0x7f52680cd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:17.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.387+0000 7f526e19b700 1 -- 172.21.15.40:0/477556408 >> v1:172.21.15.40:6789/0 conn(0x7f52680cd6e0 legacy=0x7f52680b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:17.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.387+0000 7f526e19b700 1 -- 172.21.15.40:0/477556408 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52680b4ee0 con 0x7f52680b45d0 2023-06-22T10:55:17.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.387+0000 7f526d99a700 1 --2- 172.21.15.40:0/477556408 >> v2:172.21.15.45:3300/0 conn(0x7f52680d2130 0x7f52680cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-22T10:55:17.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.387+0000 7f526e19b700 1 --2- 172.21.15.40:0/477556408 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f52680b45d0 0x7f52680b49a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5264009840 tx=0x7f5264009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5ab49714a1b68e9 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:17.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.387+0000 7f526d199700 1 -- 172.21.15.40:0/477556408 <== mon.2 v2:172.21.15.45:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5264011830 con 0x7f52680b45d0 2023-06-22T10:55:17.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.387+0000 7f526d199700 1 -- 172.21.15.40:0/477556408 <== mon.2 v2:172.21.15.45:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5264011990 con 0x7f52680b45d0 2023-06-22T10:55:17.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.387+0000 7f526d199700 1 -- 172.21.15.40:0/477556408 <== mon.2 v2:172.21.15.45:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5264011d20 con 0x7f52680b45d0 2023-06-22T10:55:17.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.388+0000 7f52703ff700 1 -- 172.21.15.40:0/477556408 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f52680b45d0 msgr2=0x7f52680b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:17.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.388+0000 7f52703ff700 1 --2- 172.21.15.40:0/477556408 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f52680b45d0 0x7f52680b49a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5264009840 tx=0x7f5264009b50 comp rx=0 tx=0).stop 2023-06-22T10:55:17.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.388+0000 7f52703ff700 1 -- 172.21.15.40:0/477556408 shutdown_connections 2023-06-22T10:55:17.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.388+0000 7f52703ff700 1 --2- 172.21.15.40:0/477556408 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f52680b45d0 0x7f52680b49a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:17.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.388+0000 7f52703ff700 1 --2- 172.21.15.40:0/477556408 >> v2:172.21.15.45:3300/0 conn(0x7f52680d2130 0x7f52680cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:17.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.388+0000 7f52703ff700 1 -- 172.21.15.40:0/477556408 >> 172.21.15.40:0/477556408 conn(0x7f52680cf5d0 msgr2=0x7f52680cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:17.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.388+0000 7f52703ff700 1 -- 172.21.15.40:0/477556408 shutdown_connections 2023-06-22T10:55:17.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.388+0000 7f52703ff700 1 -- 172.21.15.40:0/477556408 wait complete. 2023-06-22T10:55:17.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.391+0000 7f52703ff700 1 Processor -- start 2023-06-22T10:55:17.403 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.391+0000 7f52703ff700 1 -- start start 2023-06-22T10:55:17.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.392+0000 7f52703ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f52680b45d0 0x7f52680c9f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:17.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.392+0000 7f52703ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52680cd6e0 0x7f52680ccc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:17.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.392+0000 7f52703ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52680d2130 0x7f52680c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:17.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.392+0000 7f52703ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52680ca470 con 0x7f52680cd6e0 2023-06-22T10:55:17.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.392+0000 7f52703ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52680ca740 con 0x7f52680d2130 2023-06-22T10:55:17.404 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.392+0000 7f52703ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52680cc120 con 0x7f52680b45d0 2023-06-22T10:55:17.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.392+0000 7f526d99a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52680cd6e0 0x7f52680ccc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:17.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.392+0000 7f526d99a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52680cd6e0 0x7f52680ccc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58754/0 (socket says 172.21.15.40:58754) 2023-06-22T10:55:17.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.392+0000 7f526d99a700 1 -- 172.21.15.40:0/3014494982 learned_addr learned my addr 172.21.15.40:0/3014494982 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:55:17.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.392+0000 7f526e19b700 1 --2- 172.21.15.40:0/3014494982 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f52680b45d0 0x7f52680c9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:17.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.392+0000 7f526e99c700 1 --2- 172.21.15.40:0/3014494982 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52680d2130 0x7f52680c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:17.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.393+0000 7f526d99a700 1 -- 172.21.15.40:0/3014494982 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f52680b45d0 msgr2=0x7f52680c9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:17.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.393+0000 7f526d99a700 1 --2- 172.21.15.40:0/3014494982 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f52680b45d0 0x7f52680c9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:17.405 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.393+0000 7f526d99a700 1 -- 172.21.15.40:0/3014494982 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52680d2130 msgr2=0x7f52680c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:17.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.393+0000 7f526d99a700 1 --2- 172.21.15.40:0/3014494982 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52680d2130 0x7f52680c8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:17.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.393+0000 7f526d99a700 1 -- 172.21.15.40:0/3014494982 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52580094a0 con 0x7f52680cd6e0 2023-06-22T10:55:17.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.393+0000 7f526d99a700 1 --2- 172.21.15.40:0/3014494982 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52680cd6e0 0x7f52680ccc00 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f525800ebe0 tx=0x7f525800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:17.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.393+0000 7f525effd700 1 -- 172.21.15.40:0/3014494982 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525800c850 con 0x7f52680cd6e0 2023-06-22T10:55:17.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.393+0000 7f525effd700 1 -- 172.21.15.40:0/3014494982 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f525800c9b0 con 0x7f52680cd6e0 2023-06-22T10:55:17.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.393+0000 7f525effd700 1 -- 172.21.15.40:0/3014494982 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525800cd40 con 0x7f52680cd6e0 2023-06-22T10:55:17.406 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.393+0000 7f52703ff700 1 -- 172.21.15.40:0/3014494982 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52640094a0 con 0x7f52680cd6e0 2023-06-22T10:55:17.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.394+0000 7f52703ff700 1 -- 172.21.15.40:0/3014494982 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52680cc6e0 con 0x7f52680cd6e0 2023-06-22T10:55:17.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.395+0000 7f52703ff700 1 -- 172.21.15.40:0/3014494982 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52680cbf60 con 0x7f52680cd6e0 2023-06-22T10:55:17.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.396+0000 7f525effd700 1 -- 172.21.15.40:0/3014494982 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5258013470 con 0x7f52680cd6e0 2023-06-22T10:55:17.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.397+0000 7f525effd700 1 --2- 172.21.15.40:0/3014494982 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f524c06ace0 0x7f524c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:17.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.397+0000 7f525effd700 1 -- 172.21.15.40:0/3014494982 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f52580895e0 con 0x7f52680cd6e0 2023-06-22T10:55:17.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.397+0000 7f526e19b700 1 --2- 172.21.15.40:0/3014494982 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f524c06ace0 0x7f524c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:17.407 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.398+0000 7f526e19b700 1 --2- 172.21.15.40:0/3014494982 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f524c06ace0 0x7f524c06d190 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5264009fd0 tx=0x7f526401c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:17.408 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.401+0000 7f525effd700 1 -- 172.21.15.40:0/3014494982 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f52580545e0 con 0x7f52680cd6e0 2023-06-22T10:55:17.661 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:17.658+0000 7f52703ff700 1 -- 172.21.15.40:0/3014494982 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f5268067580 con 0x7f52680cd6e0 2023-06-22T10:55:17.962 INFO:tasks.ceph.mds.b.smithi045.stderr:2023-06-22T10:55:17.959+0000 7f23f21f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-22T10:55:18.160 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.157+0000 7f525effd700 1 -- 172.21.15.40:0/3014494982 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f525800cea0 con 0x7f52680cd6e0 2023-06-22T10:55:18.163 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.159+0000 7f52703ff700 1 -- 172.21.15.40:0/3014494982 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f524c06ace0 msgr2=0x7f524c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:18.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.159+0000 7f52703ff700 1 --2- 172.21.15.40:0/3014494982 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f524c06ace0 0x7f524c06d190 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5264009fd0 tx=0x7f526401c040 comp rx=0 tx=0).stop 2023-06-22T10:55:18.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.159+0000 7f52703ff700 1 -- 172.21.15.40:0/3014494982 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52680cd6e0 msgr2=0x7f52680ccc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:18.164 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.159+0000 7f52703ff700 1 --2- 172.21.15.40:0/3014494982 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52680cd6e0 0x7f52680ccc00 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f525800ebe0 tx=0x7f525800eef0 comp rx=0 tx=0).stop 2023-06-22T10:55:18.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.160+0000 7f52703ff700 1 -- 172.21.15.40:0/3014494982 shutdown_connections 2023-06-22T10:55:18.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.160+0000 7f52703ff700 1 --2- 172.21.15.40:0/3014494982 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f524c06ace0 0x7f524c06d190 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:18.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.160+0000 7f52703ff700 1 --2- 172.21.15.40:0/3014494982 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f52680b45d0 0x7f52680c9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:18.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.160+0000 7f52703ff700 1 --2- 172.21.15.40:0/3014494982 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52680d2130 0x7f52680c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:18.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.160+0000 7f52703ff700 1 --2- 172.21.15.40:0/3014494982 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52680cd6e0 0x7f52680ccc00 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:18.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.160+0000 7f52703ff700 1 -- 172.21.15.40:0/3014494982 >> 172.21.15.40:0/3014494982 conn(0x7f52680cf5d0 msgr2=0x7f5268159c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:18.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.160+0000 7f52703ff700 1 -- 172.21.15.40:0/3014494982 shutdown_connections 2023-06-22T10:55:18.165 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.160+0000 7f52703ff700 1 -- 172.21.15.40:0/3014494982 wait complete. 2023-06-22T10:55:18.183 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-06-22T10:55:18.183 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-22T10:55:18.387 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.384+0000 7f67db5ff700 1 Processor -- start 2023-06-22T10:55:18.388 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.384+0000 7f67db5ff700 1 -- start start 2023-06-22T10:55:18.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.385+0000 7f67db5ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f67d40d2830 0x7f67d40b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:18.389 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.385+0000 7f67db5ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f67d40b4c60 0x7f67d40d0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:18.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.385+0000 7f67db5ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67d40b2130 con 0x7f67d415c720 2023-06-22T10:55:18.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.385+0000 7f67db5ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67d4160d60 con 0x7f67d40b4c60 2023-06-22T10:55:18.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.385+0000 7f67db5ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67d40b50e0 con 0x7f67d40d2830 2023-06-22T10:55:18.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.386+0000 7f67d9b9c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f67d40b4c60 0x7f67d40d0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:18.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.386+0000 7f67d9b9c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f67d40b4c60 0x7f67d40d0d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58766/0 (socket says 172.21.15.40:58766) 2023-06-22T10:55:18.390 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.386+0000 7f67d9b9c700 1 -- 172.21.15.40:0/350471036 learned_addr learned my addr 172.21.15.40:0/350471036 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:55:18.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.386+0000 7f67d8b9a700 1 --2- 172.21.15.40:0/350471036 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f67d40d2830 0x7f67d40b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:18.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.386+0000 7f67d9b9c700 1 -- 172.21.15.40:0/350471036 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f67d40d2830 msgr2=0x7f67d40b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:55:18.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.386+0000 7f67d9b9c700 1 --2- 172.21.15.40:0/350471036 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f67d40d2830 0x7f67d40b4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:18.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.386+0000 7f67d9b9c700 1 -- 172.21.15.40:0/350471036 >> v1:172.21.15.45:6789/0 conn(0x7f67d415c720 legacy=0x7f67d40b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:18.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.386+0000 7f67d9b9c700 1 -- 172.21.15.40:0/350471036 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67d4161180 con 0x7f67d40b4c60 2023-06-22T10:55:18.391 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.386+0000 7f67d8b9a700 1 --2- 172.21.15.40:0/350471036 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f67d40d2830 0x7f67d40b4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:55:18.392 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.386+0000 7f67d9b9c700 1 --2- 172.21.15.40:0/350471036 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67d40b4c60 0x7f67d40d0d00 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f67cc009e50 tx=0x7f67cc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fa15b7a36748302 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:18.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.387+0000 7f67cbfff700 1 -- 172.21.15.40:0/350471036 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67cc00e070 con 0x7f67d40b4c60 2023-06-22T10:55:18.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.387+0000 7f67cbfff700 1 -- 172.21.15.40:0/350471036 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67cc00b9c0 con 0x7f67d40b4c60 2023-06-22T10:55:18.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.387+0000 7f67cbfff700 1 -- 172.21.15.40:0/350471036 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67cc00bd70 con 0x7f67d40b4c60 2023-06-22T10:55:18.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.387+0000 7f67db5ff700 1 -- 172.21.15.40:0/350471036 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67d40b4c60 msgr2=0x7f67d40d0d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:18.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.387+0000 7f67db5ff700 1 --2- 172.21.15.40:0/350471036 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67d40b4c60 0x7f67d40d0d00 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f67cc009e50 tx=0x7f67cc00b330 comp rx=0 tx=0).stop 2023-06-22T10:55:18.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.387+0000 7f67db5ff700 1 -- 172.21.15.40:0/350471036 shutdown_connections 2023-06-22T10:55:18.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.387+0000 7f67db5ff700 1 --2- 172.21.15.40:0/350471036 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67d40b4c60 0x7f67d40d0d00 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:18.393 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.387+0000 7f67db5ff700 1 --2- 172.21.15.40:0/350471036 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f67d40d2830 0x7f67d40b4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:18.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.387+0000 7f67db5ff700 1 -- 172.21.15.40:0/350471036 >> 172.21.15.40:0/350471036 conn(0x7f67d40cf720 msgr2=0x7f67d40cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:18.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.387+0000 7f67db5ff700 1 -- 172.21.15.40:0/350471036 shutdown_connections 2023-06-22T10:55:18.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.388+0000 7f67db5ff700 1 -- 172.21.15.40:0/350471036 wait complete. 2023-06-22T10:55:18.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.389+0000 7f67db5ff700 1 Processor -- start 2023-06-22T10:55:18.394 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.389+0000 7f67db5ff700 1 -- start start 2023-06-22T10:55:18.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.390+0000 7f67db5ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67d40b4c60 0x7f67d40cbff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:18.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.390+0000 7f67db5ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f67d40d2830 0x7f67d40c7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:18.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.390+0000 7f67db5ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67d415c720 0x7f67d41584b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:18.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.390+0000 7f67db5ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67d40cc530 con 0x7f67d40b4c60 2023-06-22T10:55:18.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.390+0000 7f67db5ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67d40c76d0 con 0x7f67d415c720 2023-06-22T10:55:18.396 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.390+0000 7f67db5ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67d415d160 con 0x7f67d40d2830 2023-06-22T10:55:18.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.390+0000 7f67d939b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67d40b4c60 0x7f67d40cbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:18.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.391+0000 7f67d939b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67d40b4c60 0x7f67d40cbff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58778/0 (socket says 172.21.15.40:58778) 2023-06-22T10:55:18.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.391+0000 7f67d939b700 1 -- 172.21.15.40:0/3313943414 learned_addr learned my addr 172.21.15.40:0/3313943414 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:55:18.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.391+0000 7f67d8b9a700 1 --2- 172.21.15.40:0/3313943414 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f67d40d2830 0x7f67d40c7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:18.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.391+0000 7f67d9b9c700 1 --2- 172.21.15.40:0/3313943414 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67d415c720 0x7f67d41584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:18.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.391+0000 7f67d939b700 1 -- 172.21.15.40:0/3313943414 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f67d40d2830 msgr2=0x7f67d40c7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:18.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.391+0000 7f67d939b700 1 --2- 172.21.15.40:0/3313943414 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f67d40d2830 0x7f67d40c7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:18.397 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.391+0000 7f67d939b700 1 -- 172.21.15.40:0/3313943414 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67d415c720 msgr2=0x7f67d41584b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:18.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.391+0000 7f67d939b700 1 --2- 172.21.15.40:0/3313943414 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67d415c720 0x7f67d41584b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:18.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.391+0000 7f67d939b700 1 -- 172.21.15.40:0/3313943414 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67cc009b30 con 0x7f67d40b4c60 2023-06-22T10:55:18.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.391+0000 7f67d939b700 1 --2- 172.21.15.40:0/3313943414 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67d40b4c60 0x7f67d40cbff0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f67d000c450 tx=0x7f67d000c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:18.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.392+0000 7f67c9ffb700 1 -- 172.21.15.40:0/3313943414 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d00052d0 con 0x7f67d40b4c60 2023-06-22T10:55:18.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.392+0000 7f67c9ffb700 1 -- 172.21.15.40:0/3313943414 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67d0005430 con 0x7f67d40b4c60 2023-06-22T10:55:18.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.392+0000 7f67c9ffb700 1 -- 172.21.15.40:0/3313943414 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d00038c0 con 0x7f67d40b4c60 2023-06-22T10:55:18.398 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.392+0000 7f67db5ff700 1 -- 172.21.15.40:0/3313943414 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67d40c7930 con 0x7f67d40b4c60 2023-06-22T10:55:18.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.392+0000 7f67db5ff700 1 -- 172.21.15.40:0/3313943414 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67d40c7ef0 con 0x7f67d40b4c60 2023-06-22T10:55:18.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.393+0000 7f67db5ff700 1 -- 172.21.15.40:0/3313943414 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67d415d320 con 0x7f67d40b4c60 2023-06-22T10:55:18.399 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.394+0000 7f67c9ffb700 1 -- 172.21.15.40:0/3313943414 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f67d0003a20 con 0x7f67d40b4c60 2023-06-22T10:55:18.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.394+0000 7f67c9ffb700 1 --2- 172.21.15.40:0/3313943414 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f67b806ace0 0x7f67b806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:18.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.395+0000 7f67c9ffb700 1 -- 172.21.15.40:0/3313943414 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f67d0088980 con 0x7f67d40b4c60 2023-06-22T10:55:18.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.395+0000 7f67d8b9a700 1 --2- 172.21.15.40:0/3313943414 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f67b806ace0 0x7f67b806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:18.400 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.395+0000 7f67d8b9a700 1 --2- 172.21.15.40:0/3313943414 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f67b806ace0 0x7f67b806d190 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f67d40b4950 tx=0x7f67c4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:18.402 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.399+0000 7f67c9ffb700 1 -- 172.21.15.40:0/3313943414 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f67d0053850 con 0x7f67d40b4c60 2023-06-22T10:55:18.652 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.649+0000 7f67db5ff700 1 -- 172.21.15.40:0/3313943414 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f67d4067580 con 0x7f67d40b4c60 2023-06-22T10:55:18.653 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.649+0000 7f67c9ffb700 1 -- 172.21.15.40:0/3313943414 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4665 (secure 0 0 0) 0x7f67d000ce60 con 0x7f67d40b4c60 2023-06-22T10:55:18.653 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:55:18.653 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5272,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/634433135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":634433135},{"type":"v1","addr":"172.21.15.45:6834","nonce":634433135}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5406,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6836/2810635031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":2810635031},{"type":"v1","addr":"172.21.15.40:6836","nonce":2810635031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5409,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/819227010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6835","nonce":819227010},{"type":"v1","addr":"172.21.15.40:6837","nonce":819227010}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-22T10:55:14.651884+0000","modified":"2023-06-22T10:55:18.150965+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5412},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5412":{"gid":5412,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6835/1890176635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1890176635},{"type":"v1","addr":"172.21.15.45:6835","nonce":1890176635}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-06-22T10:55:18.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.652+0000 7f67db5ff700 1 -- 172.21.15.40:0/3313943414 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f67b806ace0 msgr2=0x7f67b806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:18.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.652+0000 7f67db5ff700 1 --2- 172.21.15.40:0/3313943414 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f67b806ace0 0x7f67b806d190 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f67d40b4950 tx=0x7f67c4008040 comp rx=0 tx=0).stop 2023-06-22T10:55:18.655 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.652+0000 7f67db5ff700 1 -- 172.21.15.40:0/3313943414 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67d40b4c60 msgr2=0x7f67d40cbff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:18.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.652+0000 7f67db5ff700 1 --2- 172.21.15.40:0/3313943414 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67d40b4c60 0x7f67d40cbff0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f67d000c450 tx=0x7f67d000c760 comp rx=0 tx=0).stop 2023-06-22T10:55:18.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.652+0000 7f67db5ff700 1 -- 172.21.15.40:0/3313943414 shutdown_connections 2023-06-22T10:55:18.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.652+0000 7f67db5ff700 1 --2- 172.21.15.40:0/3313943414 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f67b806ace0 0x7f67b806d190 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:18.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.652+0000 7f67db5ff700 1 --2- 172.21.15.40:0/3313943414 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67d415c720 0x7f67d41584b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:18.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.652+0000 7f67db5ff700 1 --2- 172.21.15.40:0/3313943414 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67d40b4c60 0x7f67d40cbff0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:18.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.652+0000 7f67db5ff700 1 --2- 172.21.15.40:0/3313943414 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f67d40d2830 0x7f67d40c7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:18.656 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.652+0000 7f67db5ff700 1 -- 172.21.15.40:0/3313943414 >> 172.21.15.40:0/3313943414 conn(0x7f67d40cf720 msgr2=0x7f67d40b2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:18.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.652+0000 7f67db5ff700 1 -- 172.21.15.40:0/3313943414 shutdown_connections 2023-06-22T10:55:18.657 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.652+0000 7f67db5ff700 1 -- 172.21.15.40:0/3313943414 wait complete. 2023-06-22T10:55:18.657 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 18 2023-06-22T10:55:18.674 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-22T10:55:18.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.871+0000 7fd664fff700 1 Processor -- start 2023-06-22T10:55:18.875 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.872+0000 7fd664fff700 1 -- start start 2023-06-22T10:55:18.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.873+0000 7fd664fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd6600cf050 0x7fd6600cd200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:18.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.873+0000 7fd664fff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6600cf4a0 con 0x7fd6600b4630 2023-06-22T10:55:18.876 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.873+0000 7fd664fff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6600d1b60 con 0x7fd6600b4a00 2023-06-22T10:55:18.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.873+0000 7fd664fff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6600cd740 con 0x7fd6600cf050 2023-06-22T10:55:18.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.873+0000 7fd65e59c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd6600b4630 0x7fd6600d1ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43766/0 (socket says 172.21.15.40:43766) 2023-06-22T10:55:18.877 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.873+0000 7fd65e59c700 1 -- 172.21.15.40:0/4000063114 learned_addr learned my addr 172.21.15.40:0/4000063114 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:55:18.878 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.873+0000 7fd657fff700 1 --2- 172.21.15.40:0/4000063114 >> v2:172.21.15.45:3300/0 conn(0x7fd6600cf050 0x7fd6600cd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:18.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.873+0000 7fd65dd9b700 1 -- 172.21.15.40:0/4000063114 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3608482978 0 0) 0x7fd6600cf4a0 con 0x7fd6600b4630 2023-06-22T10:55:18.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.874+0000 7fd65dd9b700 1 -- 172.21.15.40:0/4000063114 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd64c0035b0 con 0x7fd6600b4630 2023-06-22T10:55:18.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.874+0000 7fd65dd9b700 1 -- 172.21.15.40:0/4000063114 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3918014685 0 0) 0x7fd64c0035b0 con 0x7fd6600b4630 2023-06-22T10:55:18.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.874+0000 7fd65dd9b700 1 -- 172.21.15.40:0/4000063114 >> v2:172.21.15.45:3300/0 conn(0x7fd6600cf050 msgr2=0x7fd6600cd200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:55:18.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.874+0000 7fd65dd9b700 1 --2- 172.21.15.40:0/4000063114 >> v2:172.21.15.45:3300/0 conn(0x7fd6600cf050 0x7fd6600cd200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:18.879 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.874+0000 7fd65dd9b700 1 -- 172.21.15.40:0/4000063114 >> v1:172.21.15.45:6789/0 conn(0x7fd6600b4a00 legacy=0x7fd6600b5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:18.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.874+0000 7fd65dd9b700 1 -- 172.21.15.40:0/4000063114 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6600d1230 con 0x7fd6600b4630 2023-06-22T10:55:18.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.874+0000 7fd65dd9b700 1 -- 172.21.15.40:0/4000063114 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1490606486 0 0) 0x7fd650001670 con 0x7fd6600b4630 2023-06-22T10:55:18.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.874+0000 7fd65dd9b700 1 -- 172.21.15.40:0/4000063114 >> v1:172.21.15.40:6789/0 conn(0x7fd6600b4630 legacy=0x7fd6600d1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:18.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.874+0000 7fd65dd9b700 1 --2- 172.21.15.40:0/4000063114 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd64c003a50 0x7fd64c003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:18.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.874+0000 7fd65dd9b700 1 --2- 172.21.15.40:0/4000063114 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd64c004850 0x7fd64c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:18.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.874+0000 7fd65dd9b700 1 --2- 172.21.15.40:0/4000063114 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd64c005200 0x7fd64c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:18.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.874+0000 7fd65dd9b700 1 -- 172.21.15.40:0/4000063114 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6600cd740 con 0x7fd64c003a50 2023-06-22T10:55:18.880 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.874+0000 7fd65dd9b700 1 -- 172.21.15.40:0/4000063114 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd64c00c0e0 con 0x7fd64c004850 2023-06-22T10:55:18.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.874+0000 7fd65dd9b700 1 -- 172.21.15.40:0/4000063114 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd64c00c2a0 con 0x7fd64c005200 2023-06-22T10:55:18.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.874+0000 7fd65e59c700 1 --2- 172.21.15.40:0/4000063114 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd64c003a50 0x7fd64c003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:18.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.874+0000 7fd657fff700 1 --2- 172.21.15.40:0/4000063114 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd64c004850 0x7fd64c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:18.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.875+0000 7fd65ed9d700 1 --2- 172.21.15.40:0/4000063114 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd64c005200 0x7fd64c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:18.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.875+0000 7fd65e59c700 1 -- 172.21.15.40:0/4000063114 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd64c005200 msgr2=0x7fd64c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:55:18.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.875+0000 7fd65e59c700 1 --2- 172.21.15.40:0/4000063114 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd64c005200 0x7fd64c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:18.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.875+0000 7fd65e59c700 1 -- 172.21.15.40:0/4000063114 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd64c004850 msgr2=0x7fd64c004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:55:18.881 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.875+0000 7fd65e59c700 1 --2- 172.21.15.40:0/4000063114 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd64c004850 0x7fd64c004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:18.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.875+0000 7fd65e59c700 1 -- 172.21.15.40:0/4000063114 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd64c0035b0 con 0x7fd64c003a50 2023-06-22T10:55:18.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.875+0000 7fd65ed9d700 1 --2- 172.21.15.40:0/4000063114 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd64c005200 0x7fd64c00ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:55:18.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.875+0000 7fd65ed9d700 1 -- 172.21.15.40:0/4000063114 reap_dead start 2023-06-22T10:55:18.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.875+0000 7fd65e59c700 1 --2- 172.21.15.40:0/4000063114 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd64c003a50 0x7fd64c003e60 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fd65000c160 tx=0x7fd64c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12f00b0bcf0aaa8c server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:18.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.875+0000 7fd65dd9b700 1 -- 172.21.15.40:0/4000063114 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd650007b30 con 0x7fd64c003a50 2023-06-22T10:55:18.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.875+0000 7fd65dd9b700 1 -- 172.21.15.40:0/4000063114 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd65000cce0 con 0x7fd64c003a50 2023-06-22T10:55:18.882 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.875+0000 7fd65dd9b700 1 -- 172.21.15.40:0/4000063114 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd650005ba0 con 0x7fd64c003a50 2023-06-22T10:55:18.884 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.876+0000 7fd664fff700 1 -- 172.21.15.40:0/4000063114 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd64c003a50 msgr2=0x7fd64c003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:18.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.876+0000 7fd664fff700 1 --2- 172.21.15.40:0/4000063114 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd64c003a50 0x7fd64c003e60 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fd65000c160 tx=0x7fd64c005880 comp rx=0 tx=0).stop 2023-06-22T10:55:18.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.876+0000 7fd664fff700 1 -- 172.21.15.40:0/4000063114 shutdown_connections 2023-06-22T10:55:18.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.876+0000 7fd664fff700 1 --2- 172.21.15.40:0/4000063114 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd64c003a50 0x7fd64c003e60 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:18.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.876+0000 7fd664fff700 1 -- 172.21.15.40:0/4000063114 >> 172.21.15.40:0/4000063114 conn(0x7fd6600cf630 msgr2=0x7fd6600cfa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:18.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.876+0000 7fd664fff700 1 -- 172.21.15.40:0/4000063114 shutdown_connections 2023-06-22T10:55:18.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.876+0000 7fd664fff700 1 -- 172.21.15.40:0/4000063114 wait complete. 2023-06-22T10:55:18.885 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.878+0000 7fd664fff700 1 Processor -- start 2023-06-22T10:55:18.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.878+0000 7fd664fff700 1 -- start start 2023-06-22T10:55:18.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.879+0000 7fd664fff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd64c003a50 0x7fd6601e43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:18.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.879+0000 7fd664fff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd6601e1df0 0x7fd6601e7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:18.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.879+0000 7fd664fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd66014bbb0 0x7fd66014c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:18.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.879+0000 7fd664fff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6600cb490 con 0x7fd64c003a50 2023-06-22T10:55:18.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.879+0000 7fd664fff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6601e5220 con 0x7fd66014bbb0 2023-06-22T10:55:18.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.879+0000 7fd664fff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd66014c560 con 0x7fd6601e1df0 2023-06-22T10:55:18.886 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.879+0000 7fd65e59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd64c003a50 0x7fd6601e43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:18.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.879+0000 7fd65e59c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd64c003a50 0x7fd6601e43a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35306/0 (socket says 172.21.15.40:35306) 2023-06-22T10:55:18.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.879+0000 7fd65e59c700 1 -- 172.21.15.40:0/4219274457 learned_addr learned my addr 172.21.15.40:0/4219274457 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:55:18.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.879+0000 7fd657fff700 1 --2- 172.21.15.40:0/4219274457 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd6601e1df0 0x7fd6601e7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:18.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.879+0000 7fd65ed9d700 1 --2- 172.21.15.40:0/4219274457 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd66014bbb0 0x7fd66014c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:18.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.879+0000 7fd65e59c700 1 -- 172.21.15.40:0/4219274457 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd6601e1df0 msgr2=0x7fd6601e7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:18.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.879+0000 7fd65e59c700 1 --2- 172.21.15.40:0/4219274457 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd6601e1df0 0x7fd6601e7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:18.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.879+0000 7fd65e59c700 1 -- 172.21.15.40:0/4219274457 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd66014bbb0 msgr2=0x7fd66014c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:18.887 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.879+0000 7fd65e59c700 1 --2- 172.21.15.40:0/4219274457 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd66014bbb0 0x7fd66014c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:18.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.880+0000 7fd65e59c700 1 -- 172.21.15.40:0/4219274457 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6601e4980 con 0x7fd64c003a50 2023-06-22T10:55:18.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.880+0000 7fd65e59c700 1 --2- 172.21.15.40:0/4219274457 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd64c003a50 0x7fd6601e43a0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fd65000c750 tx=0x7fd6600d1ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:18.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.880+0000 7fd656ffd700 1 -- 172.21.15.40:0/4219274457 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd650004c80 con 0x7fd64c003a50 2023-06-22T10:55:18.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.880+0000 7fd656ffd700 1 -- 172.21.15.40:0/4219274457 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd650004de0 con 0x7fd64c003a50 2023-06-22T10:55:18.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.880+0000 7fd664fff700 1 -- 172.21.15.40:0/4219274457 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6601e4c60 con 0x7fd64c003a50 2023-06-22T10:55:18.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.880+0000 7fd656ffd700 1 -- 172.21.15.40:0/4219274457 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6500072d0 con 0x7fd64c003a50 2023-06-22T10:55:18.888 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.880+0000 7fd664fff700 1 -- 172.21.15.40:0/4219274457 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6601e2260 con 0x7fd64c003a50 2023-06-22T10:55:18.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.881+0000 7fd664fff700 1 -- 172.21.15.40:0/4219274457 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd660067580 con 0x7fd64c003a50 2023-06-22T10:55:18.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.882+0000 7fd656ffd700 1 -- 172.21.15.40:0/4219274457 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd650007430 con 0x7fd64c003a50 2023-06-22T10:55:18.889 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.883+0000 7fd656ffd700 1 --2- 172.21.15.40:0/4219274457 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fd64006ace0 0x7fd64006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:18.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.883+0000 7fd656ffd700 1 -- 172.21.15.40:0/4219274457 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fd65008a7f0 con 0x7fd64c003a50 2023-06-22T10:55:18.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.883+0000 7fd657fff700 1 --2- 172.21.15.40:0/4219274457 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fd64006ace0 0x7fd64006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:18.890 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.884+0000 7fd657fff700 1 --2- 172.21.15.40:0/4219274457 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fd64006ace0 0x7fd64006d190 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd6600b7420 tx=0x7fd648008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:18.891 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:18.888+0000 7fd656ffd700 1 -- 172.21.15.40:0/4219274457 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd650055750 con 0x7fd64c003a50 2023-06-22T10:55:19.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.095+0000 7fd664fff700 1 -- 172.21.15.40:0/4219274457 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd66015aa00 con 0x7fd64c003a50 2023-06-22T10:55:19.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.097+0000 7fd656ffd700 1 -- 172.21.15.40:0/4219274457 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+18416 (secure 0 0 0) 0x7fd650058d70 con 0x7fd64c003a50 2023-06-22T10:55:19.100 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:55:19.101 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":42,"fsid":"475560bc-1a7c-4a75-b3b6-6fc6b20bdc52","created":"2023-06-22T10:53:03.784568+0000","modified":"2023-06-22T10:55:16.137621+0000","last_up_change":"2023-06-22T10:53:17.830348+0000","last_in_change":"2023-06-22T10:53:07.329974+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-22T10:53:17.182228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-22T10:53:23.874432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-06-22T10:55:12.966650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-06-22T10:55:13.613417+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"918db6b4-053a-46ba-976d-6e1a0104017f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6809","nonce":2400162888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6811","nonce":2400162888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6815","nonce":2400162888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":2400162888},{"type":"v1","addr":"172.21.15.40:6813","nonce":2400162888}]},"public_addr":"172.21.15.40:6809/2400162888","cluster_addr":"172.21.15.40:6811/2400162888","heartbeat_back_addr":"172.21.15.40:6815/2400162888","heartbeat_front_addr":"172.21.15.40:6813/2400162888","state":["exists","up"]},{"osd":1,"uuid":"0c146e2b-1725-4dae-9b5c-38795943b9d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6801","nonce":230885800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6803","nonce":230885800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6807","nonce":230885800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":230885800},{"type":"v1","addr":"172.21.15.40:6805","nonce":230885800}]},"public_addr":"172.21.15.40:6801/230885800","cluster_addr":"172.21.15.40:6803/230885800","heartbeat_back_addr":"172.21.15.40:6807/230885800","heartbeat_front_addr":"172.21.15.40:6805/230885800","state":["exists","up"]},{"osd":2,"uuid":"0b3727fd-f281-46d5-a675-86c8c5ab269e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6817","nonce":2681404929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6819","nonce":2681404929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6823","nonce":2681404929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":2681404929},{"type":"v1","addr":"172.21.15.40:6821","nonce":2681404929}]},"public_addr":"172.21.15.40:6817/2681404929","cluster_addr":"172.21.15.40:6819/2681404929","heartbeat_back_addr":"172.21.15.40:6823/2681404929","heartbeat_front_addr":"172.21.15.40:6821/2681404929","state":["exists","up"]},{"osd":3,"uuid":"2969c698-7039-4bbb-beda-f756f7a368a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6825","nonce":111110981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6827","nonce":111110981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6831","nonce":111110981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":111110981},{"type":"v1","addr":"172.21.15.40:6829","nonce":111110981}]},"public_addr":"172.21.15.40:6825/111110981","cluster_addr":"172.21.15.40:6827/111110981","heartbeat_back_addr":"172.21.15.40:6831/111110981","heartbeat_front_addr":"172.21.15.40:6829/111110981","state":["exists","up"]},{"osd":4,"uuid":"3bb1d9c8-8e42-4a6b-998d-04834f34be5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6801","nonce":3625455711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6803","nonce":3625455711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6807","nonce":3625455711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":3625455711},{"type":"v1","addr":"172.21.15.45:6805","nonce":3625455711}]},"public_addr":"172.21.15.45:6801/3625455711","cluster_addr":"172.21.15.45:6803/3625455711","heartbeat_back_addr":"172.21.15.45:6807/3625455711","heartbeat_front_addr":"172.21.15.45:6805/3625455711","state":["exists","up"]},{"osd":5,"uuid":"f9854ee4-302c-41be-977b-bedda090a3d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6817","nonce":3354411217}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6819","nonce":3354411217}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6823","nonce":3354411217}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":3354411217},{"type":"v1","addr":"172.21.15.45:6821","nonce":3354411217}]},"public_addr":"172.21.15.45:6817/3354411217","cluster_addr":"172.21.15.45:6819/3354411217","heartbeat_back_addr":"172.21.15.45:6823/3354411217","heartbeat_front_addr":"172.21.15.45:6821/3354411217","state":["exists","up"]},{"osd":6,"uuid":"bbdb1989-f6ac-4954-9b85-b8b540d683c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6809","nonce":320111074}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6811","nonce":320111074}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6815","nonce":320111074}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":320111074},{"type":"v1","addr":"172.21.15.45:6813","nonce":320111074}]},"public_addr":"172.21.15.45:6809/320111074","cluster_addr":"172.21.15.45:6811/320111074","heartbeat_back_addr":"172.21.15.45:6815/320111074","heartbeat_front_addr":"172.21.15.45:6813/320111074","state":["exists","up"]},{"osd":7,"uuid":"823d44e3-58f1-4d1d-8263-a4e4a69d4327","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6825","nonce":643617680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6827","nonce":643617680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6831","nonce":643617680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":643617680},{"type":"v1","addr":"172.21.15.45:6829","nonce":643617680}]},"public_addr":"172.21.15.45:6825/643617680","cluster_addr":"172.21.15.45:6827/643617680","heartbeat_back_addr":"172.21.15.45:6831/643617680","heartbeat_front_addr":"172.21.15.45:6829/643617680","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.731262+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.873226+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.898936+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.666578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.645990+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.953699+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.642823+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-22T10:53:12.693395+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-22T10:55:19.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.099+0000 7fd664fff700 1 -- 172.21.15.40:0/4219274457 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fd64006ace0 msgr2=0x7fd64006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:19.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.099+0000 7fd664fff700 1 --2- 172.21.15.40:0/4219274457 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fd64006ace0 0x7fd64006d190 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd6600b7420 tx=0x7fd648008040 comp rx=0 tx=0).stop 2023-06-22T10:55:19.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.099+0000 7fd664fff700 1 -- 172.21.15.40:0/4219274457 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd64c003a50 msgr2=0x7fd6601e43a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:19.103 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.099+0000 7fd664fff700 1 --2- 172.21.15.40:0/4219274457 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd64c003a50 0x7fd6601e43a0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fd65000c750 tx=0x7fd6600d1ad0 comp rx=0 tx=0).stop 2023-06-22T10:55:19.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.099+0000 7fd664fff700 1 -- 172.21.15.40:0/4219274457 shutdown_connections 2023-06-22T10:55:19.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.099+0000 7fd664fff700 1 --2- 172.21.15.40:0/4219274457 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fd64006ace0 0x7fd64006d190 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:19.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.099+0000 7fd664fff700 1 --2- 172.21.15.40:0/4219274457 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd66014bbb0 0x7fd66014c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:19.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.099+0000 7fd664fff700 1 --2- 172.21.15.40:0/4219274457 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd64c003a50 0x7fd6601e43a0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:19.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.099+0000 7fd664fff700 1 --2- 172.21.15.40:0/4219274457 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fd6601e1df0 0x7fd6601e7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:19.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.099+0000 7fd664fff700 1 -- 172.21.15.40:0/4219274457 >> 172.21.15.40:0/4219274457 conn(0x7fd6600cf630 msgr2=0x7fd66015b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:19.104 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.099+0000 7fd664fff700 1 -- 172.21.15.40:0/4219274457 shutdown_connections 2023-06-22T10:55:19.105 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.099+0000 7fd664fff700 1 -- 172.21.15.40:0/4219274457 wait complete. 2023-06-22T10:55:19.121 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-06-22T10:55:19.121 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-22T10:55:19.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.320+0000 7f32b47ff700 1 Processor -- start 2023-06-22T10:55:19.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.321+0000 7f32b47ff700 1 -- start start 2023-06-22T10:55:19.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.322+0000 7f32b47ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f32ac15c720 0x7f32ac0b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:19.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.322+0000 7f32b47ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f32ac0d2830 0x7f32ac0b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:19.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.322+0000 7f32b47ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32ac0b2130 con 0x7f32ac0b4c60 2023-06-22T10:55:19.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.322+0000 7f32b47ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32ac160d60 con 0x7f32ac15c720 2023-06-22T10:55:19.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.322+0000 7f32b47ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32ac0b50e0 con 0x7f32ac0d2830 2023-06-22T10:55:19.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.322+0000 7f32b2d9c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f32ac0b4c60 0x7f32ac06b4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43776/0 (socket says 172.21.15.40:43776) 2023-06-22T10:55:19.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.322+0000 7f32b2d9c700 1 -- 172.21.15.40:0/1428969519 learned_addr learned my addr 172.21.15.40:0/1428969519 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:55:19.326 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.322+0000 7f32b259b700 1 --2- 172.21.15.40:0/1428969519 >> v2:172.21.15.45:3300/0 conn(0x7f32ac15c720 0x7f32ac0b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:19.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.322+0000 7f32b1d9a700 1 --2- 172.21.15.40:0/1428969519 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f32ac0d2830 0x7f32ac0b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:19.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.322+0000 7f32b1599700 1 -- 172.21.15.40:0/1428969519 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 928274436 0 0) 0x7f32ac0b2130 con 0x7f32ac0b4c60 2023-06-22T10:55:19.327 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.322+0000 7f32b1599700 1 -- 172.21.15.40:0/1428969519 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32980035b0 con 0x7f32ac0b4c60 2023-06-22T10:55:19.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.323+0000 7f32b1599700 1 -- 172.21.15.40:0/1428969519 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1615762978 0 0) 0x7f32980035b0 con 0x7f32ac0b4c60 2023-06-22T10:55:19.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.323+0000 7f32b1599700 1 -- 172.21.15.40:0/1428969519 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f32ac0d2830 msgr2=0x7f32ac0b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:55:19.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.323+0000 7f32b1599700 1 --2- 172.21.15.40:0/1428969519 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f32ac0d2830 0x7f32ac0b4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:19.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.323+0000 7f32b1599700 1 -- 172.21.15.40:0/1428969519 >> v2:172.21.15.45:3300/0 conn(0x7f32ac15c720 msgr2=0x7f32ac0b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:55:19.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.323+0000 7f32b1599700 1 --2- 172.21.15.40:0/1428969519 >> v2:172.21.15.45:3300/0 conn(0x7f32ac15c720 0x7f32ac0b1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:19.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.323+0000 7f32b1599700 1 -- 172.21.15.40:0/1428969519 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32ac161180 con 0x7f32ac0b4c60 2023-06-22T10:55:19.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.323+0000 7f32b1599700 1 -- 172.21.15.40:0/1428969519 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1490606486 0 0) 0x7f32a40019f0 con 0x7f32ac0b4c60 2023-06-22T10:55:19.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.323+0000 7f32b1599700 1 -- 172.21.15.40:0/1428969519 >> v1:172.21.15.40:6789/0 conn(0x7f32ac0b4c60 legacy=0x7f32ac06b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:19.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.323+0000 7f32b1599700 1 --2- 172.21.15.40:0/1428969519 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3298003a00 0x7f3298003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:19.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.323+0000 7f32b1599700 1 --2- 172.21.15.40:0/1428969519 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3298004850 0x7f3298004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:19.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.323+0000 7f32b1599700 1 --2- 172.21.15.40:0/1428969519 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f32ac0d2830 0x7f3298005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:19.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.323+0000 7f32b1599700 1 -- 172.21.15.40:0/1428969519 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32ac160d60 con 0x7f3298003a00 2023-06-22T10:55:19.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.323+0000 7f32b1599700 1 -- 172.21.15.40:0/1428969519 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32ac0b50e0 con 0x7f3298004850 2023-06-22T10:55:19.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.323+0000 7f32b1599700 1 -- 172.21.15.40:0/1428969519 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f329800bb10 con 0x7f32ac0d2830 2023-06-22T10:55:19.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.323+0000 7f32b259b700 1 --2- 172.21.15.40:0/1428969519 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3298003a00 0x7f3298003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:19.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.323+0000 7f32b1d9a700 1 --2- 172.21.15.40:0/1428969519 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3298004850 0x7f3298004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:19.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.323+0000 7f32b2d9c700 1 --2- 172.21.15.40:0/1428969519 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f32ac0d2830 0x7f3298005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:19.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.324+0000 7f32b259b700 1 -- 172.21.15.40:0/1428969519 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f32ac0d2830 msgr2=0x7f3298005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:55:19.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.324+0000 7f32b259b700 1 --2- 172.21.15.40:0/1428969519 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f32ac0d2830 0x7f3298005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:19.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.324+0000 7f32b259b700 1 -- 172.21.15.40:0/1428969519 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3298004850 msgr2=0x7f3298004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:55:19.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.324+0000 7f32b259b700 1 --2- 172.21.15.40:0/1428969519 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3298004850 0x7f3298004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:19.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.324+0000 7f32b259b700 1 -- 172.21.15.40:0/1428969519 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32980035b0 con 0x7f3298003a00 2023-06-22T10:55:19.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.324+0000 7f32b1d9a700 1 --2- 172.21.15.40:0/1428969519 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3298004850 0x7f3298004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-22T10:55:19.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.324+0000 7f32b259b700 1 --2- 172.21.15.40:0/1428969519 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3298003a00 0x7f3298003e10 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f32a8009b60 tx=0x7f3298005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8891e244212d2a7 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:19.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.324+0000 7f32b1599700 1 -- 172.21.15.40:0/1428969519 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a800e6c0 con 0x7f3298003a00 2023-06-22T10:55:19.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.324+0000 7f32b1599700 1 -- 172.21.15.40:0/1428969519 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a800e820 con 0x7f3298003a00 2023-06-22T10:55:19.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.324+0000 7f32b1599700 1 -- 172.21.15.40:0/1428969519 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a800eb90 con 0x7f3298003a00 2023-06-22T10:55:19.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.325+0000 7f32b47ff700 1 -- 172.21.15.40:0/1428969519 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3298003a00 msgr2=0x7f3298003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:19.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.325+0000 7f32b47ff700 1 --2- 172.21.15.40:0/1428969519 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3298003a00 0x7f3298003e10 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f32a8009b60 tx=0x7f3298005880 comp rx=0 tx=0).stop 2023-06-22T10:55:19.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.325+0000 7f32b2d9c700 1 -- 172.21.15.40:0/1428969519 reap_dead start 2023-06-22T10:55:19.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.325+0000 7f32b47ff700 1 -- 172.21.15.40:0/1428969519 shutdown_connections 2023-06-22T10:55:19.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.325+0000 7f32b47ff700 1 -- 172.21.15.40:0/1428969519 >> 172.21.15.40:0/1428969519 conn(0x7f32ac0cf720 msgr2=0x7f32ac0cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:19.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.325+0000 7f32b47ff700 1 -- 172.21.15.40:0/1428969519 shutdown_connections 2023-06-22T10:55:19.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.325+0000 7f32b47ff700 1 -- 172.21.15.40:0/1428969519 wait complete. 2023-06-22T10:55:19.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.327+0000 7f32b47ff700 1 Processor -- start 2023-06-22T10:55:19.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.327+0000 7f32b47ff700 1 -- start start 2023-06-22T10:55:19.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.328+0000 7f32b47ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3298003a00 0x7f32ac0b0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:19.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.328+0000 7f32b47ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32ac0ca710 0x7f32ac06b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:19.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.328+0000 7f32b47ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f32ac0cab80 0x7f32ac06ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:19.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.328+0000 7f32b47ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32ac0b1360 con 0x7f32ac0ca710 2023-06-22T10:55:19.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.328+0000 7f32b47ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32ac15fac0 con 0x7f3298003a00 2023-06-22T10:55:19.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.328+0000 7f32b47ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32ac1597c0 con 0x7f32ac0cab80 2023-06-22T10:55:19.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.328+0000 7f32b1d9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32ac0ca710 0x7f32ac06b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:19.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.328+0000 7f32b1d9a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32ac0ca710 0x7f32ac06b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35330/0 (socket says 172.21.15.40:35330) 2023-06-22T10:55:19.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.328+0000 7f32b1d9a700 1 -- 172.21.15.40:0/2791011518 learned_addr learned my addr 172.21.15.40:0/2791011518 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:55:19.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.328+0000 7f32b1d9a700 1 -- 172.21.15.40:0/2791011518 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f32ac0cab80 msgr2=0x7f32ac06ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:19.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.328+0000 7f32b1d9a700 1 --2- 172.21.15.40:0/2791011518 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f32ac0cab80 0x7f32ac06ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:19.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.328+0000 7f32b1d9a700 1 -- 172.21.15.40:0/2791011518 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3298003a00 msgr2=0x7f32ac0b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:19.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.328+0000 7f32b1d9a700 1 --2- 172.21.15.40:0/2791011518 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3298003a00 0x7f32ac0b0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:19.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.328+0000 7f32b1d9a700 1 -- 172.21.15.40:0/2791011518 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32ac159200 con 0x7f32ac0ca710 2023-06-22T10:55:19.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.329+0000 7f32b1d9a700 1 --2- 172.21.15.40:0/2791011518 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32ac0ca710 0x7f32ac06b4d0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f329c011cd0 tx=0x7f329c00f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:19.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.329+0000 7f32a2ffd700 1 -- 172.21.15.40:0/2791011518 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f329c00fa50 con 0x7f32ac0ca710 2023-06-22T10:55:19.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.329+0000 7f32a2ffd700 1 -- 172.21.15.40:0/2791011518 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f329c00fbb0 con 0x7f32ac0ca710 2023-06-22T10:55:19.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.329+0000 7f32b47ff700 1 -- 172.21.15.40:0/2791011518 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32ac1594e0 con 0x7f32ac0ca710 2023-06-22T10:55:19.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.329+0000 7f32a2ffd700 1 -- 172.21.15.40:0/2791011518 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f329c004020 con 0x7f32ac0ca710 2023-06-22T10:55:19.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.329+0000 7f32b47ff700 1 -- 172.21.15.40:0/2791011518 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32ac0ca1f0 con 0x7f32ac0ca710 2023-06-22T10:55:19.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.330+0000 7f32b47ff700 1 -- 172.21.15.40:0/2791011518 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32ac0c9d50 con 0x7f32ac0ca710 2023-06-22T10:55:19.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.331+0000 7f32a2ffd700 1 -- 172.21.15.40:0/2791011518 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f329c004180 con 0x7f32ac0ca710 2023-06-22T10:55:19.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.332+0000 7f32a2ffd700 1 --2- 172.21.15.40:0/2791011518 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f329006ace0 0x7f329006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:19.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.332+0000 7f32a2ffd700 1 -- 172.21.15.40:0/2791011518 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f329c089b80 con 0x7f32ac0ca710 2023-06-22T10:55:19.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.332+0000 7f32b259b700 1 --2- 172.21.15.40:0/2791011518 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f329006ace0 0x7f329006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:19.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.333+0000 7f32b259b700 1 --2- 172.21.15.40:0/2791011518 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f329006ace0 0x7f329006d190 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f32a8000c00 tx=0x7f32a8013000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:19.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.337+0000 7f32a2ffd700 1 -- 172.21.15.40:0/2791011518 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f329c054a50 con 0x7f32ac0ca710 2023-06-22T10:55:19.541 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.538+0000 7f32b47ff700 1 -- 172.21.15.40:0/2791011518 --> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f32ac1606a0 con 0x7f329006ace0 2023-06-22T10:55:19.551 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.548+0000 7f32a2ffd700 1 -- 172.21.15.40:0/2791011518 <== mgr.4110 v2:172.21.15.40:6832/1803669772 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310981 (secure 0 0 0) 0x7f32a800e990 con 0x7f329006ace0 2023-06-22T10:55:19.555 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:55:19.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.553+0000 7f32b47ff700 1 -- 172.21.15.40:0/2791011518 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f329006ace0 msgr2=0x7f329006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:19.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.553+0000 7f32b47ff700 1 --2- 172.21.15.40:0/2791011518 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f329006ace0 0x7f329006d190 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f32a8000c00 tx=0x7f32a8013000 comp rx=0 tx=0).stop 2023-06-22T10:55:19.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.553+0000 7f32b47ff700 1 -- 172.21.15.40:0/2791011518 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32ac0ca710 msgr2=0x7f32ac06b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:19.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.553+0000 7f32b47ff700 1 --2- 172.21.15.40:0/2791011518 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32ac0ca710 0x7f32ac06b4d0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f329c011cd0 tx=0x7f329c00f520 comp rx=0 tx=0).stop 2023-06-22T10:55:19.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.553+0000 7f32b47ff700 1 -- 172.21.15.40:0/2791011518 shutdown_connections 2023-06-22T10:55:19.557 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.553+0000 7f32b47ff700 1 --2- 172.21.15.40:0/2791011518 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f329006ace0 0x7f329006d190 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:19.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.553+0000 7f32b47ff700 1 --2- 172.21.15.40:0/2791011518 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f32ac0cab80 0x7f32ac06ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:19.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.553+0000 7f32b47ff700 1 --2- 172.21.15.40:0/2791011518 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3298003a00 0x7f32ac0b0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:19.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.553+0000 7f32b47ff700 1 --2- 172.21.15.40:0/2791011518 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f32ac0ca710 0x7f32ac06b4d0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:19.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.553+0000 7f32b47ff700 1 -- 172.21.15.40:0/2791011518 >> 172.21.15.40:0/2791011518 conn(0x7f32ac0cf720 msgr2=0x7f32ac15bc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:19.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.553+0000 7f32b47ff700 1 -- 172.21.15.40:0/2791011518 shutdown_connections 2023-06-22T10:55:19.558 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.553+0000 7f32b47ff700 1 -- 172.21.15.40:0/2791011518 wait complete. 2023-06-22T10:55:19.559 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-06-22T10:55:19.574 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":97,"stamp":"2023-06-22T10:55:19.150510+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":174,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220556,"kb_used_data":4940,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754754164,"statfs":{"total":773094113280,"available":772868263936,"internally_reserved":0,"allocated":5058560,"data_stored":2879067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001300"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.936062+0000","last_change":"2023-06-22T10:55:15.152023+0000","last_active":"2023-06-22T10:55:16.936062+0000","last_peered":"2023-06-22T10:55:16.936062+0000","last_clean":"2023-06-22T10:55:16.936062+0000","last_became_active":"2023-06-22T10:55:15.151686+0000","last_became_peered":"2023-06-22T10:55:15.151686+0000","last_unstale":"2023-06-22T10:55:16.936062+0000","last_undegraded":"2023-06-22T10:55:16.936062+0000","last_fullsized":"2023-06-22T10:55:16.936062+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T13:01:35.861879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.149076+0000","last_change":"2023-06-22T10:55:15.151853+0000","last_active":"2023-06-22T10:55:16.149076+0000","last_peered":"2023-06-22T10:55:16.149076+0000","last_clean":"2023-06-22T10:55:16.149076+0000","last_became_active":"2023-06-22T10:55:15.151572+0000","last_became_peered":"2023-06-22T10:55:15.151572+0000","last_unstale":"2023-06-22T10:55:16.149076+0000","last_undegraded":"2023-06-22T10:55:16.149076+0000","last_fullsized":"2023-06-22T10:55:16.149076+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T11:00:35.629640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.148888+0000","last_change":"2023-06-22T10:55:15.155374+0000","last_active":"2023-06-22T10:55:16.148888+0000","last_peered":"2023-06-22T10:55:16.148888+0000","last_clean":"2023-06-22T10:55:16.148888+0000","last_became_active":"2023-06-22T10:55:15.155083+0000","last_became_peered":"2023-06-22T10:55:15.155083+0000","last_unstale":"2023-06-22T10:55:16.148888+0000","last_undegraded":"2023-06-22T10:55:16.148888+0000","last_fullsized":"2023-06-22T10:55:16.148888+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T13:21:01.245902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.934895+0000","last_change":"2023-06-22T10:55:15.152878+0000","last_active":"2023-06-22T10:55:16.934895+0000","last_peered":"2023-06-22T10:55:16.934895+0000","last_clean":"2023-06-22T10:55:16.934895+0000","last_became_active":"2023-06-22T10:55:15.152577+0000","last_became_peered":"2023-06-22T10:55:15.152577+0000","last_unstale":"2023-06-22T10:55:16.934895+0000","last_undegraded":"2023-06-22T10:55:16.934895+0000","last_fullsized":"2023-06-22T10:55:16.934895+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:46:08.324587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.148734+0000","last_change":"2023-06-22T10:55:15.150679+0000","last_active":"2023-06-22T10:55:16.148734+0000","last_peered":"2023-06-22T10:55:16.148734+0000","last_clean":"2023-06-22T10:55:16.148734+0000","last_became_active":"2023-06-22T10:55:15.150351+0000","last_became_peered":"2023-06-22T10:55:15.150351+0000","last_unstale":"2023-06-22T10:55:16.148734+0000","last_undegraded":"2023-06-22T10:55:16.148734+0000","last_fullsized":"2023-06-22T10:55:16.148734+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:24:42.334936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.202800+0000","last_change":"2023-06-22T10:55:15.140719+0000","last_active":"2023-06-22T10:55:16.202800+0000","last_peered":"2023-06-22T10:55:16.202800+0000","last_clean":"2023-06-22T10:55:16.202800+0000","last_became_active":"2023-06-22T10:55:15.140184+0000","last_became_peered":"2023-06-22T10:55:15.140184+0000","last_unstale":"2023-06-22T10:55:16.202800+0000","last_undegraded":"2023-06-22T10:55:16.202800+0000","last_fullsized":"2023-06-22T10:55:16.202800+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:38:23.689102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.935065+0000","last_change":"2023-06-22T10:55:15.147594+0000","last_active":"2023-06-22T10:55:16.935065+0000","last_peered":"2023-06-22T10:55:16.935065+0000","last_clean":"2023-06-22T10:55:16.935065+0000","last_became_active":"2023-06-22T10:55:15.147285+0000","last_became_peered":"2023-06-22T10:55:15.147285+0000","last_unstale":"2023-06-22T10:55:16.935065+0000","last_undegraded":"2023-06-22T10:55:16.935065+0000","last_fullsized":"2023-06-22T10:55:16.935065+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T18:54:53.530939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.934610+0000","last_change":"2023-06-22T10:55:15.152988+0000","last_active":"2023-06-22T10:55:16.934610+0000","last_peered":"2023-06-22T10:55:16.934610+0000","last_clean":"2023-06-22T10:55:16.934610+0000","last_became_active":"2023-06-22T10:55:15.152457+0000","last_became_peered":"2023-06-22T10:55:15.152457+0000","last_unstale":"2023-06-22T10:55:16.934610+0000","last_undegraded":"2023-06-22T10:55:16.934610+0000","last_fullsized":"2023-06-22T10:55:16.934610+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:32:58.626548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.935627+0000","last_change":"2023-06-22T10:55:15.143103+0000","last_active":"2023-06-22T10:55:16.935627+0000","last_peered":"2023-06-22T10:55:16.935627+0000","last_clean":"2023-06-22T10:55:16.935627+0000","last_became_active":"2023-06-22T10:55:15.142807+0000","last_became_peered":"2023-06-22T10:55:15.142807+0000","last_unstale":"2023-06-22T10:55:16.935627+0000","last_undegraded":"2023-06-22T10:55:16.935627+0000","last_fullsized":"2023-06-22T10:55:16.935627+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:14:03.237496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.935427+0000","last_change":"2023-06-22T10:55:15.152639+0000","last_active":"2023-06-22T10:55:16.935427+0000","last_peered":"2023-06-22T10:55:16.935427+0000","last_clean":"2023-06-22T10:55:16.935427+0000","last_became_active":"2023-06-22T10:55:15.152325+0000","last_became_peered":"2023-06-22T10:55:15.152325+0000","last_unstale":"2023-06-22T10:55:16.935427+0000","last_undegraded":"2023-06-22T10:55:16.935427+0000","last_fullsized":"2023-06-22T10:55:16.935427+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T20:56:46.097736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.935658+0000","last_change":"2023-06-22T10:55:15.144210+0000","last_active":"2023-06-22T10:55:16.935658+0000","last_peered":"2023-06-22T10:55:16.935658+0000","last_clean":"2023-06-22T10:55:16.935658+0000","last_became_active":"2023-06-22T10:55:15.143894+0000","last_became_peered":"2023-06-22T10:55:15.143894+0000","last_unstale":"2023-06-22T10:55:16.935658+0000","last_undegraded":"2023-06-22T10:55:16.935658+0000","last_fullsized":"2023-06-22T10:55:16.935658+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:22:43.639845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.148935+0000","last_change":"2023-06-22T10:55:15.158513+0000","last_active":"2023-06-22T10:55:16.148935+0000","last_peered":"2023-06-22T10:55:16.148935+0000","last_clean":"2023-06-22T10:55:16.148935+0000","last_became_active":"2023-06-22T10:55:15.158018+0000","last_became_peered":"2023-06-22T10:55:15.158018+0000","last_unstale":"2023-06-22T10:55:16.148935+0000","last_undegraded":"2023-06-22T10:55:16.148935+0000","last_fullsized":"2023-06-22T10:55:16.148935+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T13:01:35.861879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.934902+0000","last_change":"2023-06-22T10:55:15.165913+0000","last_active":"2023-06-22T10:55:16.934902+0000","last_peered":"2023-06-22T10:55:16.934902+0000","last_clean":"2023-06-22T10:55:16.934902+0000","last_became_active":"2023-06-22T10:55:15.165613+0000","last_became_peered":"2023-06-22T10:55:15.165613+0000","last_unstale":"2023-06-22T10:55:16.934902+0000","last_undegraded":"2023-06-22T10:55:16.934902+0000","last_fullsized":"2023-06-22T10:55:16.934902+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T17:59:17.867416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.935205+0000","last_change":"2023-06-22T10:55:15.143174+0000","last_active":"2023-06-22T10:55:16.935205+0000","last_peered":"2023-06-22T10:55:16.935205+0000","last_clean":"2023-06-22T10:55:16.935205+0000","last_became_active":"2023-06-22T10:55:15.142870+0000","last_became_peered":"2023-06-22T10:55:15.142870+0000","last_unstale":"2023-06-22T10:55:16.935205+0000","last_undegraded":"2023-06-22T10:55:16.935205+0000","last_fullsized":"2023-06-22T10:55:16.935205+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T20:07:47.150026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.202626+0000","last_change":"2023-06-22T10:55:15.158867+0000","last_active":"2023-06-22T10:55:16.202626+0000","last_peered":"2023-06-22T10:55:16.202626+0000","last_clean":"2023-06-22T10:55:16.202626+0000","last_became_active":"2023-06-22T10:55:15.156977+0000","last_became_peered":"2023-06-22T10:55:15.156977+0000","last_unstale":"2023-06-22T10:55:16.202626+0000","last_undegraded":"2023-06-22T10:55:16.202626+0000","last_fullsized":"2023-06-22T10:55:16.202626+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:19:51.540255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.934920+0000","last_change":"2023-06-22T10:55:15.161724+0000","last_active":"2023-06-22T10:55:16.934920+0000","last_peered":"2023-06-22T10:55:16.934920+0000","last_clean":"2023-06-22T10:55:16.934920+0000","last_became_active":"2023-06-22T10:55:15.160857+0000","last_became_peered":"2023-06-22T10:55:15.160857+0000","last_unstale":"2023-06-22T10:55:16.934920+0000","last_undegraded":"2023-06-22T10:55:16.934920+0000","last_fullsized":"2023-06-22T10:55:16.934920+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T15:59:10.534126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.149263+0000","last_change":"2023-06-22T10:55:15.148381+0000","last_active":"2023-06-22T10:55:16.149263+0000","last_peered":"2023-06-22T10:55:16.149263+0000","last_clean":"2023-06-22T10:55:16.149263+0000","last_became_active":"2023-06-22T10:55:15.148094+0000","last_became_peered":"2023-06-22T10:55:15.148094+0000","last_unstale":"2023-06-22T10:55:16.149263+0000","last_undegraded":"2023-06-22T10:55:16.149263+0000","last_fullsized":"2023-06-22T10:55:16.149263+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:38:29.809242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.148853+0000","last_change":"2023-06-22T10:55:15.162888+0000","last_active":"2023-06-22T10:55:16.148853+0000","last_peered":"2023-06-22T10:55:16.148853+0000","last_clean":"2023-06-22T10:55:16.148853+0000","last_became_active":"2023-06-22T10:55:15.162528+0000","last_became_peered":"2023-06-22T10:55:15.162528+0000","last_unstale":"2023-06-22T10:55:16.148853+0000","last_undegraded":"2023-06-22T10:55:16.148853+0000","last_fullsized":"2023-06-22T10:55:16.148853+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:00:39.642679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.935817+0000","last_change":"2023-06-22T10:55:15.161201+0000","last_active":"2023-06-22T10:55:16.935817+0000","last_peered":"2023-06-22T10:55:16.935817+0000","last_clean":"2023-06-22T10:55:16.935817+0000","last_became_active":"2023-06-22T10:55:15.160853+0000","last_became_peered":"2023-06-22T10:55:15.160853+0000","last_unstale":"2023-06-22T10:55:16.935817+0000","last_undegraded":"2023-06-22T10:55:16.935817+0000","last_fullsized":"2023-06-22T10:55:16.935817+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:42:59.236134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.935460+0000","last_change":"2023-06-22T10:55:15.164881+0000","last_active":"2023-06-22T10:55:16.935460+0000","last_peered":"2023-06-22T10:55:16.935460+0000","last_clean":"2023-06-22T10:55:16.935460+0000","last_became_active":"2023-06-22T10:55:15.163965+0000","last_became_peered":"2023-06-22T10:55:15.163965+0000","last_unstale":"2023-06-22T10:55:16.935460+0000","last_undegraded":"2023-06-22T10:55:16.935460+0000","last_fullsized":"2023-06-22T10:55:16.935460+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:45:48.928913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.202876+0000","last_change":"2023-06-22T10:55:15.154322+0000","last_active":"2023-06-22T10:55:16.202876+0000","last_peered":"2023-06-22T10:55:16.202876+0000","last_clean":"2023-06-22T10:55:16.202876+0000","last_became_active":"2023-06-22T10:55:15.154013+0000","last_became_peered":"2023-06-22T10:55:15.154013+0000","last_unstale":"2023-06-22T10:55:16.202876+0000","last_undegraded":"2023-06-22T10:55:16.202876+0000","last_fullsized":"2023-06-22T10:55:16.202876+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T17:55:25.635403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.935308+0000","last_change":"2023-06-22T10:55:15.153413+0000","last_active":"2023-06-22T10:55:16.935308+0000","last_peered":"2023-06-22T10:55:16.935308+0000","last_clean":"2023-06-22T10:55:16.935308+0000","last_became_active":"2023-06-22T10:55:15.153179+0000","last_became_peered":"2023-06-22T10:55:15.153179+0000","last_unstale":"2023-06-22T10:55:16.935308+0000","last_undegraded":"2023-06-22T10:55:16.935308+0000","last_fullsized":"2023-06-22T10:55:16.935308+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:30:48.210901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.935030+0000","last_change":"2023-06-22T10:55:15.150305+0000","last_active":"2023-06-22T10:55:16.935030+0000","last_peered":"2023-06-22T10:55:16.935030+0000","last_clean":"2023-06-22T10:55:16.935030+0000","last_became_active":"2023-06-22T10:55:15.149747+0000","last_became_peered":"2023-06-22T10:55:15.149747+0000","last_unstale":"2023-06-22T10:55:16.935030+0000","last_undegraded":"2023-06-22T10:55:16.935030+0000","last_fullsized":"2023-06-22T10:55:16.935030+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:45:48.928913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.934937+0000","last_change":"2023-06-22T10:55:15.149307+0000","last_active":"2023-06-22T10:55:16.934937+0000","last_peered":"2023-06-22T10:55:16.934937+0000","last_clean":"2023-06-22T10:55:16.934937+0000","last_became_active":"2023-06-22T10:55:15.148921+0000","last_became_peered":"2023-06-22T10:55:15.148921+0000","last_unstale":"2023-06-22T10:55:16.934937+0000","last_undegraded":"2023-06-22T10:55:16.934937+0000","last_fullsized":"2023-06-22T10:55:16.934937+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:56:55.577936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.935719+0000","last_change":"2023-06-22T10:55:15.155584+0000","last_active":"2023-06-22T10:55:16.935719+0000","last_peered":"2023-06-22T10:55:16.935719+0000","last_clean":"2023-06-22T10:55:16.935719+0000","last_became_active":"2023-06-22T10:55:15.155330+0000","last_became_peered":"2023-06-22T10:55:15.155330+0000","last_unstale":"2023-06-22T10:55:16.935719+0000","last_undegraded":"2023-06-22T10:55:16.935719+0000","last_fullsized":"2023-06-22T10:55:16.935719+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T18:31:37.223625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.935408+0000","last_change":"2023-06-22T10:55:15.164025+0000","last_active":"2023-06-22T10:55:16.935408+0000","last_peered":"2023-06-22T10:55:16.935408+0000","last_clean":"2023-06-22T10:55:16.935408+0000","last_became_active":"2023-06-22T10:55:15.163639+0000","last_became_peered":"2023-06-22T10:55:15.163639+0000","last_unstale":"2023-06-22T10:55:16.935408+0000","last_undegraded":"2023-06-22T10:55:16.935408+0000","last_fullsized":"2023-06-22T10:55:16.935408+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:56:55.577936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.149073+0000","last_change":"2023-06-22T10:55:15.148866+0000","last_active":"2023-06-22T10:55:16.149073+0000","last_peered":"2023-06-22T10:55:16.149073+0000","last_clean":"2023-06-22T10:55:16.149073+0000","last_became_active":"2023-06-22T10:55:15.148614+0000","last_became_peered":"2023-06-22T10:55:15.148614+0000","last_unstale":"2023-06-22T10:55:16.149073+0000","last_undegraded":"2023-06-22T10:55:16.149073+0000","last_fullsized":"2023-06-22T10:55:16.149073+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:00:19.057864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.148268+0000","last_change":"2023-06-22T10:55:15.158708+0000","last_active":"2023-06-22T10:55:16.148268+0000","last_peered":"2023-06-22T10:55:16.148268+0000","last_clean":"2023-06-22T10:55:16.148268+0000","last_became_active":"2023-06-22T10:55:15.158417+0000","last_became_peered":"2023-06-22T10:55:15.158417+0000","last_unstale":"2023-06-22T10:55:16.148268+0000","last_undegraded":"2023-06-22T10:55:16.148268+0000","last_fullsized":"2023-06-22T10:55:16.148268+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T17:55:25.635403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.935580+0000","last_change":"2023-06-22T10:55:15.155063+0000","last_active":"2023-06-22T10:55:16.935580+0000","last_peered":"2023-06-22T10:55:16.935580+0000","last_clean":"2023-06-22T10:55:16.935580+0000","last_became_active":"2023-06-22T10:55:15.154764+0000","last_became_peered":"2023-06-22T10:55:15.154764+0000","last_unstale":"2023-06-22T10:55:16.935580+0000","last_undegraded":"2023-06-22T10:55:16.935580+0000","last_fullsized":"2023-06-22T10:55:16.935580+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:48:31.780112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.148084+0000","last_change":"2023-06-22T10:55:15.153868+0000","last_active":"2023-06-22T10:55:16.148084+0000","last_peered":"2023-06-22T10:55:16.148084+0000","last_clean":"2023-06-22T10:55:16.148084+0000","last_became_active":"2023-06-22T10:55:15.153561+0000","last_became_peered":"2023-06-22T10:55:15.153561+0000","last_unstale":"2023-06-22T10:55:16.148084+0000","last_undegraded":"2023-06-22T10:55:16.148084+0000","last_fullsized":"2023-06-22T10:55:16.148084+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T11:51:47.650938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.202484+0000","last_change":"2023-06-22T10:55:15.139002+0000","last_active":"2023-06-22T10:55:16.202484+0000","last_peered":"2023-06-22T10:55:16.202484+0000","last_clean":"2023-06-22T10:55:16.202484+0000","last_became_active":"2023-06-22T10:55:15.138699+0000","last_became_peered":"2023-06-22T10:55:15.138699+0000","last_unstale":"2023-06-22T10:55:16.202484+0000","last_undegraded":"2023-06-22T10:55:16.202484+0000","last_fullsized":"2023-06-22T10:55:16.202484+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T20:17:28.901850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.934767+0000","last_change":"2023-06-22T10:55:15.154376+0000","last_active":"2023-06-22T10:55:16.934767+0000","last_peered":"2023-06-22T10:55:16.934767+0000","last_clean":"2023-06-22T10:55:16.934767+0000","last_became_active":"2023-06-22T10:55:15.153992+0000","last_became_peered":"2023-06-22T10:55:15.153992+0000","last_unstale":"2023-06-22T10:55:16.934767+0000","last_undegraded":"2023-06-22T10:55:16.934767+0000","last_fullsized":"2023-06-22T10:55:16.934767+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:53:32.544241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.146617+0000","last_change":"2023-06-22T10:55:15.147540+0000","last_active":"2023-06-22T10:55:16.146617+0000","last_peered":"2023-06-22T10:55:16.146617+0000","last_clean":"2023-06-22T10:55:16.146617+0000","last_became_active":"2023-06-22T10:55:15.147243+0000","last_became_peered":"2023-06-22T10:55:15.147243+0000","last_unstale":"2023-06-22T10:55:16.146617+0000","last_undegraded":"2023-06-22T10:55:16.146617+0000","last_fullsized":"2023-06-22T10:55:16.146617+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T20:07:47.150026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"41'4","reported_seq":17,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.203230+0000","last_change":"2023-06-22T10:55:14.145265+0000","last_active":"2023-06-22T10:55:16.203230+0000","last_peered":"2023-06-22T10:55:16.203230+0000","last_clean":"2023-06-22T10:55:16.203230+0000","last_became_active":"2023-06-22T10:55:14.144949+0000","last_became_peered":"2023-06-22T10:55:14.144949+0000","last_unstale":"2023-06-22T10:55:16.203230+0000","last_undegraded":"2023-06-22T10:55:16.203230+0000","last_fullsized":"2023-06-22T10:55:16.203230+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_clean_scrub_stamp":"2023-06-22T10:55:13.109670+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:33:23.861068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.935313+0000","last_change":"2023-06-22T10:55:15.153919+0000","last_active":"2023-06-22T10:55:16.935313+0000","last_peered":"2023-06-22T10:55:16.935313+0000","last_clean":"2023-06-22T10:55:16.935313+0000","last_became_active":"2023-06-22T10:55:15.153651+0000","last_became_peered":"2023-06-22T10:55:15.153651+0000","last_unstale":"2023-06-22T10:55:16.935313+0000","last_undegraded":"2023-06-22T10:55:16.935313+0000","last_fullsized":"2023-06-22T10:55:16.935313+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:37:05.075166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.149176+0000","last_change":"2023-06-22T10:55:14.145270+0000","last_active":"2023-06-22T10:55:16.149176+0000","last_peered":"2023-06-22T10:55:16.149176+0000","last_clean":"2023-06-22T10:55:16.149176+0000","last_became_active":"2023-06-22T10:55:14.144715+0000","last_became_peered":"2023-06-22T10:55:14.144715+0000","last_unstale":"2023-06-22T10:55:16.149176+0000","last_undegraded":"2023-06-22T10:55:16.149176+0000","last_fullsized":"2023-06-22T10:55:16.149176+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_clean_scrub_stamp":"2023-06-22T10:55:13.109670+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:10:40.156870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.148779+0000","last_change":"2023-06-22T10:55:15.145249+0000","last_active":"2023-06-22T10:55:16.148779+0000","last_peered":"2023-06-22T10:55:16.148779+0000","last_clean":"2023-06-22T10:55:16.148779+0000","last_became_active":"2023-06-22T10:55:15.144836+0000","last_became_peered":"2023-06-22T10:55:15.144836+0000","last_unstale":"2023-06-22T10:55:16.148779+0000","last_undegraded":"2023-06-22T10:55:16.148779+0000","last_fullsized":"2023-06-22T10:55:16.148779+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:33:24.867151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.147001+0000","last_change":"2023-06-22T10:55:14.140512+0000","last_active":"2023-06-22T10:55:16.147001+0000","last_peered":"2023-06-22T10:55:16.147001+0000","last_clean":"2023-06-22T10:55:16.147001+0000","last_became_active":"2023-06-22T10:55:14.140199+0000","last_became_peered":"2023-06-22T10:55:14.140199+0000","last_unstale":"2023-06-22T10:55:16.147001+0000","last_undegraded":"2023-06-22T10:55:16.147001+0000","last_fullsized":"2023-06-22T10:55:16.147001+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_clean_scrub_stamp":"2023-06-22T10:55:13.109670+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:39:14.457874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.146857+0000","last_change":"2023-06-22T10:55:15.152681+0000","last_active":"2023-06-22T10:55:16.146857+0000","last_peered":"2023-06-22T10:55:16.146857+0000","last_clean":"2023-06-22T10:55:16.146857+0000","last_became_active":"2023-06-22T10:55:15.152357+0000","last_became_peered":"2023-06-22T10:55:15.152357+0000","last_unstale":"2023-06-22T10:55:16.146857+0000","last_undegraded":"2023-06-22T10:55:16.146857+0000","last_fullsized":"2023-06-22T10:55:16.146857+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T20:56:46.097736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.935966+0000","last_change":"2023-06-22T10:55:14.147926+0000","last_active":"2023-06-22T10:55:16.935966+0000","last_peered":"2023-06-22T10:55:16.935966+0000","last_clean":"2023-06-22T10:55:16.935966+0000","last_became_active":"2023-06-22T10:55:14.147639+0000","last_became_peered":"2023-06-22T10:55:14.147639+0000","last_unstale":"2023-06-22T10:55:16.935966+0000","last_undegraded":"2023-06-22T10:55:16.935966+0000","last_fullsized":"2023-06-22T10:55:16.935966+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_clean_scrub_stamp":"2023-06-22T10:55:13.109670+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:33:23.861068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.148227+0000","last_change":"2023-06-22T10:55:15.153322+0000","last_active":"2023-06-22T10:55:16.148227+0000","last_peered":"2023-06-22T10:55:16.148227+0000","last_clean":"2023-06-22T10:55:16.148227+0000","last_became_active":"2023-06-22T10:55:15.152897+0000","last_became_peered":"2023-06-22T10:55:15.152897+0000","last_unstale":"2023-06-22T10:55:16.148227+0000","last_undegraded":"2023-06-22T10:55:16.148227+0000","last_fullsized":"2023-06-22T10:55:16.148227+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:45:01.575717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.203220+0000","last_change":"2023-06-22T10:55:14.147890+0000","last_active":"2023-06-22T10:55:16.203220+0000","last_peered":"2023-06-22T10:55:16.203220+0000","last_clean":"2023-06-22T10:55:16.203220+0000","last_became_active":"2023-06-22T10:55:14.147567+0000","last_became_peered":"2023-06-22T10:55:14.147567+0000","last_unstale":"2023-06-22T10:55:16.203220+0000","last_undegraded":"2023-06-22T10:55:16.203220+0000","last_fullsized":"2023-06-22T10:55:16.203220+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_clean_scrub_stamp":"2023-06-22T10:55:13.109670+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T15:56:56.611283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.935131+0000","last_change":"2023-06-22T10:55:15.155623+0000","last_active":"2023-06-22T10:55:16.935131+0000","last_peered":"2023-06-22T10:55:16.935131+0000","last_clean":"2023-06-22T10:55:16.935131+0000","last_became_active":"2023-06-22T10:55:15.155116+0000","last_became_peered":"2023-06-22T10:55:15.155116+0000","last_unstale":"2023-06-22T10:55:16.935131+0000","last_undegraded":"2023-06-22T10:55:16.935131+0000","last_fullsized":"2023-06-22T10:55:16.935131+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T20:05:18.802631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.148349+0000","last_change":"2023-06-22T10:55:14.133831+0000","last_active":"2023-06-22T10:55:16.148349+0000","last_peered":"2023-06-22T10:55:16.148349+0000","last_clean":"2023-06-22T10:55:16.148349+0000","last_became_active":"2023-06-22T10:55:14.133470+0000","last_became_peered":"2023-06-22T10:55:14.133470+0000","last_unstale":"2023-06-22T10:55:16.148349+0000","last_undegraded":"2023-06-22T10:55:16.148349+0000","last_fullsized":"2023-06-22T10:55:16.148349+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_clean_scrub_stamp":"2023-06-22T10:55:13.109670+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T20:10:21.142419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.934674+0000","last_change":"2023-06-22T10:55:15.152799+0000","last_active":"2023-06-22T10:55:16.934674+0000","last_peered":"2023-06-22T10:55:16.934674+0000","last_clean":"2023-06-22T10:55:16.934674+0000","last_became_active":"2023-06-22T10:55:15.152031+0000","last_became_peered":"2023-06-22T10:55:15.152031+0000","last_unstale":"2023-06-22T10:55:16.934674+0000","last_undegraded":"2023-06-22T10:55:16.934674+0000","last_fullsized":"2023-06-22T10:55:16.934674+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T20:16:37.221724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.148573+0000","last_change":"2023-06-22T10:55:14.132202+0000","last_active":"2023-06-22T10:55:16.148573+0000","last_peered":"2023-06-22T10:55:16.148573+0000","last_clean":"2023-06-22T10:55:16.148573+0000","last_became_active":"2023-06-22T10:55:14.131822+0000","last_became_peered":"2023-06-22T10:55:14.131822+0000","last_unstale":"2023-06-22T10:55:16.148573+0000","last_undegraded":"2023-06-22T10:55:16.148573+0000","last_fullsized":"2023-06-22T10:55:16.148573+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_clean_scrub_stamp":"2023-06-22T10:55:13.109670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T18:54:52.524856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.935279+0000","last_change":"2023-06-22T10:55:15.150085+0000","last_active":"2023-06-22T10:55:16.935279+0000","last_peered":"2023-06-22T10:55:16.935279+0000","last_clean":"2023-06-22T10:55:16.935279+0000","last_became_active":"2023-06-22T10:55:15.149274+0000","last_became_peered":"2023-06-22T10:55:15.149274+0000","last_unstale":"2023-06-22T10:55:16.935279+0000","last_undegraded":"2023-06-22T10:55:16.935279+0000","last_fullsized":"2023-06-22T10:55:16.935279+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:38:40.418219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.934710+0000","last_change":"2023-06-22T10:55:14.147810+0000","last_active":"2023-06-22T10:55:16.934710+0000","last_peered":"2023-06-22T10:55:16.934710+0000","last_clean":"2023-06-22T10:55:16.934710+0000","last_became_active":"2023-06-22T10:55:14.147165+0000","last_became_peered":"2023-06-22T10:55:14.147165+0000","last_unstale":"2023-06-22T10:55:16.934710+0000","last_undegraded":"2023-06-22T10:55:16.934710+0000","last_fullsized":"2023-06-22T10:55:16.934710+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_clean_scrub_stamp":"2023-06-22T10:55:13.109670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:44:30.738836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.149157+0000","last_change":"2023-06-22T10:55:15.158338+0000","last_active":"2023-06-22T10:55:16.149157+0000","last_peered":"2023-06-22T10:55:16.149157+0000","last_clean":"2023-06-22T10:55:16.149157+0000","last_became_active":"2023-06-22T10:55:15.158051+0000","last_became_peered":"2023-06-22T10:55:15.158051+0000","last_unstale":"2023-06-22T10:55:16.149157+0000","last_undegraded":"2023-06-22T10:55:16.149157+0000","last_fullsized":"2023-06-22T10:55:16.149157+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:50:29.465085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.149433+0000","last_change":"2023-06-22T10:55:14.140127+0000","last_active":"2023-06-22T10:55:16.149433+0000","last_peered":"2023-06-22T10:55:16.149433+0000","last_clean":"2023-06-22T10:55:16.149433+0000","last_became_active":"2023-06-22T10:55:14.139797+0000","last_became_peered":"2023-06-22T10:55:14.139797+0000","last_unstale":"2023-06-22T10:55:16.149433+0000","last_undegraded":"2023-06-22T10:55:16.149433+0000","last_fullsized":"2023-06-22T10:55:16.149433+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_clean_scrub_stamp":"2023-06-22T10:55:13.109670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T11:56:50.205108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.936176+0000","last_change":"2023-06-22T10:55:15.140260+0000","last_active":"2023-06-22T10:55:16.936176+0000","last_peered":"2023-06-22T10:55:16.936176+0000","last_clean":"2023-06-22T10:55:16.936176+0000","last_became_active":"2023-06-22T10:55:15.139971+0000","last_became_peered":"2023-06-22T10:55:15.139971+0000","last_unstale":"2023-06-22T10:55:16.936176+0000","last_undegraded":"2023-06-22T10:55:16.936176+0000","last_fullsized":"2023-06-22T10:55:16.936176+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:20:56.163441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.935690+0000","last_change":"2023-06-22T10:55:14.149309+0000","last_active":"2023-06-22T10:55:16.935690+0000","last_peered":"2023-06-22T10:55:16.935690+0000","last_clean":"2023-06-22T10:55:16.935690+0000","last_became_active":"2023-06-22T10:55:14.148956+0000","last_became_peered":"2023-06-22T10:55:14.148956+0000","last_unstale":"2023-06-22T10:55:16.935690+0000","last_undegraded":"2023-06-22T10:55:16.935690+0000","last_fullsized":"2023-06-22T10:55:16.935690+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_clean_scrub_stamp":"2023-06-22T10:55:13.109670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:33:44.445882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.203036+0000","last_change":"2023-06-22T10:55:15.156511+0000","last_active":"2023-06-22T10:55:16.203036+0000","last_peered":"2023-06-22T10:55:16.203036+0000","last_clean":"2023-06-22T10:55:16.203036+0000","last_became_active":"2023-06-22T10:55:15.156192+0000","last_became_peered":"2023-06-22T10:55:15.156192+0000","last_unstale":"2023-06-22T10:55:16.203036+0000","last_undegraded":"2023-06-22T10:55:16.203036+0000","last_fullsized":"2023-06-22T10:55:16.203036+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T18:54:53.530939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"41'3","reported_seq":16,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.936271+0000","last_change":"2023-06-22T10:55:14.147873+0000","last_active":"2023-06-22T10:55:16.936271+0000","last_peered":"2023-06-22T10:55:16.936271+0000","last_clean":"2023-06-22T10:55:16.936271+0000","last_became_active":"2023-06-22T10:55:14.147548+0000","last_became_peered":"2023-06-22T10:55:14.147548+0000","last_unstale":"2023-06-22T10:55:16.936271+0000","last_undegraded":"2023-06-22T10:55:16.936271+0000","last_fullsized":"2023-06-22T10:55:16.936271+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_clean_scrub_stamp":"2023-06-22T10:55:13.109670+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T11:18:24.285931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.936117+0000","last_change":"2023-06-22T10:55:15.143791+0000","last_active":"2023-06-22T10:55:16.936117+0000","last_peered":"2023-06-22T10:55:16.936117+0000","last_clean":"2023-06-22T10:55:16.936117+0000","last_became_active":"2023-06-22T10:55:15.143470+0000","last_became_peered":"2023-06-22T10:55:15.143470+0000","last_unstale":"2023-06-22T10:55:16.936117+0000","last_undegraded":"2023-06-22T10:55:16.936117+0000","last_fullsized":"2023-06-22T10:55:16.936117+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T11:00:35.629640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"41'6","reported_seq":19,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.935786+0000","last_change":"2023-06-22T10:55:14.144309+0000","last_active":"2023-06-22T10:55:16.935786+0000","last_peered":"2023-06-22T10:55:16.935786+0000","last_clean":"2023-06-22T10:55:16.935786+0000","last_became_active":"2023-06-22T10:55:14.144036+0000","last_became_peered":"2023-06-22T10:55:14.144036+0000","last_unstale":"2023-06-22T10:55:16.935786+0000","last_undegraded":"2023-06-22T10:55:16.935786+0000","last_fullsized":"2023-06-22T10:55:16.935786+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_clean_scrub_stamp":"2023-06-22T10:55:13.109670+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:37:04.069083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.935565+0000","last_change":"2023-06-22T10:55:15.158004+0000","last_active":"2023-06-22T10:55:16.935565+0000","last_peered":"2023-06-22T10:55:16.935565+0000","last_clean":"2023-06-22T10:55:16.935565+0000","last_became_active":"2023-06-22T10:55:15.157711+0000","last_became_peered":"2023-06-22T10:55:15.157711+0000","last_unstale":"2023-06-22T10:55:16.935565+0000","last_undegraded":"2023-06-22T10:55:16.935565+0000","last_fullsized":"2023-06-22T10:55:16.935565+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T13:53:13.845760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.203351+0000","last_change":"2023-06-22T10:55:14.141273+0000","last_active":"2023-06-22T10:55:16.203351+0000","last_peered":"2023-06-22T10:55:16.203351+0000","last_clean":"2023-06-22T10:55:16.203351+0000","last_became_active":"2023-06-22T10:55:14.140925+0000","last_became_peered":"2023-06-22T10:55:14.140925+0000","last_unstale":"2023-06-22T10:55:16.203351+0000","last_undegraded":"2023-06-22T10:55:16.203351+0000","last_fullsized":"2023-06-22T10:55:16.203351+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_clean_scrub_stamp":"2023-06-22T10:55:13.109670+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T13:01:34.855796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.935362+0000","last_change":"2023-06-22T10:55:15.151108+0000","last_active":"2023-06-22T10:55:16.935362+0000","last_peered":"2023-06-22T10:55:16.935362+0000","last_clean":"2023-06-22T10:55:16.935362+0000","last_became_active":"2023-06-22T10:55:15.150828+0000","last_became_peered":"2023-06-22T10:55:15.150828+0000","last_unstale":"2023-06-22T10:55:16.935362+0000","last_undegraded":"2023-06-22T10:55:16.935362+0000","last_fullsized":"2023-06-22T10:55:16.935362+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:38:59.468065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.935281+0000","last_change":"2023-06-22T10:55:14.146154+0000","last_active":"2023-06-22T10:55:16.935281+0000","last_peered":"2023-06-22T10:55:16.935281+0000","last_clean":"2023-06-22T10:55:16.935281+0000","last_became_active":"2023-06-22T10:55:14.145847+0000","last_became_peered":"2023-06-22T10:55:14.145847+0000","last_unstale":"2023-06-22T10:55:16.935281+0000","last_undegraded":"2023-06-22T10:55:16.935281+0000","last_fullsized":"2023-06-22T10:55:16.935281+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_clean_scrub_stamp":"2023-06-22T10:55:13.109670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T13:12:11.600421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.202555+0000","last_change":"2023-06-22T10:55:15.157089+0000","last_active":"2023-06-22T10:55:16.202555+0000","last_peered":"2023-06-22T10:55:16.202555+0000","last_clean":"2023-06-22T10:55:16.202555+0000","last_became_active":"2023-06-22T10:55:15.156769+0000","last_became_peered":"2023-06-22T10:55:15.156769+0000","last_unstale":"2023-06-22T10:55:16.202555+0000","last_undegraded":"2023-06-22T10:55:16.202555+0000","last_fullsized":"2023-06-22T10:55:16.202555+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:17:02.143564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.202613+0000","last_change":"2023-06-22T10:55:14.140597+0000","last_active":"2023-06-22T10:55:16.202613+0000","last_peered":"2023-06-22T10:55:16.202613+0000","last_clean":"2023-06-22T10:55:16.202613+0000","last_became_active":"2023-06-22T10:55:14.140296+0000","last_became_peered":"2023-06-22T10:55:14.140296+0000","last_unstale":"2023-06-22T10:55:16.202613+0000","last_undegraded":"2023-06-22T10:55:16.202613+0000","last_fullsized":"2023-06-22T10:55:16.202613+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_clean_scrub_stamp":"2023-06-22T10:55:13.109670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:25:49.648765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.935255+0000","last_change":"2023-06-22T10:55:15.149518+0000","last_active":"2023-06-22T10:55:16.935255+0000","last_peered":"2023-06-22T10:55:16.935255+0000","last_clean":"2023-06-22T10:55:16.935255+0000","last_became_active":"2023-06-22T10:55:15.149146+0000","last_became_peered":"2023-06-22T10:55:15.149146+0000","last_unstale":"2023-06-22T10:55:16.935255+0000","last_undegraded":"2023-06-22T10:55:16.935255+0000","last_fullsized":"2023-06-22T10:55:16.935255+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:24:42.334936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"41'8","reported_seq":21,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.934780+0000","last_change":"2023-06-22T10:55:14.147997+0000","last_active":"2023-06-22T10:55:16.934780+0000","last_peered":"2023-06-22T10:55:16.934780+0000","last_clean":"2023-06-22T10:55:16.934780+0000","last_became_active":"2023-06-22T10:55:14.147549+0000","last_became_peered":"2023-06-22T10:55:14.147549+0000","last_unstale":"2023-06-22T10:55:16.934780+0000","last_undegraded":"2023-06-22T10:55:16.934780+0000","last_fullsized":"2023-06-22T10:55:16.934780+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_clean_scrub_stamp":"2023-06-22T10:55:13.109670+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T17:07:54.795531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.935550+0000","last_change":"2023-06-22T10:55:15.152322+0000","last_active":"2023-06-22T10:55:16.935550+0000","last_peered":"2023-06-22T10:55:16.935550+0000","last_clean":"2023-06-22T10:55:16.935550+0000","last_became_active":"2023-06-22T10:55:15.152013+0000","last_became_peered":"2023-06-22T10:55:15.152013+0000","last_unstale":"2023-06-22T10:55:16.935550+0000","last_undegraded":"2023-06-22T10:55:16.935550+0000","last_fullsized":"2023-06-22T10:55:16.935550+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:38:40.418219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.935212+0000","last_change":"2023-06-22T10:55:14.150262+0000","last_active":"2023-06-22T10:55:16.935212+0000","last_peered":"2023-06-22T10:55:16.935212+0000","last_clean":"2023-06-22T10:55:16.935212+0000","last_became_active":"2023-06-22T10:55:14.149894+0000","last_became_peered":"2023-06-22T10:55:14.149894+0000","last_unstale":"2023-06-22T10:55:16.935212+0000","last_undegraded":"2023-06-22T10:55:16.935212+0000","last_fullsized":"2023-06-22T10:55:16.935212+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_clean_scrub_stamp":"2023-06-22T10:55:13.109670+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T15:59:09.528043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.935686+0000","last_change":"2023-06-22T10:55:15.156580+0000","last_active":"2023-06-22T10:55:16.935686+0000","last_peered":"2023-06-22T10:55:16.935686+0000","last_clean":"2023-06-22T10:55:16.935686+0000","last_became_active":"2023-06-22T10:55:15.156262+0000","last_became_peered":"2023-06-22T10:55:15.156262+0000","last_unstale":"2023-06-22T10:55:16.935686+0000","last_undegraded":"2023-06-22T10:55:16.935686+0000","last_fullsized":"2023-06-22T10:55:16.935686+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T20:10:29.104911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.149016+0000","last_change":"2023-06-22T10:55:14.145003+0000","last_active":"2023-06-22T10:55:16.149016+0000","last_peered":"2023-06-22T10:55:16.149016+0000","last_clean":"2023-06-22T10:55:16.149016+0000","last_became_active":"2023-06-22T10:55:14.144228+0000","last_became_peered":"2023-06-22T10:55:14.144228+0000","last_unstale":"2023-06-22T10:55:16.149016+0000","last_undegraded":"2023-06-22T10:55:16.149016+0000","last_fullsized":"2023-06-22T10:55:16.149016+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_clean_scrub_stamp":"2023-06-22T10:55:13.109670+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T11:53:41.666099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.935665+0000","last_change":"2023-06-22T10:55:15.161911+0000","last_active":"2023-06-22T10:55:16.935665+0000","last_peered":"2023-06-22T10:55:16.935665+0000","last_clean":"2023-06-22T10:55:16.935665+0000","last_became_active":"2023-06-22T10:55:15.161601+0000","last_became_peered":"2023-06-22T10:55:15.161601+0000","last_unstale":"2023-06-22T10:55:16.935665+0000","last_undegraded":"2023-06-22T10:55:16.935665+0000","last_fullsized":"2023-06-22T10:55:16.935665+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:48:00.545865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.148618+0000","last_change":"2023-06-22T10:55:14.144466+0000","last_active":"2023-06-22T10:55:16.148618+0000","last_peered":"2023-06-22T10:55:16.148618+0000","last_clean":"2023-06-22T10:55:16.148618+0000","last_became_active":"2023-06-22T10:55:14.143970+0000","last_became_peered":"2023-06-22T10:55:14.143970+0000","last_unstale":"2023-06-22T10:55:16.148618+0000","last_undegraded":"2023-06-22T10:55:16.148618+0000","last_fullsized":"2023-06-22T10:55:16.148618+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_clean_scrub_stamp":"2023-06-22T10:55:13.109670+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T15:56:56.611283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.935929+0000","last_change":"2023-06-22T10:55:15.154885+0000","last_active":"2023-06-22T10:55:16.935929+0000","last_peered":"2023-06-22T10:55:16.935929+0000","last_clean":"2023-06-22T10:55:16.935929+0000","last_became_active":"2023-06-22T10:55:15.154390+0000","last_became_peered":"2023-06-22T10:55:15.154390+0000","last_unstale":"2023-06-22T10:55:16.935929+0000","last_undegraded":"2023-06-22T10:55:16.935929+0000","last_fullsized":"2023-06-22T10:55:16.935929+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T18:21:58.923302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.203135+0000","last_change":"2023-06-22T10:55:14.143875+0000","last_active":"2023-06-22T10:55:16.203135+0000","last_peered":"2023-06-22T10:55:16.203135+0000","last_clean":"2023-06-22T10:55:16.203135+0000","last_became_active":"2023-06-22T10:55:14.143560+0000","last_became_peered":"2023-06-22T10:55:14.143560+0000","last_unstale":"2023-06-22T10:55:16.203135+0000","last_undegraded":"2023-06-22T10:55:16.203135+0000","last_fullsized":"2023-06-22T10:55:16.203135+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_clean_scrub_stamp":"2023-06-22T10:55:13.109670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:24:41.328853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.202644+0000","last_change":"2023-06-22T10:55:15.150811+0000","last_active":"2023-06-22T10:55:16.202644+0000","last_peered":"2023-06-22T10:55:16.202644+0000","last_clean":"2023-06-22T10:55:16.202644+0000","last_became_active":"2023-06-22T10:55:15.150542+0000","last_became_peered":"2023-06-22T10:55:15.150542+0000","last_unstale":"2023-06-22T10:55:16.202644+0000","last_undegraded":"2023-06-22T10:55:16.202644+0000","last_fullsized":"2023-06-22T10:55:16.202644+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T18:27:06.830423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.203390+0000","last_change":"2023-06-22T10:55:14.147890+0000","last_active":"2023-06-22T10:55:16.203390+0000","last_peered":"2023-06-22T10:55:16.203390+0000","last_clean":"2023-06-22T10:55:16.203390+0000","last_became_active":"2023-06-22T10:55:14.147561+0000","last_became_peered":"2023-06-22T10:55:14.147561+0000","last_unstale":"2023-06-22T10:55:16.203390+0000","last_undegraded":"2023-06-22T10:55:16.203390+0000","last_fullsized":"2023-06-22T10:55:16.203390+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_clean_scrub_stamp":"2023-06-22T10:55:13.109670+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T11:00:34.623557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.146596+0000","last_change":"2023-06-22T10:55:15.147670+0000","last_active":"2023-06-22T10:55:16.146596+0000","last_peered":"2023-06-22T10:55:16.146596+0000","last_clean":"2023-06-22T10:55:16.146596+0000","last_became_active":"2023-06-22T10:55:15.147360+0000","last_became_peered":"2023-06-22T10:55:15.147360+0000","last_unstale":"2023-06-22T10:55:16.146596+0000","last_undegraded":"2023-06-22T10:55:16.146596+0000","last_fullsized":"2023-06-22T10:55:16.146596+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T20:05:18.802631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.148570+0000","last_change":"2023-06-22T10:55:14.143289+0000","last_active":"2023-06-22T10:55:16.148570+0000","last_peered":"2023-06-22T10:55:16.148570+0000","last_clean":"2023-06-22T10:55:16.148570+0000","last_became_active":"2023-06-22T10:55:14.143008+0000","last_became_peered":"2023-06-22T10:55:14.143008+0000","last_unstale":"2023-06-22T10:55:16.148570+0000","last_undegraded":"2023-06-22T10:55:16.148570+0000","last_fullsized":"2023-06-22T10:55:16.148570+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_clean_scrub_stamp":"2023-06-22T10:55:13.109670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:38:22.683019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.934914+0000","last_change":"2023-06-22T10:55:15.148843+0000","last_active":"2023-06-22T10:55:16.934914+0000","last_peered":"2023-06-22T10:55:16.934914+0000","last_clean":"2023-06-22T10:55:16.934914+0000","last_became_active":"2023-06-22T10:55:15.148559+0000","last_became_peered":"2023-06-22T10:55:15.148559+0000","last_unstale":"2023-06-22T10:55:16.934914+0000","last_undegraded":"2023-06-22T10:55:16.934914+0000","last_fullsized":"2023-06-22T10:55:16.934914+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:27:51.619582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.934814+0000","last_change":"2023-06-22T10:55:14.149320+0000","last_active":"2023-06-22T10:55:16.934814+0000","last_peered":"2023-06-22T10:55:16.934814+0000","last_clean":"2023-06-22T10:55:16.934814+0000","last_became_active":"2023-06-22T10:55:14.149000+0000","last_became_peered":"2023-06-22T10:55:14.149000+0000","last_unstale":"2023-06-22T10:55:16.934814+0000","last_undegraded":"2023-06-22T10:55:16.934814+0000","last_fullsized":"2023-06-22T10:55:16.934814+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_clean_scrub_stamp":"2023-06-22T10:55:13.109670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:06:15.250766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.934630+0000","last_change":"2023-06-22T10:55:15.145170+0000","last_active":"2023-06-22T10:55:16.934630+0000","last_peered":"2023-06-22T10:55:16.934630+0000","last_clean":"2023-06-22T10:55:16.934630+0000","last_became_active":"2023-06-22T10:55:15.144883+0000","last_became_peered":"2023-06-22T10:55:15.144883+0000","last_unstale":"2023-06-22T10:55:16.934630+0000","last_undegraded":"2023-06-22T10:55:16.934630+0000","last_fullsized":"2023-06-22T10:55:16.934630+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:33:39.697014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.934759+0000","last_change":"2023-06-22T10:55:14.147719+0000","last_active":"2023-06-22T10:55:16.934759+0000","last_peered":"2023-06-22T10:55:16.934759+0000","last_clean":"2023-06-22T10:55:16.934759+0000","last_became_active":"2023-06-22T10:55:14.147377+0000","last_became_peered":"2023-06-22T10:55:14.147377+0000","last_unstale":"2023-06-22T10:55:16.934759+0000","last_undegraded":"2023-06-22T10:55:16.934759+0000","last_fullsized":"2023-06-22T10:55:16.934759+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_clean_scrub_stamp":"2023-06-22T10:55:13.109670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:10:51.176652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.147935+0000","last_change":"2023-06-22T10:55:15.154740+0000","last_active":"2023-06-22T10:55:16.147935+0000","last_peered":"2023-06-22T10:55:16.147935+0000","last_clean":"2023-06-22T10:55:16.147935+0000","last_became_active":"2023-06-22T10:55:15.154450+0000","last_became_peered":"2023-06-22T10:55:15.154450+0000","last_unstale":"2023-06-22T10:55:16.147935+0000","last_undegraded":"2023-06-22T10:55:16.147935+0000","last_fullsized":"2023-06-22T10:55:16.147935+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T11:27:12.575133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.934837+0000","last_change":"2023-06-22T10:55:14.152194+0000","last_active":"2023-06-22T10:55:16.934837+0000","last_peered":"2023-06-22T10:55:16.934837+0000","last_clean":"2023-06-22T10:55:16.934837+0000","last_became_active":"2023-06-22T10:55:14.151885+0000","last_became_peered":"2023-06-22T10:55:14.151885+0000","last_unstale":"2023-06-22T10:55:16.934837+0000","last_undegraded":"2023-06-22T10:55:16.934837+0000","last_fullsized":"2023-06-22T10:55:16.934837+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_clean_scrub_stamp":"2023-06-22T10:55:13.109670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:29:36.861102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":49,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.146700+0000","last_change":"2023-06-22T10:53:25.624603+0000","last_active":"2023-06-22T10:55:16.146700+0000","last_peered":"2023-06-22T10:55:16.146700+0000","last_clean":"2023-06-22T10:55:16.146700+0000","last_became_active":"2023-06-22T10:53:25.624302+0000","last_became_peered":"2023-06-22T10:53:25.624302+0000","last_unstale":"2023-06-22T10:55:16.146700+0000","last_undegraded":"2023-06-22T10:55:16.146700+0000","last_fullsized":"2023-06-22T10:55:16.146700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_clean_scrub_stamp":"2023-06-22T10:53:24.612028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:37:09.964340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.935669+0000","last_change":"2023-06-22T10:55:15.161421+0000","last_active":"2023-06-22T10:55:16.935669+0000","last_peered":"2023-06-22T10:55:16.935669+0000","last_clean":"2023-06-22T10:55:16.935669+0000","last_became_active":"2023-06-22T10:55:15.160982+0000","last_became_peered":"2023-06-22T10:55:15.160982+0000","last_unstale":"2023-06-22T10:55:16.935669+0000","last_undegraded":"2023-06-22T10:55:16.935669+0000","last_fullsized":"2023-06-22T10:55:16.935669+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:21:49.446211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"42'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.204674+0000","last_change":"2023-06-22T10:55:14.138612+0000","last_active":"2023-06-22T10:55:16.204674+0000","last_peered":"2023-06-22T10:55:16.204674+0000","last_clean":"2023-06-22T10:55:16.204674+0000","last_became_active":"2023-06-22T10:55:14.136868+0000","last_became_peered":"2023-06-22T10:55:14.136868+0000","last_unstale":"2023-06-22T10:55:16.204674+0000","last_undegraded":"2023-06-22T10:55:16.204674+0000","last_fullsized":"2023-06-22T10:55:16.204674+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_clean_scrub_stamp":"2023-06-22T10:55:13.109670+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:05:52.207090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":55,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.148114+0000","last_change":"2023-06-22T10:53:25.624213+0000","last_active":"2023-06-22T10:55:16.148114+0000","last_peered":"2023-06-22T10:55:16.148114+0000","last_clean":"2023-06-22T10:55:16.148114+0000","last_became_active":"2023-06-22T10:53:25.623692+0000","last_became_peered":"2023-06-22T10:53:25.623692+0000","last_unstale":"2023-06-22T10:55:16.148114+0000","last_undegraded":"2023-06-22T10:55:16.148114+0000","last_fullsized":"2023-06-22T10:55:16.148114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_clean_scrub_stamp":"2023-06-22T10:53:24.612028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T18:25:17.326697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.934968+0000","last_change":"2023-06-22T10:55:15.158680+0000","last_active":"2023-06-22T10:55:16.934968+0000","last_peered":"2023-06-22T10:55:16.934968+0000","last_clean":"2023-06-22T10:55:16.934968+0000","last_became_active":"2023-06-22T10:55:15.158395+0000","last_became_peered":"2023-06-22T10:55:15.158395+0000","last_unstale":"2023-06-22T10:55:16.934968+0000","last_undegraded":"2023-06-22T10:55:16.934968+0000","last_fullsized":"2023-06-22T10:55:16.934968+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:57:36.754178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.936297+0000","last_change":"2023-06-22T10:55:14.148319+0000","last_active":"2023-06-22T10:55:16.936297+0000","last_peered":"2023-06-22T10:55:16.936297+0000","last_clean":"2023-06-22T10:55:16.936297+0000","last_became_active":"2023-06-22T10:55:14.148014+0000","last_became_peered":"2023-06-22T10:55:14.148014+0000","last_unstale":"2023-06-22T10:55:16.936297+0000","last_undegraded":"2023-06-22T10:55:16.936297+0000","last_fullsized":"2023-06-22T10:55:16.936297+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_clean_scrub_stamp":"2023-06-22T10:55:13.109670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:45:26.767142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.935124+0000","last_change":"2023-06-22T10:53:25.679314+0000","last_active":"2023-06-22T10:55:16.935124+0000","last_peered":"2023-06-22T10:55:16.935124+0000","last_clean":"2023-06-22T10:55:16.935124+0000","last_became_active":"2023-06-22T10:53:25.678947+0000","last_became_peered":"2023-06-22T10:53:25.678947+0000","last_unstale":"2023-06-22T10:55:16.935124+0000","last_undegraded":"2023-06-22T10:55:16.935124+0000","last_fullsized":"2023-06-22T10:55:16.935124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_clean_scrub_stamp":"2023-06-22T10:53:24.612028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:26:57.615943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.935584+0000","last_change":"2023-06-22T10:55:15.146348+0000","last_active":"2023-06-22T10:55:16.935584+0000","last_peered":"2023-06-22T10:55:16.935584+0000","last_clean":"2023-06-22T10:55:16.935584+0000","last_became_active":"2023-06-22T10:55:15.146091+0000","last_became_peered":"2023-06-22T10:55:15.146091+0000","last_unstale":"2023-06-22T10:55:16.935584+0000","last_undegraded":"2023-06-22T10:55:16.935584+0000","last_fullsized":"2023-06-22T10:55:16.935584+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:39:15.463957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.148586+0000","last_change":"2023-06-22T10:55:14.134989+0000","last_active":"2023-06-22T10:55:16.148586+0000","last_peered":"2023-06-22T10:55:16.148586+0000","last_clean":"2023-06-22T10:55:16.148586+0000","last_became_active":"2023-06-22T10:55:14.134709+0000","last_became_peered":"2023-06-22T10:55:14.134709+0000","last_unstale":"2023-06-22T10:55:16.148586+0000","last_undegraded":"2023-06-22T10:55:16.148586+0000","last_fullsized":"2023-06-22T10:55:16.148586+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_clean_scrub_stamp":"2023-06-22T10:55:13.109670+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:05:52.207090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":55,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.148728+0000","last_change":"2023-06-22T10:53:25.624072+0000","last_active":"2023-06-22T10:55:16.148728+0000","last_peered":"2023-06-22T10:55:16.148728+0000","last_clean":"2023-06-22T10:55:16.148728+0000","last_became_active":"2023-06-22T10:53:25.623617+0000","last_became_peered":"2023-06-22T10:53:25.623617+0000","last_unstale":"2023-06-22T10:55:16.148728+0000","last_undegraded":"2023-06-22T10:55:16.148728+0000","last_fullsized":"2023-06-22T10:55:16.148728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_clean_scrub_stamp":"2023-06-22T10:53:24.612028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T13:10:23.102779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":209,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.934871+0000","last_change":"2023-06-22T10:53:19.693774+0000","last_active":"2023-06-22T10:55:16.934871+0000","last_peered":"2023-06-22T10:55:16.934871+0000","last_clean":"2023-06-22T10:55:16.934871+0000","last_became_active":"2023-06-22T10:53:19.692329+0000","last_became_peered":"2023-06-22T10:53:19.692329+0000","last_unstale":"2023-06-22T10:55:16.934871+0000","last_undegraded":"2023-06-22T10:55:16.934871+0000","last_fullsized":"2023-06-22T10:55:16.934871+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:17.830348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:17.830348+0000","last_clean_scrub_stamp":"2023-06-22T10:53:17.830348+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:03:56.927768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.936121+0000","last_change":"2023-06-22T10:55:15.156913+0000","last_active":"2023-06-22T10:55:16.936121+0000","last_peered":"2023-06-22T10:55:16.936121+0000","last_clean":"2023-06-22T10:55:16.936121+0000","last_became_active":"2023-06-22T10:55:15.156603+0000","last_became_peered":"2023-06-22T10:55:15.156603+0000","last_unstale":"2023-06-22T10:55:16.936121+0000","last_undegraded":"2023-06-22T10:55:16.936121+0000","last_fullsized":"2023-06-22T10:55:16.936121+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:08:09.202243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.146667+0000","last_change":"2023-06-22T10:55:14.141712+0000","last_active":"2023-06-22T10:55:16.146667+0000","last_peered":"2023-06-22T10:55:16.146667+0000","last_clean":"2023-06-22T10:55:16.146667+0000","last_became_active":"2023-06-22T10:55:14.141420+0000","last_became_peered":"2023-06-22T10:55:14.141420+0000","last_unstale":"2023-06-22T10:55:16.146667+0000","last_undegraded":"2023-06-22T10:55:16.146667+0000","last_fullsized":"2023-06-22T10:55:16.146667+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_clean_scrub_stamp":"2023-06-22T10:55:13.109670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:30:47.204818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":53,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.934902+0000","last_change":"2023-06-22T10:53:25.626890+0000","last_active":"2023-06-22T10:55:16.934902+0000","last_peered":"2023-06-22T10:55:16.934902+0000","last_clean":"2023-06-22T10:55:16.934902+0000","last_became_active":"2023-06-22T10:53:25.626558+0000","last_became_peered":"2023-06-22T10:53:25.626558+0000","last_unstale":"2023-06-22T10:55:16.934902+0000","last_undegraded":"2023-06-22T10:55:16.934902+0000","last_fullsized":"2023-06-22T10:55:16.934902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_clean_scrub_stamp":"2023-06-22T10:53:24.612028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T15:55:08.113640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.148297+0000","last_change":"2023-06-22T10:55:15.139319+0000","last_active":"2023-06-22T10:55:16.148297+0000","last_peered":"2023-06-22T10:55:16.148297+0000","last_clean":"2023-06-22T10:55:16.148297+0000","last_became_active":"2023-06-22T10:55:15.138997+0000","last_became_peered":"2023-06-22T10:55:15.138997+0000","last_unstale":"2023-06-22T10:55:16.148297+0000","last_undegraded":"2023-06-22T10:55:16.148297+0000","last_fullsized":"2023-06-22T10:55:16.148297+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:10:52.182735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.146518+0000","last_change":"2023-06-22T10:55:14.146106+0000","last_active":"2023-06-22T10:55:16.146518+0000","last_peered":"2023-06-22T10:55:16.146518+0000","last_clean":"2023-06-22T10:55:16.146518+0000","last_became_active":"2023-06-22T10:55:14.144527+0000","last_became_peered":"2023-06-22T10:55:14.144527+0000","last_unstale":"2023-06-22T10:55:16.146518+0000","last_undegraded":"2023-06-22T10:55:16.146518+0000","last_fullsized":"2023-06-22T10:55:16.146518+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_clean_scrub_stamp":"2023-06-22T10:55:13.109670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:57:35.748095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":53,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.936327+0000","last_change":"2023-06-22T10:53:25.626005+0000","last_active":"2023-06-22T10:55:16.936327+0000","last_peered":"2023-06-22T10:55:16.936327+0000","last_clean":"2023-06-22T10:55:16.936327+0000","last_became_active":"2023-06-22T10:53:25.625614+0000","last_became_peered":"2023-06-22T10:53:25.625614+0000","last_unstale":"2023-06-22T10:55:16.936327+0000","last_undegraded":"2023-06-22T10:55:16.936327+0000","last_fullsized":"2023-06-22T10:55:16.936327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_clean_scrub_stamp":"2023-06-22T10:53:24.612028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T18:59:28.494551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.203247+0000","last_change":"2023-06-22T10:55:15.156414+0000","last_active":"2023-06-22T10:55:16.203247+0000","last_peered":"2023-06-22T10:55:16.203247+0000","last_clean":"2023-06-22T10:55:16.203247+0000","last_became_active":"2023-06-22T10:55:15.156106+0000","last_became_peered":"2023-06-22T10:55:15.156106+0000","last_unstale":"2023-06-22T10:55:16.203247+0000","last_undegraded":"2023-06-22T10:55:16.203247+0000","last_fullsized":"2023-06-22T10:55:16.203247+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T13:12:12.606504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.148463+0000","last_change":"2023-06-22T10:55:14.138208+0000","last_active":"2023-06-22T10:55:16.148463+0000","last_peered":"2023-06-22T10:55:16.148463+0000","last_clean":"2023-06-22T10:55:16.148463+0000","last_became_active":"2023-06-22T10:55:14.137909+0000","last_became_peered":"2023-06-22T10:55:14.137909+0000","last_unstale":"2023-06-22T10:55:16.148463+0000","last_undegraded":"2023-06-22T10:55:16.148463+0000","last_fullsized":"2023-06-22T10:55:16.148463+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_clean_scrub_stamp":"2023-06-22T10:55:13.109670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T18:51:58.164506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":49,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.146784+0000","last_change":"2023-06-22T10:53:25.625427+0000","last_active":"2023-06-22T10:55:16.146784+0000","last_peered":"2023-06-22T10:55:16.146784+0000","last_clean":"2023-06-22T10:55:16.146784+0000","last_became_active":"2023-06-22T10:53:25.625237+0000","last_became_peered":"2023-06-22T10:53:25.625237+0000","last_unstale":"2023-06-22T10:55:16.146784+0000","last_undegraded":"2023-06-22T10:55:16.146784+0000","last_fullsized":"2023-06-22T10:55:16.146784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_clean_scrub_stamp":"2023-06-22T10:53:24.612028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:20:54.136120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.202986+0000","last_change":"2023-06-22T10:55:15.144245+0000","last_active":"2023-06-22T10:55:16.202986+0000","last_peered":"2023-06-22T10:55:16.202986+0000","last_clean":"2023-06-22T10:55:16.202986+0000","last_became_active":"2023-06-22T10:55:15.143929+0000","last_became_peered":"2023-06-22T10:55:15.143929+0000","last_unstale":"2023-06-22T10:55:16.202986+0000","last_undegraded":"2023-06-22T10:55:16.202986+0000","last_fullsized":"2023-06-22T10:55:16.202986+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:10:52.182735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.936154+0000","last_change":"2023-06-22T10:55:14.148308+0000","last_active":"2023-06-22T10:55:16.936154+0000","last_peered":"2023-06-22T10:55:16.936154+0000","last_clean":"2023-06-22T10:55:16.936154+0000","last_became_active":"2023-06-22T10:55:14.147480+0000","last_became_peered":"2023-06-22T10:55:14.147480+0000","last_unstale":"2023-06-22T10:55:16.936154+0000","last_undegraded":"2023-06-22T10:55:16.936154+0000","last_fullsized":"2023-06-22T10:55:16.936154+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_clean_scrub_stamp":"2023-06-22T10:55:13.109670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:49:34.451616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":49,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.935822+0000","last_change":"2023-06-22T10:53:25.625880+0000","last_active":"2023-06-22T10:55:16.935822+0000","last_peered":"2023-06-22T10:55:16.935822+0000","last_clean":"2023-06-22T10:55:16.935822+0000","last_became_active":"2023-06-22T10:53:25.625464+0000","last_became_peered":"2023-06-22T10:53:25.625464+0000","last_unstale":"2023-06-22T10:55:16.935822+0000","last_undegraded":"2023-06-22T10:55:16.935822+0000","last_fullsized":"2023-06-22T10:55:16.935822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_clean_scrub_stamp":"2023-06-22T10:53:24.612028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:47:38.604144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":0,"up_from":15,"seq":64424509467,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":1056,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1081344,"data_stored":806461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jun 22 10:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":2.6059999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":2.3540000000000001,"5min":2.3540000000000001,"15min":2.3540000000000001},"last":0.27800000000000002}]},{"osd":2,"last update":"Thu Jun 22 10:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":2.2440000000000002,"5min":2.2440000000000002,"15min":2.2440000000000002},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":2.3879999999999999,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":0.35299999999999998}]},{"osd":3,"last update":"Thu Jun 22 10:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":2.4329999999999998,"5min":2.4329999999999998,"15min":2.4329999999999998},"last":0.48799999999999999}]},{"osd":4,"last update":"Thu Jun 22 10:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":0.57699999999999996}]},{"osd":5,"last update":"Thu Jun 22 10:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.67000000000000004}]},{"osd":6,"last update":"Thu Jun 22 10:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.59299999999999997}]},{"osd":7,"last update":"Thu Jun 22 10:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":0.622}]}]},{"osd":7,"up_from":14,"seq":60129542173,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":1044,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":1069056,"data_stored":799544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jun 22 10:54:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.72999999999999998}]},{"osd":1,"last update":"Thu Jun 22 10:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.61099999999999999}]},{"osd":2,"last update":"Thu Jun 22 10:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.76400000000000001}]},{"osd":3,"last update":"Thu Jun 22 10:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":2.1739999999999999,"5min":2.1739999999999999,"15min":2.1739999999999999},"last":0.55500000000000005}]},{"osd":4,"last update":"Thu Jun 22 10:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.499},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.63900000000000001}]},{"osd":5,"last update":"Thu Jun 22 10:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":2.1030000000000002,"5min":2.1030000000000002,"15min":2.1030000000000002},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.59799999999999998}]},{"osd":6,"last update":"Thu Jun 22 10:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.747},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.78000000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":472,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":483328,"data_stored":209724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jun 22 10:54:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.441},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":4.6589999999999998,"5min":4.6589999999999998,"15min":4.6589999999999998},"last":0.40999999999999998}]},{"osd":1,"last update":"Thu Jun 22 10:54:19 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.8240000000000001,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":0.52000000000000002}]},{"osd":2,"last update":"Thu Jun 22 10:54:19 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":2.0059999999999998,"5min":2.0059999999999998,"15min":2.0059999999999998},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":4.8259999999999996,"5min":4.8259999999999996,"15min":4.8259999999999996},"last":0.46000000000000002}]},{"osd":4,"last update":"Thu Jun 22 10:54:19 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":4.7249999999999996,"5min":4.7249999999999996,"15min":4.7249999999999996},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.66800000000000004}]},{"osd":5,"last update":"Thu Jun 22 10:54:19 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":4.7619999999999996,"5min":4.7619999999999996,"15min":4.7619999999999996},"last":0.71799999999999997}]},{"osd":6,"last update":"Thu Jun 22 10:54:19 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.8819999999999999,"5min":1.8819999999999999,"15min":1.8819999999999999},"last":0.68000000000000005}]},{"osd":7,"last update":"Thu Jun 22 10:54:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":4.7930000000000001,"5min":4.7930000000000001,"15min":4.7930000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.84099999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":464,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":475136,"data_stored":209156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jun 22 10:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.34799999999999998}]},{"osd":2,"last update":"Thu Jun 22 10:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.39600000000000002}]},{"osd":3,"last update":"Thu Jun 22 10:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.45300000000000001}]},{"osd":4,"last update":"Thu Jun 22 10:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":1.0069999999999999}]},{"osd":5,"last update":"Thu Jun 22 10:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":1.1060000000000001}]},{"osd":6,"last update":"Thu Jun 22 10:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":1.1739999999999999}]},{"osd":7,"last update":"Thu Jun 22 10:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.0569999999999999},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.97899999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":472,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":483328,"data_stored":210650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jun 22 10:54:23 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.47399999999999998}]},{"osd":1,"last update":"Thu Jun 22 10:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.72799999999999998}]},{"osd":2,"last update":"Thu Jun 22 10:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.622}]},{"osd":3,"last update":"Thu Jun 22 10:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.66600000000000004}]},{"osd":5,"last update":"Thu Jun 22 10:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.76300000000000001}]},{"osd":6,"last update":"Thu Jun 22 10:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.92300000000000004}]},{"osd":7,"last update":"Thu Jun 22 10:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.84599999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":464,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":475136,"data_stored":209156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jun 22 10:54:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.53100000000000003}]},{"osd":1,"last update":"Thu Jun 22 10:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.66900000000000004}]},{"osd":2,"last update":"Thu Jun 22 10:54:22 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":3.5880000000000001,"5min":3.5880000000000001,"15min":3.5880000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.61499999999999999}]},{"osd":3,"last update":"Thu Jun 22 10:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.55000000000000004}]},{"osd":4,"last update":"Thu Jun 22 10:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.72399999999999998}]},{"osd":6,"last update":"Thu Jun 22 10:54:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.69299999999999995}]},{"osd":7,"last update":"Thu Jun 22 10:54:22 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.68600000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542171,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":488,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":499712,"data_stored":217645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jun 22 10:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":6.2789999999999999,"5min":6.2789999999999999,"15min":6.2789999999999999},"last":0.26600000000000001},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":13.273,"5min":13.273,"15min":13.273},"last":0.35999999999999999}]},{"osd":1,"last update":"Thu Jun 22 10:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":6.0789999999999997,"5min":6.0789999999999997,"15min":6.0789999999999997},"last":0.48499999999999999},{"interface":"front","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":13.215,"5min":13.215,"15min":13.215},"last":0.40300000000000002}]},{"osd":3,"last update":"Thu Jun 22 10:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":6.2430000000000003,"5min":6.2430000000000003,"15min":6.2430000000000003},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":6.3010000000000002,"5min":6.3010000000000002,"15min":6.3010000000000002},"last":0.44600000000000001}]},{"osd":4,"last update":"Thu Jun 22 10:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":5.9889999999999999,"5min":5.9889999999999999,"15min":5.9889999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.871}]},{"osd":5,"last update":"Thu Jun 22 10:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.83999999999999997},{"interface":"front","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":6.2050000000000001,"5min":6.2050000000000001,"15min":6.2050000000000001},"last":0.85399999999999998}]},{"osd":6,"last update":"Thu Jun 22 10:54:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":6.1079999999999997,"5min":6.1079999999999997,"15min":6.1079999999999997},"last":0.79000000000000004},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":6.0430000000000001,"5min":6.0430000000000001,"15min":6.0430000000000001},"last":0.68200000000000005}]},{"osd":7,"last update":"Thu Jun 22 10:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.73599999999999999},{"interface":"front","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":6.165,"5min":6.165,"15min":6.165},"last":0.82799999999999996}]}]},{"osd":6,"up_from":14,"seq":60129542172,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":480,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":491520,"data_stored":216731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jun 22 10:54:19 2023","interfaces":[{"interface":"back","average":{"1min":1.536,"5min":1.536,"15min":1.536},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":10.185,"5min":10.185,"15min":10.185},"last":0.68100000000000005},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":7.5140000000000002,"5min":7.5140000000000002,"15min":7.5140000000000002},"last":0.54200000000000004}]},{"osd":1,"last update":"Thu Jun 22 10:54:19 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.093,"15min":1.093},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":9.4580000000000002,"5min":9.4580000000000002,"15min":9.4580000000000002},"last":0.52300000000000002},{"interface":"front","average":{"1min":1.27,"5min":1.27,"15min":1.27},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":10.228,"5min":10.228,"15min":10.228},"last":0.73099999999999998}]},{"osd":2,"last update":"Thu Jun 22 10:54:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":7.7549999999999999,"5min":7.7549999999999999,"15min":7.7549999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":6.4080000000000004,"5min":6.4080000000000004,"15min":6.4080000000000004},"last":0.749}]},{"osd":3,"last update":"Thu Jun 22 10:54:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":6.5750000000000002,"5min":6.5750000000000002,"15min":6.5750000000000002},"last":0.64200000000000002},{"interface":"front","average":{"1min":1.286,"5min":1.286,"15min":1.286},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":9.5700000000000003,"5min":9.5700000000000003,"15min":9.5700000000000003},"last":0.58699999999999997}]},{"osd":4,"last update":"Thu Jun 22 10:54:19 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":2.044,"5min":2.044,"15min":2.044},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.71599999999999997}]},{"osd":5,"last update":"Thu Jun 22 10:54:19 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.70099999999999996}]},{"osd":7,"last update":"Thu Jun 22 10:54:19 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.76300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-22T10:55:19.581 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-22T10:55:19.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.812+0000 7fe87c3ff700 1 Processor -- start 2023-06-22T10:55:19.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.812+0000 7fe87c3ff700 1 -- start start 2023-06-22T10:55:19.816 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.813+0000 7fe87c3ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe87415c720 0x7fe8740b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:19.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.813+0000 7fe87c3ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe8740b4e30 0x7fe8740d0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:19.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.813+0000 7fe87c3ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8740b2130 con 0x7fe8740d2830 2023-06-22T10:55:19.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.813+0000 7fe87c3ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe874160d60 con 0x7fe8740b4e30 2023-06-22T10:55:19.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.813+0000 7fe87c3ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe874161180 con 0x7fe87415c720 2023-06-22T10:55:19.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.814+0000 7fe87a99c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe8740b4e30 0x7fe8740d0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:19.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.814+0000 7fe87a19b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe87415c720 0x7fe8740b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:19.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.814+0000 7fe87a99c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe8740b4e30 0x7fe8740d0d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35344/0 (socket says 172.21.15.40:35344) 2023-06-22T10:55:19.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.814+0000 7fe87a19b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe87415c720 0x7fe8740b1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.40:56594/0 (socket says 172.21.15.40:56594) 2023-06-22T10:55:19.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.814+0000 7fe87a99c700 1 -- 172.21.15.40:0/2405940899 learned_addr learned my addr 172.21.15.40:0/2405940899 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:55:19.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.814+0000 7fe87999a700 1 --1- 172.21.15.40:0/2405940899 >> v1:172.21.15.45:6789/0 conn(0x7fe8740d2830 0x7fe8740b4720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.40:48368/0 (socket says 172.21.15.40:48368) 2023-06-22T10:55:19.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.814+0000 7fe87a99c700 1 -- 172.21.15.40:0/2405940899 >> v2:172.21.15.45:3300/0 conn(0x7fe87415c720 msgr2=0x7fe8740b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:55:19.819 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.814+0000 7fe87a99c700 1 --2- 172.21.15.40:0/2405940899 >> v2:172.21.15.45:3300/0 conn(0x7fe87415c720 0x7fe8740b1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:19.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.814+0000 7fe87a99c700 1 -- 172.21.15.40:0/2405940899 >> v1:172.21.15.45:6789/0 conn(0x7fe8740d2830 legacy=0x7fe8740b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:19.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.814+0000 7fe87a99c700 1 -- 172.21.15.40:0/2405940899 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8741603c0 con 0x7fe8740b4e30 2023-06-22T10:55:19.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.814+0000 7fe879199700 1 -- 172.21.15.40:0/2405940899 <== mon.1 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2521841495 0 0) 0x7fe8740b2130 con 0x7fe8740d2830 2023-06-22T10:55:19.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.814+0000 7fe87a99c700 1 --2- 172.21.15.40:0/2405940899 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8740b4e30 0x7fe8740d0d00 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fe86c009e50 tx=0x7fe86c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3768ff71bf11e917 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:19.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.815+0000 7fe879199700 1 -- 172.21.15.40:0/2405940899 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86c00e070 con 0x7fe8740b4e30 2023-06-22T10:55:19.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.815+0000 7fe879199700 1 -- 172.21.15.40:0/2405940899 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe86c00b8d0 con 0x7fe8740b4e30 2023-06-22T10:55:19.820 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.815+0000 7fe879199700 1 -- 172.21.15.40:0/2405940899 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86c00bc80 con 0x7fe8740b4e30 2023-06-22T10:55:19.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.815+0000 7fe87c3ff700 1 -- 172.21.15.40:0/2405940899 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8740b4e30 msgr2=0x7fe8740d0d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:19.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.815+0000 7fe87c3ff700 1 --2- 172.21.15.40:0/2405940899 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8740b4e30 0x7fe8740d0d00 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fe86c009e50 tx=0x7fe86c00b330 comp rx=0 tx=0).stop 2023-06-22T10:55:19.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.815+0000 7fe87c3ff700 1 -- 172.21.15.40:0/2405940899 shutdown_connections 2023-06-22T10:55:19.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.815+0000 7fe87c3ff700 1 --2- 172.21.15.40:0/2405940899 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8740b4e30 0x7fe8740d0d00 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:19.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.815+0000 7fe87c3ff700 1 --2- 172.21.15.40:0/2405940899 >> v2:172.21.15.45:3300/0 conn(0x7fe87415c720 0x7fe8740b1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:19.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.815+0000 7fe87c3ff700 1 -- 172.21.15.40:0/2405940899 >> 172.21.15.40:0/2405940899 conn(0x7fe8740cf720 msgr2=0x7fe8740cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:19.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.815+0000 7fe87c3ff700 1 -- 172.21.15.40:0/2405940899 shutdown_connections 2023-06-22T10:55:19.821 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.815+0000 7fe87c3ff700 1 -- 172.21.15.40:0/2405940899 wait complete. 2023-06-22T10:55:19.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.817+0000 7fe87c3ff700 1 Processor -- start 2023-06-22T10:55:19.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.817+0000 7fe87c3ff700 1 -- start start 2023-06-22T10:55:19.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.818+0000 7fe87c3ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8740b4e30 0x7fe87415f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:19.823 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.818+0000 7fe87c3ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8740d2830 0x7fe87415fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:19.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.818+0000 7fe87c3ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe87415c720 0x7fe87415d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:19.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.818+0000 7fe87c3ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8740b7a80 con 0x7fe8740b4e30 2023-06-22T10:55:19.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.818+0000 7fe87c3ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8740b7d60 con 0x7fe8740d2830 2023-06-22T10:55:19.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.818+0000 7fe87c3ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8740b8040 con 0x7fe87415c720 2023-06-22T10:55:19.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.819+0000 7fe87a19b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8740b4e30 0x7fe87415f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:19.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.819+0000 7fe87a19b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8740b4e30 0x7fe87415f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35354/0 (socket says 172.21.15.40:35354) 2023-06-22T10:55:19.824 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.819+0000 7fe87a19b700 1 -- 172.21.15.40:0/4041275705 learned_addr learned my addr 172.21.15.40:0/4041275705 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:55:19.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.819+0000 7fe87999a700 1 --2- 172.21.15.40:0/4041275705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8740d2830 0x7fe87415fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:19.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.819+0000 7fe87a99c700 1 --2- 172.21.15.40:0/4041275705 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe87415c720 0x7fe87415d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:19.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.819+0000 7fe87a19b700 1 -- 172.21.15.40:0/4041275705 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe87415c720 msgr2=0x7fe87415d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:19.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.819+0000 7fe87a19b700 1 --2- 172.21.15.40:0/4041275705 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe87415c720 0x7fe87415d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:19.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.819+0000 7fe87a19b700 1 -- 172.21.15.40:0/4041275705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8740d2830 msgr2=0x7fe87415fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:19.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.819+0000 7fe87a19b700 1 --2- 172.21.15.40:0/4041275705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8740d2830 0x7fe87415fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:19.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.819+0000 7fe87a19b700 1 -- 172.21.15.40:0/4041275705 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe86c009b30 con 0x7fe8740b4e30 2023-06-22T10:55:19.825 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.819+0000 7fe87a19b700 1 --2- 172.21.15.40:0/4041275705 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8740b4e30 0x7fe87415f500 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fe87000e9b0 tx=0x7fe87000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:19.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.819+0000 7fe86affd700 1 -- 172.21.15.40:0/4041275705 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe870009710 con 0x7fe8740b4e30 2023-06-22T10:55:19.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.820+0000 7fe86affd700 1 -- 172.21.15.40:0/4041275705 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe87000c850 con 0x7fe8740b4e30 2023-06-22T10:55:19.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.820+0000 7fe87c3ff700 1 -- 172.21.15.40:0/4041275705 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8740b8320 con 0x7fe8740b4e30 2023-06-22T10:55:19.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.820+0000 7fe86affd700 1 -- 172.21.15.40:0/4041275705 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87000cbc0 con 0x7fe8740b4e30 2023-06-22T10:55:19.826 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.820+0000 7fe87c3ff700 1 -- 172.21.15.40:0/4041275705 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe87415cf60 con 0x7fe8740b4e30 2023-06-22T10:55:19.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.821+0000 7fe87c3ff700 1 -- 172.21.15.40:0/4041275705 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe874067580 con 0x7fe8740b4e30 2023-06-22T10:55:19.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.822+0000 7fe86affd700 1 -- 172.21.15.40:0/4041275705 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe87000cd20 con 0x7fe8740b4e30 2023-06-22T10:55:19.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.823+0000 7fe86affd700 1 --2- 172.21.15.40:0/4041275705 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe85806ace0 0x7fe85806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:19.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.823+0000 7fe86affd700 1 -- 172.21.15.40:0/4041275705 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fe870089b00 con 0x7fe8740b4e30 2023-06-22T10:55:19.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.823+0000 7fe87999a700 1 --2- 172.21.15.40:0/4041275705 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe85806ace0 0x7fe85806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:19.828 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.823+0000 7fe87999a700 1 --2- 172.21.15.40:0/4041275705 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe85806ace0 0x7fe85806d190 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe87406c500 tx=0x7fe864007be0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:19.830 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:19.827+0000 7fe86affd700 1 -- 172.21.15.40:0/4041275705 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe87008be60 con 0x7fe8740b4e30 2023-06-22T10:55:20.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.028+0000 7fe87c3ff700 1 -- 172.21.15.40:0/4041275705 --> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe874160980 con 0x7fe85806ace0 2023-06-22T10:55:20.040 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.037+0000 7fe86affd700 1 -- 172.21.15.40:0/4041275705 <== mgr.4110 v2:172.21.15.40:6832/1803669772 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310981 (secure 0 0 0) 0x7fe8640012b0 con 0x7fe85806ace0 2023-06-22T10:55:20.044 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:55:20.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.041+0000 7fe87c3ff700 1 -- 172.21.15.40:0/4041275705 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe85806ace0 msgr2=0x7fe85806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:20.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.041+0000 7fe87c3ff700 1 --2- 172.21.15.40:0/4041275705 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe85806ace0 0x7fe85806d190 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe87406c500 tx=0x7fe864007be0 comp rx=0 tx=0).stop 2023-06-22T10:55:20.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.041+0000 7fe87c3ff700 1 -- 172.21.15.40:0/4041275705 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8740b4e30 msgr2=0x7fe87415f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:20.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.041+0000 7fe87c3ff700 1 --2- 172.21.15.40:0/4041275705 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8740b4e30 0x7fe87415f500 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fe87000e9b0 tx=0x7fe87000ed70 comp rx=0 tx=0).stop 2023-06-22T10:55:20.046 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.041+0000 7fe87c3ff700 1 -- 172.21.15.40:0/4041275705 shutdown_connections 2023-06-22T10:55:20.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.041+0000 7fe87c3ff700 1 --2- 172.21.15.40:0/4041275705 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe85806ace0 0x7fe85806d190 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:20.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.041+0000 7fe87c3ff700 1 --2- 172.21.15.40:0/4041275705 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe87415c720 0x7fe87415d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:20.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.041+0000 7fe87c3ff700 1 --2- 172.21.15.40:0/4041275705 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8740b4e30 0x7fe87415f500 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:20.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.041+0000 7fe87c3ff700 1 --2- 172.21.15.40:0/4041275705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8740d2830 0x7fe87415fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:20.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.041+0000 7fe87c3ff700 1 -- 172.21.15.40:0/4041275705 >> 172.21.15.40:0/4041275705 conn(0x7fe8740cf720 msgr2=0x7fe87406b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:20.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.041+0000 7fe87c3ff700 1 -- 172.21.15.40:0/4041275705 shutdown_connections 2023-06-22T10:55:20.047 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.042+0000 7fe87c3ff700 1 -- 172.21.15.40:0/4041275705 wait complete. 2023-06-22T10:55:20.048 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2023-06-22T10:55:20.063 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":97,"stamp":"2023-06-22T10:55:19.150510+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":174,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220556,"kb_used_data":4940,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754754164,"statfs":{"total":773094113280,"available":772868263936,"internally_reserved":0,"allocated":5058560,"data_stored":2879067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001300"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.936062+0000","last_change":"2023-06-22T10:55:15.152023+0000","last_active":"2023-06-22T10:55:16.936062+0000","last_peered":"2023-06-22T10:55:16.936062+0000","last_clean":"2023-06-22T10:55:16.936062+0000","last_became_active":"2023-06-22T10:55:15.151686+0000","last_became_peered":"2023-06-22T10:55:15.151686+0000","last_unstale":"2023-06-22T10:55:16.936062+0000","last_undegraded":"2023-06-22T10:55:16.936062+0000","last_fullsized":"2023-06-22T10:55:16.936062+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T13:01:35.861879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.149076+0000","last_change":"2023-06-22T10:55:15.151853+0000","last_active":"2023-06-22T10:55:16.149076+0000","last_peered":"2023-06-22T10:55:16.149076+0000","last_clean":"2023-06-22T10:55:16.149076+0000","last_became_active":"2023-06-22T10:55:15.151572+0000","last_became_peered":"2023-06-22T10:55:15.151572+0000","last_unstale":"2023-06-22T10:55:16.149076+0000","last_undegraded":"2023-06-22T10:55:16.149076+0000","last_fullsized":"2023-06-22T10:55:16.149076+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T11:00:35.629640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.148888+0000","last_change":"2023-06-22T10:55:15.155374+0000","last_active":"2023-06-22T10:55:16.148888+0000","last_peered":"2023-06-22T10:55:16.148888+0000","last_clean":"2023-06-22T10:55:16.148888+0000","last_became_active":"2023-06-22T10:55:15.155083+0000","last_became_peered":"2023-06-22T10:55:15.155083+0000","last_unstale":"2023-06-22T10:55:16.148888+0000","last_undegraded":"2023-06-22T10:55:16.148888+0000","last_fullsized":"2023-06-22T10:55:16.148888+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T13:21:01.245902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.934895+0000","last_change":"2023-06-22T10:55:15.152878+0000","last_active":"2023-06-22T10:55:16.934895+0000","last_peered":"2023-06-22T10:55:16.934895+0000","last_clean":"2023-06-22T10:55:16.934895+0000","last_became_active":"2023-06-22T10:55:15.152577+0000","last_became_peered":"2023-06-22T10:55:15.152577+0000","last_unstale":"2023-06-22T10:55:16.934895+0000","last_undegraded":"2023-06-22T10:55:16.934895+0000","last_fullsized":"2023-06-22T10:55:16.934895+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:46:08.324587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.148734+0000","last_change":"2023-06-22T10:55:15.150679+0000","last_active":"2023-06-22T10:55:16.148734+0000","last_peered":"2023-06-22T10:55:16.148734+0000","last_clean":"2023-06-22T10:55:16.148734+0000","last_became_active":"2023-06-22T10:55:15.150351+0000","last_became_peered":"2023-06-22T10:55:15.150351+0000","last_unstale":"2023-06-22T10:55:16.148734+0000","last_undegraded":"2023-06-22T10:55:16.148734+0000","last_fullsized":"2023-06-22T10:55:16.148734+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:24:42.334936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.202800+0000","last_change":"2023-06-22T10:55:15.140719+0000","last_active":"2023-06-22T10:55:16.202800+0000","last_peered":"2023-06-22T10:55:16.202800+0000","last_clean":"2023-06-22T10:55:16.202800+0000","last_became_active":"2023-06-22T10:55:15.140184+0000","last_became_peered":"2023-06-22T10:55:15.140184+0000","last_unstale":"2023-06-22T10:55:16.202800+0000","last_undegraded":"2023-06-22T10:55:16.202800+0000","last_fullsized":"2023-06-22T10:55:16.202800+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:38:23.689102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.935065+0000","last_change":"2023-06-22T10:55:15.147594+0000","last_active":"2023-06-22T10:55:16.935065+0000","last_peered":"2023-06-22T10:55:16.935065+0000","last_clean":"2023-06-22T10:55:16.935065+0000","last_became_active":"2023-06-22T10:55:15.147285+0000","last_became_peered":"2023-06-22T10:55:15.147285+0000","last_unstale":"2023-06-22T10:55:16.935065+0000","last_undegraded":"2023-06-22T10:55:16.935065+0000","last_fullsized":"2023-06-22T10:55:16.935065+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T18:54:53.530939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.934610+0000","last_change":"2023-06-22T10:55:15.152988+0000","last_active":"2023-06-22T10:55:16.934610+0000","last_peered":"2023-06-22T10:55:16.934610+0000","last_clean":"2023-06-22T10:55:16.934610+0000","last_became_active":"2023-06-22T10:55:15.152457+0000","last_became_peered":"2023-06-22T10:55:15.152457+0000","last_unstale":"2023-06-22T10:55:16.934610+0000","last_undegraded":"2023-06-22T10:55:16.934610+0000","last_fullsized":"2023-06-22T10:55:16.934610+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:32:58.626548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.935627+0000","last_change":"2023-06-22T10:55:15.143103+0000","last_active":"2023-06-22T10:55:16.935627+0000","last_peered":"2023-06-22T10:55:16.935627+0000","last_clean":"2023-06-22T10:55:16.935627+0000","last_became_active":"2023-06-22T10:55:15.142807+0000","last_became_peered":"2023-06-22T10:55:15.142807+0000","last_unstale":"2023-06-22T10:55:16.935627+0000","last_undegraded":"2023-06-22T10:55:16.935627+0000","last_fullsized":"2023-06-22T10:55:16.935627+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:14:03.237496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.935427+0000","last_change":"2023-06-22T10:55:15.152639+0000","last_active":"2023-06-22T10:55:16.935427+0000","last_peered":"2023-06-22T10:55:16.935427+0000","last_clean":"2023-06-22T10:55:16.935427+0000","last_became_active":"2023-06-22T10:55:15.152325+0000","last_became_peered":"2023-06-22T10:55:15.152325+0000","last_unstale":"2023-06-22T10:55:16.935427+0000","last_undegraded":"2023-06-22T10:55:16.935427+0000","last_fullsized":"2023-06-22T10:55:16.935427+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T20:56:46.097736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.935658+0000","last_change":"2023-06-22T10:55:15.144210+0000","last_active":"2023-06-22T10:55:16.935658+0000","last_peered":"2023-06-22T10:55:16.935658+0000","last_clean":"2023-06-22T10:55:16.935658+0000","last_became_active":"2023-06-22T10:55:15.143894+0000","last_became_peered":"2023-06-22T10:55:15.143894+0000","last_unstale":"2023-06-22T10:55:16.935658+0000","last_undegraded":"2023-06-22T10:55:16.935658+0000","last_fullsized":"2023-06-22T10:55:16.935658+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:22:43.639845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.148935+0000","last_change":"2023-06-22T10:55:15.158513+0000","last_active":"2023-06-22T10:55:16.148935+0000","last_peered":"2023-06-22T10:55:16.148935+0000","last_clean":"2023-06-22T10:55:16.148935+0000","last_became_active":"2023-06-22T10:55:15.158018+0000","last_became_peered":"2023-06-22T10:55:15.158018+0000","last_unstale":"2023-06-22T10:55:16.148935+0000","last_undegraded":"2023-06-22T10:55:16.148935+0000","last_fullsized":"2023-06-22T10:55:16.148935+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T13:01:35.861879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.934902+0000","last_change":"2023-06-22T10:55:15.165913+0000","last_active":"2023-06-22T10:55:16.934902+0000","last_peered":"2023-06-22T10:55:16.934902+0000","last_clean":"2023-06-22T10:55:16.934902+0000","last_became_active":"2023-06-22T10:55:15.165613+0000","last_became_peered":"2023-06-22T10:55:15.165613+0000","last_unstale":"2023-06-22T10:55:16.934902+0000","last_undegraded":"2023-06-22T10:55:16.934902+0000","last_fullsized":"2023-06-22T10:55:16.934902+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T17:59:17.867416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.935205+0000","last_change":"2023-06-22T10:55:15.143174+0000","last_active":"2023-06-22T10:55:16.935205+0000","last_peered":"2023-06-22T10:55:16.935205+0000","last_clean":"2023-06-22T10:55:16.935205+0000","last_became_active":"2023-06-22T10:55:15.142870+0000","last_became_peered":"2023-06-22T10:55:15.142870+0000","last_unstale":"2023-06-22T10:55:16.935205+0000","last_undegraded":"2023-06-22T10:55:16.935205+0000","last_fullsized":"2023-06-22T10:55:16.935205+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T20:07:47.150026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.202626+0000","last_change":"2023-06-22T10:55:15.158867+0000","last_active":"2023-06-22T10:55:16.202626+0000","last_peered":"2023-06-22T10:55:16.202626+0000","last_clean":"2023-06-22T10:55:16.202626+0000","last_became_active":"2023-06-22T10:55:15.156977+0000","last_became_peered":"2023-06-22T10:55:15.156977+0000","last_unstale":"2023-06-22T10:55:16.202626+0000","last_undegraded":"2023-06-22T10:55:16.202626+0000","last_fullsized":"2023-06-22T10:55:16.202626+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:19:51.540255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.934920+0000","last_change":"2023-06-22T10:55:15.161724+0000","last_active":"2023-06-22T10:55:16.934920+0000","last_peered":"2023-06-22T10:55:16.934920+0000","last_clean":"2023-06-22T10:55:16.934920+0000","last_became_active":"2023-06-22T10:55:15.160857+0000","last_became_peered":"2023-06-22T10:55:15.160857+0000","last_unstale":"2023-06-22T10:55:16.934920+0000","last_undegraded":"2023-06-22T10:55:16.934920+0000","last_fullsized":"2023-06-22T10:55:16.934920+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T15:59:10.534126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.149263+0000","last_change":"2023-06-22T10:55:15.148381+0000","last_active":"2023-06-22T10:55:16.149263+0000","last_peered":"2023-06-22T10:55:16.149263+0000","last_clean":"2023-06-22T10:55:16.149263+0000","last_became_active":"2023-06-22T10:55:15.148094+0000","last_became_peered":"2023-06-22T10:55:15.148094+0000","last_unstale":"2023-06-22T10:55:16.149263+0000","last_undegraded":"2023-06-22T10:55:16.149263+0000","last_fullsized":"2023-06-22T10:55:16.149263+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:38:29.809242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.148853+0000","last_change":"2023-06-22T10:55:15.162888+0000","last_active":"2023-06-22T10:55:16.148853+0000","last_peered":"2023-06-22T10:55:16.148853+0000","last_clean":"2023-06-22T10:55:16.148853+0000","last_became_active":"2023-06-22T10:55:15.162528+0000","last_became_peered":"2023-06-22T10:55:15.162528+0000","last_unstale":"2023-06-22T10:55:16.148853+0000","last_undegraded":"2023-06-22T10:55:16.148853+0000","last_fullsized":"2023-06-22T10:55:16.148853+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:00:39.642679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.935817+0000","last_change":"2023-06-22T10:55:15.161201+0000","last_active":"2023-06-22T10:55:16.935817+0000","last_peered":"2023-06-22T10:55:16.935817+0000","last_clean":"2023-06-22T10:55:16.935817+0000","last_became_active":"2023-06-22T10:55:15.160853+0000","last_became_peered":"2023-06-22T10:55:15.160853+0000","last_unstale":"2023-06-22T10:55:16.935817+0000","last_undegraded":"2023-06-22T10:55:16.935817+0000","last_fullsized":"2023-06-22T10:55:16.935817+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:42:59.236134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.935460+0000","last_change":"2023-06-22T10:55:15.164881+0000","last_active":"2023-06-22T10:55:16.935460+0000","last_peered":"2023-06-22T10:55:16.935460+0000","last_clean":"2023-06-22T10:55:16.935460+0000","last_became_active":"2023-06-22T10:55:15.163965+0000","last_became_peered":"2023-06-22T10:55:15.163965+0000","last_unstale":"2023-06-22T10:55:16.935460+0000","last_undegraded":"2023-06-22T10:55:16.935460+0000","last_fullsized":"2023-06-22T10:55:16.935460+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:45:48.928913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.202876+0000","last_change":"2023-06-22T10:55:15.154322+0000","last_active":"2023-06-22T10:55:16.202876+0000","last_peered":"2023-06-22T10:55:16.202876+0000","last_clean":"2023-06-22T10:55:16.202876+0000","last_became_active":"2023-06-22T10:55:15.154013+0000","last_became_peered":"2023-06-22T10:55:15.154013+0000","last_unstale":"2023-06-22T10:55:16.202876+0000","last_undegraded":"2023-06-22T10:55:16.202876+0000","last_fullsized":"2023-06-22T10:55:16.202876+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T17:55:25.635403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.935308+0000","last_change":"2023-06-22T10:55:15.153413+0000","last_active":"2023-06-22T10:55:16.935308+0000","last_peered":"2023-06-22T10:55:16.935308+0000","last_clean":"2023-06-22T10:55:16.935308+0000","last_became_active":"2023-06-22T10:55:15.153179+0000","last_became_peered":"2023-06-22T10:55:15.153179+0000","last_unstale":"2023-06-22T10:55:16.935308+0000","last_undegraded":"2023-06-22T10:55:16.935308+0000","last_fullsized":"2023-06-22T10:55:16.935308+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:30:48.210901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.935030+0000","last_change":"2023-06-22T10:55:15.150305+0000","last_active":"2023-06-22T10:55:16.935030+0000","last_peered":"2023-06-22T10:55:16.935030+0000","last_clean":"2023-06-22T10:55:16.935030+0000","last_became_active":"2023-06-22T10:55:15.149747+0000","last_became_peered":"2023-06-22T10:55:15.149747+0000","last_unstale":"2023-06-22T10:55:16.935030+0000","last_undegraded":"2023-06-22T10:55:16.935030+0000","last_fullsized":"2023-06-22T10:55:16.935030+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:45:48.928913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.934937+0000","last_change":"2023-06-22T10:55:15.149307+0000","last_active":"2023-06-22T10:55:16.934937+0000","last_peered":"2023-06-22T10:55:16.934937+0000","last_clean":"2023-06-22T10:55:16.934937+0000","last_became_active":"2023-06-22T10:55:15.148921+0000","last_became_peered":"2023-06-22T10:55:15.148921+0000","last_unstale":"2023-06-22T10:55:16.934937+0000","last_undegraded":"2023-06-22T10:55:16.934937+0000","last_fullsized":"2023-06-22T10:55:16.934937+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:56:55.577936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.935719+0000","last_change":"2023-06-22T10:55:15.155584+0000","last_active":"2023-06-22T10:55:16.935719+0000","last_peered":"2023-06-22T10:55:16.935719+0000","last_clean":"2023-06-22T10:55:16.935719+0000","last_became_active":"2023-06-22T10:55:15.155330+0000","last_became_peered":"2023-06-22T10:55:15.155330+0000","last_unstale":"2023-06-22T10:55:16.935719+0000","last_undegraded":"2023-06-22T10:55:16.935719+0000","last_fullsized":"2023-06-22T10:55:16.935719+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T18:31:37.223625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.935408+0000","last_change":"2023-06-22T10:55:15.164025+0000","last_active":"2023-06-22T10:55:16.935408+0000","last_peered":"2023-06-22T10:55:16.935408+0000","last_clean":"2023-06-22T10:55:16.935408+0000","last_became_active":"2023-06-22T10:55:15.163639+0000","last_became_peered":"2023-06-22T10:55:15.163639+0000","last_unstale":"2023-06-22T10:55:16.935408+0000","last_undegraded":"2023-06-22T10:55:16.935408+0000","last_fullsized":"2023-06-22T10:55:16.935408+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:56:55.577936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.149073+0000","last_change":"2023-06-22T10:55:15.148866+0000","last_active":"2023-06-22T10:55:16.149073+0000","last_peered":"2023-06-22T10:55:16.149073+0000","last_clean":"2023-06-22T10:55:16.149073+0000","last_became_active":"2023-06-22T10:55:15.148614+0000","last_became_peered":"2023-06-22T10:55:15.148614+0000","last_unstale":"2023-06-22T10:55:16.149073+0000","last_undegraded":"2023-06-22T10:55:16.149073+0000","last_fullsized":"2023-06-22T10:55:16.149073+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:00:19.057864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.148268+0000","last_change":"2023-06-22T10:55:15.158708+0000","last_active":"2023-06-22T10:55:16.148268+0000","last_peered":"2023-06-22T10:55:16.148268+0000","last_clean":"2023-06-22T10:55:16.148268+0000","last_became_active":"2023-06-22T10:55:15.158417+0000","last_became_peered":"2023-06-22T10:55:15.158417+0000","last_unstale":"2023-06-22T10:55:16.148268+0000","last_undegraded":"2023-06-22T10:55:16.148268+0000","last_fullsized":"2023-06-22T10:55:16.148268+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T17:55:25.635403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.935580+0000","last_change":"2023-06-22T10:55:15.155063+0000","last_active":"2023-06-22T10:55:16.935580+0000","last_peered":"2023-06-22T10:55:16.935580+0000","last_clean":"2023-06-22T10:55:16.935580+0000","last_became_active":"2023-06-22T10:55:15.154764+0000","last_became_peered":"2023-06-22T10:55:15.154764+0000","last_unstale":"2023-06-22T10:55:16.935580+0000","last_undegraded":"2023-06-22T10:55:16.935580+0000","last_fullsized":"2023-06-22T10:55:16.935580+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:48:31.780112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.148084+0000","last_change":"2023-06-22T10:55:15.153868+0000","last_active":"2023-06-22T10:55:16.148084+0000","last_peered":"2023-06-22T10:55:16.148084+0000","last_clean":"2023-06-22T10:55:16.148084+0000","last_became_active":"2023-06-22T10:55:15.153561+0000","last_became_peered":"2023-06-22T10:55:15.153561+0000","last_unstale":"2023-06-22T10:55:16.148084+0000","last_undegraded":"2023-06-22T10:55:16.148084+0000","last_fullsized":"2023-06-22T10:55:16.148084+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T11:51:47.650938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.202484+0000","last_change":"2023-06-22T10:55:15.139002+0000","last_active":"2023-06-22T10:55:16.202484+0000","last_peered":"2023-06-22T10:55:16.202484+0000","last_clean":"2023-06-22T10:55:16.202484+0000","last_became_active":"2023-06-22T10:55:15.138699+0000","last_became_peered":"2023-06-22T10:55:15.138699+0000","last_unstale":"2023-06-22T10:55:16.202484+0000","last_undegraded":"2023-06-22T10:55:16.202484+0000","last_fullsized":"2023-06-22T10:55:16.202484+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T20:17:28.901850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.934767+0000","last_change":"2023-06-22T10:55:15.154376+0000","last_active":"2023-06-22T10:55:16.934767+0000","last_peered":"2023-06-22T10:55:16.934767+0000","last_clean":"2023-06-22T10:55:16.934767+0000","last_became_active":"2023-06-22T10:55:15.153992+0000","last_became_peered":"2023-06-22T10:55:15.153992+0000","last_unstale":"2023-06-22T10:55:16.934767+0000","last_undegraded":"2023-06-22T10:55:16.934767+0000","last_fullsized":"2023-06-22T10:55:16.934767+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:53:32.544241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.146617+0000","last_change":"2023-06-22T10:55:15.147540+0000","last_active":"2023-06-22T10:55:16.146617+0000","last_peered":"2023-06-22T10:55:16.146617+0000","last_clean":"2023-06-22T10:55:16.146617+0000","last_became_active":"2023-06-22T10:55:15.147243+0000","last_became_peered":"2023-06-22T10:55:15.147243+0000","last_unstale":"2023-06-22T10:55:16.146617+0000","last_undegraded":"2023-06-22T10:55:16.146617+0000","last_fullsized":"2023-06-22T10:55:16.146617+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T20:07:47.150026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"41'4","reported_seq":17,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.203230+0000","last_change":"2023-06-22T10:55:14.145265+0000","last_active":"2023-06-22T10:55:16.203230+0000","last_peered":"2023-06-22T10:55:16.203230+0000","last_clean":"2023-06-22T10:55:16.203230+0000","last_became_active":"2023-06-22T10:55:14.144949+0000","last_became_peered":"2023-06-22T10:55:14.144949+0000","last_unstale":"2023-06-22T10:55:16.203230+0000","last_undegraded":"2023-06-22T10:55:16.203230+0000","last_fullsized":"2023-06-22T10:55:16.203230+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_clean_scrub_stamp":"2023-06-22T10:55:13.109670+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:33:23.861068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.935313+0000","last_change":"2023-06-22T10:55:15.153919+0000","last_active":"2023-06-22T10:55:16.935313+0000","last_peered":"2023-06-22T10:55:16.935313+0000","last_clean":"2023-06-22T10:55:16.935313+0000","last_became_active":"2023-06-22T10:55:15.153651+0000","last_became_peered":"2023-06-22T10:55:15.153651+0000","last_unstale":"2023-06-22T10:55:16.935313+0000","last_undegraded":"2023-06-22T10:55:16.935313+0000","last_fullsized":"2023-06-22T10:55:16.935313+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:37:05.075166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.149176+0000","last_change":"2023-06-22T10:55:14.145270+0000","last_active":"2023-06-22T10:55:16.149176+0000","last_peered":"2023-06-22T10:55:16.149176+0000","last_clean":"2023-06-22T10:55:16.149176+0000","last_became_active":"2023-06-22T10:55:14.144715+0000","last_became_peered":"2023-06-22T10:55:14.144715+0000","last_unstale":"2023-06-22T10:55:16.149176+0000","last_undegraded":"2023-06-22T10:55:16.149176+0000","last_fullsized":"2023-06-22T10:55:16.149176+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_clean_scrub_stamp":"2023-06-22T10:55:13.109670+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:10:40.156870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.148779+0000","last_change":"2023-06-22T10:55:15.145249+0000","last_active":"2023-06-22T10:55:16.148779+0000","last_peered":"2023-06-22T10:55:16.148779+0000","last_clean":"2023-06-22T10:55:16.148779+0000","last_became_active":"2023-06-22T10:55:15.144836+0000","last_became_peered":"2023-06-22T10:55:15.144836+0000","last_unstale":"2023-06-22T10:55:16.148779+0000","last_undegraded":"2023-06-22T10:55:16.148779+0000","last_fullsized":"2023-06-22T10:55:16.148779+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:33:24.867151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.147001+0000","last_change":"2023-06-22T10:55:14.140512+0000","last_active":"2023-06-22T10:55:16.147001+0000","last_peered":"2023-06-22T10:55:16.147001+0000","last_clean":"2023-06-22T10:55:16.147001+0000","last_became_active":"2023-06-22T10:55:14.140199+0000","last_became_peered":"2023-06-22T10:55:14.140199+0000","last_unstale":"2023-06-22T10:55:16.147001+0000","last_undegraded":"2023-06-22T10:55:16.147001+0000","last_fullsized":"2023-06-22T10:55:16.147001+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_clean_scrub_stamp":"2023-06-22T10:55:13.109670+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:39:14.457874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.146857+0000","last_change":"2023-06-22T10:55:15.152681+0000","last_active":"2023-06-22T10:55:16.146857+0000","last_peered":"2023-06-22T10:55:16.146857+0000","last_clean":"2023-06-22T10:55:16.146857+0000","last_became_active":"2023-06-22T10:55:15.152357+0000","last_became_peered":"2023-06-22T10:55:15.152357+0000","last_unstale":"2023-06-22T10:55:16.146857+0000","last_undegraded":"2023-06-22T10:55:16.146857+0000","last_fullsized":"2023-06-22T10:55:16.146857+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T20:56:46.097736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.935966+0000","last_change":"2023-06-22T10:55:14.147926+0000","last_active":"2023-06-22T10:55:16.935966+0000","last_peered":"2023-06-22T10:55:16.935966+0000","last_clean":"2023-06-22T10:55:16.935966+0000","last_became_active":"2023-06-22T10:55:14.147639+0000","last_became_peered":"2023-06-22T10:55:14.147639+0000","last_unstale":"2023-06-22T10:55:16.935966+0000","last_undegraded":"2023-06-22T10:55:16.935966+0000","last_fullsized":"2023-06-22T10:55:16.935966+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_clean_scrub_stamp":"2023-06-22T10:55:13.109670+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:33:23.861068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.148227+0000","last_change":"2023-06-22T10:55:15.153322+0000","last_active":"2023-06-22T10:55:16.148227+0000","last_peered":"2023-06-22T10:55:16.148227+0000","last_clean":"2023-06-22T10:55:16.148227+0000","last_became_active":"2023-06-22T10:55:15.152897+0000","last_became_peered":"2023-06-22T10:55:15.152897+0000","last_unstale":"2023-06-22T10:55:16.148227+0000","last_undegraded":"2023-06-22T10:55:16.148227+0000","last_fullsized":"2023-06-22T10:55:16.148227+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:45:01.575717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.203220+0000","last_change":"2023-06-22T10:55:14.147890+0000","last_active":"2023-06-22T10:55:16.203220+0000","last_peered":"2023-06-22T10:55:16.203220+0000","last_clean":"2023-06-22T10:55:16.203220+0000","last_became_active":"2023-06-22T10:55:14.147567+0000","last_became_peered":"2023-06-22T10:55:14.147567+0000","last_unstale":"2023-06-22T10:55:16.203220+0000","last_undegraded":"2023-06-22T10:55:16.203220+0000","last_fullsized":"2023-06-22T10:55:16.203220+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_clean_scrub_stamp":"2023-06-22T10:55:13.109670+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T15:56:56.611283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.935131+0000","last_change":"2023-06-22T10:55:15.155623+0000","last_active":"2023-06-22T10:55:16.935131+0000","last_peered":"2023-06-22T10:55:16.935131+0000","last_clean":"2023-06-22T10:55:16.935131+0000","last_became_active":"2023-06-22T10:55:15.155116+0000","last_became_peered":"2023-06-22T10:55:15.155116+0000","last_unstale":"2023-06-22T10:55:16.935131+0000","last_undegraded":"2023-06-22T10:55:16.935131+0000","last_fullsized":"2023-06-22T10:55:16.935131+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T20:05:18.802631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.148349+0000","last_change":"2023-06-22T10:55:14.133831+0000","last_active":"2023-06-22T10:55:16.148349+0000","last_peered":"2023-06-22T10:55:16.148349+0000","last_clean":"2023-06-22T10:55:16.148349+0000","last_became_active":"2023-06-22T10:55:14.133470+0000","last_became_peered":"2023-06-22T10:55:14.133470+0000","last_unstale":"2023-06-22T10:55:16.148349+0000","last_undegraded":"2023-06-22T10:55:16.148349+0000","last_fullsized":"2023-06-22T10:55:16.148349+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_clean_scrub_stamp":"2023-06-22T10:55:13.109670+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T20:10:21.142419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.934674+0000","last_change":"2023-06-22T10:55:15.152799+0000","last_active":"2023-06-22T10:55:16.934674+0000","last_peered":"2023-06-22T10:55:16.934674+0000","last_clean":"2023-06-22T10:55:16.934674+0000","last_became_active":"2023-06-22T10:55:15.152031+0000","last_became_peered":"2023-06-22T10:55:15.152031+0000","last_unstale":"2023-06-22T10:55:16.934674+0000","last_undegraded":"2023-06-22T10:55:16.934674+0000","last_fullsized":"2023-06-22T10:55:16.934674+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T20:16:37.221724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.148573+0000","last_change":"2023-06-22T10:55:14.132202+0000","last_active":"2023-06-22T10:55:16.148573+0000","last_peered":"2023-06-22T10:55:16.148573+0000","last_clean":"2023-06-22T10:55:16.148573+0000","last_became_active":"2023-06-22T10:55:14.131822+0000","last_became_peered":"2023-06-22T10:55:14.131822+0000","last_unstale":"2023-06-22T10:55:16.148573+0000","last_undegraded":"2023-06-22T10:55:16.148573+0000","last_fullsized":"2023-06-22T10:55:16.148573+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_clean_scrub_stamp":"2023-06-22T10:55:13.109670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T18:54:52.524856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.935279+0000","last_change":"2023-06-22T10:55:15.150085+0000","last_active":"2023-06-22T10:55:16.935279+0000","last_peered":"2023-06-22T10:55:16.935279+0000","last_clean":"2023-06-22T10:55:16.935279+0000","last_became_active":"2023-06-22T10:55:15.149274+0000","last_became_peered":"2023-06-22T10:55:15.149274+0000","last_unstale":"2023-06-22T10:55:16.935279+0000","last_undegraded":"2023-06-22T10:55:16.935279+0000","last_fullsized":"2023-06-22T10:55:16.935279+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:38:40.418219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.934710+0000","last_change":"2023-06-22T10:55:14.147810+0000","last_active":"2023-06-22T10:55:16.934710+0000","last_peered":"2023-06-22T10:55:16.934710+0000","last_clean":"2023-06-22T10:55:16.934710+0000","last_became_active":"2023-06-22T10:55:14.147165+0000","last_became_peered":"2023-06-22T10:55:14.147165+0000","last_unstale":"2023-06-22T10:55:16.934710+0000","last_undegraded":"2023-06-22T10:55:16.934710+0000","last_fullsized":"2023-06-22T10:55:16.934710+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_clean_scrub_stamp":"2023-06-22T10:55:13.109670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:44:30.738836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.149157+0000","last_change":"2023-06-22T10:55:15.158338+0000","last_active":"2023-06-22T10:55:16.149157+0000","last_peered":"2023-06-22T10:55:16.149157+0000","last_clean":"2023-06-22T10:55:16.149157+0000","last_became_active":"2023-06-22T10:55:15.158051+0000","last_became_peered":"2023-06-22T10:55:15.158051+0000","last_unstale":"2023-06-22T10:55:16.149157+0000","last_undegraded":"2023-06-22T10:55:16.149157+0000","last_fullsized":"2023-06-22T10:55:16.149157+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:50:29.465085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.149433+0000","last_change":"2023-06-22T10:55:14.140127+0000","last_active":"2023-06-22T10:55:16.149433+0000","last_peered":"2023-06-22T10:55:16.149433+0000","last_clean":"2023-06-22T10:55:16.149433+0000","last_became_active":"2023-06-22T10:55:14.139797+0000","last_became_peered":"2023-06-22T10:55:14.139797+0000","last_unstale":"2023-06-22T10:55:16.149433+0000","last_undegraded":"2023-06-22T10:55:16.149433+0000","last_fullsized":"2023-06-22T10:55:16.149433+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_clean_scrub_stamp":"2023-06-22T10:55:13.109670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T11:56:50.205108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.936176+0000","last_change":"2023-06-22T10:55:15.140260+0000","last_active":"2023-06-22T10:55:16.936176+0000","last_peered":"2023-06-22T10:55:16.936176+0000","last_clean":"2023-06-22T10:55:16.936176+0000","last_became_active":"2023-06-22T10:55:15.139971+0000","last_became_peered":"2023-06-22T10:55:15.139971+0000","last_unstale":"2023-06-22T10:55:16.936176+0000","last_undegraded":"2023-06-22T10:55:16.936176+0000","last_fullsized":"2023-06-22T10:55:16.936176+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:20:56.163441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.935690+0000","last_change":"2023-06-22T10:55:14.149309+0000","last_active":"2023-06-22T10:55:16.935690+0000","last_peered":"2023-06-22T10:55:16.935690+0000","last_clean":"2023-06-22T10:55:16.935690+0000","last_became_active":"2023-06-22T10:55:14.148956+0000","last_became_peered":"2023-06-22T10:55:14.148956+0000","last_unstale":"2023-06-22T10:55:16.935690+0000","last_undegraded":"2023-06-22T10:55:16.935690+0000","last_fullsized":"2023-06-22T10:55:16.935690+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_clean_scrub_stamp":"2023-06-22T10:55:13.109670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:33:44.445882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.203036+0000","last_change":"2023-06-22T10:55:15.156511+0000","last_active":"2023-06-22T10:55:16.203036+0000","last_peered":"2023-06-22T10:55:16.203036+0000","last_clean":"2023-06-22T10:55:16.203036+0000","last_became_active":"2023-06-22T10:55:15.156192+0000","last_became_peered":"2023-06-22T10:55:15.156192+0000","last_unstale":"2023-06-22T10:55:16.203036+0000","last_undegraded":"2023-06-22T10:55:16.203036+0000","last_fullsized":"2023-06-22T10:55:16.203036+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T18:54:53.530939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"41'3","reported_seq":16,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.936271+0000","last_change":"2023-06-22T10:55:14.147873+0000","last_active":"2023-06-22T10:55:16.936271+0000","last_peered":"2023-06-22T10:55:16.936271+0000","last_clean":"2023-06-22T10:55:16.936271+0000","last_became_active":"2023-06-22T10:55:14.147548+0000","last_became_peered":"2023-06-22T10:55:14.147548+0000","last_unstale":"2023-06-22T10:55:16.936271+0000","last_undegraded":"2023-06-22T10:55:16.936271+0000","last_fullsized":"2023-06-22T10:55:16.936271+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_clean_scrub_stamp":"2023-06-22T10:55:13.109670+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T11:18:24.285931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.936117+0000","last_change":"2023-06-22T10:55:15.143791+0000","last_active":"2023-06-22T10:55:16.936117+0000","last_peered":"2023-06-22T10:55:16.936117+0000","last_clean":"2023-06-22T10:55:16.936117+0000","last_became_active":"2023-06-22T10:55:15.143470+0000","last_became_peered":"2023-06-22T10:55:15.143470+0000","last_unstale":"2023-06-22T10:55:16.936117+0000","last_undegraded":"2023-06-22T10:55:16.936117+0000","last_fullsized":"2023-06-22T10:55:16.936117+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T11:00:35.629640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"41'6","reported_seq":19,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.935786+0000","last_change":"2023-06-22T10:55:14.144309+0000","last_active":"2023-06-22T10:55:16.935786+0000","last_peered":"2023-06-22T10:55:16.935786+0000","last_clean":"2023-06-22T10:55:16.935786+0000","last_became_active":"2023-06-22T10:55:14.144036+0000","last_became_peered":"2023-06-22T10:55:14.144036+0000","last_unstale":"2023-06-22T10:55:16.935786+0000","last_undegraded":"2023-06-22T10:55:16.935786+0000","last_fullsized":"2023-06-22T10:55:16.935786+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_clean_scrub_stamp":"2023-06-22T10:55:13.109670+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:37:04.069083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.935565+0000","last_change":"2023-06-22T10:55:15.158004+0000","last_active":"2023-06-22T10:55:16.935565+0000","last_peered":"2023-06-22T10:55:16.935565+0000","last_clean":"2023-06-22T10:55:16.935565+0000","last_became_active":"2023-06-22T10:55:15.157711+0000","last_became_peered":"2023-06-22T10:55:15.157711+0000","last_unstale":"2023-06-22T10:55:16.935565+0000","last_undegraded":"2023-06-22T10:55:16.935565+0000","last_fullsized":"2023-06-22T10:55:16.935565+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T13:53:13.845760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.203351+0000","last_change":"2023-06-22T10:55:14.141273+0000","last_active":"2023-06-22T10:55:16.203351+0000","last_peered":"2023-06-22T10:55:16.203351+0000","last_clean":"2023-06-22T10:55:16.203351+0000","last_became_active":"2023-06-22T10:55:14.140925+0000","last_became_peered":"2023-06-22T10:55:14.140925+0000","last_unstale":"2023-06-22T10:55:16.203351+0000","last_undegraded":"2023-06-22T10:55:16.203351+0000","last_fullsized":"2023-06-22T10:55:16.203351+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_clean_scrub_stamp":"2023-06-22T10:55:13.109670+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T13:01:34.855796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.935362+0000","last_change":"2023-06-22T10:55:15.151108+0000","last_active":"2023-06-22T10:55:16.935362+0000","last_peered":"2023-06-22T10:55:16.935362+0000","last_clean":"2023-06-22T10:55:16.935362+0000","last_became_active":"2023-06-22T10:55:15.150828+0000","last_became_peered":"2023-06-22T10:55:15.150828+0000","last_unstale":"2023-06-22T10:55:16.935362+0000","last_undegraded":"2023-06-22T10:55:16.935362+0000","last_fullsized":"2023-06-22T10:55:16.935362+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:38:59.468065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.935281+0000","last_change":"2023-06-22T10:55:14.146154+0000","last_active":"2023-06-22T10:55:16.935281+0000","last_peered":"2023-06-22T10:55:16.935281+0000","last_clean":"2023-06-22T10:55:16.935281+0000","last_became_active":"2023-06-22T10:55:14.145847+0000","last_became_peered":"2023-06-22T10:55:14.145847+0000","last_unstale":"2023-06-22T10:55:16.935281+0000","last_undegraded":"2023-06-22T10:55:16.935281+0000","last_fullsized":"2023-06-22T10:55:16.935281+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_clean_scrub_stamp":"2023-06-22T10:55:13.109670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T13:12:11.600421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.202555+0000","last_change":"2023-06-22T10:55:15.157089+0000","last_active":"2023-06-22T10:55:16.202555+0000","last_peered":"2023-06-22T10:55:16.202555+0000","last_clean":"2023-06-22T10:55:16.202555+0000","last_became_active":"2023-06-22T10:55:15.156769+0000","last_became_peered":"2023-06-22T10:55:15.156769+0000","last_unstale":"2023-06-22T10:55:16.202555+0000","last_undegraded":"2023-06-22T10:55:16.202555+0000","last_fullsized":"2023-06-22T10:55:16.202555+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:17:02.143564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.202613+0000","last_change":"2023-06-22T10:55:14.140597+0000","last_active":"2023-06-22T10:55:16.202613+0000","last_peered":"2023-06-22T10:55:16.202613+0000","last_clean":"2023-06-22T10:55:16.202613+0000","last_became_active":"2023-06-22T10:55:14.140296+0000","last_became_peered":"2023-06-22T10:55:14.140296+0000","last_unstale":"2023-06-22T10:55:16.202613+0000","last_undegraded":"2023-06-22T10:55:16.202613+0000","last_fullsized":"2023-06-22T10:55:16.202613+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_clean_scrub_stamp":"2023-06-22T10:55:13.109670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:25:49.648765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.935255+0000","last_change":"2023-06-22T10:55:15.149518+0000","last_active":"2023-06-22T10:55:16.935255+0000","last_peered":"2023-06-22T10:55:16.935255+0000","last_clean":"2023-06-22T10:55:16.935255+0000","last_became_active":"2023-06-22T10:55:15.149146+0000","last_became_peered":"2023-06-22T10:55:15.149146+0000","last_unstale":"2023-06-22T10:55:16.935255+0000","last_undegraded":"2023-06-22T10:55:16.935255+0000","last_fullsized":"2023-06-22T10:55:16.935255+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:24:42.334936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"41'8","reported_seq":21,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.934780+0000","last_change":"2023-06-22T10:55:14.147997+0000","last_active":"2023-06-22T10:55:16.934780+0000","last_peered":"2023-06-22T10:55:16.934780+0000","last_clean":"2023-06-22T10:55:16.934780+0000","last_became_active":"2023-06-22T10:55:14.147549+0000","last_became_peered":"2023-06-22T10:55:14.147549+0000","last_unstale":"2023-06-22T10:55:16.934780+0000","last_undegraded":"2023-06-22T10:55:16.934780+0000","last_fullsized":"2023-06-22T10:55:16.934780+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_clean_scrub_stamp":"2023-06-22T10:55:13.109670+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T17:07:54.795531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.935550+0000","last_change":"2023-06-22T10:55:15.152322+0000","last_active":"2023-06-22T10:55:16.935550+0000","last_peered":"2023-06-22T10:55:16.935550+0000","last_clean":"2023-06-22T10:55:16.935550+0000","last_became_active":"2023-06-22T10:55:15.152013+0000","last_became_peered":"2023-06-22T10:55:15.152013+0000","last_unstale":"2023-06-22T10:55:16.935550+0000","last_undegraded":"2023-06-22T10:55:16.935550+0000","last_fullsized":"2023-06-22T10:55:16.935550+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:38:40.418219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.935212+0000","last_change":"2023-06-22T10:55:14.150262+0000","last_active":"2023-06-22T10:55:16.935212+0000","last_peered":"2023-06-22T10:55:16.935212+0000","last_clean":"2023-06-22T10:55:16.935212+0000","last_became_active":"2023-06-22T10:55:14.149894+0000","last_became_peered":"2023-06-22T10:55:14.149894+0000","last_unstale":"2023-06-22T10:55:16.935212+0000","last_undegraded":"2023-06-22T10:55:16.935212+0000","last_fullsized":"2023-06-22T10:55:16.935212+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_clean_scrub_stamp":"2023-06-22T10:55:13.109670+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T15:59:09.528043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.935686+0000","last_change":"2023-06-22T10:55:15.156580+0000","last_active":"2023-06-22T10:55:16.935686+0000","last_peered":"2023-06-22T10:55:16.935686+0000","last_clean":"2023-06-22T10:55:16.935686+0000","last_became_active":"2023-06-22T10:55:15.156262+0000","last_became_peered":"2023-06-22T10:55:15.156262+0000","last_unstale":"2023-06-22T10:55:16.935686+0000","last_undegraded":"2023-06-22T10:55:16.935686+0000","last_fullsized":"2023-06-22T10:55:16.935686+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T20:10:29.104911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.149016+0000","last_change":"2023-06-22T10:55:14.145003+0000","last_active":"2023-06-22T10:55:16.149016+0000","last_peered":"2023-06-22T10:55:16.149016+0000","last_clean":"2023-06-22T10:55:16.149016+0000","last_became_active":"2023-06-22T10:55:14.144228+0000","last_became_peered":"2023-06-22T10:55:14.144228+0000","last_unstale":"2023-06-22T10:55:16.149016+0000","last_undegraded":"2023-06-22T10:55:16.149016+0000","last_fullsized":"2023-06-22T10:55:16.149016+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_clean_scrub_stamp":"2023-06-22T10:55:13.109670+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T11:53:41.666099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.935665+0000","last_change":"2023-06-22T10:55:15.161911+0000","last_active":"2023-06-22T10:55:16.935665+0000","last_peered":"2023-06-22T10:55:16.935665+0000","last_clean":"2023-06-22T10:55:16.935665+0000","last_became_active":"2023-06-22T10:55:15.161601+0000","last_became_peered":"2023-06-22T10:55:15.161601+0000","last_unstale":"2023-06-22T10:55:16.935665+0000","last_undegraded":"2023-06-22T10:55:16.935665+0000","last_fullsized":"2023-06-22T10:55:16.935665+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:48:00.545865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"41'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.148618+0000","last_change":"2023-06-22T10:55:14.144466+0000","last_active":"2023-06-22T10:55:16.148618+0000","last_peered":"2023-06-22T10:55:16.148618+0000","last_clean":"2023-06-22T10:55:16.148618+0000","last_became_active":"2023-06-22T10:55:14.143970+0000","last_became_peered":"2023-06-22T10:55:14.143970+0000","last_unstale":"2023-06-22T10:55:16.148618+0000","last_undegraded":"2023-06-22T10:55:16.148618+0000","last_fullsized":"2023-06-22T10:55:16.148618+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_clean_scrub_stamp":"2023-06-22T10:55:13.109670+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T15:56:56.611283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.935929+0000","last_change":"2023-06-22T10:55:15.154885+0000","last_active":"2023-06-22T10:55:16.935929+0000","last_peered":"2023-06-22T10:55:16.935929+0000","last_clean":"2023-06-22T10:55:16.935929+0000","last_became_active":"2023-06-22T10:55:15.154390+0000","last_became_peered":"2023-06-22T10:55:15.154390+0000","last_unstale":"2023-06-22T10:55:16.935929+0000","last_undegraded":"2023-06-22T10:55:16.935929+0000","last_fullsized":"2023-06-22T10:55:16.935929+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T18:21:58.923302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.203135+0000","last_change":"2023-06-22T10:55:14.143875+0000","last_active":"2023-06-22T10:55:16.203135+0000","last_peered":"2023-06-22T10:55:16.203135+0000","last_clean":"2023-06-22T10:55:16.203135+0000","last_became_active":"2023-06-22T10:55:14.143560+0000","last_became_peered":"2023-06-22T10:55:14.143560+0000","last_unstale":"2023-06-22T10:55:16.203135+0000","last_undegraded":"2023-06-22T10:55:16.203135+0000","last_fullsized":"2023-06-22T10:55:16.203135+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_clean_scrub_stamp":"2023-06-22T10:55:13.109670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:24:41.328853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.202644+0000","last_change":"2023-06-22T10:55:15.150811+0000","last_active":"2023-06-22T10:55:16.202644+0000","last_peered":"2023-06-22T10:55:16.202644+0000","last_clean":"2023-06-22T10:55:16.202644+0000","last_became_active":"2023-06-22T10:55:15.150542+0000","last_became_peered":"2023-06-22T10:55:15.150542+0000","last_unstale":"2023-06-22T10:55:16.202644+0000","last_undegraded":"2023-06-22T10:55:16.202644+0000","last_fullsized":"2023-06-22T10:55:16.202644+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T18:27:06.830423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.203390+0000","last_change":"2023-06-22T10:55:14.147890+0000","last_active":"2023-06-22T10:55:16.203390+0000","last_peered":"2023-06-22T10:55:16.203390+0000","last_clean":"2023-06-22T10:55:16.203390+0000","last_became_active":"2023-06-22T10:55:14.147561+0000","last_became_peered":"2023-06-22T10:55:14.147561+0000","last_unstale":"2023-06-22T10:55:16.203390+0000","last_undegraded":"2023-06-22T10:55:16.203390+0000","last_fullsized":"2023-06-22T10:55:16.203390+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_clean_scrub_stamp":"2023-06-22T10:55:13.109670+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T11:00:34.623557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.146596+0000","last_change":"2023-06-22T10:55:15.147670+0000","last_active":"2023-06-22T10:55:16.146596+0000","last_peered":"2023-06-22T10:55:16.146596+0000","last_clean":"2023-06-22T10:55:16.146596+0000","last_became_active":"2023-06-22T10:55:15.147360+0000","last_became_peered":"2023-06-22T10:55:15.147360+0000","last_unstale":"2023-06-22T10:55:16.146596+0000","last_undegraded":"2023-06-22T10:55:16.146596+0000","last_fullsized":"2023-06-22T10:55:16.146596+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T20:05:18.802631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.148570+0000","last_change":"2023-06-22T10:55:14.143289+0000","last_active":"2023-06-22T10:55:16.148570+0000","last_peered":"2023-06-22T10:55:16.148570+0000","last_clean":"2023-06-22T10:55:16.148570+0000","last_became_active":"2023-06-22T10:55:14.143008+0000","last_became_peered":"2023-06-22T10:55:14.143008+0000","last_unstale":"2023-06-22T10:55:16.148570+0000","last_undegraded":"2023-06-22T10:55:16.148570+0000","last_fullsized":"2023-06-22T10:55:16.148570+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_clean_scrub_stamp":"2023-06-22T10:55:13.109670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:38:22.683019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.934914+0000","last_change":"2023-06-22T10:55:15.148843+0000","last_active":"2023-06-22T10:55:16.934914+0000","last_peered":"2023-06-22T10:55:16.934914+0000","last_clean":"2023-06-22T10:55:16.934914+0000","last_became_active":"2023-06-22T10:55:15.148559+0000","last_became_peered":"2023-06-22T10:55:15.148559+0000","last_unstale":"2023-06-22T10:55:16.934914+0000","last_undegraded":"2023-06-22T10:55:16.934914+0000","last_fullsized":"2023-06-22T10:55:16.934914+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:27:51.619582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.934814+0000","last_change":"2023-06-22T10:55:14.149320+0000","last_active":"2023-06-22T10:55:16.934814+0000","last_peered":"2023-06-22T10:55:16.934814+0000","last_clean":"2023-06-22T10:55:16.934814+0000","last_became_active":"2023-06-22T10:55:14.149000+0000","last_became_peered":"2023-06-22T10:55:14.149000+0000","last_unstale":"2023-06-22T10:55:16.934814+0000","last_undegraded":"2023-06-22T10:55:16.934814+0000","last_fullsized":"2023-06-22T10:55:16.934814+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_clean_scrub_stamp":"2023-06-22T10:55:13.109670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:06:15.250766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.934630+0000","last_change":"2023-06-22T10:55:15.145170+0000","last_active":"2023-06-22T10:55:16.934630+0000","last_peered":"2023-06-22T10:55:16.934630+0000","last_clean":"2023-06-22T10:55:16.934630+0000","last_became_active":"2023-06-22T10:55:15.144883+0000","last_became_peered":"2023-06-22T10:55:15.144883+0000","last_unstale":"2023-06-22T10:55:16.934630+0000","last_undegraded":"2023-06-22T10:55:16.934630+0000","last_fullsized":"2023-06-22T10:55:16.934630+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:33:39.697014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.934759+0000","last_change":"2023-06-22T10:55:14.147719+0000","last_active":"2023-06-22T10:55:16.934759+0000","last_peered":"2023-06-22T10:55:16.934759+0000","last_clean":"2023-06-22T10:55:16.934759+0000","last_became_active":"2023-06-22T10:55:14.147377+0000","last_became_peered":"2023-06-22T10:55:14.147377+0000","last_unstale":"2023-06-22T10:55:16.934759+0000","last_undegraded":"2023-06-22T10:55:16.934759+0000","last_fullsized":"2023-06-22T10:55:16.934759+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_clean_scrub_stamp":"2023-06-22T10:55:13.109670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:10:51.176652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.147935+0000","last_change":"2023-06-22T10:55:15.154740+0000","last_active":"2023-06-22T10:55:16.147935+0000","last_peered":"2023-06-22T10:55:16.147935+0000","last_clean":"2023-06-22T10:55:16.147935+0000","last_became_active":"2023-06-22T10:55:15.154450+0000","last_became_peered":"2023-06-22T10:55:15.154450+0000","last_unstale":"2023-06-22T10:55:16.147935+0000","last_undegraded":"2023-06-22T10:55:16.147935+0000","last_fullsized":"2023-06-22T10:55:16.147935+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T11:27:12.575133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.934837+0000","last_change":"2023-06-22T10:55:14.152194+0000","last_active":"2023-06-22T10:55:16.934837+0000","last_peered":"2023-06-22T10:55:16.934837+0000","last_clean":"2023-06-22T10:55:16.934837+0000","last_became_active":"2023-06-22T10:55:14.151885+0000","last_became_peered":"2023-06-22T10:55:14.151885+0000","last_unstale":"2023-06-22T10:55:16.934837+0000","last_undegraded":"2023-06-22T10:55:16.934837+0000","last_fullsized":"2023-06-22T10:55:16.934837+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_clean_scrub_stamp":"2023-06-22T10:55:13.109670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:29:36.861102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":49,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.146700+0000","last_change":"2023-06-22T10:53:25.624603+0000","last_active":"2023-06-22T10:55:16.146700+0000","last_peered":"2023-06-22T10:55:16.146700+0000","last_clean":"2023-06-22T10:55:16.146700+0000","last_became_active":"2023-06-22T10:53:25.624302+0000","last_became_peered":"2023-06-22T10:53:25.624302+0000","last_unstale":"2023-06-22T10:55:16.146700+0000","last_undegraded":"2023-06-22T10:55:16.146700+0000","last_fullsized":"2023-06-22T10:55:16.146700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_clean_scrub_stamp":"2023-06-22T10:53:24.612028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T14:37:09.964340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.935669+0000","last_change":"2023-06-22T10:55:15.161421+0000","last_active":"2023-06-22T10:55:16.935669+0000","last_peered":"2023-06-22T10:55:16.935669+0000","last_clean":"2023-06-22T10:55:16.935669+0000","last_became_active":"2023-06-22T10:55:15.160982+0000","last_became_peered":"2023-06-22T10:55:15.160982+0000","last_unstale":"2023-06-22T10:55:16.935669+0000","last_undegraded":"2023-06-22T10:55:16.935669+0000","last_fullsized":"2023-06-22T10:55:16.935669+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:21:49.446211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"42'1","reported_seq":14,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.204674+0000","last_change":"2023-06-22T10:55:14.138612+0000","last_active":"2023-06-22T10:55:16.204674+0000","last_peered":"2023-06-22T10:55:16.204674+0000","last_clean":"2023-06-22T10:55:16.204674+0000","last_became_active":"2023-06-22T10:55:14.136868+0000","last_became_peered":"2023-06-22T10:55:14.136868+0000","last_unstale":"2023-06-22T10:55:16.204674+0000","last_undegraded":"2023-06-22T10:55:16.204674+0000","last_fullsized":"2023-06-22T10:55:16.204674+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_clean_scrub_stamp":"2023-06-22T10:55:13.109670+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:05:52.207090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":55,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.148114+0000","last_change":"2023-06-22T10:53:25.624213+0000","last_active":"2023-06-22T10:55:16.148114+0000","last_peered":"2023-06-22T10:55:16.148114+0000","last_clean":"2023-06-22T10:55:16.148114+0000","last_became_active":"2023-06-22T10:53:25.623692+0000","last_became_peered":"2023-06-22T10:53:25.623692+0000","last_unstale":"2023-06-22T10:55:16.148114+0000","last_undegraded":"2023-06-22T10:55:16.148114+0000","last_fullsized":"2023-06-22T10:55:16.148114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_clean_scrub_stamp":"2023-06-22T10:53:24.612028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T18:25:17.326697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.934968+0000","last_change":"2023-06-22T10:55:15.158680+0000","last_active":"2023-06-22T10:55:16.934968+0000","last_peered":"2023-06-22T10:55:16.934968+0000","last_clean":"2023-06-22T10:55:16.934968+0000","last_became_active":"2023-06-22T10:55:15.158395+0000","last_became_peered":"2023-06-22T10:55:15.158395+0000","last_unstale":"2023-06-22T10:55:16.934968+0000","last_undegraded":"2023-06-22T10:55:16.934968+0000","last_fullsized":"2023-06-22T10:55:16.934968+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:57:36.754178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.936297+0000","last_change":"2023-06-22T10:55:14.148319+0000","last_active":"2023-06-22T10:55:16.936297+0000","last_peered":"2023-06-22T10:55:16.936297+0000","last_clean":"2023-06-22T10:55:16.936297+0000","last_became_active":"2023-06-22T10:55:14.148014+0000","last_became_peered":"2023-06-22T10:55:14.148014+0000","last_unstale":"2023-06-22T10:55:16.936297+0000","last_undegraded":"2023-06-22T10:55:16.936297+0000","last_fullsized":"2023-06-22T10:55:16.936297+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_clean_scrub_stamp":"2023-06-22T10:55:13.109670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:45:26.767142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":51,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.935124+0000","last_change":"2023-06-22T10:53:25.679314+0000","last_active":"2023-06-22T10:55:16.935124+0000","last_peered":"2023-06-22T10:55:16.935124+0000","last_clean":"2023-06-22T10:55:16.935124+0000","last_became_active":"2023-06-22T10:53:25.678947+0000","last_became_peered":"2023-06-22T10:53:25.678947+0000","last_unstale":"2023-06-22T10:55:16.935124+0000","last_undegraded":"2023-06-22T10:55:16.935124+0000","last_fullsized":"2023-06-22T10:55:16.935124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_clean_scrub_stamp":"2023-06-22T10:53:24.612028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:26:57.615943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.935584+0000","last_change":"2023-06-22T10:55:15.146348+0000","last_active":"2023-06-22T10:55:16.935584+0000","last_peered":"2023-06-22T10:55:16.935584+0000","last_clean":"2023-06-22T10:55:16.935584+0000","last_became_active":"2023-06-22T10:55:15.146091+0000","last_became_peered":"2023-06-22T10:55:15.146091+0000","last_unstale":"2023-06-22T10:55:16.935584+0000","last_undegraded":"2023-06-22T10:55:16.935584+0000","last_fullsized":"2023-06-22T10:55:16.935584+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:39:15.463957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"41'2","reported_seq":15,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.148586+0000","last_change":"2023-06-22T10:55:14.134989+0000","last_active":"2023-06-22T10:55:16.148586+0000","last_peered":"2023-06-22T10:55:16.148586+0000","last_clean":"2023-06-22T10:55:16.148586+0000","last_became_active":"2023-06-22T10:55:14.134709+0000","last_became_peered":"2023-06-22T10:55:14.134709+0000","last_unstale":"2023-06-22T10:55:16.148586+0000","last_undegraded":"2023-06-22T10:55:16.148586+0000","last_fullsized":"2023-06-22T10:55:16.148586+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_clean_scrub_stamp":"2023-06-22T10:55:13.109670+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:05:52.207090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":55,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.148728+0000","last_change":"2023-06-22T10:53:25.624072+0000","last_active":"2023-06-22T10:55:16.148728+0000","last_peered":"2023-06-22T10:55:16.148728+0000","last_clean":"2023-06-22T10:55:16.148728+0000","last_became_active":"2023-06-22T10:53:25.623617+0000","last_became_peered":"2023-06-22T10:53:25.623617+0000","last_unstale":"2023-06-22T10:55:16.148728+0000","last_undegraded":"2023-06-22T10:55:16.148728+0000","last_fullsized":"2023-06-22T10:55:16.148728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_clean_scrub_stamp":"2023-06-22T10:53:24.612028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T13:10:23.102779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":209,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.934871+0000","last_change":"2023-06-22T10:53:19.693774+0000","last_active":"2023-06-22T10:55:16.934871+0000","last_peered":"2023-06-22T10:55:16.934871+0000","last_clean":"2023-06-22T10:55:16.934871+0000","last_became_active":"2023-06-22T10:53:19.692329+0000","last_became_peered":"2023-06-22T10:53:19.692329+0000","last_unstale":"2023-06-22T10:55:16.934871+0000","last_undegraded":"2023-06-22T10:55:16.934871+0000","last_fullsized":"2023-06-22T10:55:16.934871+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:17.830348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:17.830348+0000","last_clean_scrub_stamp":"2023-06-22T10:53:17.830348+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T16:03:56.927768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.936121+0000","last_change":"2023-06-22T10:55:15.156913+0000","last_active":"2023-06-22T10:55:16.936121+0000","last_peered":"2023-06-22T10:55:16.936121+0000","last_clean":"2023-06-22T10:55:16.936121+0000","last_became_active":"2023-06-22T10:55:15.156603+0000","last_became_peered":"2023-06-22T10:55:15.156603+0000","last_unstale":"2023-06-22T10:55:16.936121+0000","last_undegraded":"2023-06-22T10:55:16.936121+0000","last_fullsized":"2023-06-22T10:55:16.936121+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:08:09.202243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.146667+0000","last_change":"2023-06-22T10:55:14.141712+0000","last_active":"2023-06-22T10:55:16.146667+0000","last_peered":"2023-06-22T10:55:16.146667+0000","last_clean":"2023-06-22T10:55:16.146667+0000","last_became_active":"2023-06-22T10:55:14.141420+0000","last_became_peered":"2023-06-22T10:55:14.141420+0000","last_unstale":"2023-06-22T10:55:16.146667+0000","last_undegraded":"2023-06-22T10:55:16.146667+0000","last_fullsized":"2023-06-22T10:55:16.146667+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_clean_scrub_stamp":"2023-06-22T10:55:13.109670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:30:47.204818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":53,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.934902+0000","last_change":"2023-06-22T10:53:25.626890+0000","last_active":"2023-06-22T10:55:16.934902+0000","last_peered":"2023-06-22T10:55:16.934902+0000","last_clean":"2023-06-22T10:55:16.934902+0000","last_became_active":"2023-06-22T10:53:25.626558+0000","last_became_peered":"2023-06-22T10:53:25.626558+0000","last_unstale":"2023-06-22T10:55:16.934902+0000","last_undegraded":"2023-06-22T10:55:16.934902+0000","last_fullsized":"2023-06-22T10:55:16.934902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_clean_scrub_stamp":"2023-06-22T10:53:24.612028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T15:55:08.113640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.148297+0000","last_change":"2023-06-22T10:55:15.139319+0000","last_active":"2023-06-22T10:55:16.148297+0000","last_peered":"2023-06-22T10:55:16.148297+0000","last_clean":"2023-06-22T10:55:16.148297+0000","last_became_active":"2023-06-22T10:55:15.138997+0000","last_became_peered":"2023-06-22T10:55:15.138997+0000","last_unstale":"2023-06-22T10:55:16.148297+0000","last_undegraded":"2023-06-22T10:55:16.148297+0000","last_fullsized":"2023-06-22T10:55:16.148297+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:10:52.182735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.146518+0000","last_change":"2023-06-22T10:55:14.146106+0000","last_active":"2023-06-22T10:55:16.146518+0000","last_peered":"2023-06-22T10:55:16.146518+0000","last_clean":"2023-06-22T10:55:16.146518+0000","last_became_active":"2023-06-22T10:55:14.144527+0000","last_became_peered":"2023-06-22T10:55:14.144527+0000","last_unstale":"2023-06-22T10:55:16.146518+0000","last_undegraded":"2023-06-22T10:55:16.146518+0000","last_fullsized":"2023-06-22T10:55:16.146518+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_clean_scrub_stamp":"2023-06-22T10:55:13.109670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T21:57:35.748095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":53,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.936327+0000","last_change":"2023-06-22T10:53:25.626005+0000","last_active":"2023-06-22T10:55:16.936327+0000","last_peered":"2023-06-22T10:55:16.936327+0000","last_clean":"2023-06-22T10:55:16.936327+0000","last_became_active":"2023-06-22T10:53:25.625614+0000","last_became_peered":"2023-06-22T10:53:25.625614+0000","last_unstale":"2023-06-22T10:55:16.936327+0000","last_undegraded":"2023-06-22T10:55:16.936327+0000","last_fullsized":"2023-06-22T10:55:16.936327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_clean_scrub_stamp":"2023-06-22T10:53:24.612028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T18:59:28.494551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.203247+0000","last_change":"2023-06-22T10:55:15.156414+0000","last_active":"2023-06-22T10:55:16.203247+0000","last_peered":"2023-06-22T10:55:16.203247+0000","last_clean":"2023-06-22T10:55:16.203247+0000","last_became_active":"2023-06-22T10:55:15.156106+0000","last_became_peered":"2023-06-22T10:55:15.156106+0000","last_unstale":"2023-06-22T10:55:16.203247+0000","last_undegraded":"2023-06-22T10:55:16.203247+0000","last_fullsized":"2023-06-22T10:55:16.203247+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T13:12:12.606504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.148463+0000","last_change":"2023-06-22T10:55:14.138208+0000","last_active":"2023-06-22T10:55:16.148463+0000","last_peered":"2023-06-22T10:55:16.148463+0000","last_clean":"2023-06-22T10:55:16.148463+0000","last_became_active":"2023-06-22T10:55:14.137909+0000","last_became_peered":"2023-06-22T10:55:14.137909+0000","last_unstale":"2023-06-22T10:55:16.148463+0000","last_undegraded":"2023-06-22T10:55:16.148463+0000","last_fullsized":"2023-06-22T10:55:16.148463+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_clean_scrub_stamp":"2023-06-22T10:55:13.109670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T18:51:58.164506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":49,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.146784+0000","last_change":"2023-06-22T10:53:25.625427+0000","last_active":"2023-06-22T10:55:16.146784+0000","last_peered":"2023-06-22T10:55:16.146784+0000","last_clean":"2023-06-22T10:55:16.146784+0000","last_became_active":"2023-06-22T10:53:25.625237+0000","last_became_peered":"2023-06-22T10:53:25.625237+0000","last_unstale":"2023-06-22T10:55:16.146784+0000","last_undegraded":"2023-06-22T10:55:16.146784+0000","last_fullsized":"2023-06-22T10:55:16.146784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_clean_scrub_stamp":"2023-06-22T10:53:24.612028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T19:20:54.136120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.202986+0000","last_change":"2023-06-22T10:55:15.144245+0000","last_active":"2023-06-22T10:55:16.202986+0000","last_peered":"2023-06-22T10:55:16.202986+0000","last_clean":"2023-06-22T10:55:16.202986+0000","last_became_active":"2023-06-22T10:55:15.143929+0000","last_became_peered":"2023-06-22T10:55:15.143929+0000","last_unstale":"2023-06-22T10:55:16.202986+0000","last_undegraded":"2023-06-22T10:55:16.202986+0000","last_fullsized":"2023-06-22T10:55:16.202986+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:14.115753+0000","last_clean_scrub_stamp":"2023-06-22T10:55:14.115753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T22:10:52.182735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.936154+0000","last_change":"2023-06-22T10:55:14.148308+0000","last_active":"2023-06-22T10:55:16.936154+0000","last_peered":"2023-06-22T10:55:16.936154+0000","last_clean":"2023-06-22T10:55:16.936154+0000","last_became_active":"2023-06-22T10:55:14.147480+0000","last_became_peered":"2023-06-22T10:55:14.147480+0000","last_unstale":"2023-06-22T10:55:16.936154+0000","last_undegraded":"2023-06-22T10:55:16.936154+0000","last_fullsized":"2023-06-22T10:55:16.936154+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:55:13.109670+0000","last_clean_scrub_stamp":"2023-06-22T10:55:13.109670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:49:34.451616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":49,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-06-22T10:55:16.935822+0000","last_change":"2023-06-22T10:53:25.625880+0000","last_active":"2023-06-22T10:55:16.935822+0000","last_peered":"2023-06-22T10:55:16.935822+0000","last_clean":"2023-06-22T10:55:16.935822+0000","last_became_active":"2023-06-22T10:53:25.625464+0000","last_became_peered":"2023-06-22T10:53:25.625464+0000","last_unstale":"2023-06-22T10:55:16.935822+0000","last_undegraded":"2023-06-22T10:55:16.935822+0000","last_fullsized":"2023-06-22T10:55:16.935822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-22T10:53:24.612028+0000","last_clean_scrub_stamp":"2023-06-22T10:53:24.612028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-23T12:47:38.604144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":0,"up_from":15,"seq":64424509467,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":1056,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1081344,"data_stored":806461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jun 22 10:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":2.6059999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":2.3540000000000001,"5min":2.3540000000000001,"15min":2.3540000000000001},"last":0.27800000000000002}]},{"osd":2,"last update":"Thu Jun 22 10:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":2.2440000000000002,"5min":2.2440000000000002,"15min":2.2440000000000002},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":2.3879999999999999,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":0.35299999999999998}]},{"osd":3,"last update":"Thu Jun 22 10:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":2.4329999999999998,"5min":2.4329999999999998,"15min":2.4329999999999998},"last":0.48799999999999999}]},{"osd":4,"last update":"Thu Jun 22 10:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":0.57699999999999996}]},{"osd":5,"last update":"Thu Jun 22 10:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.67000000000000004}]},{"osd":6,"last update":"Thu Jun 22 10:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.59299999999999997}]},{"osd":7,"last update":"Thu Jun 22 10:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":0.622}]}]},{"osd":7,"up_from":14,"seq":60129542173,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":1044,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":1069056,"data_stored":799544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jun 22 10:54:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.72999999999999998}]},{"osd":1,"last update":"Thu Jun 22 10:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.61099999999999999}]},{"osd":2,"last update":"Thu Jun 22 10:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.76400000000000001}]},{"osd":3,"last update":"Thu Jun 22 10:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":2.1739999999999999,"5min":2.1739999999999999,"15min":2.1739999999999999},"last":0.55500000000000005}]},{"osd":4,"last update":"Thu Jun 22 10:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.499},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.63900000000000001}]},{"osd":5,"last update":"Thu Jun 22 10:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":2.1030000000000002,"5min":2.1030000000000002,"15min":2.1030000000000002},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.59799999999999998}]},{"osd":6,"last update":"Thu Jun 22 10:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.747},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.78000000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":472,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":483328,"data_stored":209724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jun 22 10:54:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.441},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":4.6589999999999998,"5min":4.6589999999999998,"15min":4.6589999999999998},"last":0.40999999999999998}]},{"osd":1,"last update":"Thu Jun 22 10:54:19 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.8240000000000001,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":0.52000000000000002}]},{"osd":2,"last update":"Thu Jun 22 10:54:19 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":2.0059999999999998,"5min":2.0059999999999998,"15min":2.0059999999999998},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":4.8259999999999996,"5min":4.8259999999999996,"15min":4.8259999999999996},"last":0.46000000000000002}]},{"osd":4,"last update":"Thu Jun 22 10:54:19 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":4.7249999999999996,"5min":4.7249999999999996,"15min":4.7249999999999996},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.66800000000000004}]},{"osd":5,"last update":"Thu Jun 22 10:54:19 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":4.7619999999999996,"5min":4.7619999999999996,"15min":4.7619999999999996},"last":0.71799999999999997}]},{"osd":6,"last update":"Thu Jun 22 10:54:19 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.8819999999999999,"5min":1.8819999999999999,"15min":1.8819999999999999},"last":0.68000000000000005}]},{"osd":7,"last update":"Thu Jun 22 10:54:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":4.7930000000000001,"5min":4.7930000000000001,"15min":4.7930000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.84099999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":464,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":475136,"data_stored":209156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jun 22 10:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.34799999999999998}]},{"osd":2,"last update":"Thu Jun 22 10:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.39600000000000002}]},{"osd":3,"last update":"Thu Jun 22 10:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.45300000000000001}]},{"osd":4,"last update":"Thu Jun 22 10:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":1.0069999999999999}]},{"osd":5,"last update":"Thu Jun 22 10:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":1.1060000000000001}]},{"osd":6,"last update":"Thu Jun 22 10:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":1.1739999999999999}]},{"osd":7,"last update":"Thu Jun 22 10:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.0569999999999999},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.97899999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":472,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":483328,"data_stored":210650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jun 22 10:54:23 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.47399999999999998}]},{"osd":1,"last update":"Thu Jun 22 10:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.72799999999999998}]},{"osd":2,"last update":"Thu Jun 22 10:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.622}]},{"osd":3,"last update":"Thu Jun 22 10:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.66600000000000004}]},{"osd":5,"last update":"Thu Jun 22 10:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.76300000000000001}]},{"osd":6,"last update":"Thu Jun 22 10:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.92300000000000004}]},{"osd":7,"last update":"Thu Jun 22 10:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.84599999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":464,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":475136,"data_stored":209156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jun 22 10:54:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.53100000000000003}]},{"osd":1,"last update":"Thu Jun 22 10:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.66900000000000004}]},{"osd":2,"last update":"Thu Jun 22 10:54:22 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":3.5880000000000001,"5min":3.5880000000000001,"15min":3.5880000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.61499999999999999}]},{"osd":3,"last update":"Thu Jun 22 10:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.55000000000000004}]},{"osd":4,"last update":"Thu Jun 22 10:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.72399999999999998}]},{"osd":6,"last update":"Thu Jun 22 10:54:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.69299999999999995}]},{"osd":7,"last update":"Thu Jun 22 10:54:22 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.68600000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542171,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":488,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":499712,"data_stored":217645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jun 22 10:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":6.2789999999999999,"5min":6.2789999999999999,"15min":6.2789999999999999},"last":0.26600000000000001},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":13.273,"5min":13.273,"15min":13.273},"last":0.35999999999999999}]},{"osd":1,"last update":"Thu Jun 22 10:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":6.0789999999999997,"5min":6.0789999999999997,"15min":6.0789999999999997},"last":0.48499999999999999},{"interface":"front","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":13.215,"5min":13.215,"15min":13.215},"last":0.40300000000000002}]},{"osd":3,"last update":"Thu Jun 22 10:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":6.2430000000000003,"5min":6.2430000000000003,"15min":6.2430000000000003},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":6.3010000000000002,"5min":6.3010000000000002,"15min":6.3010000000000002},"last":0.44600000000000001}]},{"osd":4,"last update":"Thu Jun 22 10:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":5.9889999999999999,"5min":5.9889999999999999,"15min":5.9889999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.871}]},{"osd":5,"last update":"Thu Jun 22 10:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.83999999999999997},{"interface":"front","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":6.2050000000000001,"5min":6.2050000000000001,"15min":6.2050000000000001},"last":0.85399999999999998}]},{"osd":6,"last update":"Thu Jun 22 10:54:18 2023","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":6.1079999999999997,"5min":6.1079999999999997,"15min":6.1079999999999997},"last":0.79000000000000004},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":6.0430000000000001,"5min":6.0430000000000001,"15min":6.0430000000000001},"last":0.68200000000000005}]},{"osd":7,"last update":"Thu Jun 22 10:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.73599999999999999},{"interface":"front","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":6.165,"5min":6.165,"15min":6.165},"last":0.82799999999999996}]}]},{"osd":6,"up_from":14,"seq":60129542172,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":480,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":491520,"data_stored":216731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jun 22 10:54:19 2023","interfaces":[{"interface":"back","average":{"1min":1.536,"5min":1.536,"15min":1.536},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":10.185,"5min":10.185,"15min":10.185},"last":0.68100000000000005},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":7.5140000000000002,"5min":7.5140000000000002,"15min":7.5140000000000002},"last":0.54200000000000004}]},{"osd":1,"last update":"Thu Jun 22 10:54:19 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.093,"15min":1.093},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":9.4580000000000002,"5min":9.4580000000000002,"15min":9.4580000000000002},"last":0.52300000000000002},{"interface":"front","average":{"1min":1.27,"5min":1.27,"15min":1.27},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":10.228,"5min":10.228,"15min":10.228},"last":0.73099999999999998}]},{"osd":2,"last update":"Thu Jun 22 10:54:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":7.7549999999999999,"5min":7.7549999999999999,"15min":7.7549999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":6.4080000000000004,"5min":6.4080000000000004,"15min":6.4080000000000004},"last":0.749}]},{"osd":3,"last update":"Thu Jun 22 10:54:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":6.5750000000000002,"5min":6.5750000000000002,"15min":6.5750000000000002},"last":0.64200000000000002},{"interface":"front","average":{"1min":1.286,"5min":1.286,"15min":1.286},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":9.5700000000000003,"5min":9.5700000000000003,"15min":9.5700000000000003},"last":0.58699999999999997}]},{"osd":4,"last update":"Thu Jun 22 10:54:19 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":2.044,"5min":2.044,"15min":2.044},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.71599999999999997}]},{"osd":5,"last update":"Thu Jun 22 10:54:19 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.70099999999999996}]},{"osd":7,"last update":"Thu Jun 22 10:54:19 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.76300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-22T10:55:20.070 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-06-22T10:55:20.070 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-06-22T10:55:20.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.307+0000 7f1c45bff700 1 Processor -- start 2023-06-22T10:55:20.311 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.308+0000 7f1c45bff700 1 -- start start 2023-06-22T10:55:20.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.309+0000 7f1c45bff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1c4015a380 0x7f1c400c8d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:20.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.309+0000 7f1c45bff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1c400adc70 0x7f1c400c9950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:20.312 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.309+0000 7f1c45bff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1c400c9e90 0x7f1c4015de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:20.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.309+0000 7f1c45bff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c4006cd40 con 0x7f1c4015a380 2023-06-22T10:55:20.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.309+0000 7f1c45bff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c400ca310 con 0x7f1c400c9e90 2023-06-22T10:55:20.313 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.309+0000 7f1c45bff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4006c430 con 0x7f1c400adc70 2023-06-22T10:55:20.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.309+0000 7f1c3f7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1c4015a380 0x7f1c400c8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:20.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.309+0000 7f1c3f7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1c4015a380 0x7f1c400c8d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35370/0 (socket says 172.21.15.40:35370) 2023-06-22T10:55:20.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.309+0000 7f1c3f7fe700 1 -- 172.21.15.40:0/2349304430 learned_addr learned my addr 172.21.15.40:0/2349304430 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:55:20.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.310+0000 7f1c3ffff700 1 --2- 172.21.15.40:0/2349304430 >> v2:172.21.15.45:3300/0 conn(0x7f1c400c9e90 0x7f1c4015de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:20.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.310+0000 7f1c3effd700 1 --2- 172.21.15.40:0/2349304430 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1c400adc70 0x7f1c400c9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:20.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.310+0000 7f1c3f7fe700 1 -- 172.21.15.40:0/2349304430 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1c400adc70 msgr2=0x7f1c400c9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:55:20.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.310+0000 7f1c3f7fe700 1 --2- 172.21.15.40:0/2349304430 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1c400adc70 0x7f1c400c9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:20.315 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.310+0000 7f1c3f7fe700 1 -- 172.21.15.40:0/2349304430 >> v2:172.21.15.45:3300/0 conn(0x7f1c400c9e90 msgr2=0x7f1c4015de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:55:20.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.310+0000 7f1c3f7fe700 1 --2- 172.21.15.40:0/2349304430 >> v2:172.21.15.45:3300/0 conn(0x7f1c400c9e90 0x7f1c4015de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:20.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.310+0000 7f1c3f7fe700 1 -- 172.21.15.40:0/2349304430 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c4015a750 con 0x7f1c4015a380 2023-06-22T10:55:20.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.310+0000 7f1c3effd700 1 --2- 172.21.15.40:0/2349304430 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1c400adc70 0x7f1c400c9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-22T10:55:20.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.310+0000 7f1c3f7fe700 1 --2- 172.21.15.40:0/2349304430 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c4015a380 0x7f1c400c8d80 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f1c4006bef0 tx=0x7f1c30009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb92e96765ea3c03 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:20.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.310+0000 7f1c3e7fc700 1 -- 172.21.15.40:0/2349304430 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3000b870 con 0x7f1c4015a380 2023-06-22T10:55:20.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.310+0000 7f1c3e7fc700 1 -- 172.21.15.40:0/2349304430 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c3000b9d0 con 0x7f1c4015a380 2023-06-22T10:55:20.316 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.310+0000 7f1c3e7fc700 1 -- 172.21.15.40:0/2349304430 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3000bd60 con 0x7f1c4015a380 2023-06-22T10:55:20.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.311+0000 7f1c45bff700 1 -- 172.21.15.40:0/2349304430 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c4015a380 msgr2=0x7f1c400c8d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:20.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.311+0000 7f1c45bff700 1 --2- 172.21.15.40:0/2349304430 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c4015a380 0x7f1c400c8d80 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f1c4006bef0 tx=0x7f1c30009bd0 comp rx=0 tx=0).stop 2023-06-22T10:55:20.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.311+0000 7f1c45bff700 1 -- 172.21.15.40:0/2349304430 shutdown_connections 2023-06-22T10:55:20.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.311+0000 7f1c45bff700 1 --2- 172.21.15.40:0/2349304430 >> v2:172.21.15.45:3300/0 conn(0x7f1c400c9e90 0x7f1c4015de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:20.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.311+0000 7f1c45bff700 1 --2- 172.21.15.40:0/2349304430 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c4015a380 0x7f1c400c8d80 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:20.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.311+0000 7f1c45bff700 1 --2- 172.21.15.40:0/2349304430 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1c400adc70 0x7f1c400c9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:20.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.311+0000 7f1c45bff700 1 -- 172.21.15.40:0/2349304430 >> 172.21.15.40:0/2349304430 conn(0x7f1c4006abc0 msgr2=0x7f1c400ce730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:20.317 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.311+0000 7f1c45bff700 1 -- 172.21.15.40:0/2349304430 shutdown_connections 2023-06-22T10:55:20.318 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.311+0000 7f1c45bff700 1 -- 172.21.15.40:0/2349304430 wait complete. 2023-06-22T10:55:20.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.313+0000 7f1c45bff700 1 Processor -- start 2023-06-22T10:55:20.319 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.313+0000 7f1c45bff700 1 -- start start 2023-06-22T10:55:20.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.314+0000 7f1c45bff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c400adc70 0x7f1c400b3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:20.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.314+0000 7f1c45bff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1c400c9e90 0x7f1c400b1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:20.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.314+0000 7f1c45bff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c4015a380 0x7f1c401e3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:20.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.314+0000 7f1c45bff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c400b2500 con 0x7f1c400adc70 2023-06-22T10:55:20.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.314+0000 7f1c45bff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c400b4120 con 0x7f1c4015a380 2023-06-22T10:55:20.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.314+0000 7f1c45bff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c40157a10 con 0x7f1c400c9e90 2023-06-22T10:55:20.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.314+0000 7f1c3f7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c400adc70 0x7f1c400b3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:20.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.314+0000 7f1c3f7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c400adc70 0x7f1c400b3a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35372/0 (socket says 172.21.15.40:35372) 2023-06-22T10:55:20.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.314+0000 7f1c3f7fe700 1 -- 172.21.15.40:0/543653183 learned_addr learned my addr 172.21.15.40:0/543653183 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:55:20.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.314+0000 7f1c3effd700 1 --2- 172.21.15.40:0/543653183 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1c400c9e90 0x7f1c400b1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:20.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.314+0000 7f1c3ffff700 1 --2- 172.21.15.40:0/543653183 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c4015a380 0x7f1c401e3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:20.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.314+0000 7f1c3f7fe700 1 -- 172.21.15.40:0/543653183 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1c400c9e90 msgr2=0x7f1c400b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:20.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.314+0000 7f1c3f7fe700 1 --2- 172.21.15.40:0/543653183 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1c400c9e90 0x7f1c400b1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:20.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.314+0000 7f1c3f7fe700 1 -- 172.21.15.40:0/543653183 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c4015a380 msgr2=0x7f1c401e3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:20.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.314+0000 7f1c3f7fe700 1 --2- 172.21.15.40:0/543653183 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c4015a380 0x7f1c401e3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:20.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.314+0000 7f1c3f7fe700 1 -- 172.21.15.40:0/543653183 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c30009550 con 0x7f1c400adc70 2023-06-22T10:55:20.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.314+0000 7f1c3f7fe700 1 --2- 172.21.15.40:0/543653183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c400adc70 0x7f1c400b3a60 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f1c30000c00 tx=0x7f1c30004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:20.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.315+0000 7f1c27fff700 1 -- 172.21.15.40:0/543653183 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c30004540 con 0x7f1c400adc70 2023-06-22T10:55:20.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.315+0000 7f1c27fff700 1 -- 172.21.15.40:0/543653183 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c300036a0 con 0x7f1c400adc70 2023-06-22T10:55:20.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.315+0000 7f1c45bff700 1 -- 172.21.15.40:0/543653183 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c40157cf0 con 0x7f1c400adc70 2023-06-22T10:55:20.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.315+0000 7f1c27fff700 1 -- 172.21.15.40:0/543653183 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c30003a50 con 0x7f1c400adc70 2023-06-22T10:55:20.322 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.315+0000 7f1c45bff700 1 -- 172.21.15.40:0/543653183 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c400b4400 con 0x7f1c400adc70 2023-06-22T10:55:20.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.316+0000 7f1c45bff700 1 -- 172.21.15.40:0/543653183 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c40158210 con 0x7f1c400adc70 2023-06-22T10:55:20.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.317+0000 7f1c27fff700 1 -- 172.21.15.40:0/543653183 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1c30021070 con 0x7f1c400adc70 2023-06-22T10:55:20.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.318+0000 7f1c27fff700 1 --2- 172.21.15.40:0/543653183 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f1c2c06ace0 0x7f1c2c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:20.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.318+0000 7f1c27fff700 1 -- 172.21.15.40:0/543653183 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f1c3008ad40 con 0x7f1c400adc70 2023-06-22T10:55:20.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.318+0000 7f1c3effd700 1 --2- 172.21.15.40:0/543653183 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f1c2c06ace0 0x7f1c2c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:20.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.319+0000 7f1c3effd700 1 --2- 172.21.15.40:0/543653183 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f1c2c06ace0 0x7f1c2c06d190 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1c401e34b0 tx=0x7f1c34008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:20.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.322+0000 7f1c27fff700 1 -- 172.21.15.40:0/543653183 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1c40158210 con 0x7f1c400adc70 2023-06-22T10:55:20.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.618+0000 7f1c45bff700 1 -- 172.21.15.40:0/543653183 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f1c40158210 con 0x7f1c400adc70 2023-06-22T10:55:20.625 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.622+0000 7f1c27fff700 1 -- 172.21.15.40:0/543653183 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7f1c300150e0 con 0x7f1c400adc70 2023-06-22T10:55:20.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.625+0000 7f1c45bff700 1 -- 172.21.15.40:0/543653183 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f1c2c06ace0 msgr2=0x7f1c2c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:20.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.625+0000 7f1c45bff700 1 --2- 172.21.15.40:0/543653183 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f1c2c06ace0 0x7f1c2c06d190 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1c401e34b0 tx=0x7f1c34008040 comp rx=0 tx=0).stop 2023-06-22T10:55:20.629 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.625+0000 7f1c45bff700 1 -- 172.21.15.40:0/543653183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c400adc70 msgr2=0x7f1c400b3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:20.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.625+0000 7f1c45bff700 1 --2- 172.21.15.40:0/543653183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c400adc70 0x7f1c400b3a60 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f1c30000c00 tx=0x7f1c30004750 comp rx=0 tx=0).stop 2023-06-22T10:55:20.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.625+0000 7f1c45bff700 1 -- 172.21.15.40:0/543653183 shutdown_connections 2023-06-22T10:55:20.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.625+0000 7f1c45bff700 1 --2- 172.21.15.40:0/543653183 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f1c2c06ace0 0x7f1c2c06d190 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:20.630 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.625+0000 7f1c45bff700 1 --2- 172.21.15.40:0/543653183 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c4015a380 0x7f1c401e3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:20.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.625+0000 7f1c45bff700 1 --2- 172.21.15.40:0/543653183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c400adc70 0x7f1c400b3a60 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:20.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.625+0000 7f1c45bff700 1 --2- 172.21.15.40:0/543653183 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1c400c9e90 0x7f1c400b1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:20.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.625+0000 7f1c45bff700 1 -- 172.21.15.40:0/543653183 >> 172.21.15.40:0/543653183 conn(0x7f1c4006abc0 msgr2=0x7f1c400b0840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:20.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.625+0000 7f1c45bff700 1 -- 172.21.15.40:0/543653183 shutdown_connections 2023-06-22T10:55:20.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.625+0000 7f1c45bff700 1 -- 172.21.15.40:0/543653183 wait complete. 2023-06-22T10:55:20.632 INFO:teuthology.orchestra.run.smithi040.stderr:updated caps for client.0 2023-06-22T10:55:20.646 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-22T10:55:20.847 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.844+0000 7f5e109ff700 1 Processor -- start 2023-06-22T10:55:20.848 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.844+0000 7f5e109ff700 1 -- start start 2023-06-22T10:55:20.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.845+0000 7f5e109ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5e0c0b4630 0x7f5e0c0cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:20.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.845+0000 7f5e109ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5e0c0cd200 0x7f5e0c0d1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:20.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.846+0000 7f5e109ff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e0c0d1b60 con 0x7f5e0c0b4a00 2023-06-22T10:55:20.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.846+0000 7f5e109ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e0c0d2530 con 0x7f5e0c0b4630 2023-06-22T10:55:20.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.846+0000 7f5e109ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e0c0d1230 con 0x7f5e0c0cd200 2023-06-22T10:55:20.849 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.846+0000 7f5e0a59c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5e0c0b4630 0x7f5e0c0cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:20.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.846+0000 7f5e0a59c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5e0c0b4630 0x7f5e0c0cf050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35386/0 (socket says 172.21.15.40:35386) 2023-06-22T10:55:20.850 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.846+0000 7f5e0a59c700 1 -- 172.21.15.40:0/3739048990 learned_addr learned my addr 172.21.15.40:0/3739048990 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:55:20.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.846+0000 7f5e03fff700 1 --2- 172.21.15.40:0/3739048990 >> v2:172.21.15.45:3300/0 conn(0x7f5e0c0cd200 0x7f5e0c0d1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:20.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.846+0000 7f5e0a59c700 1 -- 172.21.15.40:0/3739048990 >> v2:172.21.15.45:3300/0 conn(0x7f5e0c0cd200 msgr2=0x7f5e0c0d1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:55:20.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.846+0000 7f5e0a59c700 1 --2- 172.21.15.40:0/3739048990 >> v2:172.21.15.45:3300/0 conn(0x7f5e0c0cd200 0x7f5e0c0d1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:20.851 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.846+0000 7f5e0a59c700 1 -- 172.21.15.40:0/3739048990 >> v1:172.21.15.45:6789/0 conn(0x7f5e0c0b4a00 legacy=0x7f5e0c0b5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:20.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.846+0000 7f5e0a59c700 1 -- 172.21.15.40:0/3739048990 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e0c0d1510 con 0x7f5e0c0b4630 2023-06-22T10:55:20.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.847+0000 7f5e0a59c700 1 --2- 172.21.15.40:0/3739048990 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e0c0b4630 0x7f5e0c0cf050 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c06a080 tx=0x7f5dfc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6e46c3f216f462f server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:20.852 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.847+0000 7f5e09d9b700 1 -- 172.21.15.40:0/3739048990 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc00b870 con 0x7f5e0c0b4630 2023-06-22T10:55:20.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.847+0000 7f5e09d9b700 1 -- 172.21.15.40:0/3739048990 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dfc00b9d0 con 0x7f5e0c0b4630 2023-06-22T10:55:20.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.847+0000 7f5e09d9b700 1 -- 172.21.15.40:0/3739048990 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc00bd60 con 0x7f5e0c0b4630 2023-06-22T10:55:20.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.847+0000 7f5e109ff700 1 -- 172.21.15.40:0/3739048990 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e0c0b4630 msgr2=0x7f5e0c0cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:20.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.847+0000 7f5e109ff700 1 --2- 172.21.15.40:0/3739048990 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e0c0b4630 0x7f5e0c0cf050 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c06a080 tx=0x7f5dfc009bd0 comp rx=0 tx=0).stop 2023-06-22T10:55:20.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.848+0000 7f5e109ff700 1 -- 172.21.15.40:0/3739048990 shutdown_connections 2023-06-22T10:55:20.853 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.848+0000 7f5e109ff700 1 --2- 172.21.15.40:0/3739048990 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e0c0b4630 0x7f5e0c0cf050 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:20.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.848+0000 7f5e109ff700 1 --2- 172.21.15.40:0/3739048990 >> v2:172.21.15.45:3300/0 conn(0x7f5e0c0cd200 0x7f5e0c0d1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:20.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.848+0000 7f5e109ff700 1 -- 172.21.15.40:0/3739048990 >> 172.21.15.40:0/3739048990 conn(0x7f5e0c0cf630 msgr2=0x7f5e0c0cfa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:20.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.848+0000 7f5e109ff700 1 -- 172.21.15.40:0/3739048990 shutdown_connections 2023-06-22T10:55:20.854 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.848+0000 7f5e109ff700 1 -- 172.21.15.40:0/3739048990 wait complete. 2023-06-22T10:55:20.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.849+0000 7f5e109ff700 1 Processor -- start 2023-06-22T10:55:20.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.850+0000 7f5e109ff700 1 -- start start 2023-06-22T10:55:20.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.850+0000 7f5e109ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f5e0c0b4630 0x7f5e0c0ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:20.856 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.850+0000 7f5e109ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e0c0b4a00 0x7f5e0c0b3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:20.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.850+0000 7f5e109ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e0c0cd200 0x7f5e0c0b7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:20.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.851+0000 7f5e109ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0c1f5720 con 0x7f5e0c0cd200 2023-06-22T10:55:20.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.851+0000 7f5e109ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0c0caa20 con 0x7f5e0c0b4a00 2023-06-22T10:55:20.857 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.851+0000 7f5e109ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0c1f59e0 con 0x7f5e0c0b4630 2023-06-22T10:55:20.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.851+0000 7f5e0a59c700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f5e0c0b4630 0x7f5e0c0ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:20.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.851+0000 7f5e03fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e0c0b4a00 0x7f5e0c0b3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:20.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.851+0000 7f5e0ad9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e0c0cd200 0x7f5e0c0b7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:20.858 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.851+0000 7f5e0a59c700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f5e0c0b4630 0x7f5e0c0ccb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3301/0 says I am v2:172.21.15.40:50154/0 (socket says 172.21.15.40:50154) 2023-06-22T10:55:20.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.851+0000 7f5e0a59c700 1 -- 172.21.15.40:0/1901654890 learned_addr learned my addr 172.21.15.40:0/1901654890 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:55:20.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.851+0000 7f5e0ad9d700 1 -- 172.21.15.40:0/1901654890 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f5e0c0b4630 msgr2=0x7f5e0c0ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:20.859 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.851+0000 7f5e0ad9d700 1 --2- 172.21.15.40:0/1901654890 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f5e0c0b4630 0x7f5e0c0ccb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:20.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.851+0000 7f5e0ad9d700 1 -- 172.21.15.40:0/1901654890 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e0c0b4a00 msgr2=0x7f5e0c0b3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:20.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.851+0000 7f5e0ad9d700 1 --2- 172.21.15.40:0/1901654890 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e0c0b4a00 0x7f5e0c0b3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:20.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.851+0000 7f5e0ad9d700 1 -- 172.21.15.40:0/1901654890 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dfc009550 con 0x7f5e0c0cd200 2023-06-22T10:55:20.860 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.852+0000 7f5e0ad9d700 1 --2- 172.21.15.40:0/1901654890 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e0c0cd200 0x7f5e0c0b7eb0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5e0400cb90 tx=0x7f5e0400cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:20.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.852+0000 7f5e02ffd700 1 -- 172.21.15.40:0/1901654890 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e04003c00 con 0x7f5e0c0cd200 2023-06-22T10:55:20.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.852+0000 7f5e02ffd700 1 -- 172.21.15.40:0/1901654890 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e04003d60 con 0x7f5e0c0cd200 2023-06-22T10:55:20.861 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.852+0000 7f5e02ffd700 1 -- 172.21.15.40:0/1901654890 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e0400aa80 con 0x7f5e0c0cd200 2023-06-22T10:55:20.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.852+0000 7f5e109ff700 1 -- 172.21.15.40:0/1901654890 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e0c1f5cc0 con 0x7f5e0c0cd200 2023-06-22T10:55:20.862 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.852+0000 7f5e109ff700 1 -- 172.21.15.40:0/1901654890 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e0c1f64c0 con 0x7f5e0c0cd200 2023-06-22T10:55:20.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.853+0000 7f5e109ff700 1 -- 172.21.15.40:0/1901654890 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e0c1f61e0 con 0x7f5e0c0cd200 2023-06-22T10:55:20.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.854+0000 7f5e02ffd700 1 -- 172.21.15.40:0/1901654890 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5e0400abe0 con 0x7f5e0c0cd200 2023-06-22T10:55:20.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.855+0000 7f5e02ffd700 1 --2- 172.21.15.40:0/1901654890 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f5dec06ace0 0x7f5dec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:20.864 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.855+0000 7f5e02ffd700 1 -- 172.21.15.40:0/1901654890 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f5e04089560 con 0x7f5e0c0cd200 2023-06-22T10:55:20.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.855+0000 7f5e0a59c700 1 --2- 172.21.15.40:0/1901654890 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f5dec06ace0 0x7f5dec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:20.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.856+0000 7f5e0a59c700 1 --2- 172.21.15.40:0/1901654890 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f5dec06ace0 0x7f5dec06d190 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc00c010 tx=0x7f5dfc008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:20.865 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:20.859+0000 7f5e02ffd700 1 -- 172.21.15.40:0/1901654890 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5e04054430 con 0x7f5e0c0cd200 2023-06-22T10:55:21.113 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.109+0000 7f5e109ff700 1 -- 172.21.15.40:0/1901654890 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5e0c067580 con 0x7f5e0c0cd200 2023-06-22T10:55:21.114 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.110+0000 7f5e02ffd700 1 -- 172.21.15.40:0/1901654890 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4665 (secure 0 0 0) 0x7f5e04057a50 con 0x7f5e0c0cd200 2023-06-22T10:55:21.114 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:55:21.114 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5272,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6834/634433135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6833","nonce":634433135},{"type":"v1","addr":"172.21.15.45:6834","nonce":634433135}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5406,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6836/2810635031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":2810635031},{"type":"v1","addr":"172.21.15.40:6836","nonce":2810635031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5409,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6837/819227010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6835","nonce":819227010},{"type":"v1","addr":"172.21.15.40:6837","nonce":819227010}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-22T10:55:14.651884+0000","modified":"2023-06-22T10:55:18.150965+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5412},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5412":{"gid":5412,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6835/1890176635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":1890176635},{"type":"v1","addr":"172.21.15.45:6835","nonce":1890176635}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-06-22T10:55:21.116 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.113+0000 7f5e109ff700 1 -- 172.21.15.40:0/1901654890 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f5dec06ace0 msgr2=0x7f5dec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:21.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.113+0000 7f5e109ff700 1 --2- 172.21.15.40:0/1901654890 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f5dec06ace0 0x7f5dec06d190 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc00c010 tx=0x7f5dfc008030 comp rx=0 tx=0).stop 2023-06-22T10:55:21.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.113+0000 7f5e109ff700 1 -- 172.21.15.40:0/1901654890 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e0c0cd200 msgr2=0x7f5e0c0b7eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:21.117 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.113+0000 7f5e109ff700 1 --2- 172.21.15.40:0/1901654890 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e0c0cd200 0x7f5e0c0b7eb0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5e0400cb90 tx=0x7f5e0400cea0 comp rx=0 tx=0).stop 2023-06-22T10:55:21.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.113+0000 7f5e109ff700 1 -- 172.21.15.40:0/1901654890 shutdown_connections 2023-06-22T10:55:21.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.113+0000 7f5e109ff700 1 --2- 172.21.15.40:0/1901654890 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f5dec06ace0 0x7f5dec06d190 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:21.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.113+0000 7f5e109ff700 1 --2- 172.21.15.40:0/1901654890 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f5e0c0b4630 0x7f5e0c0ccb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:21.118 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.113+0000 7f5e109ff700 1 --2- 172.21.15.40:0/1901654890 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5e0c0cd200 0x7f5e0c0b7eb0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:21.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.113+0000 7f5e109ff700 1 --2- 172.21.15.40:0/1901654890 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e0c0b4a00 0x7f5e0c0b3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:21.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.113+0000 7f5e109ff700 1 -- 172.21.15.40:0/1901654890 >> 172.21.15.40:0/1901654890 conn(0x7f5e0c0cf630 msgr2=0x7f5e0c0c94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:21.119 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.113+0000 7f5e109ff700 1 -- 172.21.15.40:0/1901654890 shutdown_connections 2023-06-22T10:55:21.120 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.113+0000 7f5e109ff700 1 -- 172.21.15.40:0/1901654890 wait complete. 2023-06-22T10:55:21.120 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 18 2023-06-22T10:55:21.536 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-06-22T10:55:14.651884+0000', 'modified': '2023-06-22T10:55:18.150965+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5412}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5412': {'gid': 5412, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.45:6835/1890176635', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6832', 'nonce': 1890176635}, {'type': 'v1', 'addr': '172.21.15.45:6835', 'nonce': 1890176635}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-06-22T10:55:21.537 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-06-22T10:55:21.537 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-06-22T10:55:21.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.739+0000 7f69729ff700 1 Processor -- start 2023-06-22T10:55:21.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.739+0000 7f69729ff700 1 -- start start 2023-06-22T10:55:21.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.741+0000 7f69729ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f696c15c720 0x7f696c0b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:21.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.741+0000 7f69729ff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f696c0d2830 0x7f696c0b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:21.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.741+0000 7f69729ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f696c0b4c60 0x7f696c06b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:21.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.741+0000 7f69729ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f696c160d60 con 0x7f696c15c720 2023-06-22T10:55:21.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.741+0000 7f69729ff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f696c0b50e0 con 0x7f696c0d2830 2023-06-22T10:55:21.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.741+0000 7f69729ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f696c0b2130 con 0x7f696c0b4c60 2023-06-22T10:55:21.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.741+0000 7f696bfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f696c15c720 0x7f696c0b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:21.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.741+0000 7f696bfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f696c15c720 0x7f696c0b1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35408/0 (socket says 172.21.15.40:35408) 2023-06-22T10:55:21.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.741+0000 7f696bfff700 1 -- 172.21.15.40:0/3679123448 learned_addr learned my addr 172.21.15.40:0/3679123448 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:55:21.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.741+0000 7f696b7fe700 1 --2- 172.21.15.40:0/3679123448 >> v2:172.21.15.45:3300/0 conn(0x7f696c0d2830 0x7f696c0b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:21.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.741+0000 7f6970f9c700 1 --2- 172.21.15.40:0/3679123448 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f696c0b4c60 0x7f696c06b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:21.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.741+0000 7f696bfff700 1 -- 172.21.15.40:0/3679123448 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f696c0b4c60 msgr2=0x7f696c06b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:55:21.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.741+0000 7f696bfff700 1 --2- 172.21.15.40:0/3679123448 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f696c0b4c60 0x7f696c06b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:21.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.741+0000 7f696bfff700 1 -- 172.21.15.40:0/3679123448 >> v2:172.21.15.45:3300/0 conn(0x7f696c0d2830 msgr2=0x7f696c0b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:55:21.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.741+0000 7f696bfff700 1 --2- 172.21.15.40:0/3679123448 >> v2:172.21.15.45:3300/0 conn(0x7f696c0d2830 0x7f696c0b4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:21.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.742+0000 7f696bfff700 1 -- 172.21.15.40:0/3679123448 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f696c161180 con 0x7f696c15c720 2023-06-22T10:55:21.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.742+0000 7f696bfff700 1 --2- 172.21.15.40:0/3679123448 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f696c15c720 0x7f696c0b1870 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f695c0098f0 tx=0x7f695c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba5b41d791151b23 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:21.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.742+0000 7f696affd700 1 -- 172.21.15.40:0/3679123448 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695c00b860 con 0x7f696c15c720 2023-06-22T10:55:21.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.742+0000 7f696affd700 1 -- 172.21.15.40:0/3679123448 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f695c00b9c0 con 0x7f696c15c720 2023-06-22T10:55:21.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.742+0000 7f696affd700 1 -- 172.21.15.40:0/3679123448 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695c00bd50 con 0x7f696c15c720 2023-06-22T10:55:21.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.742+0000 7f69729ff700 1 -- 172.21.15.40:0/3679123448 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f696c15c720 msgr2=0x7f696c0b1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:21.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.742+0000 7f69729ff700 1 --2- 172.21.15.40:0/3679123448 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f696c15c720 0x7f696c0b1870 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f695c0098f0 tx=0x7f695c009c00 comp rx=0 tx=0).stop 2023-06-22T10:55:21.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.743+0000 7f69729ff700 1 -- 172.21.15.40:0/3679123448 shutdown_connections 2023-06-22T10:55:21.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.743+0000 7f69729ff700 1 --2- 172.21.15.40:0/3679123448 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f696c0b4c60 0x7f696c06b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:21.749 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.743+0000 7f69729ff700 1 --2- 172.21.15.40:0/3679123448 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f696c15c720 0x7f696c0b1870 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:21.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.743+0000 7f69729ff700 1 --2- 172.21.15.40:0/3679123448 >> v2:172.21.15.45:3300/0 conn(0x7f696c0d2830 0x7f696c0b4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:21.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.743+0000 7f69729ff700 1 -- 172.21.15.40:0/3679123448 >> 172.21.15.40:0/3679123448 conn(0x7f696c0cf720 msgr2=0x7f696c0cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:21.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.743+0000 7f69729ff700 1 -- 172.21.15.40:0/3679123448 shutdown_connections 2023-06-22T10:55:21.750 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.743+0000 7f69729ff700 1 -- 172.21.15.40:0/3679123448 wait complete. 2023-06-22T10:55:21.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.744+0000 7f69729ff700 1 Processor -- start 2023-06-22T10:55:21.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.744+0000 7f69729ff700 1 -- start start 2023-06-22T10:55:21.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.745+0000 7f69729ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f696c0b4c60 0x7f696c0c8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:21.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.745+0000 7f69729ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f696c0d2830 0x7f696c0b76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:21.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.745+0000 7f69729ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f696c15c720 0x7f696c0b7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:21.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.745+0000 7f69729ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696c14a590 con 0x7f696c15c720 2023-06-22T10:55:21.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.745+0000 7f69729ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696c14b3f0 con 0x7f696c0d2830 2023-06-22T10:55:21.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.745+0000 7f69729ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f696c14a7e0 con 0x7f696c0b4c60 2023-06-22T10:55:21.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.746+0000 7f6970f9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f696c15c720 0x7f696c0b7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:21.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.746+0000 7f6970f9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f696c15c720 0x7f696c0b7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35414/0 (socket says 172.21.15.40:35414) 2023-06-22T10:55:21.753 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.746+0000 7f6970f9c700 1 -- 172.21.15.40:0/545627739 learned_addr learned my addr 172.21.15.40:0/545627739 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:55:21.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.746+0000 7f696b7fe700 1 --2- 172.21.15.40:0/545627739 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f696c0d2830 0x7f696c0b76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:21.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.746+0000 7f696bfff700 1 --2- 172.21.15.40:0/545627739 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f696c0b4c60 0x7f696c0c8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:21.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.746+0000 7f6970f9c700 1 -- 172.21.15.40:0/545627739 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f696c0b4c60 msgr2=0x7f696c0c8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:21.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.746+0000 7f6970f9c700 1 --2- 172.21.15.40:0/545627739 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f696c0b4c60 0x7f696c0c8dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:21.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.746+0000 7f6970f9c700 1 -- 172.21.15.40:0/545627739 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f696c0d2830 msgr2=0x7f696c0b76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:21.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.746+0000 7f6970f9c700 1 --2- 172.21.15.40:0/545627739 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f696c0d2830 0x7f696c0b76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:21.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.746+0000 7f6970f9c700 1 -- 172.21.15.40:0/545627739 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f695c009550 con 0x7f696c15c720 2023-06-22T10:55:21.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.746+0000 7f6970f9c700 1 --2- 172.21.15.40:0/545627739 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f696c15c720 0x7f696c0b7be0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f6964007d50 tx=0x7f696400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:21.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.747+0000 7f6968ff9700 1 -- 172.21.15.40:0/545627739 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6964007ea0 con 0x7f696c15c720 2023-06-22T10:55:21.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.747+0000 7f6968ff9700 1 -- 172.21.15.40:0/545627739 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f696400ecf0 con 0x7f696c15c720 2023-06-22T10:55:21.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.747+0000 7f6968ff9700 1 -- 172.21.15.40:0/545627739 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6964014660 con 0x7f696c15c720 2023-06-22T10:55:21.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.747+0000 7f69729ff700 1 -- 172.21.15.40:0/545627739 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f696c14aac0 con 0x7f696c15c720 2023-06-22T10:55:21.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.747+0000 7f69729ff700 1 -- 172.21.15.40:0/545627739 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f696c14b080 con 0x7f696c15c720 2023-06-22T10:55:21.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.749+0000 7f6968ff9700 1 -- 172.21.15.40:0/545627739 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f69640147c0 con 0x7f696c15c720 2023-06-22T10:55:21.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.750+0000 7f6968ff9700 1 --2- 172.21.15.40:0/545627739 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f695806ace0 0x7f695806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:21.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.750+0000 7f6968ff9700 1 -- 172.21.15.40:0/545627739 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f6964089be0 con 0x7f696c15c720 2023-06-22T10:55:21.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.750+0000 7f696bfff700 1 --2- 172.21.15.40:0/545627739 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f695806ace0 0x7f695806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:21.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.751+0000 7f696bfff700 1 --2- 172.21.15.40:0/545627739 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f695806ace0 0x7f695806d190 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f695c009c40 tx=0x7f695c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:21.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.753+0000 7f6986378b80 1 Processor -- start 2023-06-22T10:55:21.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.753+0000 7f6986378b80 1 -- start start 2023-06-22T10:55:21.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.754+0000 7f6986378b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563c67a65320 0x563c67a656f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:21.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.754+0000 7f6986378b80 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x563c67a386d0 0x563c67a3b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:21.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.754+0000 7f6986378b80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563c67a365b0 0x563c67a62510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:21.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.754+0000 7f6986378b80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c679afea0 con 0x563c67a365b0 2023-06-22T10:55:21.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.754+0000 7f6986378b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c67923600 con 0x563c67a65320 2023-06-22T10:55:21.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.754+0000 7f6986378b80 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x563c67992910 con 0x563c67a386d0 2023-06-22T10:55:21.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.754+0000 7f6970f9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563c67a365b0 0x563c67a62510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:21.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.755+0000 7f6970f9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563c67a365b0 0x563c67a62510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35422/0 (socket says 172.21.15.40:35422) 2023-06-22T10:55:21.759 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.755+0000 7f6970f9c700 1 -- 172.21.15.40:0/4207449670 learned_addr learned my addr 172.21.15.40:0/4207449670 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:55:21.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.755+0000 7f696bfff700 1 --2- 172.21.15.40:0/4207449670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563c67a65320 0x563c67a656f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:21.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.755+0000 7f696b7fe700 1 --2- 172.21.15.40:0/4207449670 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x563c67a386d0 0x563c67a3b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:21.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.755+0000 7f6970f9c700 1 -- 172.21.15.40:0/4207449670 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x563c67a386d0 msgr2=0x563c67a3b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:55:21.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.755+0000 7f6970f9c700 1 --2- 172.21.15.40:0/4207449670 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x563c67a386d0 0x563c67a3b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:21.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.755+0000 7f6970f9c700 1 -- 172.21.15.40:0/4207449670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563c67a65320 msgr2=0x563c67a656f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:55:21.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.755+0000 7f6970f9c700 1 --2- 172.21.15.40:0/4207449670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563c67a65320 0x563c67a656f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:21.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.755+0000 7f6970f9c700 1 -- 172.21.15.40:0/4207449670 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c6777f790 con 0x563c67a365b0 2023-06-22T10:55:21.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.755+0000 7f6970f9c700 1 --2- 172.21.15.40:0/4207449670 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563c67a365b0 0x563c67a62510 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f6964054c70 tx=0x7f696405c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2241fd45abae6d07 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:21.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.755+0000 7f69527fc700 1 -- 172.21.15.40:0/4207449670 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6964056b10 con 0x563c67a365b0 2023-06-22T10:55:21.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.755+0000 7f69527fc700 1 -- 172.21.15.40:0/4207449670 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6964060630 con 0x563c67a365b0 2023-06-22T10:55:21.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.755+0000 7f69527fc700 1 -- 172.21.15.40:0/4207449670 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6964059b60 con 0x563c67a365b0 2023-06-22T10:55:21.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.756+0000 7f6986378b80 1 -- 172.21.15.40:0/4207449670 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563c67a365b0 msgr2=0x563c67a62510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:21.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.756+0000 7f6986378b80 1 --2- 172.21.15.40:0/4207449670 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563c67a365b0 0x563c67a62510 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f6964054c70 tx=0x7f696405c7b0 comp rx=0 tx=0).stop 2023-06-22T10:55:21.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.756+0000 7f6986378b80 1 -- 172.21.15.40:0/4207449670 shutdown_connections 2023-06-22T10:55:21.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.756+0000 7f6986378b80 1 --2- 172.21.15.40:0/4207449670 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563c67a365b0 0x563c67a62510 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:21.764 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.756+0000 7f6986378b80 1 --2- 172.21.15.40:0/4207449670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563c67a65320 0x563c67a656f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:21.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.756+0000 7f6986378b80 1 --2- 172.21.15.40:0/4207449670 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x563c67a386d0 0x563c67a3b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:21.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.756+0000 7f6986378b80 1 -- 172.21.15.40:0/4207449670 >> 172.21.15.40:0/4207449670 conn(0x563c67a2fdd0 msgr2=0x563c67a80130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:21.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.756+0000 7f6986378b80 1 -- 172.21.15.40:0/4207449670 shutdown_connections 2023-06-22T10:55:21.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.756+0000 7f6986378b80 1 -- 172.21.15.40:0/4207449670 wait complete. 2023-06-22T10:55:21.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.757+0000 7f6986378b80 1 -- start start 2023-06-22T10:55:21.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.757+0000 7f6986378b80 1 Processor -- start 2023-06-22T10:55:21.765 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.758+0000 7f6986378b80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563c67a365b0 0x563c67a685d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:21.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.758+0000 7f6986378b80 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x563c67a386d0 0x563c67a68b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:21.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.758+0000 7f6986378b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563c67a65320 0x563c67a5f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:21.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.758+0000 7f6986378b80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c6798bbe0 con 0x563c67a365b0 2023-06-22T10:55:21.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.758+0000 7f6986378b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c679495b0 con 0x563c67a65320 2023-06-22T10:55:21.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.758+0000 7f6986378b80 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x563c6792f910 con 0x563c67a386d0 2023-06-22T10:55:21.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.758+0000 7f6986378b80 10 client.0 _ll_register_callbacks cb 0x563c67947b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-22T10:55:21.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.759+0000 7f696bfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563c67a365b0 0x563c67a685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:21.766 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.759+0000 7f696bfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563c67a365b0 0x563c67a685d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35438/0 (socket says 172.21.15.40:35438) 2023-06-22T10:55:21.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.759+0000 7f696bfff700 1 -- 172.21.15.40:0/2546177720 learned_addr learned my addr 172.21.15.40:0/2546177720 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:55:21.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.759+0000 7f6970f9c700 1 --2- 172.21.15.40:0/2546177720 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563c67a65320 0x563c67a5f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:21.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.759+0000 7f696bfff700 1 -- 172.21.15.40:0/2546177720 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x563c67a386d0 msgr2=0x563c67a68b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:55:21.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.759+0000 7f696bfff700 1 --2- 172.21.15.40:0/2546177720 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x563c67a386d0 0x563c67a68b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:21.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.759+0000 7f696bfff700 1 -- 172.21.15.40:0/2546177720 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563c67a65320 msgr2=0x563c67a5f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:55:21.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.759+0000 7f696bfff700 1 --2- 172.21.15.40:0/2546177720 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563c67a65320 0x563c67a5f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:21.767 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.759+0000 7f696bfff700 1 -- 172.21.15.40:0/2546177720 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f696c14b080 con 0x563c67a365b0 2023-06-22T10:55:21.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.759+0000 7f6970f9c700 1 --2- 172.21.15.40:0/2546177720 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563c67a65320 0x563c67a5f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-22T10:55:21.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.759+0000 7f696bfff700 1 --2- 172.21.15.40:0/2546177720 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563c67a365b0 0x563c67a685d0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f695c013000 tx=0x7f695c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c71777748f11b0f server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:21.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.759+0000 7f694affd700 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-06-22T10:55:21.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.759+0000 7f694affd700 1 -- 172.21.15.40:0/2546177720 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695c02c070 con 0x563c67a365b0 2023-06-22T10:55:21.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.760+0000 7f694affd700 1 -- 172.21.15.40:0/2546177720 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f695c003a00 con 0x563c67a365b0 2023-06-22T10:55:21.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.760+0000 7f6986378b80 1 -- 172.21.15.40:0/2546177720 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563c67a2d3e0 con 0x563c67a365b0 2023-06-22T10:55:21.768 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.760+0000 7f694affd700 1 -- 172.21.15.40:0/2546177720 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f695c020070 con 0x563c67a365b0 2023-06-22T10:55:21.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.760+0000 7f6986378b80 10 client.5583 fetch_fsmap learned FSMap version 18 2023-06-22T10:55:21.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.760+0000 7f6986378b80 1 -- 172.21.15.40:0/2546177720 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x563c6786c0a0 con 0x563c67a365b0 2023-06-22T10:55:21.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.760+0000 7f694affd700 1 -- 172.21.15.40:0/2546177720 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563c67a2d3e0 con 0x563c67a365b0 2023-06-22T10:55:21.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.760+0000 7f694affd700 1 -- 172.21.15.40:0/2546177720 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 18) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f695c003bc0 con 0x563c67a365b0 2023-06-22T10:55:21.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.760+0000 7f6986378b80 10 client.5583 fetch_fsmap finished waiting for FSMap version 18 2023-06-22T10:55:21.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.760+0000 7f6986378b80 10 client.5583 resolve_mds: resolved name 'b' to daemon mds.b 2023-06-22T10:55:21.769 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.760+0000 7f6986378b80 20 client.5583 populate_metadata read hostname 'smithi040' 2023-06-22T10:55:21.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.760+0000 7f6986378b80 1 --2- 172.21.15.40:0/2546177720 >> [v2:172.21.15.45:6832/1890176635,v1:172.21.15.45:6835/1890176635] conn(0x563c67a61320 0x563c67a60330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:21.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.760+0000 7f6986378b80 4 client.5583 mds_command: new command op to 5412 tid=0[{"prefix": "get_command_descriptions"}] 2023-06-22T10:55:21.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.760+0000 7f6986378b80 1 -- 172.21.15.40:0/2546177720 --> [v2:172.21.15.45:6832/1890176635,v1:172.21.15.45:6835/1890176635] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563c67a09a50 con 0x563c67a61320 2023-06-22T10:55:21.770 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.761+0000 7f696b7fe700 1 --2- 172.21.15.40:0/2546177720 >> [v2:172.21.15.45:6832/1890176635,v1:172.21.15.45:6835/1890176635] conn(0x563c67a61320 0x563c67a60330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:21.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.761+0000 7f696b7fe700 1 --2- 172.21.15.40:0/2546177720 >> [v2:172.21.15.45:6832/1890176635,v1:172.21.15.45:6835/1890176635] conn(0x563c67a61320 0x563c67a60330 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38796c5bf58d23d2 server_cookie=be0c881c5948bddf in_seq=0 out_seq=0 2023-06-22T10:55:21.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.761+0000 7f694affd700 10 client.5583 ms_handle_connect on v2:172.21.15.45:6832/1890176635 2023-06-22T10:55:21.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.762+0000 7f694affd700 1 -- 172.21.15.40:0/2546177720 <== mds.0 v2:172.21.15.45:6832/1890176635 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x563c67a09a50 con 0x563c67a61320 2023-06-22T10:55:21.771 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.762+0000 7f694affd700 10 client.5583 handle_command_reply: tid=0 2023-06-22T10:55:21.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.762+0000 7f6986378b80 1 client.5583 shutdown 2023-06-22T10:55:21.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.763+0000 7f6986378b80 1 -- 172.21.15.40:0/2546177720 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563c67a365b0 msgr2=0x563c67a685d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:21.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.763+0000 7f6986378b80 1 --2- 172.21.15.40:0/2546177720 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563c67a365b0 0x563c67a685d0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f695c013000 tx=0x7f695c0047c0 comp rx=0 tx=0).stop 2023-06-22T10:55:21.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.763+0000 7f6986378b80 1 -- 172.21.15.40:0/2546177720 shutdown_connections 2023-06-22T10:55:21.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.763+0000 7f6986378b80 1 --2- 172.21.15.40:0/2546177720 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563c67a65320 0x563c67a5f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:21.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.763+0000 7f6986378b80 1 --2- 172.21.15.40:0/2546177720 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563c67a365b0 0x563c67a685d0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:21.772 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.763+0000 7f6986378b80 1 --2- 172.21.15.40:0/2546177720 >> [v2:172.21.15.45:6832/1890176635,v1:172.21.15.45:6835/1890176635] conn(0x563c67a61320 0x563c67a60330 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:21.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.763+0000 7f6986378b80 1 --2- 172.21.15.40:0/2546177720 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x563c67a386d0 0x563c67a68b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:21.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.763+0000 7f694affd700 0 client.5583 ms_handle_reset on v2:172.21.15.45:6832/1890176635 2023-06-22T10:55:21.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.763+0000 7f6986378b80 1 -- 172.21.15.40:0/2546177720 >> 172.21.15.40:0/2546177720 conn(0x563c67a2fdd0 msgr2=0x563c67a354a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:21.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.763+0000 7f6986378b80 1 -- 172.21.15.40:0/2546177720 shutdown_connections 2023-06-22T10:55:21.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.763+0000 7f6986378b80 1 -- 172.21.15.40:0/2546177720 wait complete. 2023-06-22T10:55:21.773 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.763+0000 7f6986378b80 20 client.5583 trim_cache size 0 max 16384 2023-06-22T10:55:21.784 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.781+0000 7f6986378b80 1 Processor -- start 2023-06-22T10:55:21.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.781+0000 7f6986378b80 1 -- start start 2023-06-22T10:55:21.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.782+0000 7f6986378b80 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x563c67a365b0 0x563c67a83740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:21.785 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.782+0000 7f6986378b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563c67a386d0 0x563c67ae04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:21.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.782+0000 7f6986378b80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563c67a65320 0x563c67ae0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:21.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.782+0000 7f6986378b80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c67780390 con 0x563c67a65320 2023-06-22T10:55:21.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.782+0000 7f6986378b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c67a827f0 con 0x563c67a386d0 2023-06-22T10:55:21.786 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.782+0000 7f6986378b80 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x563c67a65e40 con 0x563c67a365b0 2023-06-22T10:55:21.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.783+0000 7f6970f9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563c67a65320 0x563c67ae0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:21.788 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.783+0000 7f6970f9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563c67a65320 0x563c67ae0a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35444/0 (socket says 172.21.15.40:35444) 2023-06-22T10:55:21.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.783+0000 7f6970f9c700 1 -- 172.21.15.40:0/2094235619 learned_addr learned my addr 172.21.15.40:0/2094235619 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:55:21.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.783+0000 7f696b7fe700 1 --2- 172.21.15.40:0/2094235619 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563c67a386d0 0x563c67ae04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:21.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.783+0000 7f696bfff700 1 --2- 172.21.15.40:0/2094235619 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x563c67a365b0 0x563c67a83740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:21.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.783+0000 7f6970f9c700 1 -- 172.21.15.40:0/2094235619 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x563c67a365b0 msgr2=0x563c67a83740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:55:21.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.783+0000 7f6970f9c700 1 --2- 172.21.15.40:0/2094235619 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x563c67a365b0 0x563c67a83740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:21.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.783+0000 7f6970f9c700 1 -- 172.21.15.40:0/2094235619 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563c67a386d0 msgr2=0x563c67ae04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:55:21.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.783+0000 7f6970f9c700 1 --2- 172.21.15.40:0/2094235619 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563c67a386d0 0x563c67ae04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:21.789 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.783+0000 7f6970f9c700 1 -- 172.21.15.40:0/2094235619 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c67951b10 con 0x563c67a65320 2023-06-22T10:55:21.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.783+0000 7f696bfff700 1 --2- 172.21.15.40:0/2094235619 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x563c67a365b0 0x563c67a83740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-22T10:55:21.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.783+0000 7f6970f9c700 1 --2- 172.21.15.40:0/2094235619 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563c67a65320 0x563c67ae0a00 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f696400e710 tx=0x7f6964015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62632d1e30c311d6 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:21.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.783+0000 7f6952ffd700 1 -- 172.21.15.40:0/2094235619 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6964056b10 con 0x563c67a65320 2023-06-22T10:55:21.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.783+0000 7f6952ffd700 1 -- 172.21.15.40:0/2094235619 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6964071070 con 0x563c67a65320 2023-06-22T10:55:21.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.783+0000 7f6952ffd700 1 -- 172.21.15.40:0/2094235619 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6964059b60 con 0x563c67a65320 2023-06-22T10:55:21.790 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.784+0000 7f6986378b80 1 -- 172.21.15.40:0/2094235619 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563c67a65320 msgr2=0x563c67ae0a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:21.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.784+0000 7f6986378b80 1 --2- 172.21.15.40:0/2094235619 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563c67a65320 0x563c67ae0a00 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f696400e710 tx=0x7f6964015000 comp rx=0 tx=0).stop 2023-06-22T10:55:21.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.784+0000 7f6986378b80 1 -- 172.21.15.40:0/2094235619 shutdown_connections 2023-06-22T10:55:21.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.784+0000 7f6986378b80 1 --2- 172.21.15.40:0/2094235619 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x563c67a365b0 0x563c67a83740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:21.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.784+0000 7f6986378b80 1 --2- 172.21.15.40:0/2094235619 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563c67a65320 0x563c67ae0a00 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:21.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.784+0000 7f6986378b80 1 --2- 172.21.15.40:0/2094235619 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563c67a386d0 0x563c67ae04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:21.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.784+0000 7f6986378b80 1 -- 172.21.15.40:0/2094235619 >> 172.21.15.40:0/2094235619 conn(0x563c67a2fdd0 msgr2=0x563c67a34060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:21.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.784+0000 7f6986378b80 1 -- 172.21.15.40:0/2094235619 shutdown_connections 2023-06-22T10:55:21.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.784+0000 7f6986378b80 1 -- 172.21.15.40:0/2094235619 wait complete. 2023-06-22T10:55:21.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.785+0000 7f6986378b80 1 -- start start 2023-06-22T10:55:21.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.785+0000 7f6986378b80 1 Processor -- start 2023-06-22T10:55:21.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.787+0000 7f6986378b80 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x563c67a365b0 0x563c67adf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:21.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.787+0000 7f6986378b80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563c67a386d0 0x563c67a683e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:21.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.787+0000 7f6986378b80 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563c67a65320 0x563c67a68920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:21.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.787+0000 7f6986378b80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c67adff00 con 0x563c67a386d0 2023-06-22T10:55:21.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.787+0000 7f6986378b80 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c67a64e90 con 0x563c67a65320 2023-06-22T10:55:21.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.787+0000 7f6986378b80 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x563c67aeac00 con 0x563c67a365b0 2023-06-22T10:55:21.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.787+0000 7f6986378b80 10 client.0 _ll_register_callbacks cb 0x7f695c00be60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-22T10:55:21.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.787+0000 7f696b7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563c67a386d0 0x563c67a683e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:21.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.787+0000 7f696b7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563c67a386d0 0x563c67a683e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35450/0 (socket says 172.21.15.40:35450) 2023-06-22T10:55:21.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.787+0000 7f696b7fe700 1 -- 172.21.15.40:0/2963514310 learned_addr learned my addr 172.21.15.40:0/2963514310 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:55:21.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.787+0000 7f696bfff700 1 --2- 172.21.15.40:0/2963514310 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x563c67a365b0 0x563c67adf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:21.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.787+0000 7f6970f9c700 1 --2- 172.21.15.40:0/2963514310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563c67a65320 0x563c67a68920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:21.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.787+0000 7f696b7fe700 1 -- 172.21.15.40:0/2963514310 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x563c67a365b0 msgr2=0x563c67adf9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:55:21.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.787+0000 7f696b7fe700 1 --2- 172.21.15.40:0/2963514310 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x563c67a365b0 0x563c67adf9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:21.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.787+0000 7f696b7fe700 1 -- 172.21.15.40:0/2963514310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563c67a65320 msgr2=0x563c67a68920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:55:21.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.787+0000 7f696b7fe700 1 --2- 172.21.15.40:0/2963514310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563c67a65320 0x563c67a68920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:21.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.787+0000 7f696b7fe700 1 -- 172.21.15.40:0/2963514310 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563c6777f790 con 0x563c67a386d0 2023-06-22T10:55:21.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.787+0000 7f6970f9c700 1 --2- 172.21.15.40:0/2963514310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563c67a65320 0x563c67a68920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:55:21.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.788+0000 7f696b7fe700 1 --2- 172.21.15.40:0/2963514310 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563c67a386d0 0x563c67a683e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f696c0725c0 tx=0x7f696001b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7af7093ff529051 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:21.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.788+0000 7f694affd700 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2023-06-22T10:55:21.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.788+0000 7f694affd700 1 -- 172.21.15.40:0/2963514310 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6960004490 con 0x563c67a386d0 2023-06-22T10:55:21.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.788+0000 7f694affd700 1 -- 172.21.15.40:0/2963514310 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f696001b7f0 con 0x563c67a386d0 2023-06-22T10:55:21.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.788+0000 7f6986378b80 1 -- 172.21.15.40:0/2963514310 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6964060630 con 0x563c67a386d0 2023-06-22T10:55:21.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.788+0000 7f694affd700 1 -- 172.21.15.40:0/2963514310 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f69600045f0 con 0x563c67a386d0 2023-06-22T10:55:21.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.788+0000 7f6986378b80 10 client.5589 fetch_fsmap learned FSMap version 18 2023-06-22T10:55:21.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.788+0000 7f6986378b80 1 -- 172.21.15.40:0/2963514310 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x563c677e01d0 con 0x563c67a386d0 2023-06-22T10:55:21.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.788+0000 7f694affd700 1 -- 172.21.15.40:0/2963514310 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6964060630 con 0x563c67a386d0 2023-06-22T10:55:21.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.789+0000 7f694affd700 1 -- 172.21.15.40:0/2963514310 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 18) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f696001b9b0 con 0x563c67a386d0 2023-06-22T10:55:21.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.789+0000 7f6986378b80 10 client.5589 fetch_fsmap finished waiting for FSMap version 18 2023-06-22T10:55:21.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.789+0000 7f6986378b80 10 client.5589 resolve_mds: resolved name 'b' to daemon mds.b 2023-06-22T10:55:21.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.789+0000 7f6986378b80 20 client.5589 populate_metadata read hostname 'smithi040' 2023-06-22T10:55:21.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.789+0000 7f6986378b80 1 --2- 172.21.15.40:0/2963514310 >> [v2:172.21.15.45:6832/1890176635,v1:172.21.15.45:6835/1890176635] conn(0x563c67a7bce0 0x563c67a7c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:21.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.789+0000 7f6986378b80 4 client.5589 mds_command: new command op to 5412 tid=0[{"prefix": "status"}] 2023-06-22T10:55:21.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.789+0000 7f6986378b80 1 -- 172.21.15.40:0/2963514310 --> [v2:172.21.15.45:6832/1890176635,v1:172.21.15.45:6835/1890176635] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563c67984d20 con 0x563c67a7bce0 2023-06-22T10:55:21.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.789+0000 7f696bfff700 1 --2- 172.21.15.40:0/2963514310 >> [v2:172.21.15.45:6832/1890176635,v1:172.21.15.45:6835/1890176635] conn(0x563c67a7bce0 0x563c67a7c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:21.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.789+0000 7f696bfff700 1 --2- 172.21.15.40:0/2963514310 >> [v2:172.21.15.45:6832/1890176635,v1:172.21.15.45:6835/1890176635] conn(0x563c67a7bce0 0x563c67a7c0b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb8748eaef6f2912 server_cookie=d2ead62d237e58d8 in_seq=0 out_seq=0 2023-06-22T10:55:21.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.789+0000 7f694affd700 10 client.5589 ms_handle_connect on v2:172.21.15.45:6832/1890176635 2023-06-22T10:55:21.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.790+0000 7f694affd700 1 -- 172.21.15.40:0/2963514310 <== mds.0 v2:172.21.15.45:6832/1890176635 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x563c67984d20 con 0x563c67a7bce0 2023-06-22T10:55:21.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.790+0000 7f694affd700 10 client.5589 handle_command_reply: tid=0 2023-06-22T10:55:21.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.790+0000 7f6986378b80 1 client.5589 shutdown 2023-06-22T10:55:21.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.790+0000 7f6986378b80 1 -- 172.21.15.40:0/2963514310 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563c67a386d0 msgr2=0x563c67a683e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:21.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.790+0000 7f6986378b80 1 --2- 172.21.15.40:0/2963514310 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563c67a386d0 0x563c67a683e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f696c0725c0 tx=0x7f696001b3b0 comp rx=0 tx=0).stop 2023-06-22T10:55:21.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.790+0000 7f6986378b80 1 -- 172.21.15.40:0/2963514310 shutdown_connections 2023-06-22T10:55:21.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.790+0000 7f6986378b80 1 --2- 172.21.15.40:0/2963514310 >> [v2:172.21.15.45:6832/1890176635,v1:172.21.15.45:6835/1890176635] conn(0x563c67a7bce0 0x563c67a7c0b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:21.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.790+0000 7f6986378b80 1 --2- 172.21.15.40:0/2963514310 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x563c67a365b0 0x563c67adf9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:21.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.790+0000 7f6986378b80 1 --2- 172.21.15.40:0/2963514310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563c67a65320 0x563c67a68920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:21.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.790+0000 7f694affd700 0 client.5589 ms_handle_reset on v2:172.21.15.45:6832/1890176635 2023-06-22T10:55:21.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.790+0000 7f6986378b80 1 --2- 172.21.15.40:0/2963514310 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x563c67a386d0 0x563c67a683e0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:21.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.790+0000 7f6986378b80 1 -- 172.21.15.40:0/2963514310 >> 172.21.15.40:0/2963514310 conn(0x563c67a2fdd0 msgr2=0x563c67a806a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:21.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.790+0000 7f6986378b80 1 -- 172.21.15.40:0/2963514310 shutdown_connections 2023-06-22T10:55:21.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.790+0000 7f6986378b80 1 -- 172.21.15.40:0/2963514310 wait complete. 2023-06-22T10:55:21.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.790+0000 7f6986378b80 20 client.5589 trim_cache size 0 max 16384 2023-06-22T10:55:21.803 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2023-06-22T10:55:21.803 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "475560bc-1a7c-4a75-b3b6-6fc6b20bdc52", 2023-06-22T10:55:21.803 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 0, 2023-06-22T10:55:21.803 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 5412, 2023-06-22T10:55:21.803 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2023-06-22T10:55:21.803 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2023-06-22T10:55:21.804 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2023-06-22T10:55:21.804 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 6.6671489880000001, 2023-06-22T10:55:21.804 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 18, 2023-06-22T10:55:21.804 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 42, 2023-06-22T10:55:21.804 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 42, 2023-06-22T10:55:21.804 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 15.595169305000001 2023-06-22T10:55:21.804 INFO:teuthology.orchestra.run.smithi040.stdout:} 2023-06-22T10:55:21.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.791+0000 7f69729ff700 1 -- 172.21.15.40:0/545627739 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f695806ace0 msgr2=0x7f695806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:21.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.791+0000 7f69729ff700 1 --2- 172.21.15.40:0/545627739 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f695806ace0 0x7f695806d190 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f695c009c40 tx=0x7f695c008030 comp rx=0 tx=0).stop 2023-06-22T10:55:21.805 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.791+0000 7f69729ff700 1 -- 172.21.15.40:0/545627739 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f696c15c720 msgr2=0x7f696c0b7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:21.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.791+0000 7f69729ff700 1 --2- 172.21.15.40:0/545627739 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f696c15c720 0x7f696c0b7be0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f6964007d50 tx=0x7f696400e3c0 comp rx=0 tx=0).stop 2023-06-22T10:55:21.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.791+0000 7f69729ff700 1 -- 172.21.15.40:0/545627739 shutdown_connections 2023-06-22T10:55:21.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.791+0000 7f69729ff700 1 --2- 172.21.15.40:0/545627739 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f695806ace0 0x7f695806d190 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:21.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.791+0000 7f69729ff700 1 --2- 172.21.15.40:0/545627739 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f696c0b4c60 0x7f696c0c8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:21.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.791+0000 7f69729ff700 1 --2- 172.21.15.40:0/545627739 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f696c15c720 0x7f696c0b7be0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:21.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.791+0000 7f69729ff700 1 --2- 172.21.15.40:0/545627739 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f696c0d2830 0x7f696c0b76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:21.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.791+0000 7f69729ff700 1 -- 172.21.15.40:0/545627739 >> 172.21.15.40:0/545627739 conn(0x7f696c0cf720 msgr2=0x7f696c0b5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:21.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.791+0000 7f69729ff700 1 -- 172.21.15.40:0/545627739 shutdown_connections 2023-06-22T10:55:21.807 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:21.791+0000 7f69729ff700 1 -- 172.21.15.40:0/545627739 wait complete. 2023-06-22T10:55:21.812 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-22T10:55:22.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.010+0000 7f726adff700 1 Processor -- start 2023-06-22T10:55:22.013 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.010+0000 7f726adff700 1 -- start start 2023-06-22T10:55:22.014 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.011+0000 7f726adff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f726415c720 0x7f72640b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:22.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.011+0000 7f726adff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f72640d2830 0x7f72640b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:22.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.011+0000 7f726adff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f72640b4c60 0x7f726406b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:22.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.011+0000 7f726adff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7264160d60 con 0x7f72640d2830 2023-06-22T10:55:22.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.011+0000 7f726adff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72640b50e0 con 0x7f72640b4c60 2023-06-22T10:55:22.015 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.011+0000 7f726adff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72640b2130 con 0x7f726415c720 2023-06-22T10:55:22.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.012+0000 7f7263fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f72640d2830 0x7f72640b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:22.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.012+0000 7f7268b9b700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f726415c720 0x7f72640b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:22.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.012+0000 7f7263fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f72640d2830 0x7f72640b4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35452/0 (socket says 172.21.15.40:35452) 2023-06-22T10:55:22.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.012+0000 7f7263fff700 1 -- 172.21.15.40:0/289288903 learned_addr learned my addr 172.21.15.40:0/289288903 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:55:22.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.012+0000 7f726939c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f72640b4c60 0x7f726406b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:22.017 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.012+0000 7f7263fff700 1 -- 172.21.15.40:0/289288903 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f726415c720 msgr2=0x7f72640b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:55:22.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.012+0000 7f7263fff700 1 --2- 172.21.15.40:0/289288903 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f726415c720 0x7f72640b1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:22.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.012+0000 7f7263fff700 1 -- 172.21.15.40:0/289288903 >> v2:172.21.15.45:3300/0 conn(0x7f72640b4c60 msgr2=0x7f726406b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:55:22.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.012+0000 7f7263fff700 1 --2- 172.21.15.40:0/289288903 >> v2:172.21.15.45:3300/0 conn(0x7f72640b4c60 0x7f726406b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:22.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.012+0000 7f7263fff700 1 -- 172.21.15.40:0/289288903 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7264161180 con 0x7f72640d2830 2023-06-22T10:55:22.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.012+0000 7f7263fff700 1 --2- 172.21.15.40:0/289288903 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72640d2830 0x7f72640b4720 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f72640c9d00 tx=0x7f7250009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9f60a5a086ece3 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:22.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.013+0000 7f72637fe700 1 -- 172.21.15.40:0/289288903 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7250011830 con 0x7f72640d2830 2023-06-22T10:55:22.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.013+0000 7f72637fe700 1 -- 172.21.15.40:0/289288903 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7250011990 con 0x7f72640d2830 2023-06-22T10:55:22.018 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.013+0000 7f72637fe700 1 -- 172.21.15.40:0/289288903 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7250011d20 con 0x7f72640d2830 2023-06-22T10:55:22.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.013+0000 7f726adff700 1 -- 172.21.15.40:0/289288903 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72640d2830 msgr2=0x7f72640b4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:22.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.013+0000 7f726adff700 1 --2- 172.21.15.40:0/289288903 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72640d2830 0x7f72640b4720 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f72640c9d00 tx=0x7f7250009bd0 comp rx=0 tx=0).stop 2023-06-22T10:55:22.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.013+0000 7f726adff700 1 -- 172.21.15.40:0/289288903 shutdown_connections 2023-06-22T10:55:22.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.013+0000 7f726adff700 1 --2- 172.21.15.40:0/289288903 >> v2:172.21.15.45:3300/0 conn(0x7f72640b4c60 0x7f726406b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:22.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.013+0000 7f726adff700 1 --2- 172.21.15.40:0/289288903 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f726415c720 0x7f72640b1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:22.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.013+0000 7f726adff700 1 --2- 172.21.15.40:0/289288903 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72640d2830 0x7f72640b4720 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:22.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.013+0000 7f726adff700 1 -- 172.21.15.40:0/289288903 >> 172.21.15.40:0/289288903 conn(0x7f72640cf720 msgr2=0x7f72640cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:22.019 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.013+0000 7f726adff700 1 -- 172.21.15.40:0/289288903 shutdown_connections 2023-06-22T10:55:22.020 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.013+0000 7f726adff700 1 -- 172.21.15.40:0/289288903 wait complete. 2023-06-22T10:55:22.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.015+0000 7f726adff700 1 Processor -- start 2023-06-22T10:55:22.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.015+0000 7f726adff700 1 -- start start 2023-06-22T10:55:22.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.016+0000 7f726adff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72640b4c60 0x7f72640b4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:22.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.016+0000 7f726adff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f72640d2830 0x7f726414dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:22.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.016+0000 7f726adff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f726415c720 0x7f726415e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:22.022 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.016+0000 7f726adff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f726415de30 con 0x7f726415c720 2023-06-22T10:55:22.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.016+0000 7f726adff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72640b4970 con 0x7f72640b4c60 2023-06-22T10:55:22.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.016+0000 7f726adff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f726415d7e0 con 0x7f72640d2830 2023-06-22T10:55:22.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.016+0000 7f726939c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f726415c720 0x7f726415e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:22.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.016+0000 7f726939c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f726415c720 0x7f726415e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35458/0 (socket says 172.21.15.40:35458) 2023-06-22T10:55:22.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.016+0000 7f726939c700 1 -- 172.21.15.40:0/6780457 learned_addr learned my addr 172.21.15.40:0/6780457 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:55:22.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.017+0000 7f7268b9b700 1 --2- 172.21.15.40:0/6780457 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72640b4c60 0x7f72640b4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:22.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.017+0000 7f7263fff700 1 --2- 172.21.15.40:0/6780457 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f72640d2830 0x7f726414dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:22.023 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.017+0000 7f726939c700 1 -- 172.21.15.40:0/6780457 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f72640d2830 msgr2=0x7f726414dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:22.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.017+0000 7f726939c700 1 --2- 172.21.15.40:0/6780457 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f72640d2830 0x7f726414dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:22.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.017+0000 7f726939c700 1 -- 172.21.15.40:0/6780457 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72640b4c60 msgr2=0x7f72640b4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:22.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.017+0000 7f726939c700 1 --2- 172.21.15.40:0/6780457 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72640b4c60 0x7f72640b4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:22.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.017+0000 7f726939c700 1 -- 172.21.15.40:0/6780457 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7250009550 con 0x7f726415c720 2023-06-22T10:55:22.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.017+0000 7f726939c700 1 --2- 172.21.15.40:0/6780457 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f726415c720 0x7f726415e6b0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f725c00eed0 tx=0x7f725c00ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:22.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.017+0000 7f72617fa700 1 -- 172.21.15.40:0/6780457 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725c010040 con 0x7f726415c720 2023-06-22T10:55:22.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.017+0000 7f72617fa700 1 -- 172.21.15.40:0/6780457 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f725c00b9f0 con 0x7f726415c720 2023-06-22T10:55:22.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.017+0000 7f72617fa700 1 -- 172.21.15.40:0/6780457 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725c00bda0 con 0x7f726415c720 2023-06-22T10:55:22.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.017+0000 7f726adff700 1 -- 172.21.15.40:0/6780457 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f726415dac0 con 0x7f726415c720 2023-06-22T10:55:22.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.018+0000 7f726adff700 1 -- 172.21.15.40:0/6780457 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f726415d360 con 0x7f726415c720 2023-06-22T10:55:22.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.018+0000 7f726adff700 1 -- 172.21.15.40:0/6780457 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f726415d5e0 con 0x7f726415c720 2023-06-22T10:55:22.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.019+0000 7f72617fa700 1 -- 172.21.15.40:0/6780457 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f725c014400 con 0x7f726415c720 2023-06-22T10:55:22.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.021+0000 7f72617fa700 1 --2- 172.21.15.40:0/6780457 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f724806ace0 0x7f724806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:22.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.021+0000 7f72617fa700 1 -- 172.21.15.40:0/6780457 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f725c089810 con 0x7f726415c720 2023-06-22T10:55:22.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.021+0000 7f7268b9b700 1 --2- 172.21.15.40:0/6780457 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f724806ace0 0x7f724806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:22.026 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.021+0000 7f7268b9b700 1 --2- 172.21.15.40:0/6780457 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f724806ace0 0x7f724806d190 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f726414ea90 tx=0x7f7258009210 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:22.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.025+0000 7f72617fa700 1 -- 172.21.15.40:0/6780457 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f725c054810 con 0x7f726415c720 2023-06-22T10:55:22.286 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.283+0000 7f726adff700 1 -- 172.21.15.40:0/6780457 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7264067580 con 0x7f726415c720 2023-06-22T10:55:22.287 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.283+0000 7f72617fa700 1 -- 172.21.15.40:0/6780457 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+73 (secure 0 0 0) 0x7f725c057e30 con 0x7f726415c720 2023-06-22T10:55:22.287 INFO:teuthology.orchestra.run.smithi040.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-06-22T10:55:22.289 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.286+0000 7f726adff700 1 -- 172.21.15.40:0/6780457 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f724806ace0 msgr2=0x7f724806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:22.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.286+0000 7f726adff700 1 --2- 172.21.15.40:0/6780457 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f724806ace0 0x7f724806d190 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f726414ea90 tx=0x7f7258009210 comp rx=0 tx=0).stop 2023-06-22T10:55:22.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.286+0000 7f726adff700 1 -- 172.21.15.40:0/6780457 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f726415c720 msgr2=0x7f726415e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:22.290 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.286+0000 7f726adff700 1 --2- 172.21.15.40:0/6780457 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f726415c720 0x7f726415e6b0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f725c00eed0 tx=0x7f725c00ef00 comp rx=0 tx=0).stop 2023-06-22T10:55:22.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.286+0000 7f726adff700 1 -- 172.21.15.40:0/6780457 shutdown_connections 2023-06-22T10:55:22.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.286+0000 7f726adff700 1 --2- 172.21.15.40:0/6780457 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f724806ace0 0x7f724806d190 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:22.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.286+0000 7f726adff700 1 --2- 172.21.15.40:0/6780457 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f726415c720 0x7f726415e6b0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:22.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.286+0000 7f726adff700 1 --2- 172.21.15.40:0/6780457 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72640b4c60 0x7f72640b4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:22.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.286+0000 7f726adff700 1 --2- 172.21.15.40:0/6780457 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f72640d2830 0x7f726414dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:22.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.286+0000 7f726adff700 1 -- 172.21.15.40:0/6780457 >> 172.21.15.40:0/6780457 conn(0x7f72640cf720 msgr2=0x7f72640b7ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:22.291 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.286+0000 7f726adff700 1 -- 172.21.15.40:0/6780457 shutdown_connections 2023-06-22T10:55:22.292 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:22.286+0000 7f726adff700 1 -- 172.21.15.40:0/6780457 wait complete. 2023-06-22T10:55:22.307 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-06-22T10:55:22.308 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-22T10:55:22.308 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi040.front.sepia.ceph.com 2023-06-22T10:55:22.308 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-06-22T10:55:22.309 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-06-22T10:55:22.309 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-06-22T10:55:22.309 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-06-22T10:55:22.309 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-22T10:55:22.310 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-22T10:55:22.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:55:22.310 DEBUG:teuthology.orchestra.run.smithi040:> ip addr 2023-06-22T10:55:22.357 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-22T10:55:22.357 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-22T10:55:22.357 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2023-06-22T10:55:22.357 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-06-22T10:55:22.358 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2023-06-22T10:55:22.358 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-06-22T10:55:22.358 INFO:teuthology.orchestra.run.smithi040.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-22T10:55:22.358 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:16 brd ff:ff:ff:ff:ff:ff 2023-06-22T10:55:22.358 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f0 2023-06-22T10:55:22.358 INFO:teuthology.orchestra.run.smithi040.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-22T10:55:22.359 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:17 brd ff:ff:ff:ff:ff:ff 2023-06-22T10:55:22.359 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f1 2023-06-22T10:55:22.359 INFO:teuthology.orchestra.run.smithi040.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-22T10:55:22.359 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cc brd ff:ff:ff:ff:ff:ff 2023-06-22T10:55:22.359 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f0 2023-06-22T10:55:22.359 INFO:teuthology.orchestra.run.smithi040.stdout: inet 172.21.15.40/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-06-22T10:55:22.359 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft 42225sec preferred_lft 42225sec 2023-06-22T10:55:22.359 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::ec4:7aff:febd:12cc/64 scope link 2023-06-22T10:55:22.360 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-06-22T10:55:22.360 INFO:teuthology.orchestra.run.smithi040.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-06-22T10:55:22.360 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cd brd ff:ff:ff:ff:ff:ff 2023-06-22T10:55:22.360 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f1 2023-06-22T10:55:22.360 INFO:teuthology.orchestra.run.smithi040.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-22T10:55:22.360 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 72:0a:de:69:ab:12 brd ff:ff:ff:ff:ff:ff 2023-06-22T10:55:22.360 INFO:teuthology.orchestra.run.smithi040.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-06-22T10:55:22.361 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-06-22T10:55:22.361 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::cd8:5cff:fe09:affb/64 scope link 2023-06-22T10:55:22.361 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-06-22T10:55:22.361 INFO:teuthology.orchestra.run.smithi040.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-22T10:55:22.361 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 72:0a:de:69:ab:12 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-06-22T10:55:22.361 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::700a:deff:fe69:ab12/64 scope link 2023-06-22T10:55:22.361 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-06-22T10:55:22.361 INFO:teuthology.orchestra.run.smithi040.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-22T10:55:22.362 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 76:02:29:e4:81:d5 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-06-22T10:55:22.362 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::7402:29ff:fee4:81d5/64 scope link 2023-06-22T10:55:22.362 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-06-22T10:55:22.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:55:22.363 DEBUG:teuthology.orchestra.run.smithi040:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-22T10:55:22.431 INFO:teuthology.orchestra.run.smithi040.stdout:1 2023-06-22T10:55:22.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:55:22.434 DEBUG:teuthology.orchestra.run.smithi040:> route 2023-06-22T10:55:22.483 INFO:teuthology.orchestra.run.smithi040.stdout:Kernel IP routing table 2023-06-22T10:55:22.483 INFO:teuthology.orchestra.run.smithi040.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-22T10:55:22.483 INFO:teuthology.orchestra.run.smithi040.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-06-22T10:55:22.483 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-06-22T10:55:22.483 INFO:teuthology.orchestra.run.smithi040.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-22T10:55:22.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:55:22.490 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-06-22T10:55:22.490 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-06-22T10:55:22.490 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-06-22T10:55:22.491 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-06-22T10:55:22.491 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-06-22T10:55:22.491 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-06-22T10:55:22.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:55:22.662 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2023-06-22T10:55:22.707 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-06-22T10:55:22.708 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-06-22T10:55:22.709 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-22T10:55:22.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:55:22.710 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set brx.0 up 2023-06-22T10:55:22.819 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-22T10:55:22.819 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-06-22T10:55:22.866 INFO:teuthology.orchestra.run.smithi040.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-06-22T10:55:22.866 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-22T10:55:22.866 DEBUG:teuthology.orchestra.run.smithi040:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-06-22T10:55:22.951 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-06-22T10:55:22.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:55:22.951 DEBUG:teuthology.orchestra.run.smithi040:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-22T10:55:23.096 INFO:teuthology.orchestra.run.smithi040.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-22T10:55:23.096 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-22T10:55:23.124 INFO:teuthology.orchestra.run.smithi040.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-06-22T10:55:23.124 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-06-22T10:55:23.125 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: resolved to: "172.21.15.40:3300,172.21.15.45:3300,172.21.15.45:3301" 2023-06-22T10:55:23.125 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: trying mount with new device syntax: 0@475560bc-1a7c-4a75-b3b6-6fc6b20bdc52.cephfs=/ 2023-06-22T10:55:23.125 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.40:3300/172.21.15.45:3300/172.21.15.45:3301" will pass to kernel 2023-06-22T10:55:23.129 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-06-22T10:55:23.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:55:23.130 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-06-22T10:55:23.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:55:23.205 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-22T10:55:23.324 INFO:teuthology.orchestra.run.smithi040.stdout:client5075 2023-06-22T10:55:23.324 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-06-22T10:55:23.324 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-22T10:55:23.370 DEBUG:teuthology.orchestra.run.smithi040:> mktemp -d --suffix=xfstests-dev 2023-06-22T10:55:23.455 INFO:teuthology.orchestra.run.smithi040.stdout:/tmp/tmp.a4ZvvHFGMPxfstests-dev 2023-06-22T10:55:23.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:55:23.456 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.a4ZvvHFGMPxfstests-dev) 2023-06-22T10:55:23.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:55:23.568 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.a4ZvvHFGMPxfstests-dev) 2023-06-22T10:55:23.622 INFO:teuthology.orchestra.run.smithi040.stderr:Cloning into '/tmp/tmp.a4ZvvHFGMPxfstests-dev'... 2023-06-22T10:55:24.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:55:24.566 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-06-22T10:55:24.624 DEBUG:teuthology.orchestra.run.smithi040:> mktemp -d --suffix=test 2023-06-22T10:55:24.670 INFO:teuthology.orchestra.run.smithi040.stdout:/tmp/tmp.LeLMdg91vGtest 2023-06-22T10:55:24.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:55:24.671 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-06-22T10:55:24.761 DEBUG:teuthology.orchestra.run.smithi040:> mktemp -d --suffix=scratch 2023-06-22T10:55:24.805 INFO:teuthology.orchestra.run.smithi040.stdout:/tmp/tmp.6nIBYnNpfBscratch 2023-06-22T10:55:24.806 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "centos" and "8". 2023-06-22T10:55:24.806 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc indent libtool lvm2 make psmisc quota sed xfsdump xfsprogs libacl-devel libattr-devel libaio-devel libuuid-devel xfsprogs-devel python2 sqlite xfsprogs-qa-devel 2023-06-22T10:55:24.990 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T10:55:24.995 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T10:55:25.889 INFO:teuthology.orchestra.run.smithi040.stdout:Last metadata expiration check: 0:05:19 ago on Thu 22 Jun 2023 10:50:06 AM UTC. 2023-06-22T10:55:27.161 INFO:teuthology.orchestra.run.smithi040.stdout:Package acl-2.2.53-1.el8.x86_64 is already installed. 2023-06-22T10:55:27.162 INFO:teuthology.orchestra.run.smithi040.stdout:Package attr-2.4.48-3.el8.x86_64 is already installed. 2023-06-22T10:55:27.163 INFO:teuthology.orchestra.run.smithi040.stdout:Package automake-1.16.1-7.el8.noarch is already installed. 2023-06-22T10:55:27.164 INFO:teuthology.orchestra.run.smithi040.stdout:Package bc-1.07.1-5.el8.x86_64 is already installed. 2023-06-22T10:55:27.165 INFO:teuthology.orchestra.run.smithi040.stdout:Package dbench-4.0-20.el8.x86_64 is already installed. 2023-06-22T10:55:27.167 INFO:teuthology.orchestra.run.smithi040.stdout:Package e2fsprogs-1.45.6-5.el8.x86_64 is already installed. 2023-06-22T10:55:27.169 INFO:teuthology.orchestra.run.smithi040.stdout:Package gawk-4.2.1-4.el8.x86_64 is already installed. 2023-06-22T10:55:27.170 INFO:teuthology.orchestra.run.smithi040.stdout:Package gcc-8.5.0-19.el8.x86_64 is already installed. 2023-06-22T10:55:27.172 INFO:teuthology.orchestra.run.smithi040.stdout:Package libtool-2.4.6-25.el8.x86_64 is already installed. 2023-06-22T10:55:27.173 INFO:teuthology.orchestra.run.smithi040.stdout:Package lvm2-8:2.03.14-9.el8.x86_64 is already installed. 2023-06-22T10:55:27.174 INFO:teuthology.orchestra.run.smithi040.stdout:Package make-1:4.2.1-11.el8.x86_64 is already installed. 2023-06-22T10:55:27.175 INFO:teuthology.orchestra.run.smithi040.stdout:Package psmisc-23.1-5.el8.x86_64 is already installed. 2023-06-22T10:55:27.176 INFO:teuthology.orchestra.run.smithi040.stdout:Package quota-1:4.04-14.el8.x86_64 is already installed. 2023-06-22T10:55:27.177 INFO:teuthology.orchestra.run.smithi040.stdout:Package sed-4.5-5.el8.x86_64 is already installed. 2023-06-22T10:55:27.178 INFO:teuthology.orchestra.run.smithi040.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-06-22T10:55:27.179 INFO:teuthology.orchestra.run.smithi040.stdout:Package xfsprogs-5.0.0-12.el8.x86_64 is already installed. 2023-06-22T10:55:27.180 INFO:teuthology.orchestra.run.smithi040.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-06-22T10:55:27.181 INFO:teuthology.orchestra.run.smithi040.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-06-22T10:55:27.182 INFO:teuthology.orchestra.run.smithi040.stdout:Package libaio-devel-0.3.112-1.el8.x86_64 is already installed. 2023-06-22T10:55:27.183 INFO:teuthology.orchestra.run.smithi040.stdout:Package libuuid-devel-2.32.1-42.el8.x86_64 is already installed. 2023-06-22T10:55:27.184 INFO:teuthology.orchestra.run.smithi040.stdout:Package xfsprogs-devel-5.0.0-12.el8.x86_64 is already installed. 2023-06-22T10:55:27.187 INFO:teuthology.orchestra.run.smithi040.stdout:Package sqlite-3.26.0-17.el8.x86_64 is already installed. 2023-06-22T10:55:27.191 INFO:teuthology.orchestra.run.smithi040.stdout:Package xfsprogs-5.0.0-12.el8.x86_64 is already installed. 2023-06-22T10:55:27.370 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2023-06-22T10:55:27.372 INFO:teuthology.orchestra.run.smithi040.stdout:======================================================================================= 2023-06-22T10:55:27.372 INFO:teuthology.orchestra.run.smithi040.stdout: Package Arch Version Repo Size 2023-06-22T10:55:27.372 INFO:teuthology.orchestra.run.smithi040.stdout:======================================================================================= 2023-06-22T10:55:27.373 INFO:teuthology.orchestra.run.smithi040.stdout:Installing: 2023-06-22T10:55:27.373 INFO:teuthology.orchestra.run.smithi040.stdout: dump x86_64 1:0.4-0.36.b46.el8 baseos 164 k 2023-06-22T10:55:27.373 INFO:teuthology.orchestra.run.smithi040.stdout: fio x86_64 3.19-4.el8 appstream 538 k 2023-06-22T10:55:27.373 INFO:teuthology.orchestra.run.smithi040.stdout: indent x86_64 2.2.13-2.el8 epel 187 k 2023-06-22T10:55:27.373 INFO:teuthology.orchestra.run.smithi040.stdout: python2 x86_64 2.7.18-12.module_el8+299+aa6e9afa appstream 110 k 2023-06-22T10:55:27.373 INFO:teuthology.orchestra.run.smithi040.stdout:Upgrading: 2023-06-22T10:55:27.373 INFO:teuthology.orchestra.run.smithi040.stdout: sqlite x86_64 3.26.0-18.el8 baseos 668 k 2023-06-22T10:55:27.374 INFO:teuthology.orchestra.run.smithi040.stdout: sqlite-libs x86_64 3.26.0-18.el8 baseos 581 k 2023-06-22T10:55:27.374 INFO:teuthology.orchestra.run.smithi040.stdout:Installing dependencies: 2023-06-22T10:55:27.374 INFO:teuthology.orchestra.run.smithi040.stdout: daxctl-libs x86_64 71.1-7.el8 baseos 42 k 2023-06-22T10:55:27.374 INFO:teuthology.orchestra.run.smithi040.stdout: libpmemblk x86_64 1.6.1-1.el8 appstream 92 k 2023-06-22T10:55:27.374 INFO:teuthology.orchestra.run.smithi040.stdout: ndctl-libs x86_64 71.1-7.el8 baseos 80 k 2023-06-22T10:55:27.374 INFO:teuthology.orchestra.run.smithi040.stdout: python2-libs x86_64 2.7.18-12.module_el8+299+aa6e9afa appstream 6.5 M 2023-06-22T10:55:27.374 INFO:teuthology.orchestra.run.smithi040.stdout: python2-pip-wheel noarch 9.0.3-19.module_el8+299+aa6e9afa appstream 892 k 2023-06-22T10:55:27.374 INFO:teuthology.orchestra.run.smithi040.stdout: python2-setuptools-wheel noarch 39.0.1-13.module_el8+299+aa6e9afa appstream 287 k 2023-06-22T10:55:27.375 INFO:teuthology.orchestra.run.smithi040.stdout: python2-wheel-wheel noarch 1:0.31.1-3.module_el8+299+aa6e9afa appstream 44 k 2023-06-22T10:55:27.375 INFO:teuthology.orchestra.run.smithi040.stdout: rmt x86_64 2:1.5.3-13.el8 baseos 51 k 2023-06-22T10:55:27.375 INFO:teuthology.orchestra.run.smithi040.stdout:Installing weak dependencies: 2023-06-22T10:55:27.375 INFO:teuthology.orchestra.run.smithi040.stdout: python2-pip noarch 9.0.3-19.module_el8+299+aa6e9afa appstream 1.8 M 2023-06-22T10:55:27.375 INFO:teuthology.orchestra.run.smithi040.stdout: python2-setuptools noarch 39.0.1-13.module_el8+299+aa6e9afa appstream 702 k 2023-06-22T10:55:27.375 INFO:teuthology.orchestra.run.smithi040.stdout:Enabling module streams: 2023-06-22T10:55:27.375 INFO:teuthology.orchestra.run.smithi040.stdout: python27 2.7 2023-06-22T10:55:27.375 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:55:27.376 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction Summary 2023-06-22T10:55:27.376 INFO:teuthology.orchestra.run.smithi040.stdout:======================================================================================= 2023-06-22T10:55:27.376 INFO:teuthology.orchestra.run.smithi040.stdout:Install 14 Packages 2023-06-22T10:55:27.376 INFO:teuthology.orchestra.run.smithi040.stdout:Upgrade 2 Packages 2023-06-22T10:55:27.376 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:55:27.377 INFO:teuthology.orchestra.run.smithi040.stdout:Total download size: 13 M 2023-06-22T10:55:27.377 INFO:teuthology.orchestra.run.smithi040.stdout:Downloading Packages: 2023-06-22T10:55:31.006 INFO:teuthology.orchestra.run.smithi040.stdout:(1/16): libpmemblk-1.6.1-1.el8.x86_64.rpm 71 kB/s | 92 kB 00:01 2023-06-22T10:55:31.031 INFO:teuthology.orchestra.run.smithi040.stdout:(2/16): python2-2.7.18-12.module_el8+299+aa6e9a 83 kB/s | 110 kB 00:01 2023-06-22T10:55:31.215 INFO:teuthology.orchestra.run.smithi040.stdout:(3/16): fio-3.19-4.el8.x86_64.rpm 356 kB/s | 538 kB 00:01 2023-06-22T10:55:31.390 INFO:teuthology.orchestra.run.smithi040.stdout:(4/16): python2-pip-wheel-9.0.3-19.module_el8+2 5.0 MB/s | 892 kB 00:00 2023-06-22T10:55:31.516 INFO:teuthology.orchestra.run.smithi040.stdout:(5/16): python2-pip-9.0.3-19.module_el8+299+aa6 3.8 MB/s | 1.8 MB 00:00 2023-06-22T10:55:31.558 INFO:teuthology.orchestra.run.smithi040.stdout:(6/16): python2-setuptools-39.0.1-13.module_el8 4.1 MB/s | 702 kB 00:00 2023-06-22T10:55:31.624 INFO:teuthology.orchestra.run.smithi040.stdout:(7/16): python2-setuptools-wheel-39.0.1-13.modu 2.6 MB/s | 287 kB 00:00 2023-06-22T10:55:31.650 INFO:teuthology.orchestra.run.smithi040.stdout:(8/16): python2-wheel-wheel-0.31.1-3.module_el8 484 kB/s | 44 kB 00:00 2023-06-22T10:55:31.808 INFO:teuthology.orchestra.run.smithi040.stdout:(9/16): daxctl-libs-71.1-7.el8.x86_64.rpm 230 kB/s | 42 kB 00:00 2023-06-22T10:55:31.892 INFO:teuthology.orchestra.run.smithi040.stdout:(10/16): dump-0.4-0.36.b46.el8.x86_64.rpm 679 kB/s | 164 kB 00:00 2023-06-22T10:55:31.918 INFO:teuthology.orchestra.run.smithi040.stdout:(11/16): ndctl-libs-71.1-7.el8.x86_64.rpm 738 kB/s | 80 kB 00:00 2023-06-22T10:55:31.959 INFO:teuthology.orchestra.run.smithi040.stdout:(12/16): rmt-1.5.3-13.el8.x86_64.rpm 773 kB/s | 51 kB 00:00 2023-06-22T10:55:32.127 INFO:teuthology.orchestra.run.smithi040.stdout:(13/16): python2-libs-2.7.18-12.module_el8+299+ 5.8 MB/s | 6.5 MB 00:01 2023-06-22T10:55:32.202 INFO:teuthology.orchestra.run.smithi040.stdout:(14/16): indent-2.2.13-2.el8.x86_64.rpm 657 kB/s | 187 kB 00:00 2023-06-22T10:55:32.235 INFO:teuthology.orchestra.run.smithi040.stdout:(15/16): sqlite-3.26.0-18.el8.x86_64.rpm 2.4 MB/s | 668 kB 00:00 2023-06-22T10:55:32.277 INFO:teuthology.orchestra.run.smithi040.stdout:(16/16): sqlite-libs-3.26.0-18.el8.x86_64.rpm 3.8 MB/s | 581 kB 00:00 2023-06-22T10:55:32.278 INFO:teuthology.orchestra.run.smithi040.stdout:-------------------------------------------------------------------------------- 2023-06-22T10:55:32.279 INFO:teuthology.orchestra.run.smithi040.stdout:Total 2.6 MB/s | 13 MB 00:04 2023-06-22T10:55:32.662 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction check 2023-06-22T10:55:32.707 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction check succeeded. 2023-06-22T10:55:32.707 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction test 2023-06-22T10:55:32.946 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction test succeeded. 2023-06-22T10:55:32.951 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction 2023-06-22T10:55:33.701 INFO:teuthology.orchestra.run.smithi040.stdout: Preparing : 1/1 2023-06-22T10:55:33.873 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : sqlite-libs-3.26.0-18.el8.x86_64 1/18 2023-06-22T10:55:34.032 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : daxctl-libs-71.1-7.el8.x86_64 2/18 2023-06-22T10:55:34.118 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: daxctl-libs-71.1-7.el8.x86_64 2/18 2023-06-22T10:55:34.291 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ndctl-libs-71.1-7.el8.x86_64 3/18 2023-06-22T10:55:34.389 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ndctl-libs-71.1-7.el8.x86_64 3/18 2023-06-22T10:55:34.507 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libpmemblk-1.6.1-1.el8.x86_64 4/18 2023-06-22T10:55:34.593 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libpmemblk-1.6.1-1.el8.x86_64 4/18 2023-06-22T10:55:34.772 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : rmt-2:1.5.3-13.el8.x86_64 5/18 2023-06-22T10:55:34.917 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python2-setuptools-wheel-39.0.1-13.module_el8+299+ 6/18 2023-06-22T10:55:36.465 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python2-pip-wheel-9.0.3-19.module_el8+299+aa6e9afa 7/18 2023-06-22T10:55:37.229 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python2-libs-2.7.18-12.module_el8+299+aa6e9afa.x86 8/18 2023-06-22T10:55:37.626 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python2-pip-9.0.3-19.module_el8+299+aa6e9afa.noarc 9/18 2023-06-22T10:55:37.839 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python2-setuptools-39.0.1-13.module_el8+299+aa6e9a 10/18 2023-06-22T10:55:37.992 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python2-2.7.18-12.module_el8+299+aa6e9afa.x86_64 11/18 2023-06-22T10:55:38.038 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: python2-2.7.18-12.module_el8+299+aa6e9afa.x86_64 11/18 2023-06-22T10:55:38.303 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : dump-1:0.4-0.36.b46.el8.x86_64 12/18 2023-06-22T10:55:38.543 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : fio-3.19-4.el8.x86_64 13/18 2023-06-22T10:55:38.891 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : sqlite-3.26.0-18.el8.x86_64 14/18 2023-06-22T10:55:39.070 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : indent-2.2.13-2.el8.x86_64 15/18 2023-06-22T10:55:39.200 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python2-wheel-wheel-1:0.31.1-3.module_el8+299+aa6e 16/18 2023-06-22T10:55:39.316 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : sqlite-3.26.0-17.el8.x86_64 17/18 2023-06-22T10:55:39.457 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : sqlite-libs-3.26.0-17.el8.x86_64 18/18 2023-06-22T10:55:39.960 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: sqlite-libs-3.26.0-17.el8.x86_64 18/18 2023-06-22T10:55:39.961 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : fio-3.19-4.el8.x86_64 1/18 2023-06-22T10:55:39.961 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libpmemblk-1.6.1-1.el8.x86_64 2/18 2023-06-22T10:55:39.961 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python2-2.7.18-12.module_el8+299+aa6e9afa.x86_64 3/18 2023-06-22T10:55:39.961 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python2-libs-2.7.18-12.module_el8+299+aa6e9afa.x86 4/18 2023-06-22T10:55:39.961 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python2-pip-9.0.3-19.module_el8+299+aa6e9afa.noarc 5/18 2023-06-22T10:55:39.961 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python2-pip-wheel-9.0.3-19.module_el8+299+aa6e9afa 6/18 2023-06-22T10:55:39.961 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python2-setuptools-39.0.1-13.module_el8+299+aa6e9a 7/18 2023-06-22T10:55:39.962 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python2-setuptools-wheel-39.0.1-13.module_el8+299+ 8/18 2023-06-22T10:55:39.962 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python2-wheel-wheel-1:0.31.1-3.module_el8+299+aa6e 9/18 2023-06-22T10:55:39.962 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : daxctl-libs-71.1-7.el8.x86_64 10/18 2023-06-22T10:55:39.962 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : dump-1:0.4-0.36.b46.el8.x86_64 11/18 2023-06-22T10:55:39.963 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ndctl-libs-71.1-7.el8.x86_64 12/18 2023-06-22T10:55:39.963 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rmt-2:1.5.3-13.el8.x86_64 13/18 2023-06-22T10:55:39.963 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : indent-2.2.13-2.el8.x86_64 14/18 2023-06-22T10:55:39.963 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : sqlite-3.26.0-18.el8.x86_64 15/18 2023-06-22T10:55:39.963 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : sqlite-3.26.0-17.el8.x86_64 16/18 2023-06-22T10:55:39.964 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : sqlite-libs-3.26.0-18.el8.x86_64 17/18 2023-06-22T10:55:40.757 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : sqlite-libs-3.26.0-17.el8.x86_64 18/18 2023-06-22T10:55:40.757 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:55:40.758 INFO:teuthology.orchestra.run.smithi040.stdout:Upgraded: 2023-06-22T10:55:40.758 INFO:teuthology.orchestra.run.smithi040.stdout: sqlite-3.26.0-18.el8.x86_64 sqlite-libs-3.26.0-18.el8.x86_64 2023-06-22T10:55:40.758 INFO:teuthology.orchestra.run.smithi040.stdout:Installed: 2023-06-22T10:55:40.758 INFO:teuthology.orchestra.run.smithi040.stdout: daxctl-libs-71.1-7.el8.x86_64 2023-06-22T10:55:40.758 INFO:teuthology.orchestra.run.smithi040.stdout: dump-1:0.4-0.36.b46.el8.x86_64 2023-06-22T10:55:40.758 INFO:teuthology.orchestra.run.smithi040.stdout: fio-3.19-4.el8.x86_64 2023-06-22T10:55:40.758 INFO:teuthology.orchestra.run.smithi040.stdout: indent-2.2.13-2.el8.x86_64 2023-06-22T10:55:40.759 INFO:teuthology.orchestra.run.smithi040.stdout: libpmemblk-1.6.1-1.el8.x86_64 2023-06-22T10:55:40.759 INFO:teuthology.orchestra.run.smithi040.stdout: ndctl-libs-71.1-7.el8.x86_64 2023-06-22T10:55:40.759 INFO:teuthology.orchestra.run.smithi040.stdout: python2-2.7.18-12.module_el8+299+aa6e9afa.x86_64 2023-06-22T10:55:40.759 INFO:teuthology.orchestra.run.smithi040.stdout: python2-libs-2.7.18-12.module_el8+299+aa6e9afa.x86_64 2023-06-22T10:55:40.759 INFO:teuthology.orchestra.run.smithi040.stdout: python2-pip-9.0.3-19.module_el8+299+aa6e9afa.noarch 2023-06-22T10:55:40.759 INFO:teuthology.orchestra.run.smithi040.stdout: python2-pip-wheel-9.0.3-19.module_el8+299+aa6e9afa.noarch 2023-06-22T10:55:40.759 INFO:teuthology.orchestra.run.smithi040.stdout: python2-setuptools-39.0.1-13.module_el8+299+aa6e9afa.noarch 2023-06-22T10:55:40.759 INFO:teuthology.orchestra.run.smithi040.stdout: python2-setuptools-wheel-39.0.1-13.module_el8+299+aa6e9afa.noarch 2023-06-22T10:55:40.760 INFO:teuthology.orchestra.run.smithi040.stdout: python2-wheel-wheel-1:0.31.1-3.module_el8+299+aa6e9afa.noarch 2023-06-22T10:55:40.760 INFO:teuthology.orchestra.run.smithi040.stdout: rmt-2:1.5.3-13.el8.x86_64 2023-06-22T10:55:40.760 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:55:40.760 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2023-06-22T10:55:41.104 DEBUG:teuthology.orchestra.run.smithi040:> sudo useradd -m fsgqa 2023-06-22T10:55:41.176 INFO:teuthology.orchestra.run.smithi040.stderr:useradd: user 'fsgqa' already exists 2023-06-22T10:55:41.179 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-06-22T10:55:41.179 DEBUG:teuthology.orchestra.run.smithi040:> sudo groupadd fsgqa 2023-06-22T10:55:41.248 INFO:teuthology.orchestra.run.smithi040.stderr:groupadd: group 'fsgqa' already exists 2023-06-22T10:55:41.250 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-06-22T10:55:41.251 DEBUG:teuthology.orchestra.run.smithi040:> sudo useradd fsgqa2 2023-06-22T10:55:41.960 DEBUG:teuthology.orchestra.run.smithi040:> sudo useradd 123456-fsgqa 2023-06-22T10:55:42.589 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-06-22T10:55:42.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:42.787+0000 7fe8c87ff700 1 Processor -- start 2023-06-22T10:55:42.791 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:42.788+0000 7fe8c87ff700 1 -- start start 2023-06-22T10:55:42.792 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:42.789+0000 7fe8c87ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe8c01511c0 0x7fe8c00cdf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:42.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:42.789+0000 7fe8c87ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe8c015b0c0 0x7fe8c0070b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:42.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:42.789+0000 7fe8c87ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8c015b530 con 0x7fe8c00710b0 2023-06-22T10:55:42.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:42.789+0000 7fe8c87ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8c0151590 con 0x7fe8c015b0c0 2023-06-22T10:55:42.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:42.789+0000 7fe8c87ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c00b01e0 con 0x7fe8c01511c0 2023-06-22T10:55:42.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:42.789+0000 7fe8c5d9a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe8c015b0c0 0x7fe8c0070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:42.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:42.789+0000 7fe8c6d9c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe8c00710b0 0x7fe8c0069f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:40128/0 (socket says 172.21.15.40:40128) 2023-06-22T10:55:42.793 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:42.789+0000 7fe8c6d9c700 1 -- 172.21.15.40:0/2735900530 learned_addr learned my addr 172.21.15.40:0/2735900530 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:55:42.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:42.789+0000 7fe8c659b700 1 --2- 172.21.15.40:0/2735900530 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe8c01511c0 0x7fe8c00cdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:42.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:42.790+0000 7fe8c5d9a700 1 -- 172.21.15.40:0/2735900530 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe8c01511c0 msgr2=0x7fe8c00cdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:55:42.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:42.790+0000 7fe8c5d9a700 1 --2- 172.21.15.40:0/2735900530 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe8c01511c0 0x7fe8c00cdf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:42.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:42.790+0000 7fe8c5d9a700 1 -- 172.21.15.40:0/2735900530 >> v1:172.21.15.40:6789/0 conn(0x7fe8c00710b0 legacy=0x7fe8c0069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:42.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:42.790+0000 7fe8c5d9a700 1 -- 172.21.15.40:0/2735900530 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8c00703b0 con 0x7fe8c015b0c0 2023-06-22T10:55:42.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:42.790+0000 7fe8c5599700 1 -- 172.21.15.40:0/2735900530 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1478372631 0 0) 0x7fe8c015b530 con 0x7fe8c00710b0 2023-06-22T10:55:42.795 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:42.790+0000 7fe8c5d9a700 1 --2- 172.21.15.40:0/2735900530 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8c015b0c0 0x7fe8c0070b70 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fe8b0009840 tx=0x7fe8b0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce94e0a3e6003fcc server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:42.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:42.790+0000 7fe8c5599700 1 -- 172.21.15.40:0/2735900530 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b0011830 con 0x7fe8c015b0c0 2023-06-22T10:55:42.796 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:42.790+0000 7fe8c5599700 1 -- 172.21.15.40:0/2735900530 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8b0011990 con 0x7fe8c015b0c0 2023-06-22T10:55:42.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:42.790+0000 7fe8c5599700 1 -- 172.21.15.40:0/2735900530 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b0011d20 con 0x7fe8c015b0c0 2023-06-22T10:55:42.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:42.791+0000 7fe8c87ff700 1 -- 172.21.15.40:0/2735900530 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8c015b0c0 msgr2=0x7fe8c0070b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:42.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:42.791+0000 7fe8c87ff700 1 --2- 172.21.15.40:0/2735900530 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8c015b0c0 0x7fe8c0070b70 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fe8b0009840 tx=0x7fe8b0009b50 comp rx=0 tx=0).stop 2023-06-22T10:55:42.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:42.791+0000 7fe8c87ff700 1 -- 172.21.15.40:0/2735900530 shutdown_connections 2023-06-22T10:55:42.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:42.791+0000 7fe8c87ff700 1 --2- 172.21.15.40:0/2735900530 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe8c01511c0 0x7fe8c00cdf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:42.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:42.791+0000 7fe8c87ff700 1 --2- 172.21.15.40:0/2735900530 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8c015b0c0 0x7fe8c0070b70 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:42.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:42.791+0000 7fe8c87ff700 1 -- 172.21.15.40:0/2735900530 >> 172.21.15.40:0/2735900530 conn(0x7fe8c00b1030 msgr2=0x7fe8c00ce7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:42.797 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:42.791+0000 7fe8c87ff700 1 -- 172.21.15.40:0/2735900530 shutdown_connections 2023-06-22T10:55:42.798 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:42.791+0000 7fe8c87ff700 1 -- 172.21.15.40:0/2735900530 wait complete. 2023-06-22T10:55:42.799 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:42.793+0000 7fe8c87ff700 1 Processor -- start 2023-06-22T10:55:42.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:42.793+0000 7fe8c87ff700 1 -- start start 2023-06-22T10:55:42.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:42.794+0000 7fe8c87ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8c00710b0 0x7fe8c0149e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:42.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:42.794+0000 7fe8c87ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8c01511c0 0x7fe8c01e54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:42.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:42.794+0000 7fe8c87ff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe8c015b0c0 0x7fe8c014fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:42.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:42.794+0000 7fe8c87ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c00b1f10 con 0x7fe8c00710b0 2023-06-22T10:55:42.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:42.794+0000 7fe8c87ff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c01e6170 con 0x7fe8c01511c0 2023-06-22T10:55:42.800 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:42.794+0000 7fe8c87ff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c01e5e90 con 0x7fe8c015b0c0 2023-06-22T10:55:42.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:42.794+0000 7fe8c659b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8c00710b0 0x7fe8c0149e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:42.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:42.794+0000 7fe8c659b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8c00710b0 0x7fe8c0149e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51504/0 (socket says 172.21.15.40:51504) 2023-06-22T10:55:42.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:42.794+0000 7fe8c659b700 1 -- 172.21.15.40:0/12855221 learned_addr learned my addr 172.21.15.40:0/12855221 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:55:42.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:42.794+0000 7fe8c6d9c700 1 --2- 172.21.15.40:0/12855221 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe8c015b0c0 0x7fe8c014fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:42.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:42.794+0000 7fe8c5d9a700 1 --2- 172.21.15.40:0/12855221 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8c01511c0 0x7fe8c01e54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:42.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:42.795+0000 7fe8c659b700 1 -- 172.21.15.40:0/12855221 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe8c015b0c0 msgr2=0x7fe8c014fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:42.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:42.795+0000 7fe8c659b700 1 --2- 172.21.15.40:0/12855221 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe8c015b0c0 0x7fe8c014fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:42.801 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:42.795+0000 7fe8c659b700 1 -- 172.21.15.40:0/12855221 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8c01511c0 msgr2=0x7fe8c01e54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:42.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:42.795+0000 7fe8c659b700 1 --2- 172.21.15.40:0/12855221 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8c01511c0 0x7fe8c01e54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:42.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:42.795+0000 7fe8c659b700 1 -- 172.21.15.40:0/12855221 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b00094a0 con 0x7fe8c00710b0 2023-06-22T10:55:42.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:42.795+0000 7fe8c6d9c700 1 --2- 172.21.15.40:0/12855221 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe8c015b0c0 0x7fe8c014fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:55:42.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:42.795+0000 7fe8c5d9a700 1 --2- 172.21.15.40:0/12855221 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8c01511c0 0x7fe8c01e54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-22T10:55:42.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:42.795+0000 7fe8c659b700 1 --2- 172.21.15.40:0/12855221 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8c00710b0 0x7fe8c0149e30 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc00e840 tx=0x7fe8bc00ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:42.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:42.795+0000 7fe8b6ffd700 1 -- 172.21.15.40:0/12855221 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8bc013610 con 0x7fe8c00710b0 2023-06-22T10:55:42.802 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:42.795+0000 7fe8b6ffd700 1 -- 172.21.15.40:0/12855221 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8bc013770 con 0x7fe8c00710b0 2023-06-22T10:55:42.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:42.795+0000 7fe8b6ffd700 1 -- 172.21.15.40:0/12855221 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8bc013b20 con 0x7fe8c00710b0 2023-06-22T10:55:42.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:42.795+0000 7fe8c87ff700 1 -- 172.21.15.40:0/12855221 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8c00b1850 con 0x7fe8c00710b0 2023-06-22T10:55:42.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:42.795+0000 7fe8c87ff700 1 -- 172.21.15.40:0/12855221 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8c01e59f0 con 0x7fe8c00710b0 2023-06-22T10:55:42.803 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:42.796+0000 7fe8c87ff700 1 -- 172.21.15.40:0/12855221 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8c00b16b0 con 0x7fe8c00710b0 2023-06-22T10:55:42.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:42.797+0000 7fe8b6ffd700 1 -- 172.21.15.40:0/12855221 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe8bc013c80 con 0x7fe8c00710b0 2023-06-22T10:55:42.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:42.798+0000 7fe8b6ffd700 1 --2- 172.21.15.40:0/12855221 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe8a406ace0 0x7fe8a406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:42.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:42.798+0000 7fe8b6ffd700 1 -- 172.21.15.40:0/12855221 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fe8bc0892c0 con 0x7fe8c00710b0 2023-06-22T10:55:42.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:42.799+0000 7fe8c5d9a700 1 --2- 172.21.15.40:0/12855221 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe8a406ace0 0x7fe8a406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:42.804 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:42.799+0000 7fe8c5d9a700 1 --2- 172.21.15.40:0/12855221 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe8a406ace0 0x7fe8a406d190 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe8b00090b0 tx=0x7fe8b001c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:42.806 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:42.803+0000 7fe8b6ffd700 1 -- 172.21.15.40:0/12855221 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe8c00b16b0 con 0x7fe8c00710b0 2023-06-22T10:55:43.097 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.094+0000 7fe8c87ff700 1 -- 172.21.15.40:0/12855221 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fe8c00b16b0 con 0x7fe8c00710b0 2023-06-22T10:55:43.098 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.095+0000 7fe8b6ffd700 1 -- 172.21.15.40:0/12855221 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1268 (secure 0 0 0) 0x7fe8c00b16b0 con 0x7fe8c00710b0 2023-06-22T10:55:43.098 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:55:43.099 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":1,"fsid":"475560bc-1a7c-4a75-b3b6-6fc6b20bdc52","modified":"2023-06-22T10:52:26.785110Z","created":"2023-06-22T10:52:26.785110Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:3300","nonce":0},{"type":"v1","addr":"172.21.15.40:6789","nonce":0}]},"addr":"172.21.15.40:6789/0","public_addr":"172.21.15.40:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:3300","nonce":0},{"type":"v1","addr":"172.21.15.45:6789","nonce":0}]},"addr":"172.21.15.45:6789/0","public_addr":"172.21.15.45:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:3301","nonce":0},{"type":"v1","addr":"172.21.15.45:6790","nonce":0}]},"addr":"172.21.15.45:6790/0","public_addr":"172.21.15.45:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-06-22T10:55:43.100 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.097+0000 7fe8c87ff700 1 -- 172.21.15.40:0/12855221 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe8a406ace0 msgr2=0x7fe8a406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:43.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.097+0000 7fe8c87ff700 1 --2- 172.21.15.40:0/12855221 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe8a406ace0 0x7fe8a406d190 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe8b00090b0 tx=0x7fe8b001c040 comp rx=0 tx=0).stop 2023-06-22T10:55:43.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.097+0000 7fe8c87ff700 1 -- 172.21.15.40:0/12855221 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8c00710b0 msgr2=0x7fe8c0149e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:43.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.097+0000 7fe8c87ff700 1 --2- 172.21.15.40:0/12855221 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8c00710b0 0x7fe8c0149e30 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc00e840 tx=0x7fe8bc00ec00 comp rx=0 tx=0).stop 2023-06-22T10:55:43.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.097+0000 7fe8c87ff700 1 -- 172.21.15.40:0/12855221 shutdown_connections 2023-06-22T10:55:43.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.097+0000 7fe8c87ff700 1 --2- 172.21.15.40:0/12855221 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7fe8a406ace0 0x7fe8a406d190 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:43.101 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.097+0000 7fe8c87ff700 1 --2- 172.21.15.40:0/12855221 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7fe8c015b0c0 0x7fe8c014fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:43.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.097+0000 7fe8c87ff700 1 --2- 172.21.15.40:0/12855221 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8c00710b0 0x7fe8c0149e30 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:43.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.097+0000 7fe8c87ff700 1 --2- 172.21.15.40:0/12855221 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8c01511c0 0x7fe8c01e54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:43.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.097+0000 7fe8c87ff700 1 -- 172.21.15.40:0/12855221 >> 172.21.15.40:0/12855221 conn(0x7fe8c00b1030 msgr2=0x7fe8c006c760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:43.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.097+0000 7fe8c87ff700 1 -- 172.21.15.40:0/12855221 shutdown_connections 2023-06-22T10:55:43.102 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.097+0000 7fe8c87ff700 1 -- 172.21.15.40:0/12855221 wait complete. 2023-06-22T10:55:43.103 INFO:teuthology.orchestra.run.smithi040.stderr:dumped monmap epoch 1 2023-06-22T10:55:43.119 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2023-06-22T10:55:43.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.319+0000 7f1a92dff700 1 Processor -- start 2023-06-22T10:55:43.323 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.320+0000 7f1a92dff700 1 -- start start 2023-06-22T10:55:43.324 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.321+0000 7f1a92dff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1a8c0b59a0 0x7f1a8c0b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:43.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.321+0000 7f1a92dff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a8c0d1be0 con 0x7f1a8c0d2130 2023-06-22T10:55:43.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.321+0000 7f1a92dff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a8c0d1360 con 0x7f1a8c0b45d0 2023-06-22T10:55:43.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.321+0000 7f1a92dff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a8c0d17f0 con 0x7f1a8c0b59a0 2023-06-22T10:55:43.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.321+0000 7f1a8bfff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f1a8c0d2130 0x7f1a8c0cd1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:40144/0 (socket says 172.21.15.40:40144) 2023-06-22T10:55:43.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.321+0000 7f1a8bfff700 1 -- 172.21.15.40:0/2568648168 learned_addr learned my addr 172.21.15.40:0/2568648168 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-06-22T10:55:43.325 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.321+0000 7f1a9139c700 1 --2- 172.21.15.40:0/2568648168 >> v2:172.21.15.45:3300/0 conn(0x7f1a8c0b59a0 0x7f1a8c0b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:43.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.322+0000 7f1a8b7fe700 1 -- 172.21.15.40:0/2568648168 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1811599137 0 0) 0x7f1a8c0d1be0 con 0x7f1a8c0d2130 2023-06-22T10:55:43.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.322+0000 7f1a8b7fe700 1 -- 172.21.15.40:0/2568648168 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a7c0035b0 con 0x7f1a8c0d2130 2023-06-22T10:55:43.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.322+0000 7f1a8b7fe700 1 -- 172.21.15.40:0/2568648168 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3803563204 0 0) 0x7f1a7c0035b0 con 0x7f1a8c0d2130 2023-06-22T10:55:43.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.322+0000 7f1a8b7fe700 1 -- 172.21.15.40:0/2568648168 >> v2:172.21.15.45:3300/0 conn(0x7f1a8c0b59a0 msgr2=0x7f1a8c0b5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:55:43.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.322+0000 7f1a8b7fe700 1 --2- 172.21.15.40:0/2568648168 >> v2:172.21.15.45:3300/0 conn(0x7f1a8c0b59a0 0x7f1a8c0b5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:43.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.322+0000 7f1a8b7fe700 1 -- 172.21.15.40:0/2568648168 >> v1:172.21.15.45:6789/0 conn(0x7f1a8c0b45d0 legacy=0x7f1a8c0b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:43.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.322+0000 7f1a8b7fe700 1 -- 172.21.15.40:0/2568648168 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a8c0cef40 con 0x7f1a8c0d2130 2023-06-22T10:55:43.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.322+0000 7f1a8b7fe700 1 -- 172.21.15.40:0/2568648168 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1490606486 0 0) 0x7f1a78001670 con 0x7f1a8c0d2130 2023-06-22T10:55:43.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.322+0000 7f1a9139c700 1 --2- 172.21.15.40:0/2568648168 >> v2:172.21.15.45:3300/0 conn(0x7f1a8c0b59a0 0x7f1a8c0b5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-22T10:55:43.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.322+0000 7f1a8b7fe700 1 -- 172.21.15.40:0/2568648168 >> v1:172.21.15.40:6789/0 conn(0x7f1a8c0d2130 legacy=0x7f1a8c0cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:43.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.322+0000 7f1a8b7fe700 1 --2- 172.21.15.40:0/2568648168 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a7c003a00 0x7f1a7c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:43.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.322+0000 7f1a8b7fe700 1 --2- 172.21.15.40:0/2568648168 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a7c004850 0x7f1a7c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:43.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.322+0000 7f1a8b7fe700 1 --2- 172.21.15.40:0/2568648168 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1a7c005200 0x7f1a7c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:43.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.322+0000 7f1a8b7fe700 1 -- 172.21.15.40:0/2568648168 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8c0d17f0 con 0x7f1a7c003a00 2023-06-22T10:55:43.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.322+0000 7f1a8b7fe700 1 -- 172.21.15.40:0/2568648168 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7c00c110 con 0x7f1a7c004850 2023-06-22T10:55:43.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.322+0000 7f1a8b7fe700 1 -- 172.21.15.40:0/2568648168 --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7c00c2d0 con 0x7f1a7c005200 2023-06-22T10:55:43.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.322+0000 7f1a90b9b700 1 --2- 172.21.15.40:0/2568648168 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a7c003a00 0x7f1a7c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:43.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.322+0000 7f1a8bfff700 1 --2- 172.21.15.40:0/2568648168 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a7c004850 0x7f1a7c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:43.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.323+0000 7f1a9139c700 1 --2- 172.21.15.40:0/2568648168 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1a7c005200 0x7f1a7c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:43.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.323+0000 7f1a90b9b700 1 -- 172.21.15.40:0/2568648168 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1a7c005200 msgr2=0x7f1a7c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:55:43.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.323+0000 7f1a90b9b700 1 --2- 172.21.15.40:0/2568648168 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1a7c005200 0x7f1a7c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:43.330 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.323+0000 7f1a90b9b700 1 -- 172.21.15.40:0/2568648168 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a7c004850 msgr2=0x7f1a7c004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-22T10:55:43.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.323+0000 7f1a90b9b700 1 --2- 172.21.15.40:0/2568648168 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a7c004850 0x7f1a7c004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:43.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.323+0000 7f1a90b9b700 1 -- 172.21.15.40:0/2568648168 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a7c0035b0 con 0x7f1a7c003a00 2023-06-22T10:55:43.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.323+0000 7f1a9139c700 1 -- 172.21.15.40:0/2568648168 reap_dead start 2023-06-22T10:55:43.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.323+0000 7f1a90b9b700 1 --2- 172.21.15.40:0/2568648168 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a7c003a00 0x7f1a7c003e10 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f1a800017c0 tx=0x7f1a7c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db948f857e663ed0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:43.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.323+0000 7f1a8b7fe700 1 -- 172.21.15.40:0/2568648168 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a800052d0 con 0x7f1a7c003a00 2023-06-22T10:55:43.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.323+0000 7f1a8b7fe700 1 -- 172.21.15.40:0/2568648168 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a80005430 con 0x7f1a7c003a00 2023-06-22T10:55:43.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.323+0000 7f1a8b7fe700 1 -- 172.21.15.40:0/2568648168 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a800038c0 con 0x7f1a7c003a00 2023-06-22T10:55:43.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.324+0000 7f1a92dff700 1 -- 172.21.15.40:0/2568648168 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a7c003a00 msgr2=0x7f1a7c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:43.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.324+0000 7f1a92dff700 1 --2- 172.21.15.40:0/2568648168 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a7c003a00 0x7f1a7c003e10 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f1a800017c0 tx=0x7f1a7c005880 comp rx=0 tx=0).stop 2023-06-22T10:55:43.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.324+0000 7f1a92dff700 1 -- 172.21.15.40:0/2568648168 shutdown_connections 2023-06-22T10:55:43.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.324+0000 7f1a92dff700 1 --2- 172.21.15.40:0/2568648168 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a7c003a00 0x7f1a7c003e10 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:43.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.324+0000 7f1a92dff700 1 -- 172.21.15.40:0/2568648168 >> 172.21.15.40:0/2568648168 conn(0x7f1a8c0cf5d0 msgr2=0x7f1a8c0cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:43.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.324+0000 7f1a92dff700 1 -- 172.21.15.40:0/2568648168 shutdown_connections 2023-06-22T10:55:43.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.324+0000 7f1a92dff700 1 -- 172.21.15.40:0/2568648168 wait complete. 2023-06-22T10:55:43.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.326+0000 7f1a92dff700 1 Processor -- start 2023-06-22T10:55:43.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.327+0000 7f1a92dff700 1 -- start start 2023-06-22T10:55:43.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.328+0000 7f1a92dff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a7c003a00 0x7f1a8c153620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:43.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.328+0000 7f1a92dff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a8c159380 0x7f1a8c1597f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:43.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.328+0000 7f1a92dff700 1 --2- >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1a8c15b350 0x7f1a8c15b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:43.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.328+0000 7f1a92dff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8c153b60 con 0x7f1a8c159380 2023-06-22T10:55:43.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.328+0000 7f1a92dff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8c15e0a0 con 0x7f1a7c003a00 2023-06-22T10:55:43.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.328+0000 7f1a92dff700 1 -- --> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8c15d770 con 0x7f1a8c15b350 2023-06-22T10:55:43.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.328+0000 7f1a8bfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a8c159380 0x7f1a8c1597f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:43.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.328+0000 7f1a8bfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a8c159380 0x7f1a8c1597f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:51522/0 (socket says 172.21.15.40:51522) 2023-06-22T10:55:43.335 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.328+0000 7f1a8bfff700 1 -- 172.21.15.40:0/2214632498 learned_addr learned my addr 172.21.15.40:0/2214632498 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-06-22T10:55:43.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.328+0000 7f1a90b9b700 1 --2- 172.21.15.40:0/2214632498 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a7c003a00 0x7f1a8c153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:43.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.328+0000 7f1a9139c700 1 --2- 172.21.15.40:0/2214632498 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1a8c15b350 0x7f1a8c15b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:43.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.329+0000 7f1a8bfff700 1 -- 172.21.15.40:0/2214632498 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1a8c15b350 msgr2=0x7f1a8c15b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:43.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.329+0000 7f1a8bfff700 1 --2- 172.21.15.40:0/2214632498 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1a8c15b350 0x7f1a8c15b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:43.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.329+0000 7f1a8bfff700 1 -- 172.21.15.40:0/2214632498 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a7c003a00 msgr2=0x7f1a8c153620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:43.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.329+0000 7f1a8bfff700 1 --2- 172.21.15.40:0/2214632498 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a7c003a00 0x7f1a8c153620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:43.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.329+0000 7f1a8bfff700 1 -- 172.21.15.40:0/2214632498 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a8c15da50 con 0x7f1a8c159380 2023-06-22T10:55:43.336 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.329+0000 7f1a8bfff700 1 --2- 172.21.15.40:0/2214632498 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a8c159380 0x7f1a8c1597f0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f1a7800e7b0 tx=0x7f1a7800eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:43.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.329+0000 7f1a897fa700 1 -- 172.21.15.40:0/2214632498 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a78010510 con 0x7f1a8c159380 2023-06-22T10:55:43.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.329+0000 7f1a897fa700 1 -- 172.21.15.40:0/2214632498 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a78010670 con 0x7f1a8c159380 2023-06-22T10:55:43.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.329+0000 7f1a92dff700 1 -- 172.21.15.40:0/2214632498 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a8c15dd30 con 0x7f1a8c159380 2023-06-22T10:55:43.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.329+0000 7f1a897fa700 1 -- 172.21.15.40:0/2214632498 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a78010a20 con 0x7f1a8c159380 2023-06-22T10:55:43.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.329+0000 7f1a92dff700 1 -- 172.21.15.40:0/2214632498 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a8c159e00 con 0x7f1a8c159380 2023-06-22T10:55:43.337 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.331+0000 7f1a92dff700 1 -- 172.21.15.40:0/2214632498 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a8c15d8b0 con 0x7f1a8c159380 2023-06-22T10:55:43.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.331+0000 7f1a897fa700 1 -- 172.21.15.40:0/2214632498 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1a78010b80 con 0x7f1a8c159380 2023-06-22T10:55:43.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.333+0000 7f1a897fa700 1 --2- 172.21.15.40:0/2214632498 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f1a7006ace0 0x7f1a7006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-22T10:55:43.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.333+0000 7f1a897fa700 1 -- 172.21.15.40:0/2214632498 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f1a78088dd0 con 0x7f1a8c159380 2023-06-22T10:55:43.338 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.333+0000 7f1a90b9b700 1 --2- 172.21.15.40:0/2214632498 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f1a7006ace0 0x7f1a7006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-22T10:55:43.339 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.333+0000 7f1a90b9b700 1 --2- 172.21.15.40:0/2214632498 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f1a7006ace0 0x7f1a7006d190 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1a80015040 tx=0x7f1a80009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-22T10:55:43.340 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.337+0000 7f1a897fa700 1 -- 172.21.15.40:0/2214632498 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1a8c15d8b0 con 0x7f1a8c159380 2023-06-22T10:55:43.631 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.628+0000 7f1a92dff700 1 -- 172.21.15.40:0/2214632498 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7f1a8c15d8b0 con 0x7f1a8c159380 2023-06-22T10:55:43.632 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.628+0000 7f1a897fa700 1 -- 172.21.15.40:0/2214632498 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v13) v1 ==== 92+0+63 (secure 0 0 0) 0x7f1a8c15d8b0 con 0x7f1a8c159380 2023-06-22T10:55:43.632 INFO:teuthology.orchestra.run.smithi040.stdout:[client.admin] 2023-06-22T10:55:43.632 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== 2023-06-22T10:55:43.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.630+0000 7f1a92dff700 1 -- 172.21.15.40:0/2214632498 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f1a7006ace0 msgr2=0x7f1a7006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:43.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.630+0000 7f1a92dff700 1 --2- 172.21.15.40:0/2214632498 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f1a7006ace0 0x7f1a7006d190 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1a80015040 tx=0x7f1a80009030 comp rx=0 tx=0).stop 2023-06-22T10:55:43.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.631+0000 7f1a92dff700 1 -- 172.21.15.40:0/2214632498 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a8c159380 msgr2=0x7f1a8c1597f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-22T10:55:43.634 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.631+0000 7f1a92dff700 1 --2- 172.21.15.40:0/2214632498 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a8c159380 0x7f1a8c1597f0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f1a7800e7b0 tx=0x7f1a7800eac0 comp rx=0 tx=0).stop 2023-06-22T10:55:43.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.631+0000 7f1a92dff700 1 -- 172.21.15.40:0/2214632498 shutdown_connections 2023-06-22T10:55:43.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.631+0000 7f1a92dff700 1 --2- 172.21.15.40:0/2214632498 >> [v2:172.21.15.40:6832/1803669772,v1:172.21.15.40:6833/1803669772] conn(0x7f1a7006ace0 0x7f1a7006d190 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:43.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.631+0000 7f1a92dff700 1 --2- 172.21.15.40:0/2214632498 >> [v2:172.21.15.45:3301/0,v1:172.21.15.45:6790/0] conn(0x7f1a8c15b350 0x7f1a8c15b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:43.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.631+0000 7f1a92dff700 1 --2- 172.21.15.40:0/2214632498 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a7c003a00 0x7f1a8c153620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:43.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.631+0000 7f1a92dff700 1 --2- 172.21.15.40:0/2214632498 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a8c159380 0x7f1a8c1597f0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-22T10:55:43.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.631+0000 7f1a92dff700 1 -- 172.21.15.40:0/2214632498 >> 172.21.15.40:0/2214632498 conn(0x7f1a8c0cf5d0 msgr2=0x7f1a8c0b79c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-22T10:55:43.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.631+0000 7f1a92dff700 1 -- 172.21.15.40:0/2214632498 shutdown_connections 2023-06-22T10:55:43.635 INFO:teuthology.orchestra.run.smithi040.stderr:2023-06-22T10:55:43.631+0000 7f1a92dff700 1 -- 172.21.15.40:0/2214632498 wait complete. 2023-06-22T10:55:43.652 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-06-22T10:55:43.653 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/tmp/tmp.a4ZvvHFGMPxfstests-dev/local.config 2023-06-22T10:55:43.723 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.40:6789:/test export TEST_DIR=/tmp/tmp.LeLMdg91vGtest export SCRATCH_DEV=172.21.15.40:6789:/scratch export SCRATCH_MNT=/tmp/tmp.6nIBYnNpfBscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg==" 2023-06-22T10:55:43.724 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-06-22T10:55:43.724 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/tmp/tmp.a4ZvvHFGMPxfstests-dev/ceph.exclude 2023-06-22T10:55:43.832 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo make) 2023-06-22T10:55:43.960 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize -cfi 2023-06-22T10:55:44.431 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize: putting auxiliary files in '.'. 2023-06-22T10:55:44.431 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize: copying file './config.guess' 2023-06-22T10:55:44.440 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize: copying file './config.sub' 2023-06-22T10:55:44.451 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize: copying file './install-sh' 2023-06-22T10:55:44.462 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize: copying file './ltmain.sh' 2023-06-22T10:55:44.523 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-06-22T10:55:44.523 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-06-22T10:55:44.535 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-06-22T10:55:44.548 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-06-22T10:55:44.561 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-06-22T10:55:44.573 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-06-22T10:55:44.589 INFO:teuthology.orchestra.run.smithi040.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-06-22T10:55:44.592 INFO:teuthology.orchestra.run.smithi040.stdout:cp include/install-sh . 2023-06-22T10:55:44.595 INFO:teuthology.orchestra.run.smithi040.stdout:aclocal -I m4 2023-06-22T10:55:45.900 INFO:teuthology.orchestra.run.smithi040.stdout:autoheader 2023-06-22T10:55:46.277 INFO:teuthology.orchestra.run.smithi040.stdout:autoconf 2023-06-22T10:55:46.490 INFO:teuthology.orchestra.run.smithi040.stdout:./configure \ 2023-06-22T10:55:46.490 INFO:teuthology.orchestra.run.smithi040.stdout: --libexecdir=/usr/lib \ 2023-06-22T10:55:46.490 INFO:teuthology.orchestra.run.smithi040.stdout: --exec_prefix=/var/lib 2023-06-22T10:55:47.070 INFO:teuthology.orchestra.run.smithi040.stdout:checking build system type... x86_64-pc-linux-gnu 2023-06-22T10:55:47.071 INFO:teuthology.orchestra.run.smithi040.stdout:checking host system type... x86_64-pc-linux-gnu 2023-06-22T10:55:47.074 INFO:teuthology.orchestra.run.smithi040.stdout:checking how to print strings... printf 2023-06-22T10:55:47.075 INFO:teuthology.orchestra.run.smithi040.stdout:checking for gcc... gcc 2023-06-22T10:55:47.239 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether the C compiler works... yes 2023-06-22T10:55:47.239 INFO:teuthology.orchestra.run.smithi040.stdout:checking for C compiler default output file name... a.out 2023-06-22T10:55:47.289 INFO:teuthology.orchestra.run.smithi040.stdout:checking for suffix of executables... 2023-06-22T10:55:47.379 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether we are cross compiling... no 2023-06-22T10:55:47.417 INFO:teuthology.orchestra.run.smithi040.stdout:checking for suffix of object files... o 2023-06-22T10:55:47.451 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether we are using the GNU C compiler... yes 2023-06-22T10:55:47.485 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether gcc accepts -g... yes 2023-06-22T10:55:47.533 INFO:teuthology.orchestra.run.smithi040.stdout:checking for gcc option to accept ISO C89... none needed 2023-06-22T10:55:47.541 INFO:teuthology.orchestra.run.smithi040.stdout:checking for a sed that does not truncate output... /bin/sed 2023-06-22T10:55:47.546 INFO:teuthology.orchestra.run.smithi040.stdout:checking for grep that handles long lines and -e... /bin/grep 2023-06-22T10:55:47.549 INFO:teuthology.orchestra.run.smithi040.stdout:checking for egrep... /bin/grep -E 2023-06-22T10:55:47.551 INFO:teuthology.orchestra.run.smithi040.stdout:checking for fgrep... /bin/grep -F 2023-06-22T10:55:47.560 INFO:teuthology.orchestra.run.smithi040.stdout:checking for ld used by gcc... /bin/ld 2023-06-22T10:55:47.564 INFO:teuthology.orchestra.run.smithi040.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2023-06-22T10:55:47.578 INFO:teuthology.orchestra.run.smithi040.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2023-06-22T10:55:47.619 INFO:teuthology.orchestra.run.smithi040.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2023-06-22T10:55:47.619 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether ln -s works... yes 2023-06-22T10:55:47.629 INFO:teuthology.orchestra.run.smithi040.stdout:checking the maximum length of command line arguments... 1572864 2023-06-22T10:55:47.635 INFO:teuthology.orchestra.run.smithi040.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-06-22T10:55:47.635 INFO:teuthology.orchestra.run.smithi040.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-06-22T10:55:47.636 INFO:teuthology.orchestra.run.smithi040.stdout:checking for /bin/ld option to reload object files... -r 2023-06-22T10:55:47.636 INFO:teuthology.orchestra.run.smithi040.stdout:checking for objdump... objdump 2023-06-22T10:55:47.636 INFO:teuthology.orchestra.run.smithi040.stdout:checking how to recognize dependent libraries... pass_all 2023-06-22T10:55:47.637 INFO:teuthology.orchestra.run.smithi040.stdout:checking for dlltool... no 2023-06-22T10:55:47.637 INFO:teuthology.orchestra.run.smithi040.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-06-22T10:55:47.638 INFO:teuthology.orchestra.run.smithi040.stdout:checking for ar... ar 2023-06-22T10:55:47.694 INFO:teuthology.orchestra.run.smithi040.stdout:checking for archiver @FILE support... @ 2023-06-22T10:55:47.695 INFO:teuthology.orchestra.run.smithi040.stdout:checking for strip... strip 2023-06-22T10:55:47.695 INFO:teuthology.orchestra.run.smithi040.stdout:checking for ranlib... ranlib 2023-06-22T10:55:47.696 INFO:teuthology.orchestra.run.smithi040.stdout:checking for gawk... gawk 2023-06-22T10:55:47.806 INFO:teuthology.orchestra.run.smithi040.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2023-06-22T10:55:47.809 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sysroot... no 2023-06-22T10:55:47.816 INFO:teuthology.orchestra.run.smithi040.stdout:checking for a working dd... /bin/dd 2023-06-22T10:55:47.823 INFO:teuthology.orchestra.run.smithi040.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2023-06-22T10:55:47.852 INFO:teuthology.orchestra.run.smithi040.stdout:checking for mt... no 2023-06-22T10:55:47.857 INFO:teuthology.orchestra.run.smithi040.stdout:checking if : is a manifest tool... no 2023-06-22T10:55:47.920 INFO:teuthology.orchestra.run.smithi040.stdout:checking how to run the C preprocessor... gcc -E 2023-06-22T10:55:48.160 INFO:teuthology.orchestra.run.smithi040.stdout:checking for ANSI C header files... yes 2023-06-22T10:55:48.204 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/types.h... yes 2023-06-22T10:55:48.265 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/stat.h... yes 2023-06-22T10:55:48.317 INFO:teuthology.orchestra.run.smithi040.stdout:checking for stdlib.h... yes 2023-06-22T10:55:48.371 INFO:teuthology.orchestra.run.smithi040.stdout:checking for string.h... yes 2023-06-22T10:55:48.425 INFO:teuthology.orchestra.run.smithi040.stdout:checking for memory.h... yes 2023-06-22T10:55:48.478 INFO:teuthology.orchestra.run.smithi040.stdout:checking for strings.h... yes 2023-06-22T10:55:48.534 INFO:teuthology.orchestra.run.smithi040.stdout:checking for inttypes.h... yes 2023-06-22T10:55:48.588 INFO:teuthology.orchestra.run.smithi040.stdout:checking for stdint.h... yes 2023-06-22T10:55:48.647 INFO:teuthology.orchestra.run.smithi040.stdout:checking for unistd.h... yes 2023-06-22T10:55:48.710 INFO:teuthology.orchestra.run.smithi040.stdout:checking for dlfcn.h... yes 2023-06-22T10:55:48.718 INFO:teuthology.orchestra.run.smithi040.stdout:checking for objdir... .libs 2023-06-22T10:55:48.853 INFO:teuthology.orchestra.run.smithi040.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-06-22T10:55:48.854 INFO:teuthology.orchestra.run.smithi040.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-06-22T10:55:48.892 INFO:teuthology.orchestra.run.smithi040.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-06-22T10:55:48.931 INFO:teuthology.orchestra.run.smithi040.stdout:checking if gcc static flag -static works... no 2023-06-22T10:55:48.984 INFO:teuthology.orchestra.run.smithi040.stdout:checking if gcc supports -c -o file.o... yes 2023-06-22T10:55:48.984 INFO:teuthology.orchestra.run.smithi040.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-06-22T10:55:48.999 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-06-22T10:55:49.048 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether -lc should be explicitly linked in... no 2023-06-22T10:55:49.140 INFO:teuthology.orchestra.run.smithi040.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-06-22T10:55:49.140 INFO:teuthology.orchestra.run.smithi040.stdout:checking how to hardcode library paths into programs... immediate 2023-06-22T10:55:49.150 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether stripping libraries is possible... yes 2023-06-22T10:55:49.150 INFO:teuthology.orchestra.run.smithi040.stdout:checking if libtool supports shared libraries... yes 2023-06-22T10:55:49.150 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether to build shared libraries... yes 2023-06-22T10:55:49.151 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether to build static libraries... yes 2023-06-22T10:55:49.163 INFO:teuthology.orchestra.run.smithi040.stdout:checking for gcc... (cached) gcc 2023-06-22T10:55:49.202 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-06-22T10:55:49.202 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether gcc accepts -g... (cached) yes 2023-06-22T10:55:49.203 INFO:teuthology.orchestra.run.smithi040.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-06-22T10:55:49.203 INFO:teuthology.orchestra.run.smithi040.stdout:checking for gmake... /usr/bin/gmake 2023-06-22T10:55:49.203 INFO:teuthology.orchestra.run.smithi040.stderr:./configure: line 12070: test: $(SHELL): binary operator expected 2023-06-22T10:55:49.204 INFO:teuthology.orchestra.run.smithi040.stdout:checking for tar... /bin/tar 2023-06-22T10:55:49.204 INFO:teuthology.orchestra.run.smithi040.stdout:checking for gzip... /bin/gzip 2023-06-22T10:55:49.219 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether gcc -MM is supported... yes 2023-06-22T10:55:49.221 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sort... /bin/sort 2023-06-22T10:55:49.221 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether ln -s works... yes 2023-06-22T10:55:49.222 INFO:teuthology.orchestra.run.smithi040.stdout:checking for rpm... /bin/rpm 2023-06-22T10:55:49.229 INFO:teuthology.orchestra.run.smithi040.stdout:checking for rpmbuild... no 2023-06-22T10:55:49.284 INFO:teuthology.orchestra.run.smithi040.stdout:checking assert.h usability... yes 2023-06-22T10:55:49.300 INFO:teuthology.orchestra.run.smithi040.stdout:checking assert.h presence... yes 2023-06-22T10:55:49.300 INFO:teuthology.orchestra.run.smithi040.stdout:checking for assert.h... yes 2023-06-22T10:55:49.357 INFO:teuthology.orchestra.run.smithi040.stdout:checking bstring.h usability... no 2023-06-22T10:55:49.381 INFO:teuthology.orchestra.run.smithi040.stdout:checking bstring.h presence... no 2023-06-22T10:55:49.381 INFO:teuthology.orchestra.run.smithi040.stdout:checking for bstring.h... no 2023-06-22T10:55:49.431 INFO:teuthology.orchestra.run.smithi040.stdout:checking libgen.h usability... yes 2023-06-22T10:55:49.447 INFO:teuthology.orchestra.run.smithi040.stdout:checking libgen.h presence... yes 2023-06-22T10:55:49.447 INFO:teuthology.orchestra.run.smithi040.stdout:checking for libgen.h... yes 2023-06-22T10:55:49.506 INFO:teuthology.orchestra.run.smithi040.stdout:checking dirent.h usability... yes 2023-06-22T10:55:49.523 INFO:teuthology.orchestra.run.smithi040.stdout:checking dirent.h presence... yes 2023-06-22T10:55:49.523 INFO:teuthology.orchestra.run.smithi040.stdout:checking for dirent.h... yes 2023-06-22T10:55:49.597 INFO:teuthology.orchestra.run.smithi040.stdout:checking errno.h usability... yes 2023-06-22T10:55:49.614 INFO:teuthology.orchestra.run.smithi040.stdout:checking errno.h presence... yes 2023-06-22T10:55:49.614 INFO:teuthology.orchestra.run.smithi040.stdout:checking for errno.h... yes 2023-06-22T10:55:49.680 INFO:teuthology.orchestra.run.smithi040.stdout:checking malloc.h usability... yes 2023-06-22T10:55:49.698 INFO:teuthology.orchestra.run.smithi040.stdout:checking malloc.h presence... yes 2023-06-22T10:55:49.698 INFO:teuthology.orchestra.run.smithi040.stdout:checking for malloc.h... yes 2023-06-22T10:55:49.755 INFO:teuthology.orchestra.run.smithi040.stdout:checking uuid.h usability... no 2023-06-22T10:55:49.780 INFO:teuthology.orchestra.run.smithi040.stdout:checking uuid.h presence... no 2023-06-22T10:55:49.780 INFO:teuthology.orchestra.run.smithi040.stdout:checking for uuid.h... no 2023-06-22T10:55:49.840 INFO:teuthology.orchestra.run.smithi040.stdout:checking uuid/uuid.h usability... yes 2023-06-22T10:55:49.859 INFO:teuthology.orchestra.run.smithi040.stdout:checking uuid/uuid.h presence... yes 2023-06-22T10:55:49.860 INFO:teuthology.orchestra.run.smithi040.stdout:checking for uuid/uuid.h... yes 2023-06-22T10:55:49.916 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/uuid.h usability... no 2023-06-22T10:55:49.940 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/uuid.h presence... no 2023-06-22T10:55:49.941 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/uuid.h... no 2023-06-22T10:55:49.991 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/file.h usability... yes 2023-06-22T10:55:50.009 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/file.h presence... yes 2023-06-22T10:55:50.009 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/file.h... yes 2023-06-22T10:55:50.067 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/fcntl.h usability... yes 2023-06-22T10:55:50.085 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/fcntl.h presence... yes 2023-06-22T10:55:50.085 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/fcntl.h... yes 2023-06-22T10:55:50.142 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/syssgi.h usability... no 2023-06-22T10:55:50.167 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/syssgi.h presence... no 2023-06-22T10:55:50.167 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/syssgi.h... no 2023-06-22T10:55:50.233 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/param.h usability... yes 2023-06-22T10:55:50.254 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/param.h presence... yes 2023-06-22T10:55:50.254 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/param.h... yes 2023-06-22T10:55:50.268 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/stat.h... (cached) yes 2023-06-22T10:55:50.329 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/statvfs.h usability... yes 2023-06-22T10:55:50.345 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/statvfs.h presence... yes 2023-06-22T10:55:50.346 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/statvfs.h... yes 2023-06-22T10:55:50.404 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/time.h usability... yes 2023-06-22T10:55:50.421 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/time.h presence... yes 2023-06-22T10:55:50.421 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/time.h... yes 2023-06-22T10:55:50.490 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/ioctl.h usability... yes 2023-06-22T10:55:50.507 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/ioctl.h presence... yes 2023-06-22T10:55:50.507 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/ioctl.h... yes 2023-06-22T10:55:50.568 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/wait.h usability... yes 2023-06-22T10:55:50.588 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/wait.h presence... yes 2023-06-22T10:55:50.588 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/wait.h... yes 2023-06-22T10:55:50.602 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/types.h... (cached) yes 2023-06-22T10:55:50.616 INFO:teuthology.orchestra.run.smithi040.stdout:checking for strings.h... (cached) yes 2023-06-22T10:55:50.674 INFO:teuthology.orchestra.run.smithi040.stdout:checking err.h usability... yes 2023-06-22T10:55:50.690 INFO:teuthology.orchestra.run.smithi040.stdout:checking err.h presence... yes 2023-06-22T10:55:50.690 INFO:teuthology.orchestra.run.smithi040.stdout:checking for err.h... yes 2023-06-22T10:55:50.748 INFO:teuthology.orchestra.run.smithi040.stdout:checking linux/falloc.h usability... yes 2023-06-22T10:55:50.763 INFO:teuthology.orchestra.run.smithi040.stdout:checking linux/falloc.h presence... yes 2023-06-22T10:55:50.764 INFO:teuthology.orchestra.run.smithi040.stdout:checking for linux/falloc.h... yes 2023-06-22T10:55:50.820 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-06-22T10:55:50.845 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-06-22T10:55:50.846 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/fs/xfs_fsops.h... no 2023-06-22T10:55:50.894 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/fs/xfs_itable.h usability... no 2023-06-22T10:55:50.918 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/fs/xfs_itable.h presence... no 2023-06-22T10:55:50.919 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/fs/xfs_itable.h... no 2023-06-22T10:55:50.967 INFO:teuthology.orchestra.run.smithi040.stdout:checking xfs/platform_defs.h usability... no 2023-06-22T10:55:50.991 INFO:teuthology.orchestra.run.smithi040.stdout:checking xfs/platform_defs.h presence... no 2023-06-22T10:55:50.991 INFO:teuthology.orchestra.run.smithi040.stdout:checking for xfs/platform_defs.h... no 2023-06-22T10:55:51.040 INFO:teuthology.orchestra.run.smithi040.stdout:checking btrfs/ioctl.h usability... no 2023-06-22T10:55:51.064 INFO:teuthology.orchestra.run.smithi040.stdout:checking btrfs/ioctl.h presence... no 2023-06-22T10:55:51.065 INFO:teuthology.orchestra.run.smithi040.stdout:checking for btrfs/ioctl.h... no 2023-06-22T10:55:51.113 INFO:teuthology.orchestra.run.smithi040.stdout:checking cifs/ioctl.h usability... no 2023-06-22T10:55:51.137 INFO:teuthology.orchestra.run.smithi040.stdout:checking cifs/ioctl.h presence... no 2023-06-22T10:55:51.137 INFO:teuthology.orchestra.run.smithi040.stdout:checking for cifs/ioctl.h... no 2023-06-22T10:55:51.188 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/mman.h usability... yes 2023-06-22T10:55:51.205 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/mman.h presence... yes 2023-06-22T10:55:51.206 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/mman.h... yes 2023-06-22T10:55:51.243 INFO:teuthology.orchestra.run.smithi040.stdout:checking for xfs/xfs_log_format.h... no 2023-06-22T10:55:51.311 INFO:teuthology.orchestra.run.smithi040.stdout:checking for uuid_compare... no 2023-06-22T10:55:51.368 INFO:teuthology.orchestra.run.smithi040.stdout:checking for uuid_compare in -luuid... yes 2023-06-22T10:55:51.461 INFO:teuthology.orchestra.run.smithi040.stdout:checking for xfs/xfs.h... yes 2023-06-22T10:55:51.494 INFO:teuthology.orchestra.run.smithi040.stdout:checking for xfs/libxfs.h... no 2023-06-22T10:55:51.532 INFO:teuthology.orchestra.run.smithi040.stdout:checking whether xlog_assign_lsn is declared... no 2023-06-22T10:55:51.585 INFO:teuthology.orchestra.run.smithi040.stdout:checking for xfs/xqm.h... yes 2023-06-22T10:55:51.666 INFO:teuthology.orchestra.run.smithi040.stdout:checking xfsctl from xfs/xfs.h... ok 2023-06-22T10:55:51.711 INFO:teuthology.orchestra.run.smithi040.stdout:checking xfs/handle.h usability... yes 2023-06-22T10:55:51.727 INFO:teuthology.orchestra.run.smithi040.stdout:checking xfs/handle.h presence... yes 2023-06-22T10:55:51.727 INFO:teuthology.orchestra.run.smithi040.stdout:checking for xfs/handle.h... yes 2023-06-22T10:55:51.786 INFO:teuthology.orchestra.run.smithi040.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-06-22T10:55:51.840 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/acl.h usability... yes 2023-06-22T10:55:51.858 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/acl.h presence... yes 2023-06-22T10:55:51.859 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/acl.h... yes 2023-06-22T10:55:51.916 INFO:teuthology.orchestra.run.smithi040.stdout:checking acl/libacl.h usability... yes 2023-06-22T10:55:51.935 INFO:teuthology.orchestra.run.smithi040.stdout:checking acl/libacl.h presence... yes 2023-06-22T10:55:51.935 INFO:teuthology.orchestra.run.smithi040.stdout:checking for acl/libacl.h... yes 2023-06-22T10:55:51.996 INFO:teuthology.orchestra.run.smithi040.stdout:checking for acl_init in -lacl... yes 2023-06-22T10:55:52.041 INFO:teuthology.orchestra.run.smithi040.stdout:checking gdbm-ndbm.h usability... no 2023-06-22T10:55:52.066 INFO:teuthology.orchestra.run.smithi040.stdout:checking gdbm-ndbm.h presence... no 2023-06-22T10:55:52.066 INFO:teuthology.orchestra.run.smithi040.stdout:checking for gdbm-ndbm.h... no 2023-06-22T10:55:52.109 INFO:teuthology.orchestra.run.smithi040.stdout:checking gdbm/ndbm.h usability... no 2023-06-22T10:55:52.133 INFO:teuthology.orchestra.run.smithi040.stdout:checking gdbm/ndbm.h presence... no 2023-06-22T10:55:52.134 INFO:teuthology.orchestra.run.smithi040.stdout:checking for gdbm/ndbm.h... no 2023-06-22T10:55:52.176 INFO:teuthology.orchestra.run.smithi040.stdout:checking ndbm.h usability... no 2023-06-22T10:55:52.201 INFO:teuthology.orchestra.run.smithi040.stdout:checking ndbm.h presence... no 2023-06-22T10:55:52.201 INFO:teuthology.orchestra.run.smithi040.stdout:checking for ndbm.h... no 2023-06-22T10:55:52.249 INFO:teuthology.orchestra.run.smithi040.stdout:checking libaio.h usability... yes 2023-06-22T10:55:52.271 INFO:teuthology.orchestra.run.smithi040.stdout:checking libaio.h presence... yes 2023-06-22T10:55:52.271 INFO:teuthology.orchestra.run.smithi040.stdout:checking for libaio.h... yes 2023-06-22T10:55:52.317 INFO:teuthology.orchestra.run.smithi040.stdout:checking liburing.h usability... no 2023-06-22T10:55:52.342 INFO:teuthology.orchestra.run.smithi040.stdout:checking liburing.h presence... no 2023-06-22T10:55:52.342 INFO:teuthology.orchestra.run.smithi040.stdout:checking for liburing.h... no 2023-06-22T10:55:52.384 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/capability.h usability... no 2023-06-22T10:55:52.409 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/capability.h presence... no 2023-06-22T10:55:52.409 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/capability.h... no 2023-06-22T10:55:52.453 INFO:teuthology.orchestra.run.smithi040.stdout:checking linux/fiemap.h usability... yes 2023-06-22T10:55:52.469 INFO:teuthology.orchestra.run.smithi040.stdout:checking linux/fiemap.h presence... yes 2023-06-22T10:55:52.470 INFO:teuthology.orchestra.run.smithi040.stdout:checking for linux/fiemap.h... yes 2023-06-22T10:55:52.531 INFO:teuthology.orchestra.run.smithi040.stdout:checking for fallocate... yes 2023-06-22T10:55:52.592 INFO:teuthology.orchestra.run.smithi040.stdout:checking for open_by_handle_at... yes 2023-06-22T10:55:52.639 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/prctl.h usability... yes 2023-06-22T10:55:52.655 INFO:teuthology.orchestra.run.smithi040.stdout:checking sys/prctl.h presence... yes 2023-06-22T10:55:52.656 INFO:teuthology.orchestra.run.smithi040.stdout:checking for sys/prctl.h... yes 2023-06-22T10:55:52.703 INFO:teuthology.orchestra.run.smithi040.stdout:checking linux/fs.h usability... yes 2023-06-22T10:55:52.720 INFO:teuthology.orchestra.run.smithi040.stdout:checking linux/fs.h presence... yes 2023-06-22T10:55:52.720 INFO:teuthology.orchestra.run.smithi040.stdout:checking for linux/fs.h... yes 2023-06-22T10:55:52.764 INFO:teuthology.orchestra.run.smithi040.stdout:checking btrfsutil.h usability... no 2023-06-22T10:55:52.788 INFO:teuthology.orchestra.run.smithi040.stdout:checking btrfsutil.h presence... no 2023-06-22T10:55:52.788 INFO:teuthology.orchestra.run.smithi040.stdout:checking for btrfsutil.h... no 2023-06-22T10:55:52.851 INFO:teuthology.orchestra.run.smithi040.stdout:checking for copy_file_range... yes 2023-06-22T10:55:52.915 INFO:teuthology.orchestra.run.smithi040.stdout:checking for SEEK_DATA... yes 2023-06-22T10:55:52.996 INFO:teuthology.orchestra.run.smithi040.stdout:checking for BMV_OF_SHARED... yes 2023-06-22T10:55:53.061 INFO:teuthology.orchestra.run.smithi040.stdout:checking for nftw... yes 2023-06-22T10:55:53.123 INFO:teuthology.orchestra.run.smithi040.stdout:checking for RLIMIT_NOFILE... yes 2023-06-22T10:55:53.162 INFO:teuthology.orchestra.run.smithi040.stdout:checking for FIEXCHANGE_RANGE... no 2023-06-22T10:55:53.223 INFO:teuthology.orchestra.run.smithi040.stdout:checking for renameat2... yes 2023-06-22T10:55:53.284 INFO:teuthology.orchestra.run.smithi040.stdout:checking for reallocarray... yes 2023-06-22T10:55:53.317 INFO:teuthology.orchestra.run.smithi040.stdout:checking for struct mount_attr... no 2023-06-22T10:55:53.396 INFO:teuthology.orchestra.run.smithi040.stdout:checking for struct btrfs_qgroup_limit... yes 2023-06-22T10:55:53.470 INFO:teuthology.orchestra.run.smithi040.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-06-22T10:55:53.544 INFO:teuthology.orchestra.run.smithi040.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-06-22T10:55:53.617 INFO:teuthology.orchestra.run.smithi040.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-06-22T10:55:53.692 INFO:teuthology.orchestra.run.smithi040.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-06-22T10:55:53.766 INFO:teuthology.orchestra.run.smithi040.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-06-22T10:55:53.840 INFO:teuthology.orchestra.run.smithi040.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-06-22T10:55:53.894 INFO:teuthology.orchestra.run.smithi040.stdout:checking linux/btrfs.h usability... yes 2023-06-22T10:55:53.911 INFO:teuthology.orchestra.run.smithi040.stdout:checking linux/btrfs.h presence... yes 2023-06-22T10:55:53.911 INFO:teuthology.orchestra.run.smithi040.stdout:checking for linux/btrfs.h... yes 2023-06-22T10:55:53.973 INFO:teuthology.orchestra.run.smithi040.stdout:checking linux/btrfs_tree.h usability... yes 2023-06-22T10:55:53.990 INFO:teuthology.orchestra.run.smithi040.stdout:checking linux/btrfs_tree.h presence... yes 2023-06-22T10:55:53.991 INFO:teuthology.orchestra.run.smithi040.stdout:checking for linux/btrfs_tree.h... yes 2023-06-22T10:55:54.063 INFO:teuthology.orchestra.run.smithi040.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... no 2023-06-22T10:55:54.092 INFO:teuthology.orchestra.run.smithi040.stdout:configure: creating ./config.status 2023-06-22T10:55:54.997 INFO:teuthology.orchestra.run.smithi040.stdout:config.status: creating include/builddefs 2023-06-22T10:55:55.028 INFO:teuthology.orchestra.run.smithi040.stdout:config.status: creating include/config.h 2023-06-22T10:55:55.051 INFO:teuthology.orchestra.run.smithi040.stdout:config.status: executing libtool commands 2023-06-22T10:55:55.102 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T10:55:55.107 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T10:55:55.134 INFO:teuthology.orchestra.run.smithi040.stdout:Building include 2023-06-22T10:55:55.142 INFO:teuthology.orchestra.run.smithi040.stdout:Building lib 2023-06-22T10:55:55.150 INFO:teuthology.orchestra.run.smithi040.stdout: [LTDEP] 2023-06-22T10:55:55.481 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] dataascii.lo 2023-06-22T10:55:55.685 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] databin.lo 2023-06-22T10:55:55.924 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] datapid.lo 2023-06-22T10:55:56.114 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] file_lock.lo 2023-06-22T10:55:56.355 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] forker.lo 2023-06-22T10:55:56.577 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] pattern.lo 2023-06-22T10:55:56.780 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] open_flags.lo 2023-06-22T10:55:57.013 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] random_range.lo 2023-06-22T10:55:57.328 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] string_to_tokens.lo 2023-06-22T10:55:57.516 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] str_to_bytes.lo 2023-06-22T10:55:57.735 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] tlibio.lo 2023-06-22T10:55:58.064 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] write_log.lo 2023-06-22T10:55:58.397 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] random.lo 2023-06-22T10:55:58.595 INFO:teuthology.orchestra.run.smithi040.stdout: [LD] 2023-06-22T10:55:58.734 INFO:teuthology.orchestra.run.smithi040.stdout:Building ltp 2023-06-22T10:55:58.740 INFO:teuthology.orchestra.run.smithi040.stdout: [DEP] 2023-06-22T10:55:58.969 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] doio 2023-06-22T10:55:59.737 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fsstress 2023-06-22T10:56:01.175 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fsx 2023-06-22T10:56:02.156 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] growfiles 2023-06-22T10:56:02.775 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] iogen 2023-06-22T10:56:03.241 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-stress 2023-06-22T10:56:03.770 INFO:teuthology.orchestra.run.smithi040.stdout:Building src 2023-06-22T10:56:03.779 INFO:teuthology.orchestra.run.smithi040.stdout: [DEP] 2023-06-22T10:56:06.296 INFO:teuthology.orchestra.run.smithi040.stdout: [DEP] 2023-06-22T10:56:06.347 INFO:teuthology.orchestra.run.smithi040.stdout: [DEP] 2023-06-22T10:56:06.363 INFO:teuthology.orchestra.run.smithi040.stdout: [DEP] 2023-06-22T10:56:06.710 INFO:teuthology.orchestra.run.smithi040.stdout: [DEP] 2023-06-22T10:56:06.751 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] dirstress 2023-06-22T10:56:07.097 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fill 2023-06-22T10:56:07.353 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fill2 2023-06-22T10:56:07.686 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] getpagesize 2023-06-22T10:56:07.922 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] holes 2023-06-22T10:56:08.223 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] lstat64 2023-06-22T10:56:08.508 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] nametest 2023-06-22T10:56:08.858 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] permname 2023-06-22T10:56:09.159 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] randholes 2023-06-22T10:56:09.515 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] runas 2023-06-22T10:56:09.795 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] truncfile 2023-06-22T10:56:10.081 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] usemem 2023-06-22T10:56:10.335 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] mmapcat 2023-06-22T10:56:10.585 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] append_reader 2023-06-22T10:56:10.843 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] append_writer 2023-06-22T10:56:11.096 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] dirperf 2023-06-22T10:56:11.431 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] metaperf 2023-06-22T10:56:11.791 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] devzero 2023-06-22T10:56:12.073 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] feature 2023-06-22T10:56:12.396 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] alloc 2023-06-22T10:56:12.714 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fault 2023-06-22T10:56:12.987 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fstest 2023-06-22T10:56:13.332 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_access_root 2023-06-22T10:56:13.588 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] godown 2023-06-22T10:56:13.863 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] resvtest 2023-06-22T10:56:14.155 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] writemod 2023-06-22T10:56:14.403 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] writev_on_pagefault 2023-06-22T10:56:14.665 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] makeextents 2023-06-22T10:56:14.952 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] itrash 2023-06-22T10:56:15.209 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] rename 2023-06-22T10:56:15.451 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] multi_open_unlink 2023-06-22T10:56:15.719 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] unwritten_sync 2023-06-22T10:56:16.007 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] genhashnames 2023-06-22T10:56:16.297 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_holes 2023-06-22T10:56:16.546 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_mmap_writev 2023-06-22T10:56:16.796 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_truncate_cmtime 2023-06-22T10:56:17.057 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] dirhash_collide 2023-06-22T10:56:17.343 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_rename_overwrite 2023-06-22T10:56:17.585 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] holetest 2023-06-22T10:56:17.907 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_truncate_self 2023-06-22T10:56:18.148 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] af_unix 2023-06-22T10:56:18.404 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_mmap_stale_pmd 2023-06-22T10:56:18.660 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_mmap_cow_race 2023-06-22T10:56:18.928 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_mmap_fallocate 2023-06-22T10:56:19.183 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fsync-err 2023-06-22T10:56:19.471 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_mmap_write_ro 2023-06-22T10:56:19.724 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_ext4_dax_journal_corruption 2023-06-22T10:56:19.987 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_ext4_dax_inline_corruption 2023-06-22T10:56:20.246 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_ofd_locks 2023-06-22T10:56:20.552 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_mmap_collision 2023-06-22T10:56:20.855 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] mmap-write-concurrent 2023-06-22T10:56:21.127 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_get_file_time 2023-06-22T10:56:21.377 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_create_short_dirs 2023-06-22T10:56:21.645 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_create_long_dirs 2023-06-22T10:56:21.913 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_enospc 2023-06-22T10:56:22.202 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_mmap_writev_overlap 2023-06-22T10:56:22.473 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] checkpoint_journal 2023-06-22T10:56:22.730 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] mmap-rw-fault 2023-06-22T10:56:23.013 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] allocstale 2023-06-22T10:56:23.288 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_mmap_cow_memory_failure 2023-06-22T10:56:23.564 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fake-dump-rootino 2023-06-22T10:56:23.817 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] dio-buf-fault 2023-06-22T10:56:24.074 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] xfsctl 2023-06-22T10:56:24.368 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] bstat 2023-06-22T10:56:24.679 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_mtab 2023-06-22T10:56:24.968 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] getdevicesize 2023-06-22T10:56:25.211 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] preallo_rw_pattern_reader 2023-06-22T10:56:25.443 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T10:56:25.449 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T10:56:25.480 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] preallo_rw_pattern_writer 2023-06-22T10:56:25.749 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] ftrunc 2023-06-22T10:56:26.000 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] trunc 2023-06-22T10:56:26.269 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fs_perms 2023-06-22T10:56:26.536 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] testx 2023-06-22T10:56:26.766 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] looptest 2023-06-22T10:56:27.062 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] locktest 2023-06-22T10:56:27.477 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] unwritten_mmap 2023-06-22T10:56:27.747 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] bulkstat_unlink_test 2023-06-22T10:56:28.057 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] deduperace 2023-06-22T10:56:28.355 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] bulkstat_unlink_test_modified 2023-06-22T10:56:28.659 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_dir_offset 2023-06-22T10:56:28.911 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_futimens 2023-06-22T10:56:29.153 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_immutable 2023-06-22T10:56:29.870 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] stale_handle 2023-06-22T10:56:30.145 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] pwrite_mmap_blocked 2023-06-22T10:56:30.402 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_dir_offset2 2023-06-22T10:56:30.697 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] seek_sanity_test 2023-06-22T10:56:31.223 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] seek_copy_test 2023-06-22T10:56:31.503 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_readdir_1 2023-06-22T10:56:31.754 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_readdir_2 2023-06-22T10:56:32.008 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fsync-tester 2023-06-22T10:56:32.361 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] nsexec 2023-06-22T10:56:32.640 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] cloner 2023-06-22T10:56:32.923 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] renameat2 2023-06-22T10:56:33.195 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_getcwd 2023-06-22T10:56:33.456 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] e4compact 2023-06-22T10:56:33.763 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] test-nextquota 2023-06-22T10:56:34.041 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] punch-alternating 2023-06-22T10:56:34.320 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] attr-list-by-handle-cursor-test 2023-06-22T10:56:34.594 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] listxattr 2023-06-22T10:56:34.842 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] dio-interleaved 2023-06-22T10:56:35.105 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_dir_type 2023-06-22T10:56:35.368 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] dio-invalidate-cache 2023-06-22T10:56:35.676 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] stat_test 2023-06-22T10:56:36.080 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_encrypted_d_revalidate 2023-06-22T10:56:36.350 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] attr_replace_test 2023-06-22T10:56:36.618 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] swapon 2023-06-22T10:56:36.886 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] mkswap 2023-06-22T10:56:37.141 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_attr_corruption 2023-06-22T10:56:37.396 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_open_tmpfiles 2023-06-22T10:56:37.683 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fscrypt-crypt-util 2023-06-22T10:56:38.428 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] bulkstat_null_ocount 2023-06-22T10:56:38.695 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] splice-test 2023-06-22T10:56:38.980 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] chprojid_fail 2023-06-22T10:56:39.248 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] detached_mounts_propagation 2023-06-22T10:56:39.541 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] ext4_resize 2023-06-22T10:56:39.791 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_readdir_3 2023-06-22T10:56:40.089 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] splice2pipe 2023-06-22T10:56:40.357 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] uuid_ioctl 2023-06-22T10:56:40.615 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fiemap-tester 2023-06-22T10:56:40.987 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_stripealign 2023-06-22T10:56:41.245 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] open_by_handle 2023-06-22T10:56:41.604 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] t_mmap_dio 2023-06-22T10:56:41.872 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] xfsfind 2023-06-22T10:56:42.173 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] fssum 2023-06-22T10:56:42.717 INFO:teuthology.orchestra.run.smithi040.stdout:Building log-writes 2023-06-22T10:56:42.727 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] replay-log 2023-06-22T10:56:43.150 INFO:teuthology.orchestra.run.smithi040.stdout:Building perf 2023-06-22T10:56:43.158 INFO:teuthology.orchestra.run.smithi040.stdout:Building aio-dio-regress 2023-06-22T10:56:43.171 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-dio-append-write-fallocate-race 2023-06-22T10:56:43.454 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-dio-fcntl-race 2023-06-22T10:56:43.724 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-dio-subblock-eof-read 2023-06-22T10:56:43.976 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-dio-append-write-read-race 2023-06-22T10:56:44.262 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-dio-invalidate-readahead 2023-06-22T10:56:44.535 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-dio-hole-filling-race 2023-06-22T10:56:44.792 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-06-22T10:56:45.033 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-last-ref-held-by-io 2023-06-22T10:56:45.316 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-dio-cycle-write 2023-06-22T10:56:45.609 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-dio-extend-stat 2023-06-22T10:56:45.883 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-06-22T10:56:46.124 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-dio-invalidate-failure 2023-06-22T10:56:46.393 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aiodio_sparse2 2023-06-22T10:56:46.715 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aiocp 2023-06-22T10:56:47.048 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-dio-cow-race 2023-06-22T10:56:47.312 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-dio-write-verify 2023-06-22T10:56:47.611 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] aio-dio-eof-race 2023-06-22T10:56:47.905 INFO:teuthology.orchestra.run.smithi040.stdout:Building vfs 2023-06-22T10:56:47.915 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] vfstest 2023-06-22T10:56:49.994 INFO:teuthology.orchestra.run.smithi040.stdout: [CC] mount-idmapped 2023-06-22T10:56:50.485 INFO:teuthology.orchestra.run.smithi040.stdout:Building m4 2023-06-22T10:56:50.492 INFO:teuthology.orchestra.run.smithi040.stdout:Building common 2023-06-22T10:56:50.500 INFO:teuthology.orchestra.run.smithi040.stdout:Building tests 2023-06-22T10:56:50.510 INFO:teuthology.orchestra.run.smithi040.stdout:Building perf 2023-06-22T10:56:50.520 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.a4ZvvHFGMPxfstests-dev/tests/perf/group.list 2023-06-22T10:56:50.550 INFO:teuthology.orchestra.run.smithi040.stdout:Building ext4 2023-06-22T10:56:50.560 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.a4ZvvHFGMPxfstests-dev/tests/ext4/group.list 2023-06-22T10:56:50.655 INFO:teuthology.orchestra.run.smithi040.stdout:Building ocfs2 2023-06-22T10:56:50.665 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.a4ZvvHFGMPxfstests-dev/tests/ocfs2/group.list 2023-06-22T10:56:50.700 INFO:teuthology.orchestra.run.smithi040.stdout:Building overlay 2023-06-22T10:56:50.710 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.a4ZvvHFGMPxfstests-dev/tests/overlay/group.list 2023-06-22T10:56:50.806 INFO:teuthology.orchestra.run.smithi040.stdout:Building cifs 2023-06-22T10:56:50.816 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.a4ZvvHFGMPxfstests-dev/tests/cifs/group.list 2023-06-22T10:56:50.849 INFO:teuthology.orchestra.run.smithi040.stdout:Building generic 2023-06-22T10:56:50.861 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.a4ZvvHFGMPxfstests-dev/tests/generic/group.list 2023-06-22T10:56:51.106 INFO:teuthology.orchestra.run.smithi040.stdout:Building shared 2023-06-22T10:56:51.116 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.a4ZvvHFGMPxfstests-dev/tests/shared/group.list 2023-06-22T10:56:51.162 INFO:teuthology.orchestra.run.smithi040.stdout:Building nfs 2023-06-22T10:56:51.173 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.a4ZvvHFGMPxfstests-dev/tests/nfs/group.list 2023-06-22T10:56:51.210 INFO:teuthology.orchestra.run.smithi040.stdout:Building f2fs 2023-06-22T10:56:51.220 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.a4ZvvHFGMPxfstests-dev/tests/f2fs/group.list 2023-06-22T10:56:51.264 INFO:teuthology.orchestra.run.smithi040.stdout:Building udf 2023-06-22T10:56:51.274 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.a4ZvvHFGMPxfstests-dev/tests/udf/group.list 2023-06-22T10:56:51.303 INFO:teuthology.orchestra.run.smithi040.stdout:Building ceph 2023-06-22T10:56:51.313 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.a4ZvvHFGMPxfstests-dev/tests/ceph/group.list 2023-06-22T10:56:51.350 INFO:teuthology.orchestra.run.smithi040.stdout:Building xfs 2023-06-22T10:56:51.362 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.a4ZvvHFGMPxfstests-dev/tests/xfs/group.list 2023-06-22T10:56:51.612 INFO:teuthology.orchestra.run.smithi040.stdout:Building btrfs 2023-06-22T10:56:51.623 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.a4ZvvHFGMPxfstests-dev/tests/btrfs/group.list 2023-06-22T10:56:51.769 INFO:teuthology.orchestra.run.smithi040.stdout:Building tmpfs 2023-06-22T10:56:51.779 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.a4ZvvHFGMPxfstests-dev/tests/tmpfs/group.list 2023-06-22T10:56:51.824 INFO:teuthology.orchestra.run.smithi040.stdout:Building selftest 2023-06-22T10:56:51.825 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.a4ZvvHFGMPxfstests-dev/tests/selftest/group.list 2023-06-22T10:56:51.859 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo make install) 2023-06-22T10:56:51.953 INFO:teuthology.orchestra.run.smithi040.stdout:Building include 2023-06-22T10:56:51.960 INFO:teuthology.orchestra.run.smithi040.stdout:Building lib 2023-06-22T10:56:51.968 INFO:teuthology.orchestra.run.smithi040.stdout:Building ltp 2023-06-22T10:56:51.976 INFO:teuthology.orchestra.run.smithi040.stdout:Building src 2023-06-22T10:56:52.038 INFO:teuthology.orchestra.run.smithi040.stdout:Building log-writes 2023-06-22T10:56:52.046 INFO:teuthology.orchestra.run.smithi040.stdout:Building perf 2023-06-22T10:56:52.053 INFO:teuthology.orchestra.run.smithi040.stdout:Building aio-dio-regress 2023-06-22T10:56:52.061 INFO:teuthology.orchestra.run.smithi040.stdout:Building vfs 2023-06-22T10:56:52.069 INFO:teuthology.orchestra.run.smithi040.stdout:Building m4 2023-06-22T10:56:52.076 INFO:teuthology.orchestra.run.smithi040.stdout:Building common 2023-06-22T10:56:52.084 INFO:teuthology.orchestra.run.smithi040.stdout:Building tests 2023-06-22T10:56:52.094 INFO:teuthology.orchestra.run.smithi040.stdout:Building perf 2023-06-22T10:56:52.104 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.a4ZvvHFGMPxfstests-dev/tests/perf/group.list 2023-06-22T10:56:52.134 INFO:teuthology.orchestra.run.smithi040.stdout:Building ext4 2023-06-22T10:56:52.144 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.a4ZvvHFGMPxfstests-dev/tests/ext4/group.list 2023-06-22T10:56:52.239 INFO:teuthology.orchestra.run.smithi040.stdout:Building ocfs2 2023-06-22T10:56:52.249 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.a4ZvvHFGMPxfstests-dev/tests/ocfs2/group.list 2023-06-22T10:56:52.283 INFO:teuthology.orchestra.run.smithi040.stdout:Building overlay 2023-06-22T10:56:52.293 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.a4ZvvHFGMPxfstests-dev/tests/overlay/group.list 2023-06-22T10:56:52.389 INFO:teuthology.orchestra.run.smithi040.stdout:Building cifs 2023-06-22T10:56:52.399 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.a4ZvvHFGMPxfstests-dev/tests/cifs/group.list 2023-06-22T10:56:52.431 INFO:teuthology.orchestra.run.smithi040.stdout:Building generic 2023-06-22T10:56:52.443 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.a4ZvvHFGMPxfstests-dev/tests/generic/group.list 2023-06-22T10:56:52.684 INFO:teuthology.orchestra.run.smithi040.stdout:Building shared 2023-06-22T10:56:52.694 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.a4ZvvHFGMPxfstests-dev/tests/shared/group.list 2023-06-22T10:56:52.738 INFO:teuthology.orchestra.run.smithi040.stdout:Building nfs 2023-06-22T10:56:52.748 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.a4ZvvHFGMPxfstests-dev/tests/nfs/group.list 2023-06-22T10:56:52.786 INFO:teuthology.orchestra.run.smithi040.stdout:Building f2fs 2023-06-22T10:56:52.795 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.a4ZvvHFGMPxfstests-dev/tests/f2fs/group.list 2023-06-22T10:56:52.840 INFO:teuthology.orchestra.run.smithi040.stdout:Building udf 2023-06-22T10:56:52.850 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.a4ZvvHFGMPxfstests-dev/tests/udf/group.list 2023-06-22T10:56:52.879 INFO:teuthology.orchestra.run.smithi040.stdout:Building ceph 2023-06-22T10:56:52.889 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.a4ZvvHFGMPxfstests-dev/tests/ceph/group.list 2023-06-22T10:56:52.926 INFO:teuthology.orchestra.run.smithi040.stdout:Building xfs 2023-06-22T10:56:52.938 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.a4ZvvHFGMPxfstests-dev/tests/xfs/group.list 2023-06-22T10:56:53.182 INFO:teuthology.orchestra.run.smithi040.stdout:Building btrfs 2023-06-22T10:56:53.193 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.a4ZvvHFGMPxfstests-dev/tests/btrfs/group.list 2023-06-22T10:56:53.338 INFO:teuthology.orchestra.run.smithi040.stdout:Building tmpfs 2023-06-22T10:56:53.348 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.a4ZvvHFGMPxfstests-dev/tests/tmpfs/group.list 2023-06-22T10:56:53.383 INFO:teuthology.orchestra.run.smithi040.stdout:Building selftest 2023-06-22T10:56:53.392 INFO:teuthology.orchestra.run.smithi040.stdout: [GROUP] /tmp/tmp.a4ZvvHFGMPxfstests-dev/tests/selftest/group.list 2023-06-22T10:56:53.423 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-06-22T10:56:53.426 INFO:teuthology.orchestra.run.smithi040.stdout:gmake[1]: Nothing to be done for 'install'. 2023-06-22T10:56:53.426 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-06-22T10:56:53.429 INFO:teuthology.orchestra.run.smithi040.stdout:gmake[1]: Nothing to be done for 'install'. 2023-06-22T10:56:53.430 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-06-22T10:56:53.433 INFO:teuthology.orchestra.run.smithi040.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-06-22T10:56:53.457 INFO:teuthology.orchestra.run.smithi040.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-06-22T10:56:53.633 INFO:teuthology.orchestra.run.smithi040.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-06-22T10:56:53.657 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-06-22T10:56:53.688 INFO:teuthology.orchestra.run.smithi040.stdout:Building log-writes 2023-06-22T10:56:53.695 INFO:teuthology.orchestra.run.smithi040.stdout:Building perf 2023-06-22T10:56:53.703 INFO:teuthology.orchestra.run.smithi040.stdout:Building aio-dio-regress 2023-06-22T10:56:53.711 INFO:teuthology.orchestra.run.smithi040.stdout:Building vfs 2023-06-22T10:56:53.716 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake -C log-writes install 2023-06-22T10:56:53.719 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-06-22T10:56:53.743 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-06-22T10:56:53.766 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake -C perf install 2023-06-22T10:56:53.769 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-06-22T10:56:53.792 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 ResultData.py fio-insert-and-compare.py FioResultDecoder.py FioCompare.py generate-schema.py fio-results.sql /var/lib/xfstests/src/perf 2023-06-22T10:56:53.853 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-06-22T10:56:53.856 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-06-22T10:56:53.879 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 aio-dio-fcntl-race aio-dio-subblock-eof-read aio-dio-append-write-read-race aio-dio-invalidate-readahead aio-dio-hole-filling-race aio-dio-append-write-fallocate-race aio-free-ring-with-bogus-nr-pages aio-last-ref-held-by-io aio-dio-cycle-write aio-dio-extend-stat aio-io-setup-with-nonwritable-context-pointer aio-dio-invalidate-failure aiodio_sparse2 aiocp aio-dio-cow-race aio-dio-write-verify aio-dio-eof-race /var/lib/xfstests/src/aio-dio-regress 2023-06-22T10:56:54.022 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake -C vfs install 2023-06-22T10:56:54.024 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-06-22T10:56:54.048 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-06-22T10:56:54.080 INFO:teuthology.orchestra.run.smithi040.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-06-22T10:56:54.103 INFO:teuthology.orchestra.run.smithi040.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio xfsfind fssum /var/lib/xfstests/src 2023-06-22T10:56:55.567 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T10:56:55.571 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T10:56:57.097 INFO:teuthology.orchestra.run.smithi040.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py /var/lib/xfstests/src 2023-06-22T10:56:57.318 INFO:teuthology.orchestra.run.smithi040.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-06-22T10:56:57.374 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-06-22T10:56:57.376 INFO:teuthology.orchestra.run.smithi040.stdout:gmake[1]: Nothing to be done for 'install'. 2023-06-22T10:56:57.377 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-06-22T10:56:57.379 INFO:teuthology.orchestra.run.smithi040.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-06-22T10:56:57.403 INFO:teuthology.orchestra.run.smithi040.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-06-22T10:56:57.758 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-06-22T10:56:57.761 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.a4ZvvHFGMPxfstests-dev/tests/btrfs/ install 2023-06-22T10:56:57.765 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-06-22T10:56:57.788 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 290 291 299 /var/lib/xfstests/tests/btrfs 2023-06-22T10:56:59.937 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-06-22T10:56:59.960 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 014.out 036.out 016.out 175.out 193.out 240.out 069.out 282.out 015.out 280.out 140.out 258.out 008.out 004.out 199.out 233.out 194.out 234.out 248.out 109.out 033.out 252.out 270.out 040.out 176.out 202.out 137.out 125.out 078.out 152.out 103.out 264.out 243.out 192.out 148.out 075.out 077.out 178.out 284.out 052.out 256.out 207.out 228.out 028.out 183.out 094.out 046.out 273.out 251.out 209.out 089.out 206.out 215.out 115.out 197.out 250.out 266.out 051.out 246.out 219.out 119.out 244.out 128.out 232.out 021.out 275.out 221.out 087.out 121.out 112.out 012.out 195.out 107.out 162.out 083.out 147.out 242.out 187.out 220.out 020.out 102.out 002.out 171.out 261.out 135.out 156.out 092.out 255.out 072.out 068.out 143.out 048.out 062.out 073.out 084.out 129.out 241.out 029.out 229.out 254.out 111.out 011.out 155.out 134.out 170.out 260.out 034.out 161.out 043.out 247.out 216.out 116.out 157.out 274.out 110.out 101.out 238.out 276.out 114.out 138.out 095.out 038.out 145.out 160.out 091.out 081.out 071.out 061.out 085.out 265.out 200.out 100.out 025.out 286.out 269.out 039.out 196.out 098.out 090.out 080.out 070.out 060.out 208.out 009.out 167.out 217.out 120.out 191.out 133.out 117.out 017.out 211.out 158.out 182.out 066.out 146.out 212.out 188.out 065.out 204.out 104.out 041.out 177.out 279.out 281.out 225.out 235.out 253.out 257.out 124.out 035.out 172.out 278.out 063.out 058.out 262.out 169.out 042.out 153.out 097.out 283.out 236.out 186.out 053.out 164.out 154.out 239.out 189.out 139.out 267.out 141.out 214.out 005.out 223.out 086.out 132.out 179.out 144.out 032.out 277.out 205.out 136.out 180.out 096.out 198.out 108.out 190.out 173.out 050.out 105.out 106.out 291.out 185.out 037.out 088.out 285.out 123.out 056.out 201.out 019.out 001.out 287.out 142.out 237.out 151.out 231.out 024.out 163.out 044.out 131.out 213.out 113.out 013.out 031.out 027.out 057.out 272.out 268.out 184.out 259.out 210.out 067.out 227.out 010.out 263.out 127.out 230.out 166.out 130.out 023.out 099.out 082.out 030.out 203.out 003.out 055.out 076.out 245.out 122.out 074.out 222.out 159.out 249.out 022.out 174.out 006.out 045.out 290.out 299.out 224.out 181.out 271.out 149.out 064.out 218.out 118.out 018.out 047.out 168.out 007.out 093.out 079.out 054.out 059.out 150.out 049.out 226.out 126.out 165.out 026.out /var/lib/xfstests/tests/btrfs 2023-06-22T10:57:02.115 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.a4ZvvHFGMPxfstests-dev/tests/ceph/ install 2023-06-22T10:57:02.118 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-06-22T10:57:02.141 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-06-22T10:57:02.194 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-06-22T10:57:02.218 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/ceph 2023-06-22T10:57:02.271 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.a4ZvvHFGMPxfstests-dev/tests/cifs/ install 2023-06-22T10:57:02.274 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-06-22T10:57:02.297 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-06-22T10:57:02.320 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-06-22T10:57:02.344 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-06-22T10:57:02.367 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.a4ZvvHFGMPxfstests-dev/tests/ext4/ install 2023-06-22T10:57:02.370 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-06-22T10:57:02.393 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-06-22T10:57:02.909 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-06-22T10:57:02.932 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 001.out.nodelalloc 001.out.default 001.out.nozero 001.cfg 032.out 039.out 005.out 026.out 308.out 008.out 040.out 304.out 007.out 021.out 016.out 037.out 044.out 012.out 009.out 033.out 057.out 050.out 301.out 019.out 034.out 046.out 058.out 047.out 302.out 020.out 002.out 024.out 013.out 031.out 025.out 306.out 017.out 004.out 048.out 038.out 056.out 042.out 052.out 307.out 029.out 011.out 027.out 303.out 003.out 045.out 055.out 053.out 035.out 043.out 059.out 010.out 023.out 022.out 014.out 006.out 015.out 305.out 036.out 271.out 051.out 041.out 030.out 018.out 028.out 054.out 049.out /var/lib/xfstests/tests/ext4 2023-06-22T10:57:03.470 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.a4ZvvHFGMPxfstests-dev/tests/f2fs/ install 2023-06-22T10:57:03.473 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-06-22T10:57:03.496 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-06-22T10:57:03.527 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-06-22T10:57:03.550 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-06-22T10:57:03.581 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.a4ZvvHFGMPxfstests-dev/tests/generic/ install 2023-06-22T10:57:03.587 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-06-22T10:57:03.610 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 /var/lib/xfstests/tests/generic 2023-06-22T10:57:08.994 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-06-22T10:57:09.017 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 035.out.nfs 050.out.xfsquota 035.out.default 050.out.nojournal 050.out.default 050.cfg 035.cfg 537.out 194.out 133.out 683.out 033.out 489.out 696.out 237.out 502.out 310.out 202.out 137.out 586.out 181.out 664.out 571.out 126.out 243.out 592.out 282.out 272.out 728.out 178.out 628.out 528.out 607.out 428.out 507.out 407.out 328.out 171.out 028.out 620.out 273.out 570.out 468.out 182.out 265.out 420.out 492.out 120.out 059.out 595.out 346.out 466.out 443.out 700.out 632.out 652.out 311.out 655.out 591.out 064.out 471.out 432.out 255.out 623.out 371.out 319.out 177.out 523.out 119.out 423.out 232.out 673.out 260.out 312.out 718.out 034.out 465.out 716.out 616.out 246.out 416.out 247.out 216.out 116.out 041.out 358.out 338.out 287.out 238.out 295.out 390.out 497.out 160.out 691.out 274.out 061.out 239.out 457.out 025.out 530.out 258.out 362.out 039.out 098.out 690.out 573.out 706.out 606.out 506.out 406.out 306.out 106.out 642.out 217.out 446.out 017.out 211.out 130.out 158.out 370.out 442.out 188.out 640.out 199.out 467.out 281.out 174.out 163.out 324.out 224.out 355.out 124.out 672.out 278.out 058.out 384.out 296.out 042.out 193.out 097.out 271.out 283.out 541.out 709.out 609.out 045.out 509.out 309.out 391.out 441.out 009.out 356.out 341.out 494.out 189.out 037.out 555.out 712.out 241.out 501.out 612.out 540.out 365.out 412.out 614.out 514.out 414.out 314.out 440.out 114.out 316.out 014.out 026.out 012.out 634.out 340.out 156.out 572.out 240.out 180.out 549.out 473.out 633.out 321.out 140.out 348.out 568.out 185.out 408.out 308.out 566.out 433.out 704.out 108.out 504.out 404.out 304.out 104.out 175.out 096.out 297.out 393.out 333.out 599.out 476.out 099.out 233.out 639.out 107.out 086.out 053.out 500.out 164.out 339.out 294.out 352.out 498.out 139.out 267.out 317.out 399.out 220.out 552.out 695.out 480.out 436.out 544.out 169.out 593.out 067.out 186.out 187.out 679.out 252.out 585.out 003.out 376.out 724.out 206.out 663.out 651.out 248.out 625.out 525.out 670.out 488.out 040.out 325.out 551.out 225.out 636.out 125.out 142.out 715.out 279.out 222.out 515.out 650.out 152.out 658.out 563.out 215.out 451.out 015.out 392.out 682.out 472.out 684.out 674.out 550.out 052.out 351.out 430.out 276.out 094.out 266.out 450.out 463.out 157.out 600.out 349.out 444.out 644.out 487.out 688.out 643.out 615.out 395.out 151.out 415.out 315.out 344.out 115.out 539.out 179.out 542.out 250.out 705.out 475.out 536.out 228.out 518.out 101.out 030.out 244.out 128.out 385.out 005.out 336.out 579.out 236.out 405.out 667.out 205.out 136.out 598.out 036.out 198.out 723.out 008.out 680.out 605.out 505.out 305.out 105.out 263.out 144.out 291.out 437.out 044.out 719.out 619.out 721.out 323.out 685.out 088.out 382.out 337.out 219.out 527.out 019.out 577.out 481.out 574.out 556.out 332.out 060.out 521.out 027.out 191.out 582.out 372.out 478.out 584.out 462.out 597.out 350.out 132.out 693.out 638.out 448.out 660.out 063.out 561.out 214.out 074.out 648.out 387.out 594.out 335.out 438.out 076.out 289.out 699.out 545.out 516.out 477.out 621.out 519.out 290.out 548.out 560.out 166.out 707.out 461.out 381.out 445.out 647.out 626.out 380.out 562.out 526.out 479.out 426.out 192.out 150.out 613.out 326.out 082.out 226.out 668.out 454.out 121.out 447.out 499.out 580.out 460.out 485.out 694.out 347.out 077.out 361.out 564.out 455.out 089.out 558.out 162.out 686.out 147.out 173.out 197.out 396.out 051.out 354.out 298.out 024.out 148.out 360.out 543.out 270.out 261.out 251.out 657.out 692.out 482.out 046.out 726.out 378.out 004.out 458.out 062.out 529.out 231.out 343.out 662.out 503.out 329.out 334.out 590.out 254.out 363.out 131.out 155.out 661.out 547.out 368.out 486.out 223.out 123.out 669.out 023.out 459.out 032.out 277.out 398.out 366.out 161.out 190.out 280.out 470.out 484.out 257.out 006.out 016.out 091.out 201.out 656.out 227.out 676.out 374.out 583.out 285.out 127.out 256.out 654.out 389.out 649.out 301.out 431.out 635.out 288.out 722.out 331.out 377.out 713.out 535.out 513.out 554.out 622.out 313.out 213.out 113.out 013.out 031.out 435.out 630.out 645.out 057.out 727.out 078.out 510.out 627.out 184.out 534.out 427.out 210.out 449.out 327.out 330.out 493.out 604.out 419.out 230.out 071.out 083.out 292.out 299.out 434.out 575.out 073.out 603.out 135.out 403.out 303.out 203.out 103.out 345.out 165.out 386.out 055.out 532.out 245.out 522.out 422.out 624.out 322.out 394.out 159.out 524.out 122.out 689.out 234.out 022.out 424.out 637.out 578.out 490.out 439.out 517.out 154.out 149.out 618.out 675.out 418.out 318.out 264.out 218.out 118.out 018.out 047.out 172.out 168.out 293.out 079.out 469.out 054.out 049.out 208.out 379.out 569.out 456.out 268.out 421.out 533.out 512.out 221.out 087.out 212.out 538.out 112.out 342.out 021.out 195.out 388.out 483.out 397.out 070.out 596.out 720.out 565.out 196.out 520.out 242.out 576.out 587.out 320.out 629.out 702.out 602.out 153.out 402.out 302.out 020.out 102.out 002.out 717.out 617.out 129.out 429.out 417.out 138.out 167.out 092.out 117.out 357.out 072.out 068.out 143.out 229.out 038.out 084.out 369.out 711.out 262.out 611.out 511.out 411.out 029.out 111.out 011.out 659.out 183.out 170.out 065.out 286.out 043.out 056.out 714.out 559.out 710.out 610.out 687.out 413.out 410.out 701.out 601.out 401.out 110.out 010.out 001.out 141.out 495.out 048.out 665.out 589.out 095.out 581.out 697.out 145.out 641.out 464.out 491.out 081.out 075.out 653.out 671.out 400.out 300.out 200.out 100.out 359.out 367.out 269.out 546.out 677.out 698.out 553.out 375.out 259.out 090.out 080.out 708.out 608.out 508.out 409.out 307.out 209.out 109.out 007.out 567.out 284.out 557.out 453.out 666.out 364.out 725.out 383.out 085.out 066.out 588.out 146.out 631.out 204.out 353.out 425.out 069.out 093.out 681.out 249.out 207.out 531.out 235.out 646.out 474.out 703.out 253.out 275.out 678.out 496.out 373.out 176.out 134.out 452.out /var/lib/xfstests/tests/generic 2023-06-22T10:57:14.453 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.a4ZvvHFGMPxfstests-dev/tests/nfs/ install 2023-06-22T10:57:14.456 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-06-22T10:57:14.479 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-06-22T10:57:14.502 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-06-22T10:57:14.526 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-06-22T10:57:14.550 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.a4ZvvHFGMPxfstests-dev/tests/ocfs2/ install 2023-06-22T10:57:14.552 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-06-22T10:57:14.575 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-06-22T10:57:14.599 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-06-22T10:57:14.622 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-06-22T10:57:14.646 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.a4ZvvHFGMPxfstests-dev/tests/overlay/ install 2023-06-22T10:57:14.649 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-06-22T10:57:14.672 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-06-22T10:57:15.393 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-06-22T10:57:15.417 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 110.out 067.out 018.out 024.out 010.out 065.out 020.out 102.out 002.out 113.out 013.out 031.out 045.out 117.out 046.out 075.out 072.out 068.out 063.out 014.out 062.out 038.out 042.out 052.out 029.out 027.out 043.out 112.out 023.out 073.out 078.out 030.out 058.out 003.out 004.out 055.out 053.out 109.out 035.out 116.out 016.out 059.out 101.out 001.out 009.out 047.out 076.out 022.out 074.out 006.out 044.out 115.out 015.out 064.out 114.out 026.out 071.out 111.out 061.out 011.out 041.out 048.out 100.out 019.out 107.out 007.out 028.out 069.out 054.out 049.out 032.out 039.out 077.out 105.out 025.out 056.out 057.out 108.out 070.out 060.out 008.out 040.out 106.out 005.out 021.out 017.out 012.out 037.out 103.out 033.out 066.out 050.out 036.out 051.out 034.out 104.out /var/lib/xfstests/tests/overlay 2023-06-22T10:57:16.141 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.a4ZvvHFGMPxfstests-dev/tests/perf/ install 2023-06-22T10:57:16.144 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-06-22T10:57:16.168 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-06-22T10:57:16.191 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-06-22T10:57:16.214 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-06-22T10:57:16.238 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.a4ZvvHFGMPxfstests-dev/tests/selftest/ install 2023-06-22T10:57:16.241 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-06-22T10:57:16.265 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-06-22T10:57:16.324 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-06-22T10:57:16.349 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 006.out 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/selftest 2023-06-22T10:57:16.409 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.a4ZvvHFGMPxfstests-dev/tests/shared/ install 2023-06-22T10:57:16.412 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-06-22T10:57:16.435 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-06-22T10:57:16.473 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-06-22T10:57:16.497 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 032.out 298.out 002.out /var/lib/xfstests/tests/shared 2023-06-22T10:57:16.536 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.a4ZvvHFGMPxfstests-dev/tests/tmpfs/ install 2023-06-22T10:57:16.538 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-06-22T10:57:16.562 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-06-22T10:57:16.585 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-06-22T10:57:16.608 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-06-22T10:57:16.632 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.a4ZvvHFGMPxfstests-dev/tests/udf/ install 2023-06-22T10:57:16.635 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-06-22T10:57:16.658 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-06-22T10:57:16.682 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-06-22T10:57:16.705 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-06-22T10:57:16.729 INFO:teuthology.orchestra.run.smithi040.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.a4ZvvHFGMPxfstests-dev/tests/xfs/ install 2023-06-22T10:57:16.735 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-06-22T10:57:16.758 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-06-22T10:57:21.849 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-06-22T10:57:21.873 INFO:teuthology.orchestra.run.smithi040.stdout:../../install-sh -o root -g root -m 644 096.out.internal 033.out.crc 096.out.external 033.out.default 071.out.64 216.out.classic 216.out.64mblog 071.out.32 216.cfg 033.cfg 308.out 737.out 108.out 504.out 404.out 104.out 004.out 377.out 537.out 194.out 158.out 337.out 082.out 237.out 759.out 502.out 088.out 202.out 137.out 102.out 746.out 110.out 586.out 181.out 571.out 567.out 592.out 282.out 266.out 728.out 178.out 528.out 769.out 428.out 507.out 407.out 328.out 171.out 028.out 046.out 273.out 570.out 468.out 474.out 059.out 346.out 732.out 784.out 443.out 411.out 532.out 591.out 064.out 471.out 111.out 432.out 255.out 371.out 319.out 177.out 523.out 119.out 775.out 232.out 131.out 243.out 183.out 547.out 738.out 260.out 718.out 034.out 465.out 716.out 161.out 246.out 416.out 247.out 116.out 016.out 041.out 358.out 338.out 287.out 099.out 238.out 065.out 566.out 295.out 138.out 765.out 160.out 291.out 274.out 722.out 061.out 239.out 085.out 457.out 025.out 772.out 530.out 258.out 322.out 039.out 498.out 098.out 517.out 573.out 060.out 506.out 406.out 306.out 106.out 006.out 003.out 217.out 120.out 191.out 133.out 455.out 130.out 442.out 188.out 030.out 199.out 595.out 467.out 281.out 242.out 163.out 771.out 324.out 224.out 050.out 764.out 124.out 382.out 278.out 058.out 741.out 384.out 262.out 042.out 497.out 466.out 193.out 097.out 392.out 283.out 541.out 770.out 709.out 755.out 309.out 441.out 157.out 740.out 356.out 341.out 494.out 189.out 555.out 241.out 540.out 077.out 412.out 514.out 414.out 314.out 440.out 114.out 316.out 074.out 147.out 012.out 155.out 340.out 793.out 156.out 572.out 568.out 240.out 279.out 180.out 733.out 280.out 434.out 140.out 766.out 185.out 408.out 066.out 552.out 304.out 204.out 353.out 425.out 069.out 254.out 335.out 531.out 235.out 556.out 253.out 503.out 418.out 275.out 272.out 496.out 751.out 433.out 176.out 134.out 393.out 333.out 476.out 535.out 739.out 233.out 752.out 736.out 107.out 053.out 164.out 587.out 339.out 294.out 521.out 352.out 799.out 489.out 139.out 774.out 267.out 390.out 399.out 781.out 017.out 169.out 593.out 186.out 452.out 252.out 585.out 167.out 724.out 206.out 794.out 348.out 394.out 509.out 248.out 785.out 424.out 750.out 525.out 488.out 040.out 325.out 551.out 225.out 125.out 142.out 715.out 789.out 581.out 152.out 563.out 215.out 436.out 792.out 075.out 472.out 578.out 463.out 550.out 052.out 351.out 430.out 276.out 290.out 094.out 451.out 450.out 744.out 043.out 086.out 349.out 444.out 500.out 487.out 762.out 544.out 305.out 395.out 515.out 415.out 389.out 315.out 344.out 115.out 015.out 542.out 250.out 791.out 464.out 475.out 536.out 228.out 439.out 244.out 128.out 385.out 005.out 336.out 150.out 579.out 236.out 342.out 580.out 136.out 036.out 198.out 723.out 008.out 790.out 505.out 405.out 588.out 205.out 105.out 144.out 768.out 437.out 037.out 044.out 719.out 381.out 721.out 323.out 519.out 562.out 419.out 388.out 123.out 056.out 019.out 577.out 151.out 760.out 574.out 332.out 796.out 027.out 372.out 584.out 462.out 220.out 350.out 312.out 492.out 745.out 076.out 112.out 063.out 561.out 214.out 776.out 014.out 758.out 362.out 387.out 594.out 438.out 265.out 289.out 554.out 516.out 477.out 548.out 560.out 166.out 461.out 445.out 296.out 207.out 493.out 786.out 007.out 251.out 380.out 093.out 526.out 479.out 426.out 192.out 326.out 226.out 454.out 126.out 121.out 447.out 761.out 773.out 460.out 485.out 347.out 035.out 361.out 564.out 788.out 795.out 089.out 747.out 558.out 162.out 743.out 288.out 197.out 396.out 576.out 051.out 354.out 355.out 575.out 148.out 301.out 360.out 543.out 263.out 270.out 261.out 734.out 045.out 292.out 482.out 726.out 729.out 378.out 458.out 062.out 249.out 231.out 343.out 334.out 590.out 363.out 368.out 486.out 223.out 132.out 023.out 459.out 032.out 798.out 277.out 748.out 527.out 146.out 398.out 366.out 427.out 190.out 173.out 470.out 484.out 754.out 767.out 749.out 187.out 091.out 201.out 731.out 782.out 374.out 583.out 285.out 127.out 256.out 501.out 376.out 431.out 068.out 331.out 179.out 713.out 024.out 513.out 413.out 313.out 549.out 213.out 730.out 113.out 013.out 031.out 435.out 182.out 057.out 727.out 078.out 510.out 184.out 797.out 534.out 545.out 210.out 449.out 327.out 330.out 067.out 227.out 010.out 230.out 083.out 473.out 299.out 219.out 073.out 370.out 135.out 403.out 303.out 203.out 103.out 345.out 165.out 386.out 055.out 742.out 245.out 026.out 522.out 787.out 422.out 222.out 159.out 539.out 524.out 122.out 448.out 234.out 022.out 174.out 779.out 490.out 565.out 090.out 423.out 154.out 271.out 149.out 518.out 318.out 264.out 218.out 118.out 018.out 329.out 047.out 172.out 168.out 293.out 079.out 469.out 054.out 049.out 208.out 379.out 456.out 268.out 421.out 712.out 321.out 533.out 512.out 221.out 087.out 212.out 538.out 021.out 195.out 725.out 483.out 397.out 070.out 373.out 720.out 481.out 196.out 520.out 129.out 446.out 420.out 478.out 320.out 499.out 153.out 402.out 302.out 020.out 529.out 002.out 717.out 429.out 417.out 317.out 365.out 092.out 117.out 357.out 072.out 778.out 143.out 229.out 038.out 084.out 369.out 711.out 511.out 029.out 311.out 211.out 011.out 783.out 170.out 286.out 756.out 175.out 714.out 559.out 710.out 410.out 310.out 401.out 101.out 001.out 141.out 495.out 048.out 589.out 753.out 095.out 297.out 480.out 145.out 257.out 757.out 491.out 081.out 800.out 777.out 400.out 300.out 200.out 100.out 359.out 367.out 269.out 546.out 780.out 553.out 763.out 375.out 298.out 259.out 080.out 708.out 508.out 409.out 307.out 209.out 109.out 009.out 391.out 284.out 557.out 453.out 364.out 582.out 735.out 383.out /var/lib/xfstests/tests/xfs 2023-06-22T10:57:25.674 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T10:57:25.680 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T10:57:27.030 INFO:teuthology.orchestra.run.smithi040.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-06-22T10:57:27.053 INFO:teuthology.orchestra.run.smithi040.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-06-22T10:57:27.077 INFO:teuthology.orchestra.run.smithi040.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-06-22T10:57:27.100 INFO:teuthology.orchestra.run.smithi040.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-06-22T10:57:27.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-22T10:57:27.128 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec ls tests/generic) 2023-06-22T10:57:27.177 INFO:teuthology.orchestra.run.smithi040.stdout:001 2023-06-22T10:57:27.177 INFO:teuthology.orchestra.run.smithi040.stdout:001.out 2023-06-22T10:57:27.178 INFO:teuthology.orchestra.run.smithi040.stdout:002 2023-06-22T10:57:27.178 INFO:teuthology.orchestra.run.smithi040.stdout:002.out 2023-06-22T10:57:27.178 INFO:teuthology.orchestra.run.smithi040.stdout:003 2023-06-22T10:57:27.178 INFO:teuthology.orchestra.run.smithi040.stdout:003.out 2023-06-22T10:57:27.178 INFO:teuthology.orchestra.run.smithi040.stdout:004 2023-06-22T10:57:27.178 INFO:teuthology.orchestra.run.smithi040.stdout:004.out 2023-06-22T10:57:27.178 INFO:teuthology.orchestra.run.smithi040.stdout:005 2023-06-22T10:57:27.179 INFO:teuthology.orchestra.run.smithi040.stdout:005.out 2023-06-22T10:57:27.179 INFO:teuthology.orchestra.run.smithi040.stdout:006 2023-06-22T10:57:27.179 INFO:teuthology.orchestra.run.smithi040.stdout:006.out 2023-06-22T10:57:27.179 INFO:teuthology.orchestra.run.smithi040.stdout:007 2023-06-22T10:57:27.179 INFO:teuthology.orchestra.run.smithi040.stdout:007.out 2023-06-22T10:57:27.179 INFO:teuthology.orchestra.run.smithi040.stdout:008 2023-06-22T10:57:27.179 INFO:teuthology.orchestra.run.smithi040.stdout:008.out 2023-06-22T10:57:27.179 INFO:teuthology.orchestra.run.smithi040.stdout:009 2023-06-22T10:57:27.180 INFO:teuthology.orchestra.run.smithi040.stdout:009.out 2023-06-22T10:57:27.180 INFO:teuthology.orchestra.run.smithi040.stdout:010 2023-06-22T10:57:27.180 INFO:teuthology.orchestra.run.smithi040.stdout:010.out 2023-06-22T10:57:27.180 INFO:teuthology.orchestra.run.smithi040.stdout:011 2023-06-22T10:57:27.180 INFO:teuthology.orchestra.run.smithi040.stdout:011.out 2023-06-22T10:57:27.180 INFO:teuthology.orchestra.run.smithi040.stdout:012 2023-06-22T10:57:27.181 INFO:teuthology.orchestra.run.smithi040.stdout:012.out 2023-06-22T10:57:27.181 INFO:teuthology.orchestra.run.smithi040.stdout:013 2023-06-22T10:57:27.181 INFO:teuthology.orchestra.run.smithi040.stdout:013.out 2023-06-22T10:57:27.181 INFO:teuthology.orchestra.run.smithi040.stdout:014 2023-06-22T10:57:27.181 INFO:teuthology.orchestra.run.smithi040.stdout:014.out 2023-06-22T10:57:27.181 INFO:teuthology.orchestra.run.smithi040.stdout:015 2023-06-22T10:57:27.181 INFO:teuthology.orchestra.run.smithi040.stdout:015.out 2023-06-22T10:57:27.182 INFO:teuthology.orchestra.run.smithi040.stdout:016 2023-06-22T10:57:27.182 INFO:teuthology.orchestra.run.smithi040.stdout:016.out 2023-06-22T10:57:27.182 INFO:teuthology.orchestra.run.smithi040.stdout:017 2023-06-22T10:57:27.182 INFO:teuthology.orchestra.run.smithi040.stdout:017.out 2023-06-22T10:57:27.183 INFO:teuthology.orchestra.run.smithi040.stdout:018 2023-06-22T10:57:27.183 INFO:teuthology.orchestra.run.smithi040.stdout:018.out 2023-06-22T10:57:27.183 INFO:teuthology.orchestra.run.smithi040.stdout:019 2023-06-22T10:57:27.183 INFO:teuthology.orchestra.run.smithi040.stdout:019.out 2023-06-22T10:57:27.184 INFO:teuthology.orchestra.run.smithi040.stdout:020 2023-06-22T10:57:27.184 INFO:teuthology.orchestra.run.smithi040.stdout:020.out 2023-06-22T10:57:27.184 INFO:teuthology.orchestra.run.smithi040.stdout:021 2023-06-22T10:57:27.184 INFO:teuthology.orchestra.run.smithi040.stdout:021.out 2023-06-22T10:57:27.184 INFO:teuthology.orchestra.run.smithi040.stdout:022 2023-06-22T10:57:27.184 INFO:teuthology.orchestra.run.smithi040.stdout:022.out 2023-06-22T10:57:27.184 INFO:teuthology.orchestra.run.smithi040.stdout:023 2023-06-22T10:57:27.185 INFO:teuthology.orchestra.run.smithi040.stdout:023.out 2023-06-22T10:57:27.185 INFO:teuthology.orchestra.run.smithi040.stdout:024 2023-06-22T10:57:27.185 INFO:teuthology.orchestra.run.smithi040.stdout:024.out 2023-06-22T10:57:27.185 INFO:teuthology.orchestra.run.smithi040.stdout:025 2023-06-22T10:57:27.185 INFO:teuthology.orchestra.run.smithi040.stdout:025.out 2023-06-22T10:57:27.185 INFO:teuthology.orchestra.run.smithi040.stdout:026 2023-06-22T10:57:27.185 INFO:teuthology.orchestra.run.smithi040.stdout:026.out 2023-06-22T10:57:27.185 INFO:teuthology.orchestra.run.smithi040.stdout:027 2023-06-22T10:57:27.186 INFO:teuthology.orchestra.run.smithi040.stdout:027.out 2023-06-22T10:57:27.186 INFO:teuthology.orchestra.run.smithi040.stdout:028 2023-06-22T10:57:27.186 INFO:teuthology.orchestra.run.smithi040.stdout:028.out 2023-06-22T10:57:27.186 INFO:teuthology.orchestra.run.smithi040.stdout:029 2023-06-22T10:57:27.186 INFO:teuthology.orchestra.run.smithi040.stdout:029.out 2023-06-22T10:57:27.186 INFO:teuthology.orchestra.run.smithi040.stdout:030 2023-06-22T10:57:27.186 INFO:teuthology.orchestra.run.smithi040.stdout:030.out 2023-06-22T10:57:27.186 INFO:teuthology.orchestra.run.smithi040.stdout:031 2023-06-22T10:57:27.187 INFO:teuthology.orchestra.run.smithi040.stdout:031.out 2023-06-22T10:57:27.187 INFO:teuthology.orchestra.run.smithi040.stdout:032 2023-06-22T10:57:27.187 INFO:teuthology.orchestra.run.smithi040.stdout:032.out 2023-06-22T10:57:27.187 INFO:teuthology.orchestra.run.smithi040.stdout:033 2023-06-22T10:57:27.187 INFO:teuthology.orchestra.run.smithi040.stdout:033.out 2023-06-22T10:57:27.187 INFO:teuthology.orchestra.run.smithi040.stdout:034 2023-06-22T10:57:27.187 INFO:teuthology.orchestra.run.smithi040.stdout:034.out 2023-06-22T10:57:27.187 INFO:teuthology.orchestra.run.smithi040.stdout:035 2023-06-22T10:57:27.188 INFO:teuthology.orchestra.run.smithi040.stdout:035.cfg 2023-06-22T10:57:27.188 INFO:teuthology.orchestra.run.smithi040.stdout:035.out.default 2023-06-22T10:57:27.188 INFO:teuthology.orchestra.run.smithi040.stdout:035.out.nfs 2023-06-22T10:57:27.188 INFO:teuthology.orchestra.run.smithi040.stdout:036 2023-06-22T10:57:27.188 INFO:teuthology.orchestra.run.smithi040.stdout:036.out 2023-06-22T10:57:27.188 INFO:teuthology.orchestra.run.smithi040.stdout:037 2023-06-22T10:57:27.188 INFO:teuthology.orchestra.run.smithi040.stdout:037.out 2023-06-22T10:57:27.189 INFO:teuthology.orchestra.run.smithi040.stdout:038 2023-06-22T10:57:27.189 INFO:teuthology.orchestra.run.smithi040.stdout:038.out 2023-06-22T10:57:27.189 INFO:teuthology.orchestra.run.smithi040.stdout:039 2023-06-22T10:57:27.189 INFO:teuthology.orchestra.run.smithi040.stdout:039.out 2023-06-22T10:57:27.189 INFO:teuthology.orchestra.run.smithi040.stdout:040 2023-06-22T10:57:27.189 INFO:teuthology.orchestra.run.smithi040.stdout:040.out 2023-06-22T10:57:27.189 INFO:teuthology.orchestra.run.smithi040.stdout:041 2023-06-22T10:57:27.189 INFO:teuthology.orchestra.run.smithi040.stdout:041.out 2023-06-22T10:57:27.190 INFO:teuthology.orchestra.run.smithi040.stdout:042 2023-06-22T10:57:27.190 INFO:teuthology.orchestra.run.smithi040.stdout:042.out 2023-06-22T10:57:27.190 INFO:teuthology.orchestra.run.smithi040.stdout:043 2023-06-22T10:57:27.190 INFO:teuthology.orchestra.run.smithi040.stdout:043.out 2023-06-22T10:57:27.190 INFO:teuthology.orchestra.run.smithi040.stdout:044 2023-06-22T10:57:27.190 INFO:teuthology.orchestra.run.smithi040.stdout:044.out 2023-06-22T10:57:27.190 INFO:teuthology.orchestra.run.smithi040.stdout:045 2023-06-22T10:57:27.191 INFO:teuthology.orchestra.run.smithi040.stdout:045.out 2023-06-22T10:57:27.191 INFO:teuthology.orchestra.run.smithi040.stdout:046 2023-06-22T10:57:27.191 INFO:teuthology.orchestra.run.smithi040.stdout:046.out 2023-06-22T10:57:27.191 INFO:teuthology.orchestra.run.smithi040.stdout:047 2023-06-22T10:57:27.191 INFO:teuthology.orchestra.run.smithi040.stdout:047.out 2023-06-22T10:57:27.191 INFO:teuthology.orchestra.run.smithi040.stdout:048 2023-06-22T10:57:27.191 INFO:teuthology.orchestra.run.smithi040.stdout:048.out 2023-06-22T10:57:27.191 INFO:teuthology.orchestra.run.smithi040.stdout:049 2023-06-22T10:57:27.192 INFO:teuthology.orchestra.run.smithi040.stdout:049.out 2023-06-22T10:57:27.192 INFO:teuthology.orchestra.run.smithi040.stdout:050 2023-06-22T10:57:27.192 INFO:teuthology.orchestra.run.smithi040.stdout:050.cfg 2023-06-22T10:57:27.192 INFO:teuthology.orchestra.run.smithi040.stdout:050.out.default 2023-06-22T10:57:27.192 INFO:teuthology.orchestra.run.smithi040.stdout:050.out.nojournal 2023-06-22T10:57:27.192 INFO:teuthology.orchestra.run.smithi040.stdout:050.out.xfsquota 2023-06-22T10:57:27.192 INFO:teuthology.orchestra.run.smithi040.stdout:051 2023-06-22T10:57:27.192 INFO:teuthology.orchestra.run.smithi040.stdout:051.out 2023-06-22T10:57:27.193 INFO:teuthology.orchestra.run.smithi040.stdout:052 2023-06-22T10:57:27.193 INFO:teuthology.orchestra.run.smithi040.stdout:052.out 2023-06-22T10:57:27.193 INFO:teuthology.orchestra.run.smithi040.stdout:053 2023-06-22T10:57:27.193 INFO:teuthology.orchestra.run.smithi040.stdout:053.out 2023-06-22T10:57:27.193 INFO:teuthology.orchestra.run.smithi040.stdout:054 2023-06-22T10:57:27.193 INFO:teuthology.orchestra.run.smithi040.stdout:054.out 2023-06-22T10:57:27.193 INFO:teuthology.orchestra.run.smithi040.stdout:055 2023-06-22T10:57:27.193 INFO:teuthology.orchestra.run.smithi040.stdout:055.out 2023-06-22T10:57:27.194 INFO:teuthology.orchestra.run.smithi040.stdout:056 2023-06-22T10:57:27.194 INFO:teuthology.orchestra.run.smithi040.stdout:056.out 2023-06-22T10:57:27.194 INFO:teuthology.orchestra.run.smithi040.stdout:057 2023-06-22T10:57:27.194 INFO:teuthology.orchestra.run.smithi040.stdout:057.out 2023-06-22T10:57:27.194 INFO:teuthology.orchestra.run.smithi040.stdout:058 2023-06-22T10:57:27.194 INFO:teuthology.orchestra.run.smithi040.stdout:058.out 2023-06-22T10:57:27.194 INFO:teuthology.orchestra.run.smithi040.stdout:059 2023-06-22T10:57:27.195 INFO:teuthology.orchestra.run.smithi040.stdout:059.out 2023-06-22T10:57:27.195 INFO:teuthology.orchestra.run.smithi040.stdout:060 2023-06-22T10:57:27.195 INFO:teuthology.orchestra.run.smithi040.stdout:060.out 2023-06-22T10:57:27.195 INFO:teuthology.orchestra.run.smithi040.stdout:061 2023-06-22T10:57:27.195 INFO:teuthology.orchestra.run.smithi040.stdout:061.out 2023-06-22T10:57:27.195 INFO:teuthology.orchestra.run.smithi040.stdout:062 2023-06-22T10:57:27.195 INFO:teuthology.orchestra.run.smithi040.stdout:062.out 2023-06-22T10:57:27.195 INFO:teuthology.orchestra.run.smithi040.stdout:063 2023-06-22T10:57:27.196 INFO:teuthology.orchestra.run.smithi040.stdout:063.out 2023-06-22T10:57:27.196 INFO:teuthology.orchestra.run.smithi040.stdout:064 2023-06-22T10:57:27.196 INFO:teuthology.orchestra.run.smithi040.stdout:064.out 2023-06-22T10:57:27.196 INFO:teuthology.orchestra.run.smithi040.stdout:065 2023-06-22T10:57:27.196 INFO:teuthology.orchestra.run.smithi040.stdout:065.out 2023-06-22T10:57:27.196 INFO:teuthology.orchestra.run.smithi040.stdout:066 2023-06-22T10:57:27.196 INFO:teuthology.orchestra.run.smithi040.stdout:066.out 2023-06-22T10:57:27.196 INFO:teuthology.orchestra.run.smithi040.stdout:067 2023-06-22T10:57:27.197 INFO:teuthology.orchestra.run.smithi040.stdout:067.out 2023-06-22T10:57:27.197 INFO:teuthology.orchestra.run.smithi040.stdout:068 2023-06-22T10:57:27.197 INFO:teuthology.orchestra.run.smithi040.stdout:068.out 2023-06-22T10:57:27.197 INFO:teuthology.orchestra.run.smithi040.stdout:069 2023-06-22T10:57:27.197 INFO:teuthology.orchestra.run.smithi040.stdout:069.out 2023-06-22T10:57:27.197 INFO:teuthology.orchestra.run.smithi040.stdout:070 2023-06-22T10:57:27.197 INFO:teuthology.orchestra.run.smithi040.stdout:070.out 2023-06-22T10:57:27.197 INFO:teuthology.orchestra.run.smithi040.stdout:071 2023-06-22T10:57:27.198 INFO:teuthology.orchestra.run.smithi040.stdout:071.out 2023-06-22T10:57:27.198 INFO:teuthology.orchestra.run.smithi040.stdout:072 2023-06-22T10:57:27.198 INFO:teuthology.orchestra.run.smithi040.stdout:072.out 2023-06-22T10:57:27.198 INFO:teuthology.orchestra.run.smithi040.stdout:073 2023-06-22T10:57:27.198 INFO:teuthology.orchestra.run.smithi040.stdout:073.out 2023-06-22T10:57:27.198 INFO:teuthology.orchestra.run.smithi040.stdout:074 2023-06-22T10:57:27.198 INFO:teuthology.orchestra.run.smithi040.stdout:074.out 2023-06-22T10:57:27.199 INFO:teuthology.orchestra.run.smithi040.stdout:075 2023-06-22T10:57:27.199 INFO:teuthology.orchestra.run.smithi040.stdout:075.out 2023-06-22T10:57:27.199 INFO:teuthology.orchestra.run.smithi040.stdout:076 2023-06-22T10:57:27.199 INFO:teuthology.orchestra.run.smithi040.stdout:076.out 2023-06-22T10:57:27.199 INFO:teuthology.orchestra.run.smithi040.stdout:077 2023-06-22T10:57:27.199 INFO:teuthology.orchestra.run.smithi040.stdout:077.out 2023-06-22T10:57:27.199 INFO:teuthology.orchestra.run.smithi040.stdout:078 2023-06-22T10:57:27.199 INFO:teuthology.orchestra.run.smithi040.stdout:078.out 2023-06-22T10:57:27.200 INFO:teuthology.orchestra.run.smithi040.stdout:079 2023-06-22T10:57:27.200 INFO:teuthology.orchestra.run.smithi040.stdout:079.out 2023-06-22T10:57:27.200 INFO:teuthology.orchestra.run.smithi040.stdout:080 2023-06-22T10:57:27.200 INFO:teuthology.orchestra.run.smithi040.stdout:080.out 2023-06-22T10:57:27.200 INFO:teuthology.orchestra.run.smithi040.stdout:081 2023-06-22T10:57:27.200 INFO:teuthology.orchestra.run.smithi040.stdout:081.out 2023-06-22T10:57:27.200 INFO:teuthology.orchestra.run.smithi040.stdout:082 2023-06-22T10:57:27.200 INFO:teuthology.orchestra.run.smithi040.stdout:082.out 2023-06-22T10:57:27.201 INFO:teuthology.orchestra.run.smithi040.stdout:083 2023-06-22T10:57:27.201 INFO:teuthology.orchestra.run.smithi040.stdout:083.out 2023-06-22T10:57:27.201 INFO:teuthology.orchestra.run.smithi040.stdout:084 2023-06-22T10:57:27.201 INFO:teuthology.orchestra.run.smithi040.stdout:084.out 2023-06-22T10:57:27.201 INFO:teuthology.orchestra.run.smithi040.stdout:085 2023-06-22T10:57:27.201 INFO:teuthology.orchestra.run.smithi040.stdout:085.out 2023-06-22T10:57:27.201 INFO:teuthology.orchestra.run.smithi040.stdout:086 2023-06-22T10:57:27.202 INFO:teuthology.orchestra.run.smithi040.stdout:086.out 2023-06-22T10:57:27.202 INFO:teuthology.orchestra.run.smithi040.stdout:087 2023-06-22T10:57:27.202 INFO:teuthology.orchestra.run.smithi040.stdout:087.out 2023-06-22T10:57:27.202 INFO:teuthology.orchestra.run.smithi040.stdout:088 2023-06-22T10:57:27.202 INFO:teuthology.orchestra.run.smithi040.stdout:088.out 2023-06-22T10:57:27.202 INFO:teuthology.orchestra.run.smithi040.stdout:089 2023-06-22T10:57:27.202 INFO:teuthology.orchestra.run.smithi040.stdout:089.out 2023-06-22T10:57:27.202 INFO:teuthology.orchestra.run.smithi040.stdout:090 2023-06-22T10:57:27.203 INFO:teuthology.orchestra.run.smithi040.stdout:090.out 2023-06-22T10:57:27.203 INFO:teuthology.orchestra.run.smithi040.stdout:091 2023-06-22T10:57:27.203 INFO:teuthology.orchestra.run.smithi040.stdout:091.out 2023-06-22T10:57:27.203 INFO:teuthology.orchestra.run.smithi040.stdout:092 2023-06-22T10:57:27.203 INFO:teuthology.orchestra.run.smithi040.stdout:092.out 2023-06-22T10:57:27.203 INFO:teuthology.orchestra.run.smithi040.stdout:093 2023-06-22T10:57:27.203 INFO:teuthology.orchestra.run.smithi040.stdout:093.out 2023-06-22T10:57:27.203 INFO:teuthology.orchestra.run.smithi040.stdout:094 2023-06-22T10:57:27.204 INFO:teuthology.orchestra.run.smithi040.stdout:094.out 2023-06-22T10:57:27.204 INFO:teuthology.orchestra.run.smithi040.stdout:095 2023-06-22T10:57:27.204 INFO:teuthology.orchestra.run.smithi040.stdout:095.out 2023-06-22T10:57:27.204 INFO:teuthology.orchestra.run.smithi040.stdout:096 2023-06-22T10:57:27.204 INFO:teuthology.orchestra.run.smithi040.stdout:096.out 2023-06-22T10:57:27.204 INFO:teuthology.orchestra.run.smithi040.stdout:097 2023-06-22T10:57:27.204 INFO:teuthology.orchestra.run.smithi040.stdout:097.out 2023-06-22T10:57:27.204 INFO:teuthology.orchestra.run.smithi040.stdout:098 2023-06-22T10:57:27.205 INFO:teuthology.orchestra.run.smithi040.stdout:098.out 2023-06-22T10:57:27.205 INFO:teuthology.orchestra.run.smithi040.stdout:099 2023-06-22T10:57:27.205 INFO:teuthology.orchestra.run.smithi040.stdout:099.out 2023-06-22T10:57:27.205 INFO:teuthology.orchestra.run.smithi040.stdout:100 2023-06-22T10:57:27.205 INFO:teuthology.orchestra.run.smithi040.stdout:100.out 2023-06-22T10:57:27.205 INFO:teuthology.orchestra.run.smithi040.stdout:101 2023-06-22T10:57:27.205 INFO:teuthology.orchestra.run.smithi040.stdout:101.out 2023-06-22T10:57:27.206 INFO:teuthology.orchestra.run.smithi040.stdout:102 2023-06-22T10:57:27.206 INFO:teuthology.orchestra.run.smithi040.stdout:102.out 2023-06-22T10:57:27.206 INFO:teuthology.orchestra.run.smithi040.stdout:103 2023-06-22T10:57:27.206 INFO:teuthology.orchestra.run.smithi040.stdout:103.out 2023-06-22T10:57:27.206 INFO:teuthology.orchestra.run.smithi040.stdout:104 2023-06-22T10:57:27.206 INFO:teuthology.orchestra.run.smithi040.stdout:104.out 2023-06-22T10:57:27.206 INFO:teuthology.orchestra.run.smithi040.stdout:105 2023-06-22T10:57:27.206 INFO:teuthology.orchestra.run.smithi040.stdout:105.out 2023-06-22T10:57:27.207 INFO:teuthology.orchestra.run.smithi040.stdout:106 2023-06-22T10:57:27.207 INFO:teuthology.orchestra.run.smithi040.stdout:106.out 2023-06-22T10:57:27.207 INFO:teuthology.orchestra.run.smithi040.stdout:107 2023-06-22T10:57:27.207 INFO:teuthology.orchestra.run.smithi040.stdout:107.out 2023-06-22T10:57:27.207 INFO:teuthology.orchestra.run.smithi040.stdout:108 2023-06-22T10:57:27.207 INFO:teuthology.orchestra.run.smithi040.stdout:108.out 2023-06-22T10:57:27.207 INFO:teuthology.orchestra.run.smithi040.stdout:109 2023-06-22T10:57:27.207 INFO:teuthology.orchestra.run.smithi040.stdout:109.out 2023-06-22T10:57:27.208 INFO:teuthology.orchestra.run.smithi040.stdout:110 2023-06-22T10:57:27.208 INFO:teuthology.orchestra.run.smithi040.stdout:110.out 2023-06-22T10:57:27.208 INFO:teuthology.orchestra.run.smithi040.stdout:111 2023-06-22T10:57:27.208 INFO:teuthology.orchestra.run.smithi040.stdout:111.out 2023-06-22T10:57:27.208 INFO:teuthology.orchestra.run.smithi040.stdout:112 2023-06-22T10:57:27.208 INFO:teuthology.orchestra.run.smithi040.stdout:112.out 2023-06-22T10:57:27.208 INFO:teuthology.orchestra.run.smithi040.stdout:113 2023-06-22T10:57:27.209 INFO:teuthology.orchestra.run.smithi040.stdout:113.out 2023-06-22T10:57:27.209 INFO:teuthology.orchestra.run.smithi040.stdout:114 2023-06-22T10:57:27.209 INFO:teuthology.orchestra.run.smithi040.stdout:114.out 2023-06-22T10:57:27.209 INFO:teuthology.orchestra.run.smithi040.stdout:115 2023-06-22T10:57:27.209 INFO:teuthology.orchestra.run.smithi040.stdout:115.out 2023-06-22T10:57:27.209 INFO:teuthology.orchestra.run.smithi040.stdout:116 2023-06-22T10:57:27.209 INFO:teuthology.orchestra.run.smithi040.stdout:116.out 2023-06-22T10:57:27.209 INFO:teuthology.orchestra.run.smithi040.stdout:117 2023-06-22T10:57:27.210 INFO:teuthology.orchestra.run.smithi040.stdout:117.out 2023-06-22T10:57:27.210 INFO:teuthology.orchestra.run.smithi040.stdout:118 2023-06-22T10:57:27.210 INFO:teuthology.orchestra.run.smithi040.stdout:118.out 2023-06-22T10:57:27.210 INFO:teuthology.orchestra.run.smithi040.stdout:119 2023-06-22T10:57:27.210 INFO:teuthology.orchestra.run.smithi040.stdout:119.out 2023-06-22T10:57:27.210 INFO:teuthology.orchestra.run.smithi040.stdout:120 2023-06-22T10:57:27.211 INFO:teuthology.orchestra.run.smithi040.stdout:120.out 2023-06-22T10:57:27.211 INFO:teuthology.orchestra.run.smithi040.stdout:121 2023-06-22T10:57:27.211 INFO:teuthology.orchestra.run.smithi040.stdout:121.out 2023-06-22T10:57:27.211 INFO:teuthology.orchestra.run.smithi040.stdout:122 2023-06-22T10:57:27.212 INFO:teuthology.orchestra.run.smithi040.stdout:122.out 2023-06-22T10:57:27.212 INFO:teuthology.orchestra.run.smithi040.stdout:123 2023-06-22T10:57:27.212 INFO:teuthology.orchestra.run.smithi040.stdout:123.out 2023-06-22T10:57:27.213 INFO:teuthology.orchestra.run.smithi040.stdout:124 2023-06-22T10:57:27.213 INFO:teuthology.orchestra.run.smithi040.stdout:124.out 2023-06-22T10:57:27.213 INFO:teuthology.orchestra.run.smithi040.stdout:125 2023-06-22T10:57:27.213 INFO:teuthology.orchestra.run.smithi040.stdout:125.out 2023-06-22T10:57:27.213 INFO:teuthology.orchestra.run.smithi040.stdout:126 2023-06-22T10:57:27.214 INFO:teuthology.orchestra.run.smithi040.stdout:126.out 2023-06-22T10:57:27.214 INFO:teuthology.orchestra.run.smithi040.stdout:127 2023-06-22T10:57:27.214 INFO:teuthology.orchestra.run.smithi040.stdout:127.out 2023-06-22T10:57:27.214 INFO:teuthology.orchestra.run.smithi040.stdout:128 2023-06-22T10:57:27.214 INFO:teuthology.orchestra.run.smithi040.stdout:128.out 2023-06-22T10:57:27.214 INFO:teuthology.orchestra.run.smithi040.stdout:129 2023-06-22T10:57:27.214 INFO:teuthology.orchestra.run.smithi040.stdout:129.out 2023-06-22T10:57:27.214 INFO:teuthology.orchestra.run.smithi040.stdout:130 2023-06-22T10:57:27.215 INFO:teuthology.orchestra.run.smithi040.stdout:130.out 2023-06-22T10:57:27.215 INFO:teuthology.orchestra.run.smithi040.stdout:131 2023-06-22T10:57:27.215 INFO:teuthology.orchestra.run.smithi040.stdout:131.out 2023-06-22T10:57:27.215 INFO:teuthology.orchestra.run.smithi040.stdout:132 2023-06-22T10:57:27.215 INFO:teuthology.orchestra.run.smithi040.stdout:132.out 2023-06-22T10:57:27.215 INFO:teuthology.orchestra.run.smithi040.stdout:133 2023-06-22T10:57:27.215 INFO:teuthology.orchestra.run.smithi040.stdout:133.out 2023-06-22T10:57:27.215 INFO:teuthology.orchestra.run.smithi040.stdout:134 2023-06-22T10:57:27.216 INFO:teuthology.orchestra.run.smithi040.stdout:134.out 2023-06-22T10:57:27.216 INFO:teuthology.orchestra.run.smithi040.stdout:135 2023-06-22T10:57:27.216 INFO:teuthology.orchestra.run.smithi040.stdout:135.out 2023-06-22T10:57:27.216 INFO:teuthology.orchestra.run.smithi040.stdout:136 2023-06-22T10:57:27.216 INFO:teuthology.orchestra.run.smithi040.stdout:136.out 2023-06-22T10:57:27.216 INFO:teuthology.orchestra.run.smithi040.stdout:137 2023-06-22T10:57:27.216 INFO:teuthology.orchestra.run.smithi040.stdout:137.out 2023-06-22T10:57:27.217 INFO:teuthology.orchestra.run.smithi040.stdout:138 2023-06-22T10:57:27.217 INFO:teuthology.orchestra.run.smithi040.stdout:138.out 2023-06-22T10:57:27.217 INFO:teuthology.orchestra.run.smithi040.stdout:139 2023-06-22T10:57:27.217 INFO:teuthology.orchestra.run.smithi040.stdout:139.out 2023-06-22T10:57:27.217 INFO:teuthology.orchestra.run.smithi040.stdout:140 2023-06-22T10:57:27.217 INFO:teuthology.orchestra.run.smithi040.stdout:140.out 2023-06-22T10:57:27.217 INFO:teuthology.orchestra.run.smithi040.stdout:141 2023-06-22T10:57:27.218 INFO:teuthology.orchestra.run.smithi040.stdout:141.out 2023-06-22T10:57:27.218 INFO:teuthology.orchestra.run.smithi040.stdout:142 2023-06-22T10:57:27.218 INFO:teuthology.orchestra.run.smithi040.stdout:142.out 2023-06-22T10:57:27.218 INFO:teuthology.orchestra.run.smithi040.stdout:143 2023-06-22T10:57:27.218 INFO:teuthology.orchestra.run.smithi040.stdout:143.out 2023-06-22T10:57:27.218 INFO:teuthology.orchestra.run.smithi040.stdout:144 2023-06-22T10:57:27.218 INFO:teuthology.orchestra.run.smithi040.stdout:144.out 2023-06-22T10:57:27.218 INFO:teuthology.orchestra.run.smithi040.stdout:145 2023-06-22T10:57:27.219 INFO:teuthology.orchestra.run.smithi040.stdout:145.out 2023-06-22T10:57:27.219 INFO:teuthology.orchestra.run.smithi040.stdout:146 2023-06-22T10:57:27.219 INFO:teuthology.orchestra.run.smithi040.stdout:146.out 2023-06-22T10:57:27.219 INFO:teuthology.orchestra.run.smithi040.stdout:147 2023-06-22T10:57:27.219 INFO:teuthology.orchestra.run.smithi040.stdout:147.out 2023-06-22T10:57:27.219 INFO:teuthology.orchestra.run.smithi040.stdout:148 2023-06-22T10:57:27.219 INFO:teuthology.orchestra.run.smithi040.stdout:148.out 2023-06-22T10:57:27.219 INFO:teuthology.orchestra.run.smithi040.stdout:149 2023-06-22T10:57:27.220 INFO:teuthology.orchestra.run.smithi040.stdout:149.out 2023-06-22T10:57:27.220 INFO:teuthology.orchestra.run.smithi040.stdout:150 2023-06-22T10:57:27.220 INFO:teuthology.orchestra.run.smithi040.stdout:150.out 2023-06-22T10:57:27.220 INFO:teuthology.orchestra.run.smithi040.stdout:151 2023-06-22T10:57:27.220 INFO:teuthology.orchestra.run.smithi040.stdout:151.out 2023-06-22T10:57:27.220 INFO:teuthology.orchestra.run.smithi040.stdout:152 2023-06-22T10:57:27.220 INFO:teuthology.orchestra.run.smithi040.stdout:152.out 2023-06-22T10:57:27.221 INFO:teuthology.orchestra.run.smithi040.stdout:153 2023-06-22T10:57:27.221 INFO:teuthology.orchestra.run.smithi040.stdout:153.out 2023-06-22T10:57:27.221 INFO:teuthology.orchestra.run.smithi040.stdout:154 2023-06-22T10:57:27.221 INFO:teuthology.orchestra.run.smithi040.stdout:154.out 2023-06-22T10:57:27.221 INFO:teuthology.orchestra.run.smithi040.stdout:155 2023-06-22T10:57:27.221 INFO:teuthology.orchestra.run.smithi040.stdout:155.out 2023-06-22T10:57:27.221 INFO:teuthology.orchestra.run.smithi040.stdout:156 2023-06-22T10:57:27.221 INFO:teuthology.orchestra.run.smithi040.stdout:156.out 2023-06-22T10:57:27.222 INFO:teuthology.orchestra.run.smithi040.stdout:157 2023-06-22T10:57:27.222 INFO:teuthology.orchestra.run.smithi040.stdout:157.out 2023-06-22T10:57:27.222 INFO:teuthology.orchestra.run.smithi040.stdout:158 2023-06-22T10:57:27.222 INFO:teuthology.orchestra.run.smithi040.stdout:158.out 2023-06-22T10:57:27.222 INFO:teuthology.orchestra.run.smithi040.stdout:159 2023-06-22T10:57:27.222 INFO:teuthology.orchestra.run.smithi040.stdout:159.out 2023-06-22T10:57:27.222 INFO:teuthology.orchestra.run.smithi040.stdout:160 2023-06-22T10:57:27.222 INFO:teuthology.orchestra.run.smithi040.stdout:160.out 2023-06-22T10:57:27.223 INFO:teuthology.orchestra.run.smithi040.stdout:161 2023-06-22T10:57:27.223 INFO:teuthology.orchestra.run.smithi040.stdout:161.out 2023-06-22T10:57:27.223 INFO:teuthology.orchestra.run.smithi040.stdout:162 2023-06-22T10:57:27.223 INFO:teuthology.orchestra.run.smithi040.stdout:162.out 2023-06-22T10:57:27.223 INFO:teuthology.orchestra.run.smithi040.stdout:163 2023-06-22T10:57:27.223 INFO:teuthology.orchestra.run.smithi040.stdout:163.out 2023-06-22T10:57:27.223 INFO:teuthology.orchestra.run.smithi040.stdout:164 2023-06-22T10:57:27.223 INFO:teuthology.orchestra.run.smithi040.stdout:164.out 2023-06-22T10:57:27.224 INFO:teuthology.orchestra.run.smithi040.stdout:165 2023-06-22T10:57:27.224 INFO:teuthology.orchestra.run.smithi040.stdout:165.out 2023-06-22T10:57:27.224 INFO:teuthology.orchestra.run.smithi040.stdout:166 2023-06-22T10:57:27.224 INFO:teuthology.orchestra.run.smithi040.stdout:166.out 2023-06-22T10:57:27.224 INFO:teuthology.orchestra.run.smithi040.stdout:167 2023-06-22T10:57:27.224 INFO:teuthology.orchestra.run.smithi040.stdout:167.out 2023-06-22T10:57:27.224 INFO:teuthology.orchestra.run.smithi040.stdout:168 2023-06-22T10:57:27.224 INFO:teuthology.orchestra.run.smithi040.stdout:168.out 2023-06-22T10:57:27.225 INFO:teuthology.orchestra.run.smithi040.stdout:169 2023-06-22T10:57:27.225 INFO:teuthology.orchestra.run.smithi040.stdout:169.out 2023-06-22T10:57:27.225 INFO:teuthology.orchestra.run.smithi040.stdout:170 2023-06-22T10:57:27.225 INFO:teuthology.orchestra.run.smithi040.stdout:170.out 2023-06-22T10:57:27.225 INFO:teuthology.orchestra.run.smithi040.stdout:171 2023-06-22T10:57:27.225 INFO:teuthology.orchestra.run.smithi040.stdout:171.out 2023-06-22T10:57:27.225 INFO:teuthology.orchestra.run.smithi040.stdout:172 2023-06-22T10:57:27.226 INFO:teuthology.orchestra.run.smithi040.stdout:172.out 2023-06-22T10:57:27.226 INFO:teuthology.orchestra.run.smithi040.stdout:173 2023-06-22T10:57:27.226 INFO:teuthology.orchestra.run.smithi040.stdout:173.out 2023-06-22T10:57:27.226 INFO:teuthology.orchestra.run.smithi040.stdout:174 2023-06-22T10:57:27.226 INFO:teuthology.orchestra.run.smithi040.stdout:174.out 2023-06-22T10:57:27.226 INFO:teuthology.orchestra.run.smithi040.stdout:175 2023-06-22T10:57:27.226 INFO:teuthology.orchestra.run.smithi040.stdout:175.out 2023-06-22T10:57:27.226 INFO:teuthology.orchestra.run.smithi040.stdout:176 2023-06-22T10:57:27.227 INFO:teuthology.orchestra.run.smithi040.stdout:176.out 2023-06-22T10:57:27.227 INFO:teuthology.orchestra.run.smithi040.stdout:177 2023-06-22T10:57:27.227 INFO:teuthology.orchestra.run.smithi040.stdout:177.out 2023-06-22T10:57:27.227 INFO:teuthology.orchestra.run.smithi040.stdout:178 2023-06-22T10:57:27.227 INFO:teuthology.orchestra.run.smithi040.stdout:178.out 2023-06-22T10:57:27.227 INFO:teuthology.orchestra.run.smithi040.stdout:179 2023-06-22T10:57:27.227 INFO:teuthology.orchestra.run.smithi040.stdout:179.out 2023-06-22T10:57:27.227 INFO:teuthology.orchestra.run.smithi040.stdout:180 2023-06-22T10:57:27.228 INFO:teuthology.orchestra.run.smithi040.stdout:180.out 2023-06-22T10:57:27.228 INFO:teuthology.orchestra.run.smithi040.stdout:181 2023-06-22T10:57:27.228 INFO:teuthology.orchestra.run.smithi040.stdout:181.out 2023-06-22T10:57:27.228 INFO:teuthology.orchestra.run.smithi040.stdout:182 2023-06-22T10:57:27.228 INFO:teuthology.orchestra.run.smithi040.stdout:182.out 2023-06-22T10:57:27.228 INFO:teuthology.orchestra.run.smithi040.stdout:183 2023-06-22T10:57:27.228 INFO:teuthology.orchestra.run.smithi040.stdout:183.out 2023-06-22T10:57:27.228 INFO:teuthology.orchestra.run.smithi040.stdout:184 2023-06-22T10:57:27.229 INFO:teuthology.orchestra.run.smithi040.stdout:184.out 2023-06-22T10:57:27.229 INFO:teuthology.orchestra.run.smithi040.stdout:185 2023-06-22T10:57:27.229 INFO:teuthology.orchestra.run.smithi040.stdout:185.out 2023-06-22T10:57:27.229 INFO:teuthology.orchestra.run.smithi040.stdout:186 2023-06-22T10:57:27.229 INFO:teuthology.orchestra.run.smithi040.stdout:186.out 2023-06-22T10:57:27.229 INFO:teuthology.orchestra.run.smithi040.stdout:187 2023-06-22T10:57:27.229 INFO:teuthology.orchestra.run.smithi040.stdout:187.out 2023-06-22T10:57:27.229 INFO:teuthology.orchestra.run.smithi040.stdout:188 2023-06-22T10:57:27.230 INFO:teuthology.orchestra.run.smithi040.stdout:188.out 2023-06-22T10:57:27.230 INFO:teuthology.orchestra.run.smithi040.stdout:189 2023-06-22T10:57:27.230 INFO:teuthology.orchestra.run.smithi040.stdout:189.out 2023-06-22T10:57:27.230 INFO:teuthology.orchestra.run.smithi040.stdout:190 2023-06-22T10:57:27.230 INFO:teuthology.orchestra.run.smithi040.stdout:190.out 2023-06-22T10:57:27.230 INFO:teuthology.orchestra.run.smithi040.stdout:191 2023-06-22T10:57:27.230 INFO:teuthology.orchestra.run.smithi040.stdout:191.out 2023-06-22T10:57:27.230 INFO:teuthology.orchestra.run.smithi040.stdout:192 2023-06-22T10:57:27.231 INFO:teuthology.orchestra.run.smithi040.stdout:192.out 2023-06-22T10:57:27.231 INFO:teuthology.orchestra.run.smithi040.stdout:193 2023-06-22T10:57:27.231 INFO:teuthology.orchestra.run.smithi040.stdout:193.out 2023-06-22T10:57:27.231 INFO:teuthology.orchestra.run.smithi040.stdout:194 2023-06-22T10:57:27.231 INFO:teuthology.orchestra.run.smithi040.stdout:194.out 2023-06-22T10:57:27.231 INFO:teuthology.orchestra.run.smithi040.stdout:195 2023-06-22T10:57:27.231 INFO:teuthology.orchestra.run.smithi040.stdout:195.out 2023-06-22T10:57:27.231 INFO:teuthology.orchestra.run.smithi040.stdout:196 2023-06-22T10:57:27.232 INFO:teuthology.orchestra.run.smithi040.stdout:196.out 2023-06-22T10:57:27.232 INFO:teuthology.orchestra.run.smithi040.stdout:197 2023-06-22T10:57:27.232 INFO:teuthology.orchestra.run.smithi040.stdout:197.out 2023-06-22T10:57:27.232 INFO:teuthology.orchestra.run.smithi040.stdout:198 2023-06-22T10:57:27.232 INFO:teuthology.orchestra.run.smithi040.stdout:198.out 2023-06-22T10:57:27.232 INFO:teuthology.orchestra.run.smithi040.stdout:199 2023-06-22T10:57:27.232 INFO:teuthology.orchestra.run.smithi040.stdout:199.out 2023-06-22T10:57:27.233 INFO:teuthology.orchestra.run.smithi040.stdout:200 2023-06-22T10:57:27.233 INFO:teuthology.orchestra.run.smithi040.stdout:200.out 2023-06-22T10:57:27.233 INFO:teuthology.orchestra.run.smithi040.stdout:201 2023-06-22T10:57:27.233 INFO:teuthology.orchestra.run.smithi040.stdout:201.out 2023-06-22T10:57:27.233 INFO:teuthology.orchestra.run.smithi040.stdout:202 2023-06-22T10:57:27.233 INFO:teuthology.orchestra.run.smithi040.stdout:202.out 2023-06-22T10:57:27.233 INFO:teuthology.orchestra.run.smithi040.stdout:203 2023-06-22T10:57:27.233 INFO:teuthology.orchestra.run.smithi040.stdout:203.out 2023-06-22T10:57:27.234 INFO:teuthology.orchestra.run.smithi040.stdout:204 2023-06-22T10:57:27.234 INFO:teuthology.orchestra.run.smithi040.stdout:204.out 2023-06-22T10:57:27.234 INFO:teuthology.orchestra.run.smithi040.stdout:205 2023-06-22T10:57:27.234 INFO:teuthology.orchestra.run.smithi040.stdout:205.out 2023-06-22T10:57:27.234 INFO:teuthology.orchestra.run.smithi040.stdout:206 2023-06-22T10:57:27.234 INFO:teuthology.orchestra.run.smithi040.stdout:206.out 2023-06-22T10:57:27.234 INFO:teuthology.orchestra.run.smithi040.stdout:207 2023-06-22T10:57:27.234 INFO:teuthology.orchestra.run.smithi040.stdout:207.out 2023-06-22T10:57:27.235 INFO:teuthology.orchestra.run.smithi040.stdout:208 2023-06-22T10:57:27.235 INFO:teuthology.orchestra.run.smithi040.stdout:208.out 2023-06-22T10:57:27.235 INFO:teuthology.orchestra.run.smithi040.stdout:209 2023-06-22T10:57:27.235 INFO:teuthology.orchestra.run.smithi040.stdout:209.out 2023-06-22T10:57:27.235 INFO:teuthology.orchestra.run.smithi040.stdout:210 2023-06-22T10:57:27.235 INFO:teuthology.orchestra.run.smithi040.stdout:210.out 2023-06-22T10:57:27.235 INFO:teuthology.orchestra.run.smithi040.stdout:211 2023-06-22T10:57:27.235 INFO:teuthology.orchestra.run.smithi040.stdout:211.out 2023-06-22T10:57:27.236 INFO:teuthology.orchestra.run.smithi040.stdout:212 2023-06-22T10:57:27.236 INFO:teuthology.orchestra.run.smithi040.stdout:212.out 2023-06-22T10:57:27.236 INFO:teuthology.orchestra.run.smithi040.stdout:213 2023-06-22T10:57:27.236 INFO:teuthology.orchestra.run.smithi040.stdout:213.out 2023-06-22T10:57:27.236 INFO:teuthology.orchestra.run.smithi040.stdout:214 2023-06-22T10:57:27.236 INFO:teuthology.orchestra.run.smithi040.stdout:214.out 2023-06-22T10:57:27.236 INFO:teuthology.orchestra.run.smithi040.stdout:215 2023-06-22T10:57:27.237 INFO:teuthology.orchestra.run.smithi040.stdout:215.out 2023-06-22T10:57:27.237 INFO:teuthology.orchestra.run.smithi040.stdout:216 2023-06-22T10:57:27.237 INFO:teuthology.orchestra.run.smithi040.stdout:216.out 2023-06-22T10:57:27.237 INFO:teuthology.orchestra.run.smithi040.stdout:217 2023-06-22T10:57:27.237 INFO:teuthology.orchestra.run.smithi040.stdout:217.out 2023-06-22T10:57:27.237 INFO:teuthology.orchestra.run.smithi040.stdout:218 2023-06-22T10:57:27.237 INFO:teuthology.orchestra.run.smithi040.stdout:218.out 2023-06-22T10:57:27.237 INFO:teuthology.orchestra.run.smithi040.stdout:219 2023-06-22T10:57:27.238 INFO:teuthology.orchestra.run.smithi040.stdout:219.out 2023-06-22T10:57:27.238 INFO:teuthology.orchestra.run.smithi040.stdout:220 2023-06-22T10:57:27.238 INFO:teuthology.orchestra.run.smithi040.stdout:220.out 2023-06-22T10:57:27.238 INFO:teuthology.orchestra.run.smithi040.stdout:221 2023-06-22T10:57:27.238 INFO:teuthology.orchestra.run.smithi040.stdout:221.out 2023-06-22T10:57:27.238 INFO:teuthology.orchestra.run.smithi040.stdout:222 2023-06-22T10:57:27.238 INFO:teuthology.orchestra.run.smithi040.stdout:222.out 2023-06-22T10:57:27.238 INFO:teuthology.orchestra.run.smithi040.stdout:223 2023-06-22T10:57:27.239 INFO:teuthology.orchestra.run.smithi040.stdout:223.out 2023-06-22T10:57:27.239 INFO:teuthology.orchestra.run.smithi040.stdout:224 2023-06-22T10:57:27.239 INFO:teuthology.orchestra.run.smithi040.stdout:224.out 2023-06-22T10:57:27.239 INFO:teuthology.orchestra.run.smithi040.stdout:225 2023-06-22T10:57:27.239 INFO:teuthology.orchestra.run.smithi040.stdout:225.out 2023-06-22T10:57:27.239 INFO:teuthology.orchestra.run.smithi040.stdout:226 2023-06-22T10:57:27.239 INFO:teuthology.orchestra.run.smithi040.stdout:226.out 2023-06-22T10:57:27.239 INFO:teuthology.orchestra.run.smithi040.stdout:227 2023-06-22T10:57:27.240 INFO:teuthology.orchestra.run.smithi040.stdout:227.out 2023-06-22T10:57:27.240 INFO:teuthology.orchestra.run.smithi040.stdout:228 2023-06-22T10:57:27.240 INFO:teuthology.orchestra.run.smithi040.stdout:228.out 2023-06-22T10:57:27.240 INFO:teuthology.orchestra.run.smithi040.stdout:229 2023-06-22T10:57:27.240 INFO:teuthology.orchestra.run.smithi040.stdout:229.out 2023-06-22T10:57:27.240 INFO:teuthology.orchestra.run.smithi040.stdout:230 2023-06-22T10:57:27.240 INFO:teuthology.orchestra.run.smithi040.stdout:230.out 2023-06-22T10:57:27.241 INFO:teuthology.orchestra.run.smithi040.stdout:231 2023-06-22T10:57:27.241 INFO:teuthology.orchestra.run.smithi040.stdout:231.out 2023-06-22T10:57:27.241 INFO:teuthology.orchestra.run.smithi040.stdout:232 2023-06-22T10:57:27.241 INFO:teuthology.orchestra.run.smithi040.stdout:232.out 2023-06-22T10:57:27.241 INFO:teuthology.orchestra.run.smithi040.stdout:233 2023-06-22T10:57:27.241 INFO:teuthology.orchestra.run.smithi040.stdout:233.out 2023-06-22T10:57:27.241 INFO:teuthology.orchestra.run.smithi040.stdout:234 2023-06-22T10:57:27.241 INFO:teuthology.orchestra.run.smithi040.stdout:234.out 2023-06-22T10:57:27.242 INFO:teuthology.orchestra.run.smithi040.stdout:235 2023-06-22T10:57:27.242 INFO:teuthology.orchestra.run.smithi040.stdout:235.out 2023-06-22T10:57:27.242 INFO:teuthology.orchestra.run.smithi040.stdout:236 2023-06-22T10:57:27.242 INFO:teuthology.orchestra.run.smithi040.stdout:236.out 2023-06-22T10:57:27.242 INFO:teuthology.orchestra.run.smithi040.stdout:237 2023-06-22T10:57:27.242 INFO:teuthology.orchestra.run.smithi040.stdout:237.out 2023-06-22T10:57:27.242 INFO:teuthology.orchestra.run.smithi040.stdout:238 2023-06-22T10:57:27.242 INFO:teuthology.orchestra.run.smithi040.stdout:238.out 2023-06-22T10:57:27.243 INFO:teuthology.orchestra.run.smithi040.stdout:239 2023-06-22T10:57:27.243 INFO:teuthology.orchestra.run.smithi040.stdout:239.out 2023-06-22T10:57:27.243 INFO:teuthology.orchestra.run.smithi040.stdout:240 2023-06-22T10:57:27.243 INFO:teuthology.orchestra.run.smithi040.stdout:240.out 2023-06-22T10:57:27.243 INFO:teuthology.orchestra.run.smithi040.stdout:241 2023-06-22T10:57:27.243 INFO:teuthology.orchestra.run.smithi040.stdout:241.out 2023-06-22T10:57:27.243 INFO:teuthology.orchestra.run.smithi040.stdout:242 2023-06-22T10:57:27.243 INFO:teuthology.orchestra.run.smithi040.stdout:242.out 2023-06-22T10:57:27.244 INFO:teuthology.orchestra.run.smithi040.stdout:243 2023-06-22T10:57:27.244 INFO:teuthology.orchestra.run.smithi040.stdout:243.out 2023-06-22T10:57:27.244 INFO:teuthology.orchestra.run.smithi040.stdout:244 2023-06-22T10:57:27.244 INFO:teuthology.orchestra.run.smithi040.stdout:244.out 2023-06-22T10:57:27.244 INFO:teuthology.orchestra.run.smithi040.stdout:245 2023-06-22T10:57:27.244 INFO:teuthology.orchestra.run.smithi040.stdout:245.out 2023-06-22T10:57:27.244 INFO:teuthology.orchestra.run.smithi040.stdout:246 2023-06-22T10:57:27.245 INFO:teuthology.orchestra.run.smithi040.stdout:246.out 2023-06-22T10:57:27.245 INFO:teuthology.orchestra.run.smithi040.stdout:247 2023-06-22T10:57:27.245 INFO:teuthology.orchestra.run.smithi040.stdout:247.out 2023-06-22T10:57:27.245 INFO:teuthology.orchestra.run.smithi040.stdout:248 2023-06-22T10:57:27.246 INFO:teuthology.orchestra.run.smithi040.stdout:248.out 2023-06-22T10:57:27.246 INFO:teuthology.orchestra.run.smithi040.stdout:249 2023-06-22T10:57:27.246 INFO:teuthology.orchestra.run.smithi040.stdout:249.out 2023-06-22T10:57:27.246 INFO:teuthology.orchestra.run.smithi040.stdout:250 2023-06-22T10:57:27.247 INFO:teuthology.orchestra.run.smithi040.stdout:250.out 2023-06-22T10:57:27.247 INFO:teuthology.orchestra.run.smithi040.stdout:251 2023-06-22T10:57:27.247 INFO:teuthology.orchestra.run.smithi040.stdout:251.out 2023-06-22T10:57:27.247 INFO:teuthology.orchestra.run.smithi040.stdout:252 2023-06-22T10:57:27.248 INFO:teuthology.orchestra.run.smithi040.stdout:252.out 2023-06-22T10:57:27.248 INFO:teuthology.orchestra.run.smithi040.stdout:253 2023-06-22T10:57:27.248 INFO:teuthology.orchestra.run.smithi040.stdout:253.out 2023-06-22T10:57:27.249 INFO:teuthology.orchestra.run.smithi040.stdout:254 2023-06-22T10:57:27.249 INFO:teuthology.orchestra.run.smithi040.stdout:254.out 2023-06-22T10:57:27.249 INFO:teuthology.orchestra.run.smithi040.stdout:255 2023-06-22T10:57:27.250 INFO:teuthology.orchestra.run.smithi040.stdout:255.out 2023-06-22T10:57:27.250 INFO:teuthology.orchestra.run.smithi040.stdout:256 2023-06-22T10:57:27.250 INFO:teuthology.orchestra.run.smithi040.stdout:256.out 2023-06-22T10:57:27.250 INFO:teuthology.orchestra.run.smithi040.stdout:257 2023-06-22T10:57:27.251 INFO:teuthology.orchestra.run.smithi040.stdout:257.out 2023-06-22T10:57:27.251 INFO:teuthology.orchestra.run.smithi040.stdout:258 2023-06-22T10:57:27.251 INFO:teuthology.orchestra.run.smithi040.stdout:258.out 2023-06-22T10:57:27.251 INFO:teuthology.orchestra.run.smithi040.stdout:259 2023-06-22T10:57:27.251 INFO:teuthology.orchestra.run.smithi040.stdout:259.out 2023-06-22T10:57:27.251 INFO:teuthology.orchestra.run.smithi040.stdout:260 2023-06-22T10:57:27.251 INFO:teuthology.orchestra.run.smithi040.stdout:260.out 2023-06-22T10:57:27.251 INFO:teuthology.orchestra.run.smithi040.stdout:261 2023-06-22T10:57:27.252 INFO:teuthology.orchestra.run.smithi040.stdout:261.out 2023-06-22T10:57:27.252 INFO:teuthology.orchestra.run.smithi040.stdout:262 2023-06-22T10:57:27.252 INFO:teuthology.orchestra.run.smithi040.stdout:262.out 2023-06-22T10:57:27.252 INFO:teuthology.orchestra.run.smithi040.stdout:263 2023-06-22T10:57:27.252 INFO:teuthology.orchestra.run.smithi040.stdout:263.out 2023-06-22T10:57:27.252 INFO:teuthology.orchestra.run.smithi040.stdout:264 2023-06-22T10:57:27.252 INFO:teuthology.orchestra.run.smithi040.stdout:264.out 2023-06-22T10:57:27.253 INFO:teuthology.orchestra.run.smithi040.stdout:265 2023-06-22T10:57:27.253 INFO:teuthology.orchestra.run.smithi040.stdout:265.out 2023-06-22T10:57:27.253 INFO:teuthology.orchestra.run.smithi040.stdout:266 2023-06-22T10:57:27.253 INFO:teuthology.orchestra.run.smithi040.stdout:266.out 2023-06-22T10:57:27.253 INFO:teuthology.orchestra.run.smithi040.stdout:267 2023-06-22T10:57:27.253 INFO:teuthology.orchestra.run.smithi040.stdout:267.out 2023-06-22T10:57:27.253 INFO:teuthology.orchestra.run.smithi040.stdout:268 2023-06-22T10:57:27.253 INFO:teuthology.orchestra.run.smithi040.stdout:268.out 2023-06-22T10:57:27.254 INFO:teuthology.orchestra.run.smithi040.stdout:269 2023-06-22T10:57:27.254 INFO:teuthology.orchestra.run.smithi040.stdout:269.out 2023-06-22T10:57:27.254 INFO:teuthology.orchestra.run.smithi040.stdout:270 2023-06-22T10:57:27.254 INFO:teuthology.orchestra.run.smithi040.stdout:270.out 2023-06-22T10:57:27.254 INFO:teuthology.orchestra.run.smithi040.stdout:271 2023-06-22T10:57:27.254 INFO:teuthology.orchestra.run.smithi040.stdout:271.out 2023-06-22T10:57:27.254 INFO:teuthology.orchestra.run.smithi040.stdout:272 2023-06-22T10:57:27.254 INFO:teuthology.orchestra.run.smithi040.stdout:272.out 2023-06-22T10:57:27.255 INFO:teuthology.orchestra.run.smithi040.stdout:273 2023-06-22T10:57:27.255 INFO:teuthology.orchestra.run.smithi040.stdout:273.out 2023-06-22T10:57:27.255 INFO:teuthology.orchestra.run.smithi040.stdout:274 2023-06-22T10:57:27.255 INFO:teuthology.orchestra.run.smithi040.stdout:274.out 2023-06-22T10:57:27.255 INFO:teuthology.orchestra.run.smithi040.stdout:275 2023-06-22T10:57:27.255 INFO:teuthology.orchestra.run.smithi040.stdout:275.out 2023-06-22T10:57:27.255 INFO:teuthology.orchestra.run.smithi040.stdout:276 2023-06-22T10:57:27.255 INFO:teuthology.orchestra.run.smithi040.stdout:276.out 2023-06-22T10:57:27.256 INFO:teuthology.orchestra.run.smithi040.stdout:277 2023-06-22T10:57:27.256 INFO:teuthology.orchestra.run.smithi040.stdout:277.out 2023-06-22T10:57:27.256 INFO:teuthology.orchestra.run.smithi040.stdout:278 2023-06-22T10:57:27.256 INFO:teuthology.orchestra.run.smithi040.stdout:278.out 2023-06-22T10:57:27.256 INFO:teuthology.orchestra.run.smithi040.stdout:279 2023-06-22T10:57:27.256 INFO:teuthology.orchestra.run.smithi040.stdout:279.out 2023-06-22T10:57:27.256 INFO:teuthology.orchestra.run.smithi040.stdout:280 2023-06-22T10:57:27.257 INFO:teuthology.orchestra.run.smithi040.stdout:280.out 2023-06-22T10:57:27.257 INFO:teuthology.orchestra.run.smithi040.stdout:281 2023-06-22T10:57:27.257 INFO:teuthology.orchestra.run.smithi040.stdout:281.out 2023-06-22T10:57:27.257 INFO:teuthology.orchestra.run.smithi040.stdout:282 2023-06-22T10:57:27.257 INFO:teuthology.orchestra.run.smithi040.stdout:282.out 2023-06-22T10:57:27.257 INFO:teuthology.orchestra.run.smithi040.stdout:283 2023-06-22T10:57:27.257 INFO:teuthology.orchestra.run.smithi040.stdout:283.out 2023-06-22T10:57:27.257 INFO:teuthology.orchestra.run.smithi040.stdout:284 2023-06-22T10:57:27.258 INFO:teuthology.orchestra.run.smithi040.stdout:284.out 2023-06-22T10:57:27.258 INFO:teuthology.orchestra.run.smithi040.stdout:285 2023-06-22T10:57:27.258 INFO:teuthology.orchestra.run.smithi040.stdout:285.out 2023-06-22T10:57:27.258 INFO:teuthology.orchestra.run.smithi040.stdout:286 2023-06-22T10:57:27.258 INFO:teuthology.orchestra.run.smithi040.stdout:286.out 2023-06-22T10:57:27.258 INFO:teuthology.orchestra.run.smithi040.stdout:287 2023-06-22T10:57:27.258 INFO:teuthology.orchestra.run.smithi040.stdout:287.out 2023-06-22T10:57:27.258 INFO:teuthology.orchestra.run.smithi040.stdout:288 2023-06-22T10:57:27.259 INFO:teuthology.orchestra.run.smithi040.stdout:288.out 2023-06-22T10:57:27.259 INFO:teuthology.orchestra.run.smithi040.stdout:289 2023-06-22T10:57:27.259 INFO:teuthology.orchestra.run.smithi040.stdout:289.out 2023-06-22T10:57:27.259 INFO:teuthology.orchestra.run.smithi040.stdout:290 2023-06-22T10:57:27.259 INFO:teuthology.orchestra.run.smithi040.stdout:290.out 2023-06-22T10:57:27.259 INFO:teuthology.orchestra.run.smithi040.stdout:291 2023-06-22T10:57:27.259 INFO:teuthology.orchestra.run.smithi040.stdout:291.out 2023-06-22T10:57:27.259 INFO:teuthology.orchestra.run.smithi040.stdout:292 2023-06-22T10:57:27.260 INFO:teuthology.orchestra.run.smithi040.stdout:292.out 2023-06-22T10:57:27.260 INFO:teuthology.orchestra.run.smithi040.stdout:293 2023-06-22T10:57:27.260 INFO:teuthology.orchestra.run.smithi040.stdout:293.out 2023-06-22T10:57:27.260 INFO:teuthology.orchestra.run.smithi040.stdout:294 2023-06-22T10:57:27.260 INFO:teuthology.orchestra.run.smithi040.stdout:294.out 2023-06-22T10:57:27.260 INFO:teuthology.orchestra.run.smithi040.stdout:295 2023-06-22T10:57:27.260 INFO:teuthology.orchestra.run.smithi040.stdout:295.out 2023-06-22T10:57:27.261 INFO:teuthology.orchestra.run.smithi040.stdout:296 2023-06-22T10:57:27.261 INFO:teuthology.orchestra.run.smithi040.stdout:296.out 2023-06-22T10:57:27.261 INFO:teuthology.orchestra.run.smithi040.stdout:297 2023-06-22T10:57:27.261 INFO:teuthology.orchestra.run.smithi040.stdout:297.out 2023-06-22T10:57:27.261 INFO:teuthology.orchestra.run.smithi040.stdout:298 2023-06-22T10:57:27.261 INFO:teuthology.orchestra.run.smithi040.stdout:298.out 2023-06-22T10:57:27.261 INFO:teuthology.orchestra.run.smithi040.stdout:299 2023-06-22T10:57:27.261 INFO:teuthology.orchestra.run.smithi040.stdout:299.out 2023-06-22T10:57:27.262 INFO:teuthology.orchestra.run.smithi040.stdout:300 2023-06-22T10:57:27.262 INFO:teuthology.orchestra.run.smithi040.stdout:300.out 2023-06-22T10:57:27.262 INFO:teuthology.orchestra.run.smithi040.stdout:301 2023-06-22T10:57:27.262 INFO:teuthology.orchestra.run.smithi040.stdout:301.out 2023-06-22T10:57:27.262 INFO:teuthology.orchestra.run.smithi040.stdout:302 2023-06-22T10:57:27.262 INFO:teuthology.orchestra.run.smithi040.stdout:302.out 2023-06-22T10:57:27.262 INFO:teuthology.orchestra.run.smithi040.stdout:303 2023-06-22T10:57:27.262 INFO:teuthology.orchestra.run.smithi040.stdout:303.out 2023-06-22T10:57:27.263 INFO:teuthology.orchestra.run.smithi040.stdout:304 2023-06-22T10:57:27.263 INFO:teuthology.orchestra.run.smithi040.stdout:304.out 2023-06-22T10:57:27.263 INFO:teuthology.orchestra.run.smithi040.stdout:305 2023-06-22T10:57:27.263 INFO:teuthology.orchestra.run.smithi040.stdout:305.out 2023-06-22T10:57:27.263 INFO:teuthology.orchestra.run.smithi040.stdout:306 2023-06-22T10:57:27.263 INFO:teuthology.orchestra.run.smithi040.stdout:306.out 2023-06-22T10:57:27.263 INFO:teuthology.orchestra.run.smithi040.stdout:307 2023-06-22T10:57:27.263 INFO:teuthology.orchestra.run.smithi040.stdout:307.out 2023-06-22T10:57:27.264 INFO:teuthology.orchestra.run.smithi040.stdout:308 2023-06-22T10:57:27.264 INFO:teuthology.orchestra.run.smithi040.stdout:308.out 2023-06-22T10:57:27.264 INFO:teuthology.orchestra.run.smithi040.stdout:309 2023-06-22T10:57:27.264 INFO:teuthology.orchestra.run.smithi040.stdout:309.out 2023-06-22T10:57:27.264 INFO:teuthology.orchestra.run.smithi040.stdout:310 2023-06-22T10:57:27.264 INFO:teuthology.orchestra.run.smithi040.stdout:310.out 2023-06-22T10:57:27.264 INFO:teuthology.orchestra.run.smithi040.stdout:311 2023-06-22T10:57:27.264 INFO:teuthology.orchestra.run.smithi040.stdout:311.out 2023-06-22T10:57:27.265 INFO:teuthology.orchestra.run.smithi040.stdout:312 2023-06-22T10:57:27.265 INFO:teuthology.orchestra.run.smithi040.stdout:312.out 2023-06-22T10:57:27.265 INFO:teuthology.orchestra.run.smithi040.stdout:313 2023-06-22T10:57:27.265 INFO:teuthology.orchestra.run.smithi040.stdout:313.out 2023-06-22T10:57:27.265 INFO:teuthology.orchestra.run.smithi040.stdout:314 2023-06-22T10:57:27.265 INFO:teuthology.orchestra.run.smithi040.stdout:314.out 2023-06-22T10:57:27.266 INFO:teuthology.orchestra.run.smithi040.stdout:315 2023-06-22T10:57:27.266 INFO:teuthology.orchestra.run.smithi040.stdout:315.out 2023-06-22T10:57:27.266 INFO:teuthology.orchestra.run.smithi040.stdout:316 2023-06-22T10:57:27.266 INFO:teuthology.orchestra.run.smithi040.stdout:316.out 2023-06-22T10:57:27.266 INFO:teuthology.orchestra.run.smithi040.stdout:317 2023-06-22T10:57:27.266 INFO:teuthology.orchestra.run.smithi040.stdout:317.out 2023-06-22T10:57:27.266 INFO:teuthology.orchestra.run.smithi040.stdout:318 2023-06-22T10:57:27.266 INFO:teuthology.orchestra.run.smithi040.stdout:318.out 2023-06-22T10:57:27.267 INFO:teuthology.orchestra.run.smithi040.stdout:319 2023-06-22T10:57:27.267 INFO:teuthology.orchestra.run.smithi040.stdout:319.out 2023-06-22T10:57:27.267 INFO:teuthology.orchestra.run.smithi040.stdout:320 2023-06-22T10:57:27.267 INFO:teuthology.orchestra.run.smithi040.stdout:320.out 2023-06-22T10:57:27.267 INFO:teuthology.orchestra.run.smithi040.stdout:321 2023-06-22T10:57:27.267 INFO:teuthology.orchestra.run.smithi040.stdout:321.out 2023-06-22T10:57:27.267 INFO:teuthology.orchestra.run.smithi040.stdout:322 2023-06-22T10:57:27.267 INFO:teuthology.orchestra.run.smithi040.stdout:322.out 2023-06-22T10:57:27.268 INFO:teuthology.orchestra.run.smithi040.stdout:323 2023-06-22T10:57:27.268 INFO:teuthology.orchestra.run.smithi040.stdout:323.out 2023-06-22T10:57:27.268 INFO:teuthology.orchestra.run.smithi040.stdout:324 2023-06-22T10:57:27.268 INFO:teuthology.orchestra.run.smithi040.stdout:324.out 2023-06-22T10:57:27.268 INFO:teuthology.orchestra.run.smithi040.stdout:325 2023-06-22T10:57:27.268 INFO:teuthology.orchestra.run.smithi040.stdout:325.out 2023-06-22T10:57:27.268 INFO:teuthology.orchestra.run.smithi040.stdout:326 2023-06-22T10:57:27.269 INFO:teuthology.orchestra.run.smithi040.stdout:326.out 2023-06-22T10:57:27.269 INFO:teuthology.orchestra.run.smithi040.stdout:327 2023-06-22T10:57:27.269 INFO:teuthology.orchestra.run.smithi040.stdout:327.out 2023-06-22T10:57:27.269 INFO:teuthology.orchestra.run.smithi040.stdout:328 2023-06-22T10:57:27.269 INFO:teuthology.orchestra.run.smithi040.stdout:328.out 2023-06-22T10:57:27.269 INFO:teuthology.orchestra.run.smithi040.stdout:329 2023-06-22T10:57:27.269 INFO:teuthology.orchestra.run.smithi040.stdout:329.out 2023-06-22T10:57:27.269 INFO:teuthology.orchestra.run.smithi040.stdout:330 2023-06-22T10:57:27.270 INFO:teuthology.orchestra.run.smithi040.stdout:330.out 2023-06-22T10:57:27.270 INFO:teuthology.orchestra.run.smithi040.stdout:331 2023-06-22T10:57:27.270 INFO:teuthology.orchestra.run.smithi040.stdout:331.out 2023-06-22T10:57:27.270 INFO:teuthology.orchestra.run.smithi040.stdout:332 2023-06-22T10:57:27.270 INFO:teuthology.orchestra.run.smithi040.stdout:332.out 2023-06-22T10:57:27.270 INFO:teuthology.orchestra.run.smithi040.stdout:333 2023-06-22T10:57:27.270 INFO:teuthology.orchestra.run.smithi040.stdout:333.out 2023-06-22T10:57:27.270 INFO:teuthology.orchestra.run.smithi040.stdout:334 2023-06-22T10:57:27.271 INFO:teuthology.orchestra.run.smithi040.stdout:334.out 2023-06-22T10:57:27.271 INFO:teuthology.orchestra.run.smithi040.stdout:335 2023-06-22T10:57:27.271 INFO:teuthology.orchestra.run.smithi040.stdout:335.out 2023-06-22T10:57:27.271 INFO:teuthology.orchestra.run.smithi040.stdout:336 2023-06-22T10:57:27.271 INFO:teuthology.orchestra.run.smithi040.stdout:336.out 2023-06-22T10:57:27.271 INFO:teuthology.orchestra.run.smithi040.stdout:337 2023-06-22T10:57:27.271 INFO:teuthology.orchestra.run.smithi040.stdout:337.out 2023-06-22T10:57:27.271 INFO:teuthology.orchestra.run.smithi040.stdout:338 2023-06-22T10:57:27.272 INFO:teuthology.orchestra.run.smithi040.stdout:338.out 2023-06-22T10:57:27.272 INFO:teuthology.orchestra.run.smithi040.stdout:339 2023-06-22T10:57:27.272 INFO:teuthology.orchestra.run.smithi040.stdout:339.out 2023-06-22T10:57:27.272 INFO:teuthology.orchestra.run.smithi040.stdout:340 2023-06-22T10:57:27.272 INFO:teuthology.orchestra.run.smithi040.stdout:340.out 2023-06-22T10:57:27.272 INFO:teuthology.orchestra.run.smithi040.stdout:341 2023-06-22T10:57:27.272 INFO:teuthology.orchestra.run.smithi040.stdout:341.out 2023-06-22T10:57:27.273 INFO:teuthology.orchestra.run.smithi040.stdout:342 2023-06-22T10:57:27.273 INFO:teuthology.orchestra.run.smithi040.stdout:342.out 2023-06-22T10:57:27.273 INFO:teuthology.orchestra.run.smithi040.stdout:343 2023-06-22T10:57:27.273 INFO:teuthology.orchestra.run.smithi040.stdout:343.out 2023-06-22T10:57:27.273 INFO:teuthology.orchestra.run.smithi040.stdout:344 2023-06-22T10:57:27.273 INFO:teuthology.orchestra.run.smithi040.stdout:344.out 2023-06-22T10:57:27.273 INFO:teuthology.orchestra.run.smithi040.stdout:345 2023-06-22T10:57:27.273 INFO:teuthology.orchestra.run.smithi040.stdout:345.out 2023-06-22T10:57:27.274 INFO:teuthology.orchestra.run.smithi040.stdout:346 2023-06-22T10:57:27.274 INFO:teuthology.orchestra.run.smithi040.stdout:346.out 2023-06-22T10:57:27.274 INFO:teuthology.orchestra.run.smithi040.stdout:347 2023-06-22T10:57:27.274 INFO:teuthology.orchestra.run.smithi040.stdout:347.out 2023-06-22T10:57:27.274 INFO:teuthology.orchestra.run.smithi040.stdout:348 2023-06-22T10:57:27.274 INFO:teuthology.orchestra.run.smithi040.stdout:348.out 2023-06-22T10:57:27.274 INFO:teuthology.orchestra.run.smithi040.stdout:349 2023-06-22T10:57:27.274 INFO:teuthology.orchestra.run.smithi040.stdout:349.out 2023-06-22T10:57:27.275 INFO:teuthology.orchestra.run.smithi040.stdout:350 2023-06-22T10:57:27.275 INFO:teuthology.orchestra.run.smithi040.stdout:350.out 2023-06-22T10:57:27.275 INFO:teuthology.orchestra.run.smithi040.stdout:351 2023-06-22T10:57:27.275 INFO:teuthology.orchestra.run.smithi040.stdout:351.out 2023-06-22T10:57:27.275 INFO:teuthology.orchestra.run.smithi040.stdout:352 2023-06-22T10:57:27.275 INFO:teuthology.orchestra.run.smithi040.stdout:352.out 2023-06-22T10:57:27.275 INFO:teuthology.orchestra.run.smithi040.stdout:353 2023-06-22T10:57:27.275 INFO:teuthology.orchestra.run.smithi040.stdout:353.out 2023-06-22T10:57:27.276 INFO:teuthology.orchestra.run.smithi040.stdout:354 2023-06-22T10:57:27.276 INFO:teuthology.orchestra.run.smithi040.stdout:354.out 2023-06-22T10:57:27.276 INFO:teuthology.orchestra.run.smithi040.stdout:355 2023-06-22T10:57:27.276 INFO:teuthology.orchestra.run.smithi040.stdout:355.out 2023-06-22T10:57:27.276 INFO:teuthology.orchestra.run.smithi040.stdout:356 2023-06-22T10:57:27.276 INFO:teuthology.orchestra.run.smithi040.stdout:356.out 2023-06-22T10:57:27.276 INFO:teuthology.orchestra.run.smithi040.stdout:357 2023-06-22T10:57:27.277 INFO:teuthology.orchestra.run.smithi040.stdout:357.out 2023-06-22T10:57:27.277 INFO:teuthology.orchestra.run.smithi040.stdout:358 2023-06-22T10:57:27.277 INFO:teuthology.orchestra.run.smithi040.stdout:358.out 2023-06-22T10:57:27.277 INFO:teuthology.orchestra.run.smithi040.stdout:359 2023-06-22T10:57:27.277 INFO:teuthology.orchestra.run.smithi040.stdout:359.out 2023-06-22T10:57:27.277 INFO:teuthology.orchestra.run.smithi040.stdout:360 2023-06-22T10:57:27.277 INFO:teuthology.orchestra.run.smithi040.stdout:360.out 2023-06-22T10:57:27.278 INFO:teuthology.orchestra.run.smithi040.stdout:361 2023-06-22T10:57:27.278 INFO:teuthology.orchestra.run.smithi040.stdout:361.out 2023-06-22T10:57:27.278 INFO:teuthology.orchestra.run.smithi040.stdout:362 2023-06-22T10:57:27.278 INFO:teuthology.orchestra.run.smithi040.stdout:362.out 2023-06-22T10:57:27.278 INFO:teuthology.orchestra.run.smithi040.stdout:363 2023-06-22T10:57:27.278 INFO:teuthology.orchestra.run.smithi040.stdout:363.out 2023-06-22T10:57:27.278 INFO:teuthology.orchestra.run.smithi040.stdout:364 2023-06-22T10:57:27.278 INFO:teuthology.orchestra.run.smithi040.stdout:364.out 2023-06-22T10:57:27.279 INFO:teuthology.orchestra.run.smithi040.stdout:365 2023-06-22T10:57:27.279 INFO:teuthology.orchestra.run.smithi040.stdout:365.out 2023-06-22T10:57:27.279 INFO:teuthology.orchestra.run.smithi040.stdout:366 2023-06-22T10:57:27.279 INFO:teuthology.orchestra.run.smithi040.stdout:366.out 2023-06-22T10:57:27.279 INFO:teuthology.orchestra.run.smithi040.stdout:367 2023-06-22T10:57:27.279 INFO:teuthology.orchestra.run.smithi040.stdout:367.out 2023-06-22T10:57:27.279 INFO:teuthology.orchestra.run.smithi040.stdout:368 2023-06-22T10:57:27.279 INFO:teuthology.orchestra.run.smithi040.stdout:368.out 2023-06-22T10:57:27.280 INFO:teuthology.orchestra.run.smithi040.stdout:369 2023-06-22T10:57:27.280 INFO:teuthology.orchestra.run.smithi040.stdout:369.out 2023-06-22T10:57:27.280 INFO:teuthology.orchestra.run.smithi040.stdout:370 2023-06-22T10:57:27.280 INFO:teuthology.orchestra.run.smithi040.stdout:370.out 2023-06-22T10:57:27.280 INFO:teuthology.orchestra.run.smithi040.stdout:371 2023-06-22T10:57:27.280 INFO:teuthology.orchestra.run.smithi040.stdout:371.out 2023-06-22T10:57:27.280 INFO:teuthology.orchestra.run.smithi040.stdout:372 2023-06-22T10:57:27.280 INFO:teuthology.orchestra.run.smithi040.stdout:372.out 2023-06-22T10:57:27.281 INFO:teuthology.orchestra.run.smithi040.stdout:373 2023-06-22T10:57:27.281 INFO:teuthology.orchestra.run.smithi040.stdout:373.out 2023-06-22T10:57:27.281 INFO:teuthology.orchestra.run.smithi040.stdout:374 2023-06-22T10:57:27.281 INFO:teuthology.orchestra.run.smithi040.stdout:374.out 2023-06-22T10:57:27.281 INFO:teuthology.orchestra.run.smithi040.stdout:375 2023-06-22T10:57:27.281 INFO:teuthology.orchestra.run.smithi040.stdout:375.out 2023-06-22T10:57:27.281 INFO:teuthology.orchestra.run.smithi040.stdout:376 2023-06-22T10:57:27.282 INFO:teuthology.orchestra.run.smithi040.stdout:376.out 2023-06-22T10:57:27.282 INFO:teuthology.orchestra.run.smithi040.stdout:377 2023-06-22T10:57:27.282 INFO:teuthology.orchestra.run.smithi040.stdout:377.out 2023-06-22T10:57:27.282 INFO:teuthology.orchestra.run.smithi040.stdout:378 2023-06-22T10:57:27.282 INFO:teuthology.orchestra.run.smithi040.stdout:378.out 2023-06-22T10:57:27.283 INFO:teuthology.orchestra.run.smithi040.stdout:379 2023-06-22T10:57:27.283 INFO:teuthology.orchestra.run.smithi040.stdout:379.out 2023-06-22T10:57:27.283 INFO:teuthology.orchestra.run.smithi040.stdout:380 2023-06-22T10:57:27.283 INFO:teuthology.orchestra.run.smithi040.stdout:380.out 2023-06-22T10:57:27.284 INFO:teuthology.orchestra.run.smithi040.stdout:381 2023-06-22T10:57:27.284 INFO:teuthology.orchestra.run.smithi040.stdout:381.out 2023-06-22T10:57:27.284 INFO:teuthology.orchestra.run.smithi040.stdout:382 2023-06-22T10:57:27.284 INFO:teuthology.orchestra.run.smithi040.stdout:382.out 2023-06-22T10:57:27.285 INFO:teuthology.orchestra.run.smithi040.stdout:383 2023-06-22T10:57:27.285 INFO:teuthology.orchestra.run.smithi040.stdout:383.out 2023-06-22T10:57:27.285 INFO:teuthology.orchestra.run.smithi040.stdout:384 2023-06-22T10:57:27.286 INFO:teuthology.orchestra.run.smithi040.stdout:384.out 2023-06-22T10:57:27.286 INFO:teuthology.orchestra.run.smithi040.stdout:385 2023-06-22T10:57:27.286 INFO:teuthology.orchestra.run.smithi040.stdout:385.out 2023-06-22T10:57:27.286 INFO:teuthology.orchestra.run.smithi040.stdout:386 2023-06-22T10:57:27.287 INFO:teuthology.orchestra.run.smithi040.stdout:386.out 2023-06-22T10:57:27.287 INFO:teuthology.orchestra.run.smithi040.stdout:387 2023-06-22T10:57:27.287 INFO:teuthology.orchestra.run.smithi040.stdout:387.out 2023-06-22T10:57:27.288 INFO:teuthology.orchestra.run.smithi040.stdout:388 2023-06-22T10:57:27.288 INFO:teuthology.orchestra.run.smithi040.stdout:388.out 2023-06-22T10:57:27.288 INFO:teuthology.orchestra.run.smithi040.stdout:389 2023-06-22T10:57:27.288 INFO:teuthology.orchestra.run.smithi040.stdout:389.out 2023-06-22T10:57:27.288 INFO:teuthology.orchestra.run.smithi040.stdout:390 2023-06-22T10:57:27.288 INFO:teuthology.orchestra.run.smithi040.stdout:390.out 2023-06-22T10:57:27.288 INFO:teuthology.orchestra.run.smithi040.stdout:391 2023-06-22T10:57:27.289 INFO:teuthology.orchestra.run.smithi040.stdout:391.out 2023-06-22T10:57:27.289 INFO:teuthology.orchestra.run.smithi040.stdout:392 2023-06-22T10:57:27.289 INFO:teuthology.orchestra.run.smithi040.stdout:392.out 2023-06-22T10:57:27.289 INFO:teuthology.orchestra.run.smithi040.stdout:393 2023-06-22T10:57:27.289 INFO:teuthology.orchestra.run.smithi040.stdout:393.out 2023-06-22T10:57:27.289 INFO:teuthology.orchestra.run.smithi040.stdout:394 2023-06-22T10:57:27.289 INFO:teuthology.orchestra.run.smithi040.stdout:394.out 2023-06-22T10:57:27.289 INFO:teuthology.orchestra.run.smithi040.stdout:395 2023-06-22T10:57:27.290 INFO:teuthology.orchestra.run.smithi040.stdout:395.out 2023-06-22T10:57:27.290 INFO:teuthology.orchestra.run.smithi040.stdout:396 2023-06-22T10:57:27.290 INFO:teuthology.orchestra.run.smithi040.stdout:396.out 2023-06-22T10:57:27.290 INFO:teuthology.orchestra.run.smithi040.stdout:397 2023-06-22T10:57:27.290 INFO:teuthology.orchestra.run.smithi040.stdout:397.out 2023-06-22T10:57:27.290 INFO:teuthology.orchestra.run.smithi040.stdout:398 2023-06-22T10:57:27.290 INFO:teuthology.orchestra.run.smithi040.stdout:398.out 2023-06-22T10:57:27.290 INFO:teuthology.orchestra.run.smithi040.stdout:399 2023-06-22T10:57:27.291 INFO:teuthology.orchestra.run.smithi040.stdout:399.out 2023-06-22T10:57:27.291 INFO:teuthology.orchestra.run.smithi040.stdout:400 2023-06-22T10:57:27.291 INFO:teuthology.orchestra.run.smithi040.stdout:400.out 2023-06-22T10:57:27.291 INFO:teuthology.orchestra.run.smithi040.stdout:401 2023-06-22T10:57:27.291 INFO:teuthology.orchestra.run.smithi040.stdout:401.out 2023-06-22T10:57:27.291 INFO:teuthology.orchestra.run.smithi040.stdout:402 2023-06-22T10:57:27.291 INFO:teuthology.orchestra.run.smithi040.stdout:402.out 2023-06-22T10:57:27.291 INFO:teuthology.orchestra.run.smithi040.stdout:403 2023-06-22T10:57:27.292 INFO:teuthology.orchestra.run.smithi040.stdout:403.out 2023-06-22T10:57:27.292 INFO:teuthology.orchestra.run.smithi040.stdout:404 2023-06-22T10:57:27.292 INFO:teuthology.orchestra.run.smithi040.stdout:404.out 2023-06-22T10:57:27.292 INFO:teuthology.orchestra.run.smithi040.stdout:405 2023-06-22T10:57:27.292 INFO:teuthology.orchestra.run.smithi040.stdout:405.out 2023-06-22T10:57:27.292 INFO:teuthology.orchestra.run.smithi040.stdout:406 2023-06-22T10:57:27.292 INFO:teuthology.orchestra.run.smithi040.stdout:406.out 2023-06-22T10:57:27.293 INFO:teuthology.orchestra.run.smithi040.stdout:407 2023-06-22T10:57:27.293 INFO:teuthology.orchestra.run.smithi040.stdout:407.out 2023-06-22T10:57:27.293 INFO:teuthology.orchestra.run.smithi040.stdout:408 2023-06-22T10:57:27.293 INFO:teuthology.orchestra.run.smithi040.stdout:408.out 2023-06-22T10:57:27.293 INFO:teuthology.orchestra.run.smithi040.stdout:409 2023-06-22T10:57:27.294 INFO:teuthology.orchestra.run.smithi040.stdout:409.out 2023-06-22T10:57:27.294 INFO:teuthology.orchestra.run.smithi040.stdout:410 2023-06-22T10:57:27.294 INFO:teuthology.orchestra.run.smithi040.stdout:410.out 2023-06-22T10:57:27.294 INFO:teuthology.orchestra.run.smithi040.stdout:411 2023-06-22T10:57:27.294 INFO:teuthology.orchestra.run.smithi040.stdout:411.out 2023-06-22T10:57:27.294 INFO:teuthology.orchestra.run.smithi040.stdout:412 2023-06-22T10:57:27.294 INFO:teuthology.orchestra.run.smithi040.stdout:412.out 2023-06-22T10:57:27.295 INFO:teuthology.orchestra.run.smithi040.stdout:413 2023-06-22T10:57:27.295 INFO:teuthology.orchestra.run.smithi040.stdout:413.out 2023-06-22T10:57:27.295 INFO:teuthology.orchestra.run.smithi040.stdout:414 2023-06-22T10:57:27.295 INFO:teuthology.orchestra.run.smithi040.stdout:414.out 2023-06-22T10:57:27.295 INFO:teuthology.orchestra.run.smithi040.stdout:415 2023-06-22T10:57:27.295 INFO:teuthology.orchestra.run.smithi040.stdout:415.out 2023-06-22T10:57:27.295 INFO:teuthology.orchestra.run.smithi040.stdout:416 2023-06-22T10:57:27.295 INFO:teuthology.orchestra.run.smithi040.stdout:416.out 2023-06-22T10:57:27.296 INFO:teuthology.orchestra.run.smithi040.stdout:417 2023-06-22T10:57:27.296 INFO:teuthology.orchestra.run.smithi040.stdout:417.out 2023-06-22T10:57:27.296 INFO:teuthology.orchestra.run.smithi040.stdout:418 2023-06-22T10:57:27.296 INFO:teuthology.orchestra.run.smithi040.stdout:418.out 2023-06-22T10:57:27.296 INFO:teuthology.orchestra.run.smithi040.stdout:419 2023-06-22T10:57:27.296 INFO:teuthology.orchestra.run.smithi040.stdout:419.out 2023-06-22T10:57:27.296 INFO:teuthology.orchestra.run.smithi040.stdout:420 2023-06-22T10:57:27.296 INFO:teuthology.orchestra.run.smithi040.stdout:420.out 2023-06-22T10:57:27.297 INFO:teuthology.orchestra.run.smithi040.stdout:421 2023-06-22T10:57:27.297 INFO:teuthology.orchestra.run.smithi040.stdout:421.out 2023-06-22T10:57:27.297 INFO:teuthology.orchestra.run.smithi040.stdout:422 2023-06-22T10:57:27.297 INFO:teuthology.orchestra.run.smithi040.stdout:422.out 2023-06-22T10:57:27.297 INFO:teuthology.orchestra.run.smithi040.stdout:423 2023-06-22T10:57:27.297 INFO:teuthology.orchestra.run.smithi040.stdout:423.out 2023-06-22T10:57:27.297 INFO:teuthology.orchestra.run.smithi040.stdout:424 2023-06-22T10:57:27.297 INFO:teuthology.orchestra.run.smithi040.stdout:424.out 2023-06-22T10:57:27.298 INFO:teuthology.orchestra.run.smithi040.stdout:425 2023-06-22T10:57:27.298 INFO:teuthology.orchestra.run.smithi040.stdout:425.out 2023-06-22T10:57:27.298 INFO:teuthology.orchestra.run.smithi040.stdout:426 2023-06-22T10:57:27.298 INFO:teuthology.orchestra.run.smithi040.stdout:426.out 2023-06-22T10:57:27.298 INFO:teuthology.orchestra.run.smithi040.stdout:427 2023-06-22T10:57:27.298 INFO:teuthology.orchestra.run.smithi040.stdout:427.out 2023-06-22T10:57:27.298 INFO:teuthology.orchestra.run.smithi040.stdout:428 2023-06-22T10:57:27.298 INFO:teuthology.orchestra.run.smithi040.stdout:428.out 2023-06-22T10:57:27.299 INFO:teuthology.orchestra.run.smithi040.stdout:429 2023-06-22T10:57:27.299 INFO:teuthology.orchestra.run.smithi040.stdout:429.out 2023-06-22T10:57:27.299 INFO:teuthology.orchestra.run.smithi040.stdout:430 2023-06-22T10:57:27.299 INFO:teuthology.orchestra.run.smithi040.stdout:430.out 2023-06-22T10:57:27.299 INFO:teuthology.orchestra.run.smithi040.stdout:431 2023-06-22T10:57:27.299 INFO:teuthology.orchestra.run.smithi040.stdout:431.out 2023-06-22T10:57:27.299 INFO:teuthology.orchestra.run.smithi040.stdout:432 2023-06-22T10:57:27.300 INFO:teuthology.orchestra.run.smithi040.stdout:432.out 2023-06-22T10:57:27.300 INFO:teuthology.orchestra.run.smithi040.stdout:433 2023-06-22T10:57:27.300 INFO:teuthology.orchestra.run.smithi040.stdout:433.out 2023-06-22T10:57:27.300 INFO:teuthology.orchestra.run.smithi040.stdout:434 2023-06-22T10:57:27.300 INFO:teuthology.orchestra.run.smithi040.stdout:434.out 2023-06-22T10:57:27.300 INFO:teuthology.orchestra.run.smithi040.stdout:435 2023-06-22T10:57:27.300 INFO:teuthology.orchestra.run.smithi040.stdout:435.out 2023-06-22T10:57:27.301 INFO:teuthology.orchestra.run.smithi040.stdout:436 2023-06-22T10:57:27.301 INFO:teuthology.orchestra.run.smithi040.stdout:436.out 2023-06-22T10:57:27.301 INFO:teuthology.orchestra.run.smithi040.stdout:437 2023-06-22T10:57:27.301 INFO:teuthology.orchestra.run.smithi040.stdout:437.out 2023-06-22T10:57:27.302 INFO:teuthology.orchestra.run.smithi040.stdout:438 2023-06-22T10:57:27.302 INFO:teuthology.orchestra.run.smithi040.stdout:438.out 2023-06-22T10:57:27.302 INFO:teuthology.orchestra.run.smithi040.stdout:439 2023-06-22T10:57:27.303 INFO:teuthology.orchestra.run.smithi040.stdout:439.out 2023-06-22T10:57:27.303 INFO:teuthology.orchestra.run.smithi040.stdout:440 2023-06-22T10:57:27.303 INFO:teuthology.orchestra.run.smithi040.stdout:440.out 2023-06-22T10:57:27.303 INFO:teuthology.orchestra.run.smithi040.stdout:441 2023-06-22T10:57:27.304 INFO:teuthology.orchestra.run.smithi040.stdout:441.out 2023-06-22T10:57:27.304 INFO:teuthology.orchestra.run.smithi040.stdout:442 2023-06-22T10:57:27.304 INFO:teuthology.orchestra.run.smithi040.stdout:442.out 2023-06-22T10:57:27.304 INFO:teuthology.orchestra.run.smithi040.stdout:443 2023-06-22T10:57:27.305 INFO:teuthology.orchestra.run.smithi040.stdout:443.out 2023-06-22T10:57:27.305 INFO:teuthology.orchestra.run.smithi040.stdout:444 2023-06-22T10:57:27.305 INFO:teuthology.orchestra.run.smithi040.stdout:444.out 2023-06-22T10:57:27.306 INFO:teuthology.orchestra.run.smithi040.stdout:445 2023-06-22T10:57:27.306 INFO:teuthology.orchestra.run.smithi040.stdout:445.out 2023-06-22T10:57:27.306 INFO:teuthology.orchestra.run.smithi040.stdout:446 2023-06-22T10:57:27.306 INFO:teuthology.orchestra.run.smithi040.stdout:446.out 2023-06-22T10:57:27.307 INFO:teuthology.orchestra.run.smithi040.stdout:447 2023-06-22T10:57:27.307 INFO:teuthology.orchestra.run.smithi040.stdout:447.out 2023-06-22T10:57:27.307 INFO:teuthology.orchestra.run.smithi040.stdout:448 2023-06-22T10:57:27.308 INFO:teuthology.orchestra.run.smithi040.stdout:448.out 2023-06-22T10:57:27.308 INFO:teuthology.orchestra.run.smithi040.stdout:449 2023-06-22T10:57:27.308 INFO:teuthology.orchestra.run.smithi040.stdout:449.out 2023-06-22T10:57:27.308 INFO:teuthology.orchestra.run.smithi040.stdout:450 2023-06-22T10:57:27.308 INFO:teuthology.orchestra.run.smithi040.stdout:450.out 2023-06-22T10:57:27.308 INFO:teuthology.orchestra.run.smithi040.stdout:451 2023-06-22T10:57:27.308 INFO:teuthology.orchestra.run.smithi040.stdout:451.out 2023-06-22T10:57:27.309 INFO:teuthology.orchestra.run.smithi040.stdout:452 2023-06-22T10:57:27.309 INFO:teuthology.orchestra.run.smithi040.stdout:452.out 2023-06-22T10:57:27.309 INFO:teuthology.orchestra.run.smithi040.stdout:453 2023-06-22T10:57:27.309 INFO:teuthology.orchestra.run.smithi040.stdout:453.out 2023-06-22T10:57:27.309 INFO:teuthology.orchestra.run.smithi040.stdout:454 2023-06-22T10:57:27.309 INFO:teuthology.orchestra.run.smithi040.stdout:454.out 2023-06-22T10:57:27.309 INFO:teuthology.orchestra.run.smithi040.stdout:455 2023-06-22T10:57:27.309 INFO:teuthology.orchestra.run.smithi040.stdout:455.out 2023-06-22T10:57:27.310 INFO:teuthology.orchestra.run.smithi040.stdout:456 2023-06-22T10:57:27.310 INFO:teuthology.orchestra.run.smithi040.stdout:456.out 2023-06-22T10:57:27.310 INFO:teuthology.orchestra.run.smithi040.stdout:457 2023-06-22T10:57:27.310 INFO:teuthology.orchestra.run.smithi040.stdout:457.out 2023-06-22T10:57:27.310 INFO:teuthology.orchestra.run.smithi040.stdout:458 2023-06-22T10:57:27.310 INFO:teuthology.orchestra.run.smithi040.stdout:458.out 2023-06-22T10:57:27.310 INFO:teuthology.orchestra.run.smithi040.stdout:459 2023-06-22T10:57:27.311 INFO:teuthology.orchestra.run.smithi040.stdout:459.out 2023-06-22T10:57:27.311 INFO:teuthology.orchestra.run.smithi040.stdout:460 2023-06-22T10:57:27.311 INFO:teuthology.orchestra.run.smithi040.stdout:460.out 2023-06-22T10:57:27.311 INFO:teuthology.orchestra.run.smithi040.stdout:461 2023-06-22T10:57:27.311 INFO:teuthology.orchestra.run.smithi040.stdout:461.out 2023-06-22T10:57:27.311 INFO:teuthology.orchestra.run.smithi040.stdout:462 2023-06-22T10:57:27.311 INFO:teuthology.orchestra.run.smithi040.stdout:462.out 2023-06-22T10:57:27.311 INFO:teuthology.orchestra.run.smithi040.stdout:463 2023-06-22T10:57:27.312 INFO:teuthology.orchestra.run.smithi040.stdout:463.out 2023-06-22T10:57:27.312 INFO:teuthology.orchestra.run.smithi040.stdout:464 2023-06-22T10:57:27.312 INFO:teuthology.orchestra.run.smithi040.stdout:464.out 2023-06-22T10:57:27.312 INFO:teuthology.orchestra.run.smithi040.stdout:465 2023-06-22T10:57:27.312 INFO:teuthology.orchestra.run.smithi040.stdout:465.out 2023-06-22T10:57:27.312 INFO:teuthology.orchestra.run.smithi040.stdout:466 2023-06-22T10:57:27.312 INFO:teuthology.orchestra.run.smithi040.stdout:466.out 2023-06-22T10:57:27.312 INFO:teuthology.orchestra.run.smithi040.stdout:467 2023-06-22T10:57:27.313 INFO:teuthology.orchestra.run.smithi040.stdout:467.out 2023-06-22T10:57:27.313 INFO:teuthology.orchestra.run.smithi040.stdout:468 2023-06-22T10:57:27.313 INFO:teuthology.orchestra.run.smithi040.stdout:468.out 2023-06-22T10:57:27.313 INFO:teuthology.orchestra.run.smithi040.stdout:469 2023-06-22T10:57:27.313 INFO:teuthology.orchestra.run.smithi040.stdout:469.out 2023-06-22T10:57:27.313 INFO:teuthology.orchestra.run.smithi040.stdout:470 2023-06-22T10:57:27.313 INFO:teuthology.orchestra.run.smithi040.stdout:470.out 2023-06-22T10:57:27.313 INFO:teuthology.orchestra.run.smithi040.stdout:471 2023-06-22T10:57:27.314 INFO:teuthology.orchestra.run.smithi040.stdout:471.out 2023-06-22T10:57:27.314 INFO:teuthology.orchestra.run.smithi040.stdout:472 2023-06-22T10:57:27.314 INFO:teuthology.orchestra.run.smithi040.stdout:472.out 2023-06-22T10:57:27.314 INFO:teuthology.orchestra.run.smithi040.stdout:473 2023-06-22T10:57:27.314 INFO:teuthology.orchestra.run.smithi040.stdout:473.out 2023-06-22T10:57:27.314 INFO:teuthology.orchestra.run.smithi040.stdout:474 2023-06-22T10:57:27.314 INFO:teuthology.orchestra.run.smithi040.stdout:474.out 2023-06-22T10:57:27.314 INFO:teuthology.orchestra.run.smithi040.stdout:475 2023-06-22T10:57:27.315 INFO:teuthology.orchestra.run.smithi040.stdout:475.out 2023-06-22T10:57:27.315 INFO:teuthology.orchestra.run.smithi040.stdout:476 2023-06-22T10:57:27.315 INFO:teuthology.orchestra.run.smithi040.stdout:476.out 2023-06-22T10:57:27.315 INFO:teuthology.orchestra.run.smithi040.stdout:477 2023-06-22T10:57:27.315 INFO:teuthology.orchestra.run.smithi040.stdout:477.out 2023-06-22T10:57:27.315 INFO:teuthology.orchestra.run.smithi040.stdout:478 2023-06-22T10:57:27.315 INFO:teuthology.orchestra.run.smithi040.stdout:478.out 2023-06-22T10:57:27.315 INFO:teuthology.orchestra.run.smithi040.stdout:479 2023-06-22T10:57:27.316 INFO:teuthology.orchestra.run.smithi040.stdout:479.out 2023-06-22T10:57:27.316 INFO:teuthology.orchestra.run.smithi040.stdout:480 2023-06-22T10:57:27.316 INFO:teuthology.orchestra.run.smithi040.stdout:480.out 2023-06-22T10:57:27.316 INFO:teuthology.orchestra.run.smithi040.stdout:481 2023-06-22T10:57:27.316 INFO:teuthology.orchestra.run.smithi040.stdout:481.out 2023-06-22T10:57:27.316 INFO:teuthology.orchestra.run.smithi040.stdout:482 2023-06-22T10:57:27.316 INFO:teuthology.orchestra.run.smithi040.stdout:482.out 2023-06-22T10:57:27.316 INFO:teuthology.orchestra.run.smithi040.stdout:483 2023-06-22T10:57:27.317 INFO:teuthology.orchestra.run.smithi040.stdout:483.out 2023-06-22T10:57:27.317 INFO:teuthology.orchestra.run.smithi040.stdout:484 2023-06-22T10:57:27.317 INFO:teuthology.orchestra.run.smithi040.stdout:484.out 2023-06-22T10:57:27.317 INFO:teuthology.orchestra.run.smithi040.stdout:485 2023-06-22T10:57:27.317 INFO:teuthology.orchestra.run.smithi040.stdout:485.out 2023-06-22T10:57:27.317 INFO:teuthology.orchestra.run.smithi040.stdout:486 2023-06-22T10:57:27.317 INFO:teuthology.orchestra.run.smithi040.stdout:486.out 2023-06-22T10:57:27.317 INFO:teuthology.orchestra.run.smithi040.stdout:487 2023-06-22T10:57:27.318 INFO:teuthology.orchestra.run.smithi040.stdout:487.out 2023-06-22T10:57:27.318 INFO:teuthology.orchestra.run.smithi040.stdout:488 2023-06-22T10:57:27.318 INFO:teuthology.orchestra.run.smithi040.stdout:488.out 2023-06-22T10:57:27.318 INFO:teuthology.orchestra.run.smithi040.stdout:489 2023-06-22T10:57:27.318 INFO:teuthology.orchestra.run.smithi040.stdout:489.out 2023-06-22T10:57:27.318 INFO:teuthology.orchestra.run.smithi040.stdout:490 2023-06-22T10:57:27.318 INFO:teuthology.orchestra.run.smithi040.stdout:490.out 2023-06-22T10:57:27.318 INFO:teuthology.orchestra.run.smithi040.stdout:491 2023-06-22T10:57:27.319 INFO:teuthology.orchestra.run.smithi040.stdout:491.out 2023-06-22T10:57:27.319 INFO:teuthology.orchestra.run.smithi040.stdout:492 2023-06-22T10:57:27.319 INFO:teuthology.orchestra.run.smithi040.stdout:492.out 2023-06-22T10:57:27.319 INFO:teuthology.orchestra.run.smithi040.stdout:493 2023-06-22T10:57:27.319 INFO:teuthology.orchestra.run.smithi040.stdout:493.out 2023-06-22T10:57:27.319 INFO:teuthology.orchestra.run.smithi040.stdout:494 2023-06-22T10:57:27.319 INFO:teuthology.orchestra.run.smithi040.stdout:494.out 2023-06-22T10:57:27.319 INFO:teuthology.orchestra.run.smithi040.stdout:495 2023-06-22T10:57:27.320 INFO:teuthology.orchestra.run.smithi040.stdout:495.out 2023-06-22T10:57:27.320 INFO:teuthology.orchestra.run.smithi040.stdout:496 2023-06-22T10:57:27.320 INFO:teuthology.orchestra.run.smithi040.stdout:496.out 2023-06-22T10:57:27.320 INFO:teuthology.orchestra.run.smithi040.stdout:497 2023-06-22T10:57:27.320 INFO:teuthology.orchestra.run.smithi040.stdout:497.out 2023-06-22T10:57:27.320 INFO:teuthology.orchestra.run.smithi040.stdout:498 2023-06-22T10:57:27.320 INFO:teuthology.orchestra.run.smithi040.stdout:498.out 2023-06-22T10:57:27.320 INFO:teuthology.orchestra.run.smithi040.stdout:499 2023-06-22T10:57:27.321 INFO:teuthology.orchestra.run.smithi040.stdout:499.out 2023-06-22T10:57:27.321 INFO:teuthology.orchestra.run.smithi040.stdout:500 2023-06-22T10:57:27.321 INFO:teuthology.orchestra.run.smithi040.stdout:500.out 2023-06-22T10:57:27.321 INFO:teuthology.orchestra.run.smithi040.stdout:501 2023-06-22T10:57:27.321 INFO:teuthology.orchestra.run.smithi040.stdout:501.out 2023-06-22T10:57:27.321 INFO:teuthology.orchestra.run.smithi040.stdout:502 2023-06-22T10:57:27.321 INFO:teuthology.orchestra.run.smithi040.stdout:502.out 2023-06-22T10:57:27.321 INFO:teuthology.orchestra.run.smithi040.stdout:503 2023-06-22T10:57:27.322 INFO:teuthology.orchestra.run.smithi040.stdout:503.out 2023-06-22T10:57:27.322 INFO:teuthology.orchestra.run.smithi040.stdout:504 2023-06-22T10:57:27.322 INFO:teuthology.orchestra.run.smithi040.stdout:504.out 2023-06-22T10:57:27.322 INFO:teuthology.orchestra.run.smithi040.stdout:505 2023-06-22T10:57:27.322 INFO:teuthology.orchestra.run.smithi040.stdout:505.out 2023-06-22T10:57:27.322 INFO:teuthology.orchestra.run.smithi040.stdout:506 2023-06-22T10:57:27.322 INFO:teuthology.orchestra.run.smithi040.stdout:506.out 2023-06-22T10:57:27.322 INFO:teuthology.orchestra.run.smithi040.stdout:507 2023-06-22T10:57:27.323 INFO:teuthology.orchestra.run.smithi040.stdout:507.out 2023-06-22T10:57:27.323 INFO:teuthology.orchestra.run.smithi040.stdout:508 2023-06-22T10:57:27.323 INFO:teuthology.orchestra.run.smithi040.stdout:508.out 2023-06-22T10:57:27.323 INFO:teuthology.orchestra.run.smithi040.stdout:509 2023-06-22T10:57:27.323 INFO:teuthology.orchestra.run.smithi040.stdout:509.out 2023-06-22T10:57:27.323 INFO:teuthology.orchestra.run.smithi040.stdout:510 2023-06-22T10:57:27.323 INFO:teuthology.orchestra.run.smithi040.stdout:510.out 2023-06-22T10:57:27.324 INFO:teuthology.orchestra.run.smithi040.stdout:511 2023-06-22T10:57:27.324 INFO:teuthology.orchestra.run.smithi040.stdout:511.out 2023-06-22T10:57:27.324 INFO:teuthology.orchestra.run.smithi040.stdout:512 2023-06-22T10:57:27.324 INFO:teuthology.orchestra.run.smithi040.stdout:512.out 2023-06-22T10:57:27.324 INFO:teuthology.orchestra.run.smithi040.stdout:513 2023-06-22T10:57:27.324 INFO:teuthology.orchestra.run.smithi040.stdout:513.out 2023-06-22T10:57:27.324 INFO:teuthology.orchestra.run.smithi040.stdout:514 2023-06-22T10:57:27.324 INFO:teuthology.orchestra.run.smithi040.stdout:514.out 2023-06-22T10:57:27.325 INFO:teuthology.orchestra.run.smithi040.stdout:515 2023-06-22T10:57:27.325 INFO:teuthology.orchestra.run.smithi040.stdout:515.out 2023-06-22T10:57:27.325 INFO:teuthology.orchestra.run.smithi040.stdout:516 2023-06-22T10:57:27.325 INFO:teuthology.orchestra.run.smithi040.stdout:516.out 2023-06-22T10:57:27.325 INFO:teuthology.orchestra.run.smithi040.stdout:517 2023-06-22T10:57:27.325 INFO:teuthology.orchestra.run.smithi040.stdout:517.out 2023-06-22T10:57:27.325 INFO:teuthology.orchestra.run.smithi040.stdout:518 2023-06-22T10:57:27.325 INFO:teuthology.orchestra.run.smithi040.stdout:518.out 2023-06-22T10:57:27.326 INFO:teuthology.orchestra.run.smithi040.stdout:519 2023-06-22T10:57:27.326 INFO:teuthology.orchestra.run.smithi040.stdout:519.out 2023-06-22T10:57:27.326 INFO:teuthology.orchestra.run.smithi040.stdout:520 2023-06-22T10:57:27.326 INFO:teuthology.orchestra.run.smithi040.stdout:520.out 2023-06-22T10:57:27.326 INFO:teuthology.orchestra.run.smithi040.stdout:521 2023-06-22T10:57:27.326 INFO:teuthology.orchestra.run.smithi040.stdout:521.out 2023-06-22T10:57:27.326 INFO:teuthology.orchestra.run.smithi040.stdout:522 2023-06-22T10:57:27.326 INFO:teuthology.orchestra.run.smithi040.stdout:522.out 2023-06-22T10:57:27.327 INFO:teuthology.orchestra.run.smithi040.stdout:523 2023-06-22T10:57:27.327 INFO:teuthology.orchestra.run.smithi040.stdout:523.out 2023-06-22T10:57:27.327 INFO:teuthology.orchestra.run.smithi040.stdout:524 2023-06-22T10:57:27.327 INFO:teuthology.orchestra.run.smithi040.stdout:524.out 2023-06-22T10:57:27.327 INFO:teuthology.orchestra.run.smithi040.stdout:525 2023-06-22T10:57:27.327 INFO:teuthology.orchestra.run.smithi040.stdout:525.out 2023-06-22T10:57:27.327 INFO:teuthology.orchestra.run.smithi040.stdout:526 2023-06-22T10:57:27.327 INFO:teuthology.orchestra.run.smithi040.stdout:526.out 2023-06-22T10:57:27.328 INFO:teuthology.orchestra.run.smithi040.stdout:527 2023-06-22T10:57:27.328 INFO:teuthology.orchestra.run.smithi040.stdout:527.out 2023-06-22T10:57:27.328 INFO:teuthology.orchestra.run.smithi040.stdout:528 2023-06-22T10:57:27.328 INFO:teuthology.orchestra.run.smithi040.stdout:528.out 2023-06-22T10:57:27.328 INFO:teuthology.orchestra.run.smithi040.stdout:529 2023-06-22T10:57:27.328 INFO:teuthology.orchestra.run.smithi040.stdout:529.out 2023-06-22T10:57:27.328 INFO:teuthology.orchestra.run.smithi040.stdout:530 2023-06-22T10:57:27.328 INFO:teuthology.orchestra.run.smithi040.stdout:530.out 2023-06-22T10:57:27.329 INFO:teuthology.orchestra.run.smithi040.stdout:531 2023-06-22T10:57:27.329 INFO:teuthology.orchestra.run.smithi040.stdout:531.out 2023-06-22T10:57:27.329 INFO:teuthology.orchestra.run.smithi040.stdout:532 2023-06-22T10:57:27.329 INFO:teuthology.orchestra.run.smithi040.stdout:532.out 2023-06-22T10:57:27.329 INFO:teuthology.orchestra.run.smithi040.stdout:533 2023-06-22T10:57:27.329 INFO:teuthology.orchestra.run.smithi040.stdout:533.out 2023-06-22T10:57:27.329 INFO:teuthology.orchestra.run.smithi040.stdout:534 2023-06-22T10:57:27.329 INFO:teuthology.orchestra.run.smithi040.stdout:534.out 2023-06-22T10:57:27.330 INFO:teuthology.orchestra.run.smithi040.stdout:535 2023-06-22T10:57:27.330 INFO:teuthology.orchestra.run.smithi040.stdout:535.out 2023-06-22T10:57:27.330 INFO:teuthology.orchestra.run.smithi040.stdout:536 2023-06-22T10:57:27.330 INFO:teuthology.orchestra.run.smithi040.stdout:536.out 2023-06-22T10:57:27.330 INFO:teuthology.orchestra.run.smithi040.stdout:537 2023-06-22T10:57:27.330 INFO:teuthology.orchestra.run.smithi040.stdout:537.out 2023-06-22T10:57:27.330 INFO:teuthology.orchestra.run.smithi040.stdout:538 2023-06-22T10:57:27.331 INFO:teuthology.orchestra.run.smithi040.stdout:538.out 2023-06-22T10:57:27.331 INFO:teuthology.orchestra.run.smithi040.stdout:539 2023-06-22T10:57:27.331 INFO:teuthology.orchestra.run.smithi040.stdout:539.out 2023-06-22T10:57:27.331 INFO:teuthology.orchestra.run.smithi040.stdout:540 2023-06-22T10:57:27.331 INFO:teuthology.orchestra.run.smithi040.stdout:540.out 2023-06-22T10:57:27.331 INFO:teuthology.orchestra.run.smithi040.stdout:541 2023-06-22T10:57:27.331 INFO:teuthology.orchestra.run.smithi040.stdout:541.out 2023-06-22T10:57:27.331 INFO:teuthology.orchestra.run.smithi040.stdout:542 2023-06-22T10:57:27.332 INFO:teuthology.orchestra.run.smithi040.stdout:542.out 2023-06-22T10:57:27.332 INFO:teuthology.orchestra.run.smithi040.stdout:543 2023-06-22T10:57:27.332 INFO:teuthology.orchestra.run.smithi040.stdout:543.out 2023-06-22T10:57:27.332 INFO:teuthology.orchestra.run.smithi040.stdout:544 2023-06-22T10:57:27.332 INFO:teuthology.orchestra.run.smithi040.stdout:544.out 2023-06-22T10:57:27.332 INFO:teuthology.orchestra.run.smithi040.stdout:545 2023-06-22T10:57:27.332 INFO:teuthology.orchestra.run.smithi040.stdout:545.out 2023-06-22T10:57:27.332 INFO:teuthology.orchestra.run.smithi040.stdout:546 2023-06-22T10:57:27.333 INFO:teuthology.orchestra.run.smithi040.stdout:546.out 2023-06-22T10:57:27.333 INFO:teuthology.orchestra.run.smithi040.stdout:547 2023-06-22T10:57:27.333 INFO:teuthology.orchestra.run.smithi040.stdout:547.out 2023-06-22T10:57:27.333 INFO:teuthology.orchestra.run.smithi040.stdout:548 2023-06-22T10:57:27.333 INFO:teuthology.orchestra.run.smithi040.stdout:548.out 2023-06-22T10:57:27.333 INFO:teuthology.orchestra.run.smithi040.stdout:549 2023-06-22T10:57:27.333 INFO:teuthology.orchestra.run.smithi040.stdout:549.out 2023-06-22T10:57:27.333 INFO:teuthology.orchestra.run.smithi040.stdout:550 2023-06-22T10:57:27.334 INFO:teuthology.orchestra.run.smithi040.stdout:550.out 2023-06-22T10:57:27.334 INFO:teuthology.orchestra.run.smithi040.stdout:551 2023-06-22T10:57:27.334 INFO:teuthology.orchestra.run.smithi040.stdout:551.out 2023-06-22T10:57:27.334 INFO:teuthology.orchestra.run.smithi040.stdout:552 2023-06-22T10:57:27.334 INFO:teuthology.orchestra.run.smithi040.stdout:552.out 2023-06-22T10:57:27.334 INFO:teuthology.orchestra.run.smithi040.stdout:553 2023-06-22T10:57:27.334 INFO:teuthology.orchestra.run.smithi040.stdout:553.out 2023-06-22T10:57:27.334 INFO:teuthology.orchestra.run.smithi040.stdout:554 2023-06-22T10:57:27.335 INFO:teuthology.orchestra.run.smithi040.stdout:554.out 2023-06-22T10:57:27.335 INFO:teuthology.orchestra.run.smithi040.stdout:555 2023-06-22T10:57:27.335 INFO:teuthology.orchestra.run.smithi040.stdout:555.out 2023-06-22T10:57:27.335 INFO:teuthology.orchestra.run.smithi040.stdout:556 2023-06-22T10:57:27.335 INFO:teuthology.orchestra.run.smithi040.stdout:556.out 2023-06-22T10:57:27.335 INFO:teuthology.orchestra.run.smithi040.stdout:557 2023-06-22T10:57:27.335 INFO:teuthology.orchestra.run.smithi040.stdout:557.out 2023-06-22T10:57:27.335 INFO:teuthology.orchestra.run.smithi040.stdout:558 2023-06-22T10:57:27.336 INFO:teuthology.orchestra.run.smithi040.stdout:558.out 2023-06-22T10:57:27.336 INFO:teuthology.orchestra.run.smithi040.stdout:559 2023-06-22T10:57:27.336 INFO:teuthology.orchestra.run.smithi040.stdout:559.out 2023-06-22T10:57:27.336 INFO:teuthology.orchestra.run.smithi040.stdout:560 2023-06-22T10:57:27.336 INFO:teuthology.orchestra.run.smithi040.stdout:560.out 2023-06-22T10:57:27.336 INFO:teuthology.orchestra.run.smithi040.stdout:561 2023-06-22T10:57:27.336 INFO:teuthology.orchestra.run.smithi040.stdout:561.out 2023-06-22T10:57:27.336 INFO:teuthology.orchestra.run.smithi040.stdout:562 2023-06-22T10:57:27.337 INFO:teuthology.orchestra.run.smithi040.stdout:562.out 2023-06-22T10:57:27.337 INFO:teuthology.orchestra.run.smithi040.stdout:563 2023-06-22T10:57:27.337 INFO:teuthology.orchestra.run.smithi040.stdout:563.out 2023-06-22T10:57:27.337 INFO:teuthology.orchestra.run.smithi040.stdout:564 2023-06-22T10:57:27.337 INFO:teuthology.orchestra.run.smithi040.stdout:564.out 2023-06-22T10:57:27.337 INFO:teuthology.orchestra.run.smithi040.stdout:565 2023-06-22T10:57:27.337 INFO:teuthology.orchestra.run.smithi040.stdout:565.out 2023-06-22T10:57:27.337 INFO:teuthology.orchestra.run.smithi040.stdout:566 2023-06-22T10:57:27.338 INFO:teuthology.orchestra.run.smithi040.stdout:566.out 2023-06-22T10:57:27.338 INFO:teuthology.orchestra.run.smithi040.stdout:567 2023-06-22T10:57:27.338 INFO:teuthology.orchestra.run.smithi040.stdout:567.out 2023-06-22T10:57:27.338 INFO:teuthology.orchestra.run.smithi040.stdout:568 2023-06-22T10:57:27.338 INFO:teuthology.orchestra.run.smithi040.stdout:568.out 2023-06-22T10:57:27.338 INFO:teuthology.orchestra.run.smithi040.stdout:569 2023-06-22T10:57:27.338 INFO:teuthology.orchestra.run.smithi040.stdout:569.out 2023-06-22T10:57:27.338 INFO:teuthology.orchestra.run.smithi040.stdout:570 2023-06-22T10:57:27.339 INFO:teuthology.orchestra.run.smithi040.stdout:570.out 2023-06-22T10:57:27.339 INFO:teuthology.orchestra.run.smithi040.stdout:571 2023-06-22T10:57:27.339 INFO:teuthology.orchestra.run.smithi040.stdout:571.out 2023-06-22T10:57:27.339 INFO:teuthology.orchestra.run.smithi040.stdout:572 2023-06-22T10:57:27.339 INFO:teuthology.orchestra.run.smithi040.stdout:572.out 2023-06-22T10:57:27.339 INFO:teuthology.orchestra.run.smithi040.stdout:573 2023-06-22T10:57:27.339 INFO:teuthology.orchestra.run.smithi040.stdout:573.out 2023-06-22T10:57:27.339 INFO:teuthology.orchestra.run.smithi040.stdout:574 2023-06-22T10:57:27.340 INFO:teuthology.orchestra.run.smithi040.stdout:574.out 2023-06-22T10:57:27.340 INFO:teuthology.orchestra.run.smithi040.stdout:575 2023-06-22T10:57:27.340 INFO:teuthology.orchestra.run.smithi040.stdout:575.out 2023-06-22T10:57:27.340 INFO:teuthology.orchestra.run.smithi040.stdout:576 2023-06-22T10:57:27.340 INFO:teuthology.orchestra.run.smithi040.stdout:576.out 2023-06-22T10:57:27.340 INFO:teuthology.orchestra.run.smithi040.stdout:577 2023-06-22T10:57:27.340 INFO:teuthology.orchestra.run.smithi040.stdout:577.out 2023-06-22T10:57:27.340 INFO:teuthology.orchestra.run.smithi040.stdout:578 2023-06-22T10:57:27.341 INFO:teuthology.orchestra.run.smithi040.stdout:578.out 2023-06-22T10:57:27.341 INFO:teuthology.orchestra.run.smithi040.stdout:579 2023-06-22T10:57:27.341 INFO:teuthology.orchestra.run.smithi040.stdout:579.out 2023-06-22T10:57:27.341 INFO:teuthology.orchestra.run.smithi040.stdout:580 2023-06-22T10:57:27.341 INFO:teuthology.orchestra.run.smithi040.stdout:580.out 2023-06-22T10:57:27.341 INFO:teuthology.orchestra.run.smithi040.stdout:581 2023-06-22T10:57:27.341 INFO:teuthology.orchestra.run.smithi040.stdout:581.out 2023-06-22T10:57:27.341 INFO:teuthology.orchestra.run.smithi040.stdout:582 2023-06-22T10:57:27.342 INFO:teuthology.orchestra.run.smithi040.stdout:582.out 2023-06-22T10:57:27.342 INFO:teuthology.orchestra.run.smithi040.stdout:583 2023-06-22T10:57:27.342 INFO:teuthology.orchestra.run.smithi040.stdout:583.out 2023-06-22T10:57:27.342 INFO:teuthology.orchestra.run.smithi040.stdout:584 2023-06-22T10:57:27.342 INFO:teuthology.orchestra.run.smithi040.stdout:584.out 2023-06-22T10:57:27.342 INFO:teuthology.orchestra.run.smithi040.stdout:585 2023-06-22T10:57:27.342 INFO:teuthology.orchestra.run.smithi040.stdout:585.out 2023-06-22T10:57:27.342 INFO:teuthology.orchestra.run.smithi040.stdout:586 2023-06-22T10:57:27.343 INFO:teuthology.orchestra.run.smithi040.stdout:586.out 2023-06-22T10:57:27.343 INFO:teuthology.orchestra.run.smithi040.stdout:587 2023-06-22T10:57:27.343 INFO:teuthology.orchestra.run.smithi040.stdout:587.out 2023-06-22T10:57:27.343 INFO:teuthology.orchestra.run.smithi040.stdout:588 2023-06-22T10:57:27.343 INFO:teuthology.orchestra.run.smithi040.stdout:588.out 2023-06-22T10:57:27.343 INFO:teuthology.orchestra.run.smithi040.stdout:589 2023-06-22T10:57:27.343 INFO:teuthology.orchestra.run.smithi040.stdout:589.out 2023-06-22T10:57:27.343 INFO:teuthology.orchestra.run.smithi040.stdout:590 2023-06-22T10:57:27.344 INFO:teuthology.orchestra.run.smithi040.stdout:590.out 2023-06-22T10:57:27.344 INFO:teuthology.orchestra.run.smithi040.stdout:591 2023-06-22T10:57:27.344 INFO:teuthology.orchestra.run.smithi040.stdout:591.out 2023-06-22T10:57:27.344 INFO:teuthology.orchestra.run.smithi040.stdout:592 2023-06-22T10:57:27.344 INFO:teuthology.orchestra.run.smithi040.stdout:592.out 2023-06-22T10:57:27.344 INFO:teuthology.orchestra.run.smithi040.stdout:593 2023-06-22T10:57:27.344 INFO:teuthology.orchestra.run.smithi040.stdout:593.out 2023-06-22T10:57:27.345 INFO:teuthology.orchestra.run.smithi040.stdout:594 2023-06-22T10:57:27.345 INFO:teuthology.orchestra.run.smithi040.stdout:594.out 2023-06-22T10:57:27.345 INFO:teuthology.orchestra.run.smithi040.stdout:595 2023-06-22T10:57:27.345 INFO:teuthology.orchestra.run.smithi040.stdout:595.out 2023-06-22T10:57:27.345 INFO:teuthology.orchestra.run.smithi040.stdout:596 2023-06-22T10:57:27.345 INFO:teuthology.orchestra.run.smithi040.stdout:596.out 2023-06-22T10:57:27.345 INFO:teuthology.orchestra.run.smithi040.stdout:597 2023-06-22T10:57:27.345 INFO:teuthology.orchestra.run.smithi040.stdout:597.out 2023-06-22T10:57:27.346 INFO:teuthology.orchestra.run.smithi040.stdout:598 2023-06-22T10:57:27.346 INFO:teuthology.orchestra.run.smithi040.stdout:598.out 2023-06-22T10:57:27.346 INFO:teuthology.orchestra.run.smithi040.stdout:599 2023-06-22T10:57:27.346 INFO:teuthology.orchestra.run.smithi040.stdout:599.out 2023-06-22T10:57:27.346 INFO:teuthology.orchestra.run.smithi040.stdout:600 2023-06-22T10:57:27.346 INFO:teuthology.orchestra.run.smithi040.stdout:600.out 2023-06-22T10:57:27.346 INFO:teuthology.orchestra.run.smithi040.stdout:601 2023-06-22T10:57:27.346 INFO:teuthology.orchestra.run.smithi040.stdout:601.out 2023-06-22T10:57:27.347 INFO:teuthology.orchestra.run.smithi040.stdout:602 2023-06-22T10:57:27.347 INFO:teuthology.orchestra.run.smithi040.stdout:602.out 2023-06-22T10:57:27.347 INFO:teuthology.orchestra.run.smithi040.stdout:603 2023-06-22T10:57:27.347 INFO:teuthology.orchestra.run.smithi040.stdout:603.out 2023-06-22T10:57:27.347 INFO:teuthology.orchestra.run.smithi040.stdout:604 2023-06-22T10:57:27.347 INFO:teuthology.orchestra.run.smithi040.stdout:604.out 2023-06-22T10:57:27.347 INFO:teuthology.orchestra.run.smithi040.stdout:605 2023-06-22T10:57:27.347 INFO:teuthology.orchestra.run.smithi040.stdout:605.out 2023-06-22T10:57:27.348 INFO:teuthology.orchestra.run.smithi040.stdout:606 2023-06-22T10:57:27.348 INFO:teuthology.orchestra.run.smithi040.stdout:606.out 2023-06-22T10:57:27.348 INFO:teuthology.orchestra.run.smithi040.stdout:607 2023-06-22T10:57:27.348 INFO:teuthology.orchestra.run.smithi040.stdout:607.out 2023-06-22T10:57:27.348 INFO:teuthology.orchestra.run.smithi040.stdout:608 2023-06-22T10:57:27.348 INFO:teuthology.orchestra.run.smithi040.stdout:608.out 2023-06-22T10:57:27.348 INFO:teuthology.orchestra.run.smithi040.stdout:609 2023-06-22T10:57:27.348 INFO:teuthology.orchestra.run.smithi040.stdout:609.out 2023-06-22T10:57:27.349 INFO:teuthology.orchestra.run.smithi040.stdout:610 2023-06-22T10:57:27.349 INFO:teuthology.orchestra.run.smithi040.stdout:610.out 2023-06-22T10:57:27.349 INFO:teuthology.orchestra.run.smithi040.stdout:611 2023-06-22T10:57:27.349 INFO:teuthology.orchestra.run.smithi040.stdout:611.out 2023-06-22T10:57:27.349 INFO:teuthology.orchestra.run.smithi040.stdout:612 2023-06-22T10:57:27.349 INFO:teuthology.orchestra.run.smithi040.stdout:612.out 2023-06-22T10:57:27.349 INFO:teuthology.orchestra.run.smithi040.stdout:613 2023-06-22T10:57:27.349 INFO:teuthology.orchestra.run.smithi040.stdout:613.out 2023-06-22T10:57:27.350 INFO:teuthology.orchestra.run.smithi040.stdout:614 2023-06-22T10:57:27.350 INFO:teuthology.orchestra.run.smithi040.stdout:614.out 2023-06-22T10:57:27.350 INFO:teuthology.orchestra.run.smithi040.stdout:615 2023-06-22T10:57:27.350 INFO:teuthology.orchestra.run.smithi040.stdout:615.out 2023-06-22T10:57:27.350 INFO:teuthology.orchestra.run.smithi040.stdout:616 2023-06-22T10:57:27.350 INFO:teuthology.orchestra.run.smithi040.stdout:616.out 2023-06-22T10:57:27.350 INFO:teuthology.orchestra.run.smithi040.stdout:617 2023-06-22T10:57:27.350 INFO:teuthology.orchestra.run.smithi040.stdout:617.out 2023-06-22T10:57:27.351 INFO:teuthology.orchestra.run.smithi040.stdout:618 2023-06-22T10:57:27.351 INFO:teuthology.orchestra.run.smithi040.stdout:618.out 2023-06-22T10:57:27.351 INFO:teuthology.orchestra.run.smithi040.stdout:619 2023-06-22T10:57:27.351 INFO:teuthology.orchestra.run.smithi040.stdout:619.out 2023-06-22T10:57:27.351 INFO:teuthology.orchestra.run.smithi040.stdout:620 2023-06-22T10:57:27.351 INFO:teuthology.orchestra.run.smithi040.stdout:620.out 2023-06-22T10:57:27.351 INFO:teuthology.orchestra.run.smithi040.stdout:621 2023-06-22T10:57:27.351 INFO:teuthology.orchestra.run.smithi040.stdout:621.out 2023-06-22T10:57:27.352 INFO:teuthology.orchestra.run.smithi040.stdout:622 2023-06-22T10:57:27.352 INFO:teuthology.orchestra.run.smithi040.stdout:622.out 2023-06-22T10:57:27.352 INFO:teuthology.orchestra.run.smithi040.stdout:623 2023-06-22T10:57:27.352 INFO:teuthology.orchestra.run.smithi040.stdout:623.out 2023-06-22T10:57:27.352 INFO:teuthology.orchestra.run.smithi040.stdout:624 2023-06-22T10:57:27.352 INFO:teuthology.orchestra.run.smithi040.stdout:624.out 2023-06-22T10:57:27.352 INFO:teuthology.orchestra.run.smithi040.stdout:625 2023-06-22T10:57:27.353 INFO:teuthology.orchestra.run.smithi040.stdout:625.out 2023-06-22T10:57:27.353 INFO:teuthology.orchestra.run.smithi040.stdout:626 2023-06-22T10:57:27.353 INFO:teuthology.orchestra.run.smithi040.stdout:626.out 2023-06-22T10:57:27.353 INFO:teuthology.orchestra.run.smithi040.stdout:627 2023-06-22T10:57:27.353 INFO:teuthology.orchestra.run.smithi040.stdout:627.out 2023-06-22T10:57:27.353 INFO:teuthology.orchestra.run.smithi040.stdout:628 2023-06-22T10:57:27.353 INFO:teuthology.orchestra.run.smithi040.stdout:628.out 2023-06-22T10:57:27.353 INFO:teuthology.orchestra.run.smithi040.stdout:629 2023-06-22T10:57:27.354 INFO:teuthology.orchestra.run.smithi040.stdout:629.out 2023-06-22T10:57:27.354 INFO:teuthology.orchestra.run.smithi040.stdout:630 2023-06-22T10:57:27.354 INFO:teuthology.orchestra.run.smithi040.stdout:630.out 2023-06-22T10:57:27.354 INFO:teuthology.orchestra.run.smithi040.stdout:631 2023-06-22T10:57:27.354 INFO:teuthology.orchestra.run.smithi040.stdout:631.out 2023-06-22T10:57:27.354 INFO:teuthology.orchestra.run.smithi040.stdout:632 2023-06-22T10:57:27.354 INFO:teuthology.orchestra.run.smithi040.stdout:632.out 2023-06-22T10:57:27.354 INFO:teuthology.orchestra.run.smithi040.stdout:633 2023-06-22T10:57:27.355 INFO:teuthology.orchestra.run.smithi040.stdout:633.out 2023-06-22T10:57:27.355 INFO:teuthology.orchestra.run.smithi040.stdout:634 2023-06-22T10:57:27.355 INFO:teuthology.orchestra.run.smithi040.stdout:634.out 2023-06-22T10:57:27.355 INFO:teuthology.orchestra.run.smithi040.stdout:635 2023-06-22T10:57:27.355 INFO:teuthology.orchestra.run.smithi040.stdout:635.out 2023-06-22T10:57:27.355 INFO:teuthology.orchestra.run.smithi040.stdout:636 2023-06-22T10:57:27.355 INFO:teuthology.orchestra.run.smithi040.stdout:636.out 2023-06-22T10:57:27.355 INFO:teuthology.orchestra.run.smithi040.stdout:637 2023-06-22T10:57:27.356 INFO:teuthology.orchestra.run.smithi040.stdout:637.out 2023-06-22T10:57:27.356 INFO:teuthology.orchestra.run.smithi040.stdout:638 2023-06-22T10:57:27.356 INFO:teuthology.orchestra.run.smithi040.stdout:638.out 2023-06-22T10:57:27.356 INFO:teuthology.orchestra.run.smithi040.stdout:639 2023-06-22T10:57:27.356 INFO:teuthology.orchestra.run.smithi040.stdout:639.out 2023-06-22T10:57:27.356 INFO:teuthology.orchestra.run.smithi040.stdout:640 2023-06-22T10:57:27.356 INFO:teuthology.orchestra.run.smithi040.stdout:640.out 2023-06-22T10:57:27.356 INFO:teuthology.orchestra.run.smithi040.stdout:641 2023-06-22T10:57:27.357 INFO:teuthology.orchestra.run.smithi040.stdout:641.out 2023-06-22T10:57:27.357 INFO:teuthology.orchestra.run.smithi040.stdout:642 2023-06-22T10:57:27.357 INFO:teuthology.orchestra.run.smithi040.stdout:642.out 2023-06-22T10:57:27.357 INFO:teuthology.orchestra.run.smithi040.stdout:643 2023-06-22T10:57:27.357 INFO:teuthology.orchestra.run.smithi040.stdout:643.out 2023-06-22T10:57:27.357 INFO:teuthology.orchestra.run.smithi040.stdout:644 2023-06-22T10:57:27.357 INFO:teuthology.orchestra.run.smithi040.stdout:644.out 2023-06-22T10:57:27.357 INFO:teuthology.orchestra.run.smithi040.stdout:645 2023-06-22T10:57:27.358 INFO:teuthology.orchestra.run.smithi040.stdout:645.out 2023-06-22T10:57:27.358 INFO:teuthology.orchestra.run.smithi040.stdout:646 2023-06-22T10:57:27.358 INFO:teuthology.orchestra.run.smithi040.stdout:646.out 2023-06-22T10:57:27.358 INFO:teuthology.orchestra.run.smithi040.stdout:647 2023-06-22T10:57:27.358 INFO:teuthology.orchestra.run.smithi040.stdout:647.out 2023-06-22T10:57:27.358 INFO:teuthology.orchestra.run.smithi040.stdout:648 2023-06-22T10:57:27.358 INFO:teuthology.orchestra.run.smithi040.stdout:648.out 2023-06-22T10:57:27.358 INFO:teuthology.orchestra.run.smithi040.stdout:649 2023-06-22T10:57:27.359 INFO:teuthology.orchestra.run.smithi040.stdout:649.out 2023-06-22T10:57:27.359 INFO:teuthology.orchestra.run.smithi040.stdout:650 2023-06-22T10:57:27.359 INFO:teuthology.orchestra.run.smithi040.stdout:650.out 2023-06-22T10:57:27.359 INFO:teuthology.orchestra.run.smithi040.stdout:651 2023-06-22T10:57:27.359 INFO:teuthology.orchestra.run.smithi040.stdout:651.out 2023-06-22T10:57:27.359 INFO:teuthology.orchestra.run.smithi040.stdout:652 2023-06-22T10:57:27.359 INFO:teuthology.orchestra.run.smithi040.stdout:652.out 2023-06-22T10:57:27.359 INFO:teuthology.orchestra.run.smithi040.stdout:653 2023-06-22T10:57:27.360 INFO:teuthology.orchestra.run.smithi040.stdout:653.out 2023-06-22T10:57:27.360 INFO:teuthology.orchestra.run.smithi040.stdout:654 2023-06-22T10:57:27.360 INFO:teuthology.orchestra.run.smithi040.stdout:654.out 2023-06-22T10:57:27.360 INFO:teuthology.orchestra.run.smithi040.stdout:655 2023-06-22T10:57:27.360 INFO:teuthology.orchestra.run.smithi040.stdout:655.out 2023-06-22T10:57:27.360 INFO:teuthology.orchestra.run.smithi040.stdout:656 2023-06-22T10:57:27.360 INFO:teuthology.orchestra.run.smithi040.stdout:656.out 2023-06-22T10:57:27.360 INFO:teuthology.orchestra.run.smithi040.stdout:657 2023-06-22T10:57:27.361 INFO:teuthology.orchestra.run.smithi040.stdout:657.out 2023-06-22T10:57:27.361 INFO:teuthology.orchestra.run.smithi040.stdout:658 2023-06-22T10:57:27.361 INFO:teuthology.orchestra.run.smithi040.stdout:658.out 2023-06-22T10:57:27.361 INFO:teuthology.orchestra.run.smithi040.stdout:659 2023-06-22T10:57:27.361 INFO:teuthology.orchestra.run.smithi040.stdout:659.out 2023-06-22T10:57:27.361 INFO:teuthology.orchestra.run.smithi040.stdout:660 2023-06-22T10:57:27.361 INFO:teuthology.orchestra.run.smithi040.stdout:660.out 2023-06-22T10:57:27.361 INFO:teuthology.orchestra.run.smithi040.stdout:661 2023-06-22T10:57:27.362 INFO:teuthology.orchestra.run.smithi040.stdout:661.out 2023-06-22T10:57:27.362 INFO:teuthology.orchestra.run.smithi040.stdout:662 2023-06-22T10:57:27.362 INFO:teuthology.orchestra.run.smithi040.stdout:662.out 2023-06-22T10:57:27.362 INFO:teuthology.orchestra.run.smithi040.stdout:663 2023-06-22T10:57:27.362 INFO:teuthology.orchestra.run.smithi040.stdout:663.out 2023-06-22T10:57:27.362 INFO:teuthology.orchestra.run.smithi040.stdout:664 2023-06-22T10:57:27.362 INFO:teuthology.orchestra.run.smithi040.stdout:664.out 2023-06-22T10:57:27.362 INFO:teuthology.orchestra.run.smithi040.stdout:665 2023-06-22T10:57:27.363 INFO:teuthology.orchestra.run.smithi040.stdout:665.out 2023-06-22T10:57:27.363 INFO:teuthology.orchestra.run.smithi040.stdout:666 2023-06-22T10:57:27.363 INFO:teuthology.orchestra.run.smithi040.stdout:666.out 2023-06-22T10:57:27.363 INFO:teuthology.orchestra.run.smithi040.stdout:667 2023-06-22T10:57:27.363 INFO:teuthology.orchestra.run.smithi040.stdout:667.out 2023-06-22T10:57:27.363 INFO:teuthology.orchestra.run.smithi040.stdout:668 2023-06-22T10:57:27.363 INFO:teuthology.orchestra.run.smithi040.stdout:668.out 2023-06-22T10:57:27.363 INFO:teuthology.orchestra.run.smithi040.stdout:669 2023-06-22T10:57:27.364 INFO:teuthology.orchestra.run.smithi040.stdout:669.out 2023-06-22T10:57:27.364 INFO:teuthology.orchestra.run.smithi040.stdout:670 2023-06-22T10:57:27.364 INFO:teuthology.orchestra.run.smithi040.stdout:670.out 2023-06-22T10:57:27.364 INFO:teuthology.orchestra.run.smithi040.stdout:671 2023-06-22T10:57:27.364 INFO:teuthology.orchestra.run.smithi040.stdout:671.out 2023-06-22T10:57:27.364 INFO:teuthology.orchestra.run.smithi040.stdout:672 2023-06-22T10:57:27.364 INFO:teuthology.orchestra.run.smithi040.stdout:672.out 2023-06-22T10:57:27.364 INFO:teuthology.orchestra.run.smithi040.stdout:673 2023-06-22T10:57:27.365 INFO:teuthology.orchestra.run.smithi040.stdout:673.out 2023-06-22T10:57:27.365 INFO:teuthology.orchestra.run.smithi040.stdout:674 2023-06-22T10:57:27.365 INFO:teuthology.orchestra.run.smithi040.stdout:674.out 2023-06-22T10:57:27.365 INFO:teuthology.orchestra.run.smithi040.stdout:675 2023-06-22T10:57:27.365 INFO:teuthology.orchestra.run.smithi040.stdout:675.out 2023-06-22T10:57:27.365 INFO:teuthology.orchestra.run.smithi040.stdout:676 2023-06-22T10:57:27.365 INFO:teuthology.orchestra.run.smithi040.stdout:676.out 2023-06-22T10:57:27.365 INFO:teuthology.orchestra.run.smithi040.stdout:677 2023-06-22T10:57:27.366 INFO:teuthology.orchestra.run.smithi040.stdout:677.out 2023-06-22T10:57:27.366 INFO:teuthology.orchestra.run.smithi040.stdout:678 2023-06-22T10:57:27.366 INFO:teuthology.orchestra.run.smithi040.stdout:678.out 2023-06-22T10:57:27.366 INFO:teuthology.orchestra.run.smithi040.stdout:679 2023-06-22T10:57:27.366 INFO:teuthology.orchestra.run.smithi040.stdout:679.out 2023-06-22T10:57:27.366 INFO:teuthology.orchestra.run.smithi040.stdout:680 2023-06-22T10:57:27.366 INFO:teuthology.orchestra.run.smithi040.stdout:680.out 2023-06-22T10:57:27.366 INFO:teuthology.orchestra.run.smithi040.stdout:681 2023-06-22T10:57:27.367 INFO:teuthology.orchestra.run.smithi040.stdout:681.out 2023-06-22T10:57:27.367 INFO:teuthology.orchestra.run.smithi040.stdout:682 2023-06-22T10:57:27.367 INFO:teuthology.orchestra.run.smithi040.stdout:682.out 2023-06-22T10:57:27.367 INFO:teuthology.orchestra.run.smithi040.stdout:683 2023-06-22T10:57:27.367 INFO:teuthology.orchestra.run.smithi040.stdout:683.out 2023-06-22T10:57:27.367 INFO:teuthology.orchestra.run.smithi040.stdout:684 2023-06-22T10:57:27.367 INFO:teuthology.orchestra.run.smithi040.stdout:684.out 2023-06-22T10:57:27.368 INFO:teuthology.orchestra.run.smithi040.stdout:685 2023-06-22T10:57:27.368 INFO:teuthology.orchestra.run.smithi040.stdout:685.out 2023-06-22T10:57:27.368 INFO:teuthology.orchestra.run.smithi040.stdout:686 2023-06-22T10:57:27.368 INFO:teuthology.orchestra.run.smithi040.stdout:686.out 2023-06-22T10:57:27.368 INFO:teuthology.orchestra.run.smithi040.stdout:687 2023-06-22T10:57:27.368 INFO:teuthology.orchestra.run.smithi040.stdout:687.out 2023-06-22T10:57:27.368 INFO:teuthology.orchestra.run.smithi040.stdout:688 2023-06-22T10:57:27.368 INFO:teuthology.orchestra.run.smithi040.stdout:688.out 2023-06-22T10:57:27.369 INFO:teuthology.orchestra.run.smithi040.stdout:689 2023-06-22T10:57:27.369 INFO:teuthology.orchestra.run.smithi040.stdout:689.out 2023-06-22T10:57:27.369 INFO:teuthology.orchestra.run.smithi040.stdout:690 2023-06-22T10:57:27.369 INFO:teuthology.orchestra.run.smithi040.stdout:690.out 2023-06-22T10:57:27.369 INFO:teuthology.orchestra.run.smithi040.stdout:691 2023-06-22T10:57:27.369 INFO:teuthology.orchestra.run.smithi040.stdout:691.out 2023-06-22T10:57:27.369 INFO:teuthology.orchestra.run.smithi040.stdout:692 2023-06-22T10:57:27.369 INFO:teuthology.orchestra.run.smithi040.stdout:692.out 2023-06-22T10:57:27.370 INFO:teuthology.orchestra.run.smithi040.stdout:693 2023-06-22T10:57:27.370 INFO:teuthology.orchestra.run.smithi040.stdout:693.out 2023-06-22T10:57:27.370 INFO:teuthology.orchestra.run.smithi040.stdout:694 2023-06-22T10:57:27.370 INFO:teuthology.orchestra.run.smithi040.stdout:694.out 2023-06-22T10:57:27.370 INFO:teuthology.orchestra.run.smithi040.stdout:695 2023-06-22T10:57:27.370 INFO:teuthology.orchestra.run.smithi040.stdout:695.out 2023-06-22T10:57:27.370 INFO:teuthology.orchestra.run.smithi040.stdout:696 2023-06-22T10:57:27.370 INFO:teuthology.orchestra.run.smithi040.stdout:696.out 2023-06-22T10:57:27.371 INFO:teuthology.orchestra.run.smithi040.stdout:697 2023-06-22T10:57:27.371 INFO:teuthology.orchestra.run.smithi040.stdout:697.out 2023-06-22T10:57:27.371 INFO:teuthology.orchestra.run.smithi040.stdout:698 2023-06-22T10:57:27.371 INFO:teuthology.orchestra.run.smithi040.stdout:698.out 2023-06-22T10:57:27.371 INFO:teuthology.orchestra.run.smithi040.stdout:699 2023-06-22T10:57:27.371 INFO:teuthology.orchestra.run.smithi040.stdout:699.out 2023-06-22T10:57:27.371 INFO:teuthology.orchestra.run.smithi040.stdout:700 2023-06-22T10:57:27.371 INFO:teuthology.orchestra.run.smithi040.stdout:700.out 2023-06-22T10:57:27.372 INFO:teuthology.orchestra.run.smithi040.stdout:701 2023-06-22T10:57:27.372 INFO:teuthology.orchestra.run.smithi040.stdout:701.out 2023-06-22T10:57:27.372 INFO:teuthology.orchestra.run.smithi040.stdout:702 2023-06-22T10:57:27.372 INFO:teuthology.orchestra.run.smithi040.stdout:702.out 2023-06-22T10:57:27.372 INFO:teuthology.orchestra.run.smithi040.stdout:703 2023-06-22T10:57:27.372 INFO:teuthology.orchestra.run.smithi040.stdout:703.out 2023-06-22T10:57:27.372 INFO:teuthology.orchestra.run.smithi040.stdout:704 2023-06-22T10:57:27.372 INFO:teuthology.orchestra.run.smithi040.stdout:704.out 2023-06-22T10:57:27.373 INFO:teuthology.orchestra.run.smithi040.stdout:705 2023-06-22T10:57:27.373 INFO:teuthology.orchestra.run.smithi040.stdout:705.out 2023-06-22T10:57:27.373 INFO:teuthology.orchestra.run.smithi040.stdout:706 2023-06-22T10:57:27.373 INFO:teuthology.orchestra.run.smithi040.stdout:706.out 2023-06-22T10:57:27.373 INFO:teuthology.orchestra.run.smithi040.stdout:707 2023-06-22T10:57:27.373 INFO:teuthology.orchestra.run.smithi040.stdout:707.out 2023-06-22T10:57:27.373 INFO:teuthology.orchestra.run.smithi040.stdout:708 2023-06-22T10:57:27.373 INFO:teuthology.orchestra.run.smithi040.stdout:708.out 2023-06-22T10:57:27.374 INFO:teuthology.orchestra.run.smithi040.stdout:709 2023-06-22T10:57:27.374 INFO:teuthology.orchestra.run.smithi040.stdout:709.out 2023-06-22T10:57:27.374 INFO:teuthology.orchestra.run.smithi040.stdout:710 2023-06-22T10:57:27.374 INFO:teuthology.orchestra.run.smithi040.stdout:710.out 2023-06-22T10:57:27.374 INFO:teuthology.orchestra.run.smithi040.stdout:711 2023-06-22T10:57:27.374 INFO:teuthology.orchestra.run.smithi040.stdout:711.out 2023-06-22T10:57:27.374 INFO:teuthology.orchestra.run.smithi040.stdout:712 2023-06-22T10:57:27.374 INFO:teuthology.orchestra.run.smithi040.stdout:712.out 2023-06-22T10:57:27.375 INFO:teuthology.orchestra.run.smithi040.stdout:713 2023-06-22T10:57:27.375 INFO:teuthology.orchestra.run.smithi040.stdout:713.out 2023-06-22T10:57:27.375 INFO:teuthology.orchestra.run.smithi040.stdout:714 2023-06-22T10:57:27.375 INFO:teuthology.orchestra.run.smithi040.stdout:714.out 2023-06-22T10:57:27.375 INFO:teuthology.orchestra.run.smithi040.stdout:715 2023-06-22T10:57:27.375 INFO:teuthology.orchestra.run.smithi040.stdout:715.out 2023-06-22T10:57:27.375 INFO:teuthology.orchestra.run.smithi040.stdout:716 2023-06-22T10:57:27.375 INFO:teuthology.orchestra.run.smithi040.stdout:716.out 2023-06-22T10:57:27.376 INFO:teuthology.orchestra.run.smithi040.stdout:717 2023-06-22T10:57:27.376 INFO:teuthology.orchestra.run.smithi040.stdout:717.out 2023-06-22T10:57:27.376 INFO:teuthology.orchestra.run.smithi040.stdout:718 2023-06-22T10:57:27.376 INFO:teuthology.orchestra.run.smithi040.stdout:718.out 2023-06-22T10:57:27.376 INFO:teuthology.orchestra.run.smithi040.stdout:719 2023-06-22T10:57:27.376 INFO:teuthology.orchestra.run.smithi040.stdout:719.out 2023-06-22T10:57:27.376 INFO:teuthology.orchestra.run.smithi040.stdout:720 2023-06-22T10:57:27.376 INFO:teuthology.orchestra.run.smithi040.stdout:720.out 2023-06-22T10:57:27.377 INFO:teuthology.orchestra.run.smithi040.stdout:721 2023-06-22T10:57:27.377 INFO:teuthology.orchestra.run.smithi040.stdout:721.out 2023-06-22T10:57:27.377 INFO:teuthology.orchestra.run.smithi040.stdout:722 2023-06-22T10:57:27.377 INFO:teuthology.orchestra.run.smithi040.stdout:722.out 2023-06-22T10:57:27.377 INFO:teuthology.orchestra.run.smithi040.stdout:723 2023-06-22T10:57:27.377 INFO:teuthology.orchestra.run.smithi040.stdout:723.out 2023-06-22T10:57:27.377 INFO:teuthology.orchestra.run.smithi040.stdout:724 2023-06-22T10:57:27.378 INFO:teuthology.orchestra.run.smithi040.stdout:724.out 2023-06-22T10:57:27.378 INFO:teuthology.orchestra.run.smithi040.stdout:725 2023-06-22T10:57:27.378 INFO:teuthology.orchestra.run.smithi040.stdout:725.out 2023-06-22T10:57:27.378 INFO:teuthology.orchestra.run.smithi040.stdout:726 2023-06-22T10:57:27.378 INFO:teuthology.orchestra.run.smithi040.stdout:726.out 2023-06-22T10:57:27.378 INFO:teuthology.orchestra.run.smithi040.stdout:727 2023-06-22T10:57:27.378 INFO:teuthology.orchestra.run.smithi040.stdout:727.out 2023-06-22T10:57:27.378 INFO:teuthology.orchestra.run.smithi040.stdout:728 2023-06-22T10:57:27.379 INFO:teuthology.orchestra.run.smithi040.stdout:728.out 2023-06-22T10:57:27.379 INFO:teuthology.orchestra.run.smithi040.stdout:group.list 2023-06-22T10:57:27.379 INFO:teuthology.orchestra.run.smithi040.stdout:Makefile 2023-06-22T10:57:27.379 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2023-06-22T10:57:27.884 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T10:57:27.896 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T10:57:27.898 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T10:57:27.900 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T10:57:27.900 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:57:35.723 INFO:teuthology.orchestra.run.smithi040.stdout:generic/001 7s 2023-06-22T10:57:35.737 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/001 2023-06-22T10:57:35.738 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T10:57:35.744 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:57:35.961 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T10:57:35.961 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2023-06-22T10:57:36.465 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T10:57:36.477 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T10:57:36.479 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T10:57:36.481 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T10:57:36.481 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:57:37.338 INFO:teuthology.orchestra.run.smithi040.stdout:generic/002 1s 2023-06-22T10:57:37.351 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/002 2023-06-22T10:57:37.352 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T10:57:37.357 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:57:37.440 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T10:57:37.448 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2023-06-22T10:57:37.905 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T10:57:37.917 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T10:57:37.918 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T10:57:37.921 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T10:57:37.921 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:57:38.435 INFO:teuthology.orchestra.run.smithi040.stdout:generic/003 [not run] atime not maintained by ceph 2023-06-22T10:57:38.444 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/003 2023-06-22T10:57:38.445 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/003 2023-06-22T10:57:38.445 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T10:57:38.450 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:57:38.489 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T10:57:38.489 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2023-06-22T10:57:38.940 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T10:57:38.952 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T10:57:38.953 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T10:57:38.956 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T10:57:38.956 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:57:39.474 INFO:teuthology.orchestra.run.smithi040.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-06-22T10:57:39.484 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/004 2023-06-22T10:57:39.484 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/004 2023-06-22T10:57:39.484 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T10:57:39.490 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:57:39.527 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T10:57:39.527 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2023-06-22T10:57:39.976 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T10:57:39.988 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T10:57:39.990 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T10:57:39.992 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T10:57:39.992 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:57:40.786 INFO:teuthology.orchestra.run.smithi040.stdout:generic/005 0s 2023-06-22T10:57:40.799 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/005 2023-06-22T10:57:40.799 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T10:57:40.805 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:57:40.909 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T10:57:40.910 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2023-06-22T10:57:41.364 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T10:57:41.376 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T10:57:41.377 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T10:57:41.380 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T10:57:41.380 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:57:55.781 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T10:57:55.786 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T10:58:05.252 INFO:teuthology.orchestra.run.smithi040.stdout:generic/006 24s 2023-06-22T10:58:05.264 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/006 2023-06-22T10:58:05.265 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T10:58:05.270 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:58:05.325 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T10:58:05.326 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2023-06-22T10:58:05.902 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T10:58:05.914 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T10:58:05.915 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T10:58:05.917 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T10:58:05.918 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:58:25.915 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T10:58:25.921 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T10:58:56.003 INFO:teuthology.orchestra.run.smithi040.stdout:generic/007 49s 2023-06-22T10:58:56.015 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/007 2023-06-22T10:58:56.015 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T10:58:56.021 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:58:56.127 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T10:58:56.128 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2023-06-22T10:58:56.617 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T10:58:56.642 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T10:58:56.644 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T10:58:56.648 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T10:58:56.648 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:58:57.128 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T10:58:57.133 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T10:58:57.280 INFO:teuthology.orchestra.run.smithi040.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-06-22T10:58:57.289 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/008 2023-06-22T10:58:57.290 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/008 2023-06-22T10:58:57.290 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T10:58:57.295 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:58:57.339 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T10:58:57.339 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2023-06-22T10:58:57.794 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T10:58:57.807 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T10:58:57.808 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T10:58:57.810 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T10:58:57.811 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:58:58.421 INFO:teuthology.orchestra.run.smithi040.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-06-22T10:58:58.431 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/009 2023-06-22T10:58:58.431 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/009 2023-06-22T10:58:58.431 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T10:58:58.437 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:58:58.479 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T10:58:58.479 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2023-06-22T10:58:58.930 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T10:58:58.942 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T10:58:58.943 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T10:58:58.946 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T10:58:58.946 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:58:59.433 INFO:teuthology.orchestra.run.smithi040.stdout:generic/010 [not run] /tmp/tmp.a4ZvvHFGMPxfstests-dev/src/dbtest not built 2023-06-22T10:58:59.443 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/010 2023-06-22T10:58:59.443 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/010 2023-06-22T10:58:59.443 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T10:58:59.449 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:58:59.494 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T10:58:59.495 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2023-06-22T10:58:59.945 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T10:58:59.957 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T10:58:59.960 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T10:58:59.961 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T10:58:59.961 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:59:27.240 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T10:59:27.245 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T10:59:31.632 INFO:teuthology.orchestra.run.smithi040.stdout:generic/011 31s 2023-06-22T10:59:31.645 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/011 2023-06-22T10:59:31.645 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T10:59:31.651 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:59:31.866 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T10:59:31.867 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2023-06-22T10:59:32.396 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T10:59:32.408 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T10:59:32.409 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T10:59:32.412 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T10:59:32.412 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:59:33.061 INFO:teuthology.orchestra.run.smithi040.stdout:generic/012 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-22T10:59:33.070 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/012 2023-06-22T10:59:33.071 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/012 2023-06-22T10:59:33.071 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T10:59:33.077 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:59:33.157 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T10:59:33.157 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2023-06-22T10:59:33.611 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T10:59:33.623 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T10:59:33.625 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T10:59:33.627 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T10:59:33.627 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T10:59:58.924 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T10:59:58.931 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:00:29.457 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:00:29.464 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:00:37.940 INFO:teuthology.orchestra.run.smithi040.stdout:generic/013 64s 2023-06-22T11:00:39.900 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/013 2023-06-22T11:00:39.901 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:00:39.911 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:00:39.973 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:00:39.974 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2023-06-22T11:00:40.672 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:00:40.692 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:00:40.696 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:00:40.701 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:00:40.701 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:00:59.612 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:00:59.617 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:01:30.882 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:01:30.888 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:02:06.214 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:02:06.222 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:02:39.129 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:02:39.135 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:03:12.427 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:03:12.433 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:03:43.575 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:03:43.584 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:04:13.755 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:04:13.763 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:04:44.778 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:04:44.785 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:05:08.895 INFO:teuthology.orchestra.run.smithi040.stdout:generic/014 267s 2023-06-22T11:05:08.911 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/014 2023-06-22T11:05:08.911 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:05:08.919 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:05:08.989 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:05:08.990 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2023-06-22T11:05:09.703 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:05:09.723 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:05:09.725 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:05:09.732 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:05:09.733 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:05:10.487 INFO:teuthology.orchestra.run.smithi040.stdout:generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-22T11:05:10.507 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/015 2023-06-22T11:05:10.507 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/015 2023-06-22T11:05:10.508 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:05:10.519 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:05:10.575 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:05:10.576 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2023-06-22T11:05:11.296 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:05:11.319 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:05:11.321 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:05:11.324 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:05:11.324 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:05:12.333 INFO:teuthology.orchestra.run.smithi040.stdout:generic/016 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-22T11:05:12.347 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/016 2023-06-22T11:05:12.348 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/016 2023-06-22T11:05:12.348 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:05:12.356 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:05:12.503 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:05:12.504 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2023-06-22T11:05:13.336 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:05:13.353 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:05:13.354 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:05:13.358 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:05:13.358 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:05:14.153 INFO:teuthology.orchestra.run.smithi040.stdout:generic/017 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-22T11:05:14.168 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/017 2023-06-22T11:05:14.169 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/017 2023-06-22T11:05:14.169 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:05:14.177 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:05:14.235 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:05:14.236 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2023-06-22T11:05:14.900 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:05:14.914 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:05:14.916 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:05:14.920 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:05:14.921 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:05:14.965 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:05:14.971 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:05:15.880 INFO:teuthology.orchestra.run.smithi040.stdout:generic/018 [not run] defragmentation not supported for fstype "ceph" 2023-06-22T11:05:15.919 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/018 2023-06-22T11:05:15.919 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/018 2023-06-22T11:05:15.919 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:05:15.927 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:05:15.988 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:05:15.989 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2023-06-22T11:05:16.696 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:05:16.717 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:05:16.721 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:05:16.726 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:05:16.727 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:05:17.485 INFO:teuthology.orchestra.run.smithi040.stdout:generic/019 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-06-22T11:05:17.500 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/019 2023-06-22T11:05:17.501 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/019 2023-06-22T11:05:17.501 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:05:17.512 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:05:17.568 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:05:17.569 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2023-06-22T11:05:18.278 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:05:18.297 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:05:18.299 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:05:18.302 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:05:18.302 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:05:26.759 INFO:teuthology.orchestra.run.smithi040.stdout:generic/020 8s 2023-06-22T11:05:26.782 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/020 2023-06-22T11:05:26.782 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:05:26.791 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:05:26.913 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:05:26.915 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2023-06-22T11:05:27.756 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:05:27.776 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:05:27.778 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:05:27.782 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:05:27.782 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:05:28.816 INFO:teuthology.orchestra.run.smithi040.stdout:generic/021 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-22T11:05:28.830 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/021 2023-06-22T11:05:28.831 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/021 2023-06-22T11:05:28.831 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:05:28.839 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:05:28.973 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:05:28.973 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2023-06-22T11:05:29.843 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:05:29.860 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:05:29.861 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:05:29.866 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:05:29.866 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:05:30.874 INFO:teuthology.orchestra.run.smithi040.stdout:generic/022 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-22T11:05:30.890 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/022 2023-06-22T11:05:30.891 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/022 2023-06-22T11:05:30.891 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:05:30.902 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:05:31.009 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:05:31.010 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2023-06-22T11:05:31.852 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:05:31.872 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:05:31.873 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:05:31.876 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:05:31.876 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:05:45.106 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:05:45.112 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:06:11.553 INFO:teuthology.orchestra.run.smithi040.stdout:generic/023 39s 2023-06-22T11:06:13.160 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/023 2023-06-22T11:06:13.160 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:06:13.170 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:06:13.316 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:06:13.316 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2023-06-22T11:06:14.127 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:06:14.145 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:06:14.146 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:06:14.150 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:06:14.151 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:06:14.909 INFO:teuthology.orchestra.run.smithi040.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-06-22T11:06:14.925 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/024 2023-06-22T11:06:14.926 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/024 2023-06-22T11:06:14.926 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:06:14.935 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:06:15.082 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:06:15.082 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2023-06-22T11:06:15.247 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:06:15.255 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:06:15.788 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:06:15.806 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:06:15.807 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:06:15.815 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:06:15.815 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:06:16.709 INFO:teuthology.orchestra.run.smithi040.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-06-22T11:06:16.727 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/025 2023-06-22T11:06:16.727 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/025 2023-06-22T11:06:16.727 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:06:16.738 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:06:16.875 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:06:16.876 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2023-06-22T11:06:17.722 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:06:17.743 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:06:17.744 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:06:17.747 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:06:17.747 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:06:18.579 INFO:teuthology.orchestra.run.smithi040.stdout:generic/026 [not run] ceph does not define maximum ACL count 2023-06-22T11:06:18.598 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/026 2023-06-22T11:06:18.599 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/026 2023-06-22T11:06:18.599 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:06:18.608 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:06:18.677 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:06:18.678 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2023-06-22T11:06:19.375 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:06:19.392 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:06:19.393 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:06:19.397 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:06:19.398 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:06:20.171 INFO:teuthology.orchestra.run.smithi040.stdout:generic/027 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-22T11:06:20.188 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/027 2023-06-22T11:06:20.188 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/027 2023-06-22T11:06:20.188 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:06:20.197 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:06:20.249 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:06:20.250 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2023-06-22T11:06:20.942 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:06:20.964 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:06:20.966 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:06:20.970 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:06:20.970 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:06:26.806 INFO:teuthology.orchestra.run.smithi040.stdout:generic/028 5s 2023-06-22T11:06:26.828 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/028 2023-06-22T11:06:26.829 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:06:26.839 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:06:26.903 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:06:26.903 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2023-06-22T11:06:27.628 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:06:27.650 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:06:27.651 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:06:27.655 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:06:27.655 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:06:32.067 INFO:teuthology.orchestra.run.smithi040.stdout:generic/029 5s 2023-06-22T11:06:32.087 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/029 2023-06-22T11:06:32.088 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:06:32.098 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:06:32.135 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:06:32.137 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2023-06-22T11:06:32.854 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:06:32.870 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:06:32.871 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:06:32.874 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:06:32.875 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:06:35.530 INFO:teuthology.orchestra.run.smithi040.stdout:generic/030 2s 2023-06-22T11:06:35.551 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/030 2023-06-22T11:06:35.551 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:06:35.558 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:06:35.594 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:06:35.595 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2023-06-22T11:06:36.304 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:06:36.321 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:06:36.322 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:06:36.329 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:06:36.329 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:06:37.283 INFO:teuthology.orchestra.run.smithi040.stdout:generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-06-22T11:06:37.297 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/031 2023-06-22T11:06:37.297 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/031 2023-06-22T11:06:37.297 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:06:37.306 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:06:37.368 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:06:37.369 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2023-06-22T11:06:38.074 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:06:38.094 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:06:38.096 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:06:38.099 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:06:38.099 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:06:38.872 INFO:teuthology.orchestra.run.smithi040.stdout:generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-22T11:06:38.886 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/032 2023-06-22T11:06:38.887 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/032 2023-06-22T11:06:38.887 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:06:38.895 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:06:38.954 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:06:38.954 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2023-06-22T11:06:39.675 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:06:39.694 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:06:39.697 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:06:39.700 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:06:39.701 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:06:40.637 INFO:teuthology.orchestra.run.smithi040.stdout:generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-06-22T11:06:40.654 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/033 2023-06-22T11:06:40.654 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/033 2023-06-22T11:06:40.654 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:06:40.667 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:06:40.722 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:06:40.723 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2023-06-22T11:06:41.446 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:06:41.471 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:06:41.473 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:06:41.478 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:06:41.478 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:06:42.277 INFO:teuthology.orchestra.run.smithi040.stdout:generic/034 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-06-22T11:06:42.292 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/034 2023-06-22T11:06:42.292 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/034 2023-06-22T11:06:42.292 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:06:42.303 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:06:42.355 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:06:42.356 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2023-06-22T11:06:43.047 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:06:43.064 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:06:43.065 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:06:43.068 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:06:43.068 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:06:43.991 INFO:teuthology.orchestra.run.smithi040.stdout:generic/035 0s 2023-06-22T11:06:44.010 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/035 2023-06-22T11:06:44.011 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:06:44.023 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:06:44.180 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:06:44.180 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2023-06-22T11:06:45.030 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:06:45.048 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:06:45.049 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:06:45.052 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:06:45.052 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:06:46.511 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:06:46.527 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:06:55.994 INFO:teuthology.orchestra.run.smithi040.stdout:generic/036 10s 2023-06-22T11:06:56.012 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/036 2023-06-22T11:06:56.012 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:06:56.021 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:06:56.158 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:06:56.158 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2023-06-22T11:06:57.001 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:06:57.023 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:06:57.024 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:06:57.026 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:06:57.027 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:07:10.492 INFO:teuthology.orchestra.run.smithi040.stdout:generic/037 13s 2023-06-22T11:07:10.512 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/037 2023-06-22T11:07:10.513 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:07:10.520 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:07:10.550 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:07:10.551 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2023-06-22T11:07:11.249 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:07:11.271 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:07:11.272 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:07:11.276 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:07:11.276 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:07:12.044 INFO:teuthology.orchestra.run.smithi040.stdout:generic/038 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-22T11:07:12.071 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/038 2023-06-22T11:07:12.071 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/038 2023-06-22T11:07:12.071 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:07:12.077 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:07:12.144 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:07:12.145 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2023-06-22T11:07:12.865 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:07:12.882 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:07:12.884 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:07:12.889 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:07:12.889 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:07:13.716 INFO:teuthology.orchestra.run.smithi040.stdout:generic/039 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-06-22T11:07:13.733 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/039 2023-06-22T11:07:13.733 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/039 2023-06-22T11:07:13.734 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:07:13.744 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:07:13.805 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:07:13.805 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2023-06-22T11:07:14.553 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:07:14.568 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:07:14.569 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:07:14.574 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:07:14.574 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:07:15.222 INFO:teuthology.orchestra.run.smithi040.stdout:generic/040 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-06-22T11:07:15.232 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/040 2023-06-22T11:07:15.233 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/040 2023-06-22T11:07:15.233 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:07:15.239 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:07:15.281 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:07:15.281 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2023-06-22T11:07:15.735 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:07:15.746 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:07:15.748 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:07:15.750 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:07:15.750 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:07:16.292 INFO:teuthology.orchestra.run.smithi040.stdout:generic/041 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-06-22T11:07:16.302 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/041 2023-06-22T11:07:16.302 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/041 2023-06-22T11:07:16.302 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:07:16.308 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:07:16.354 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:07:16.355 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2023-06-22T11:07:16.676 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:07:16.682 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:07:16.813 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:07:16.825 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:07:16.827 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:07:16.829 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:07:16.829 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:07:17.482 INFO:teuthology.orchestra.run.smithi040.stdout:generic/042 [not run] ceph does not support shutdown 2023-06-22T11:07:17.505 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/042 2023-06-22T11:07:17.505 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/042 2023-06-22T11:07:17.505 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:07:17.511 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:07:17.549 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:07:17.549 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2023-06-22T11:07:18.044 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:07:18.057 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:07:18.058 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:07:18.060 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:07:18.061 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:07:18.713 INFO:teuthology.orchestra.run.smithi040.stdout:generic/043 [not run] ceph does not support shutdown 2023-06-22T11:07:18.740 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/043 2023-06-22T11:07:18.740 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/043 2023-06-22T11:07:18.741 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:07:18.746 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:07:18.787 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:07:18.788 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2023-06-22T11:07:19.236 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:07:19.249 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:07:19.249 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:07:19.252 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:07:19.252 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:07:19.903 INFO:teuthology.orchestra.run.smithi040.stdout:generic/044 [not run] ceph does not support shutdown 2023-06-22T11:07:19.932 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/044 2023-06-22T11:07:19.932 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/044 2023-06-22T11:07:19.932 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:07:19.938 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:07:19.974 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:07:19.975 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2023-06-22T11:07:20.432 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:07:20.445 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:07:20.446 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:07:20.448 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:07:20.449 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:07:21.097 INFO:teuthology.orchestra.run.smithi040.stdout:generic/045 [not run] ceph does not support shutdown 2023-06-22T11:07:21.126 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/045 2023-06-22T11:07:21.127 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/045 2023-06-22T11:07:21.127 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:07:21.132 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:07:21.169 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:07:21.170 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2023-06-22T11:07:21.620 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:07:21.632 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:07:21.633 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:07:21.636 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:07:21.636 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:07:22.273 INFO:teuthology.orchestra.run.smithi040.stdout:generic/046 [not run] ceph does not support shutdown 2023-06-22T11:07:22.298 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/046 2023-06-22T11:07:22.299 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/046 2023-06-22T11:07:22.299 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:07:22.305 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:07:22.339 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:07:22.340 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2023-06-22T11:07:22.794 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:07:22.806 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:07:22.807 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:07:22.810 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:07:22.811 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:07:23.465 INFO:teuthology.orchestra.run.smithi040.stdout:generic/047 [not run] ceph does not support shutdown 2023-06-22T11:07:23.493 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/047 2023-06-22T11:07:23.493 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/047 2023-06-22T11:07:23.493 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:07:23.499 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:07:23.535 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:07:23.535 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2023-06-22T11:07:23.992 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:07:24.005 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:07:24.006 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:07:24.008 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:07:24.008 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:07:24.647 INFO:teuthology.orchestra.run.smithi040.stdout:generic/048 [not run] ceph does not support shutdown 2023-06-22T11:07:24.677 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/048 2023-06-22T11:07:24.677 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/048 2023-06-22T11:07:24.677 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:07:24.683 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:07:24.723 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:07:24.724 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2023-06-22T11:07:25.184 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:07:25.197 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:07:25.198 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:07:25.200 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:07:25.200 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:07:25.843 INFO:teuthology.orchestra.run.smithi040.stdout:generic/049 [not run] ceph does not support shutdown 2023-06-22T11:07:25.879 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/049 2023-06-22T11:07:25.880 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/049 2023-06-22T11:07:25.880 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:07:25.885 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:07:25.926 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:07:25.927 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2023-06-22T11:07:26.372 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:07:26.384 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:07:26.385 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:07:26.387 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:07:26.388 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:07:27.030 INFO:teuthology.orchestra.run.smithi040.stdout:generic/050 [not run] ceph does not support shutdown 2023-06-22T11:07:27.053 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/050 2023-06-22T11:07:27.053 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/050 2023-06-22T11:07:27.053 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:07:27.059 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:07:27.094 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:07:27.094 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2023-06-22T11:07:27.545 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:07:27.557 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:07:27.558 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:07:27.561 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:07:27.561 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:07:28.223 INFO:teuthology.orchestra.run.smithi040.stdout:generic/051 [not run] ceph does not support shutdown 2023-06-22T11:07:28.233 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/051 2023-06-22T11:07:28.233 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/051 2023-06-22T11:07:28.233 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:07:28.239 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:07:28.273 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:07:28.273 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2023-06-22T11:07:28.728 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:07:28.740 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:07:28.741 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:07:28.744 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:07:28.744 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:07:29.404 INFO:teuthology.orchestra.run.smithi040.stdout:generic/052 [not run] ceph does not support shutdown 2023-06-22T11:07:29.431 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/052 2023-06-22T11:07:29.431 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/052 2023-06-22T11:07:29.432 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:07:29.437 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:07:29.483 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:07:29.483 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2023-06-22T11:07:29.932 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:07:29.945 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:07:29.945 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:07:29.948 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:07:29.948 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:07:31.150 INFO:teuthology.orchestra.run.smithi040.stdout:generic/053 1s 2023-06-22T11:07:31.221 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/053 2023-06-22T11:07:31.221 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:07:31.225 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:07:31.256 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:07:31.257 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2023-06-22T11:07:31.709 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:07:31.721 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:07:31.722 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:07:31.725 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:07:31.725 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:07:32.409 INFO:teuthology.orchestra.run.smithi040.stdout:generic/054 [not run] ceph does not support shutdown 2023-06-22T11:07:32.432 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/054 2023-06-22T11:07:32.432 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/054 2023-06-22T11:07:32.432 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:07:32.438 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:07:32.470 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:07:32.471 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2023-06-22T11:07:32.923 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:07:32.935 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:07:32.936 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:07:32.939 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:07:32.939 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:07:33.604 INFO:teuthology.orchestra.run.smithi040.stdout:generic/055 [not run] ceph does not support shutdown 2023-06-22T11:07:33.632 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/055 2023-06-22T11:07:33.632 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/055 2023-06-22T11:07:33.633 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:07:33.638 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:07:33.675 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:07:33.675 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2023-06-22T11:07:34.122 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:07:34.135 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:07:34.136 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:07:34.139 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:07:34.139 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:07:34.694 INFO:teuthology.orchestra.run.smithi040.stdout:generic/056 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-06-22T11:07:34.703 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/056 2023-06-22T11:07:34.704 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/056 2023-06-22T11:07:34.704 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:07:34.710 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:07:34.753 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:07:34.754 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2023-06-22T11:07:35.210 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:07:35.222 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:07:35.224 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:07:35.226 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:07:35.226 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:07:35.767 INFO:teuthology.orchestra.run.smithi040.stdout:generic/057 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-06-22T11:07:35.777 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/057 2023-06-22T11:07:35.777 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/057 2023-06-22T11:07:35.777 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:07:35.783 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:07:35.827 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:07:35.827 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2023-06-22T11:07:36.284 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:07:36.297 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:07:36.298 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:07:36.300 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:07:36.301 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:07:36.959 INFO:teuthology.orchestra.run.smithi040.stdout:generic/058 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-22T11:07:36.969 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/058 2023-06-22T11:07:36.969 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/058 2023-06-22T11:07:36.969 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:07:36.975 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:07:37.111 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:07:37.111 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2023-06-22T11:07:37.761 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:07:37.773 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:07:37.774 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:07:37.777 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:07:37.777 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:07:38.304 INFO:teuthology.orchestra.run.smithi040.stdout:generic/059 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-06-22T11:07:38.314 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/059 2023-06-22T11:07:38.314 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/059 2023-06-22T11:07:38.314 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:07:38.320 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:07:38.369 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:07:38.370 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2023-06-22T11:07:38.821 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:07:38.833 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:07:38.834 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:07:38.837 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:07:38.837 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:07:39.530 INFO:teuthology.orchestra.run.smithi040.stdout:generic/060 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-22T11:07:39.540 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/060 2023-06-22T11:07:39.541 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/060 2023-06-22T11:07:39.541 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:07:39.546 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:07:39.679 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:07:39.679 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2023-06-22T11:07:40.302 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:07:40.314 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:07:40.315 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:07:40.318 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:07:40.318 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:07:41.000 INFO:teuthology.orchestra.run.smithi040.stdout:generic/061 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-22T11:07:41.010 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/061 2023-06-22T11:07:41.010 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/061 2023-06-22T11:07:41.011 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:07:41.016 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:07:41.174 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:07:41.175 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2023-06-22T11:07:41.788 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:07:41.800 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:07:41.801 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:07:41.804 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:07:41.805 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:07:44.551 INFO:teuthology.orchestra.run.smithi040.stdout:generic/062 2s 2023-06-22T11:07:44.596 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/062 2023-06-22T11:07:44.597 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:07:44.616 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:07:44.674 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:07:44.675 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2023-06-22T11:07:45.150 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:07:45.162 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:07:45.163 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:07:45.166 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:07:45.166 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:07:45.897 INFO:teuthology.orchestra.run.smithi040.stdout:generic/063 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-22T11:07:45.906 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/063 2023-06-22T11:07:45.907 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/063 2023-06-22T11:07:45.907 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:07:45.912 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:07:46.047 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:07:46.047 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2023-06-22T11:07:46.671 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:07:46.684 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:07:46.684 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:07:46.687 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:07:46.687 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:07:46.793 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:07:46.798 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:07:47.216 INFO:teuthology.orchestra.run.smithi040.stdout:generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-22T11:07:47.226 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/064 2023-06-22T11:07:47.226 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/064 2023-06-22T11:07:47.226 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:07:47.232 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:07:47.274 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:07:47.275 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2023-06-22T11:07:47.729 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:07:47.740 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:07:47.742 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:07:47.744 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:07:47.745 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:07:48.292 INFO:teuthology.orchestra.run.smithi040.stdout:generic/065 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-06-22T11:07:48.302 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/065 2023-06-22T11:07:48.302 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/065 2023-06-22T11:07:48.302 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:07:48.308 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:07:48.352 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:07:48.353 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2023-06-22T11:07:48.808 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:07:48.820 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:07:48.821 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:07:48.824 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:07:48.824 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:07:49.343 INFO:teuthology.orchestra.run.smithi040.stdout:generic/066 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-06-22T11:07:49.353 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/066 2023-06-22T11:07:49.353 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/066 2023-06-22T11:07:49.353 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:07:49.359 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:07:49.399 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:07:49.400 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2023-06-22T11:07:49.859 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:07:49.871 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:07:49.872 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:07:49.875 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:07:49.876 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:07:50.450 INFO:teuthology.orchestra.run.smithi040.stdout:generic/067 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-06-22T11:07:50.460 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/067 2023-06-22T11:07:50.460 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/067 2023-06-22T11:07:50.460 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:07:50.466 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:07:50.509 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:07:50.510 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2023-06-22T11:07:50.955 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:07:50.967 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:07:50.968 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:07:50.971 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:07:50.971 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:07:51.496 INFO:teuthology.orchestra.run.smithi040.stdout:generic/068 [not run] ceph does not support freezing 2023-06-22T11:07:51.506 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/068 2023-06-22T11:07:51.506 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/068 2023-06-22T11:07:51.507 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:07:51.512 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:07:51.555 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:07:51.556 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2023-06-22T11:07:52.006 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:07:52.018 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:07:52.019 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:07:52.021 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:07:52.021 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:08:13.026 INFO:teuthology.orchestra.run.smithi040.stdout:generic/069 20s 2023-06-22T11:08:13.076 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/069 2023-06-22T11:08:13.077 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:08:13.089 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:08:13.135 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:08:13.136 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2023-06-22T11:08:13.587 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:08:13.600 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:08:13.601 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:08:13.603 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:08:13.603 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:08:16.943 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:08:16.948 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:08:43.029 INFO:teuthology.orchestra.run.smithi040.stdout:generic/070 30s 2023-06-22T11:08:43.052 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/070 2023-06-22T11:08:43.052 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:08:43.063 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:08:43.211 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:08:43.211 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2023-06-22T11:08:44.041 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:08:44.056 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:08:44.058 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:08:44.063 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:08:44.063 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:08:44.866 INFO:teuthology.orchestra.run.smithi040.stdout:generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-06-22T11:08:44.884 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/071 2023-06-22T11:08:44.885 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/071 2023-06-22T11:08:44.885 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:08:44.894 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:08:44.953 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:08:44.954 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2023-06-22T11:08:45.624 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:08:45.643 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:08:45.644 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:08:45.648 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:08:45.648 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:08:46.626 INFO:teuthology.orchestra.run.smithi040.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-06-22T11:08:46.641 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/072 2023-06-22T11:08:46.641 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/072 2023-06-22T11:08:46.641 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:08:46.650 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:08:46.720 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:08:46.721 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2023-06-22T11:08:47.115 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:08:47.124 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:08:47.377 INFO:tasks.ceph.mds.d.smithi045.stderr:2023-06-22T11:08:47.373+0000 7ff7841f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 117813) UID: 0 2023-06-22T11:08:47.378 INFO:tasks.ceph.mds.b.smithi045.stderr:2023-06-22T11:08:47.374+0000 7f23f61f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 117813) UID: 0 2023-06-22T11:08:47.466 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:08:47.483 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:08:47.484 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:08:47.487 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:08:47.487 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:08:48.267 INFO:teuthology.orchestra.run.smithi040.stdout:generic/073 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-06-22T11:08:48.280 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/073 2023-06-22T11:08:48.280 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/073 2023-06-22T11:08:48.281 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:08:48.288 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:08:48.339 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:08:48.340 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2023-06-22T11:08:49.028 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:08:49.043 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:08:49.045 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:08:49.048 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:08:49.048 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:09:36.219 INFO:teuthology.orchestra.run.smithi040.stdout:generic/074 47s 2023-06-22T11:09:36.240 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/074 2023-06-22T11:09:36.240 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:09:36.250 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:09:37.322 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:09:37.322 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2023-06-22T11:09:38.115 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:09:38.138 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:09:38.139 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:09:38.143 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:09:38.143 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:10:16.945 INFO:teuthology.orchestra.run.smithi040.stdout:generic/075 38s 2023-06-22T11:10:16.962 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/075 2023-06-22T11:10:16.962 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:10:16.970 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:10:17.123 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:10:17.124 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2023-06-22T11:10:17.906 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:10:17.929 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:10:17.930 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:10:17.934 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:10:17.934 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:10:18.681 INFO:teuthology.orchestra.run.smithi040.stdout:generic/076 [not run] require 172.21.15.40:6789:/scratch to be local device 2023-06-22T11:10:18.696 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/076 2023-06-22T11:10:18.697 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/076 2023-06-22T11:10:18.697 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:10:18.711 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:10:18.774 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:10:18.775 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2023-06-22T11:10:19.498 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:10:19.518 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:10:19.520 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:10:19.523 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:10:19.523 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:10:21.486 INFO:teuthology.orchestra.run.smithi040.stdout:generic/077 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-22T11:10:21.500 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/077 2023-06-22T11:10:21.500 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/077 2023-06-22T11:10:21.500 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:10:21.513 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:10:21.687 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:10:21.688 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2023-06-22T11:10:22.510 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:10:22.524 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:10:22.525 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:10:22.528 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:10:22.528 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:10:23.342 INFO:teuthology.orchestra.run.smithi040.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-06-22T11:10:23.357 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/078 2023-06-22T11:10:23.357 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/078 2023-06-22T11:10:23.357 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:10:23.364 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:10:23.485 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:10:23.485 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2023-06-22T11:10:24.384 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:10:24.398 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:10:24.399 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:10:24.402 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:10:24.402 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:10:25.176 INFO:teuthology.orchestra.run.smithi040.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-06-22T11:10:25.191 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/079 2023-06-22T11:10:25.191 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/079 2023-06-22T11:10:25.191 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:10:25.200 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:10:25.277 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:10:25.277 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2023-06-22T11:10:26.003 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:10:26.017 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:10:26.018 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:10:26.022 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:10:26.023 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:10:28.892 INFO:teuthology.orchestra.run.smithi040.stdout:generic/080 2s 2023-06-22T11:10:28.912 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/080 2023-06-22T11:10:28.912 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:10:28.919 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:10:29.010 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:10:29.011 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2023-06-22T11:10:29.728 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:10:29.748 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:10:29.750 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:10:29.753 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:10:29.753 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:10:30.552 INFO:teuthology.orchestra.run.smithi040.stdout:generic/081 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-06-22T11:10:30.569 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/081 2023-06-22T11:10:30.569 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/081 2023-06-22T11:10:30.569 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:10:30.577 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:10:30.634 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:10:30.634 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2023-06-22T11:10:31.353 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:10:31.430 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:10:31.430 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:10:31.430 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:10:31.430 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:10:32.188 INFO:teuthology.orchestra.run.smithi040.stdout:generic/082 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-22T11:10:32.202 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/082 2023-06-22T11:10:32.202 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/082 2023-06-22T11:10:32.202 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:10:32.210 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:10:32.257 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:10:32.258 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2023-06-22T11:10:32.950 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:10:32.969 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:10:32.970 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:10:32.974 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:10:32.975 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:10:33.703 INFO:teuthology.orchestra.run.smithi040.stdout:generic/083 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-22T11:10:33.718 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/083 2023-06-22T11:10:33.719 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/083 2023-06-22T11:10:33.719 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:10:33.729 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:10:33.778 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:10:33.779 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2023-06-22T11:10:34.471 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:10:34.488 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:10:34.489 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:10:34.493 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:10:34.494 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:10:40.968 INFO:teuthology.orchestra.run.smithi040.stdout:generic/084 6s 2023-06-22T11:10:41.010 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/084 2023-06-22T11:10:41.011 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:10:41.017 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:10:41.065 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:10:41.066 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2023-06-22T11:10:41.772 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:10:41.793 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:10:41.796 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:10:41.799 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:10:41.799 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:10:42.603 INFO:teuthology.orchestra.run.smithi040.stdout:generic/085 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-06-22T11:10:42.617 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/085 2023-06-22T11:10:42.618 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/085 2023-06-22T11:10:42.618 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:10:42.626 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:10:42.683 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:10:42.683 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2023-06-22T11:10:43.372 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:10:43.396 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:10:43.397 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:10:43.402 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:10:43.403 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:10:44.227 INFO:teuthology.orchestra.run.smithi040.stdout:generic/086 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-22T11:10:44.242 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/086 2023-06-22T11:10:44.242 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/086 2023-06-22T11:10:44.242 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:10:44.250 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:10:44.309 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:10:44.310 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2023-06-22T11:10:44.986 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:10:45.004 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:10:45.006 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:10:45.009 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:10:45.010 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:10:45.991 INFO:teuthology.orchestra.run.smithi040.stdout:generic/087 0s 2023-06-22T11:10:46.008 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/087 2023-06-22T11:10:46.008 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:10:46.021 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:10:46.172 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:10:46.172 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2023-06-22T11:10:47.033 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:10:47.052 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:10:47.054 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:10:47.056 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:10:47.057 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:10:47.869 INFO:teuthology.orchestra.run.smithi040.stdout:generic/088 0s 2023-06-22T11:10:48.259 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/088 2023-06-22T11:10:48.259 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:10:48.270 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:10:48.444 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:10:48.444 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2023-06-22T11:10:49.261 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:10:49.278 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:10:49.280 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:10:49.283 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:10:49.283 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:11:58.269 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:11:58.274 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:12:28.688 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:12:28.695 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:12:59.388 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:12:59.393 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:13:29.510 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:13:29.516 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:13:59.634 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:13:59.639 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:14:32.574 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:14:32.584 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:15:02.896 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:15:02.901 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:15:03.609 INFO:tasks.ceph.mds.b.smithi045.stderr:2023-06-22T11:15:03.605+0000 7f23f61f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 118173) UID: 0 2023-06-22T11:15:03.609 INFO:tasks.ceph.mds.d.smithi045.stderr:2023-06-22T11:15:03.606+0000 7ff7841f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 118173) UID: 0 2023-06-22T11:18:07.962 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:18:07.968 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:18:44.698 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:18:44.703 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:19:14.815 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:19:14.821 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:19:14.913 INFO:tasks.ceph.mds.b.smithi045.stderr:2023-06-22T11:19:14.910+0000 7f23f61f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 118284) UID: 0 2023-06-22T11:19:14.914 INFO:tasks.ceph.mds.d.smithi045.stderr:2023-06-22T11:19:14.911+0000 7ff7841f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 118284) UID: 0 2023-06-22T11:20:13.907 INFO:teuthology.orchestra.run.smithi040.stdout:generic/089 564s 2023-06-22T11:20:13.920 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/089 2023-06-22T11:20:13.920 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:20:13.926 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:20:14.244 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:20:14.245 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/090) 2023-06-22T11:20:14.799 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:20:14.811 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:20:14.812 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:20:14.815 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:20:14.815 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:20:15.496 INFO:teuthology.orchestra.run.smithi040.stdout:generic/090 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-06-22T11:20:15.506 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/090 2023-06-22T11:20:15.506 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/090 2023-06-22T11:20:15.507 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:20:15.512 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:20:15.553 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:20:15.554 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/091) 2023-06-22T11:20:16.007 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:20:16.019 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:20:16.021 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:20:16.023 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:20:16.023 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:22:03.720 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:22:03.725 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:22:05.750 INFO:teuthology.orchestra.run.smithi040.stdout:generic/091 109s 2023-06-22T11:22:05.763 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/091 2023-06-22T11:22:05.764 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:22:05.769 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:22:05.928 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:22:05.929 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/092) 2023-06-22T11:22:06.578 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:22:06.590 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:22:06.591 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:22:06.594 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:22:06.594 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:22:07.127 INFO:teuthology.orchestra.run.smithi040.stdout:generic/092 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-22T11:22:07.137 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/092 2023-06-22T11:22:07.137 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/092 2023-06-22T11:22:07.137 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:22:07.143 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:22:07.194 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:22:07.194 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/093) 2023-06-22T11:22:07.651 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:22:07.664 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:22:07.665 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:22:07.667 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:22:07.668 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:22:08.576 INFO:teuthology.orchestra.run.smithi040.stdout:generic/093 1s 2023-06-22T11:22:08.589 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/093 2023-06-22T11:22:08.589 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:22:08.595 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:22:08.755 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:22:08.755 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/094) 2023-06-22T11:22:09.400 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:22:09.413 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:22:09.414 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:22:09.416 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:22:09.416 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:22:09.982 INFO:teuthology.orchestra.run.smithi040.stdout:generic/094 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-22T11:22:09.992 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/094 2023-06-22T11:22:09.992 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/094 2023-06-22T11:22:09.992 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:22:09.998 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:22:10.124 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:22:10.125 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/095) 2023-06-22T11:22:10.803 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:22:10.816 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:22:10.817 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:22:10.820 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:22:10.820 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:22:27.610 INFO:teuthology.orchestra.run.smithi040.stdout:generic/095 16s 2023-06-22T11:22:27.624 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/095 2023-06-22T11:22:27.625 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:22:27.631 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:22:27.653 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:22:27.653 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/096) 2023-06-22T11:22:28.365 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:22:28.378 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:22:28.379 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:22:28.381 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:22:28.381 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:22:29.058 INFO:teuthology.orchestra.run.smithi040.stdout:generic/096 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-06-22T11:22:29.068 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/096 2023-06-22T11:22:29.068 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/096 2023-06-22T11:22:29.069 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:22:29.074 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:22:29.122 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:22:29.123 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/097) 2023-06-22T11:22:29.582 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:22:29.594 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:22:29.595 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:22:29.598 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:22:29.598 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:22:30.692 INFO:teuthology.orchestra.run.smithi040.stdout:generic/097 1s 2023-06-22T11:22:30.705 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/097 2023-06-22T11:22:30.705 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:22:30.711 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:22:30.750 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:22:30.751 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/098) 2023-06-22T11:22:31.204 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:22:31.217 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:22:31.218 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:22:31.219 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:22:31.220 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:22:33.269 INFO:teuthology.orchestra.run.smithi040.stdout:generic/098 2s 2023-06-22T11:22:33.282 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/098 2023-06-22T11:22:33.282 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:22:33.288 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:22:33.309 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:22:33.309 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2023-06-22T11:22:33.762 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:22:33.774 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:22:33.775 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:22:33.778 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:22:33.778 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:22:33.833 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:22:33.838 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:22:35.217 INFO:teuthology.orchestra.run.smithi040.stdout:generic/099 2s 2023-06-22T11:22:35.230 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/099 2023-06-22T11:22:35.230 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:22:35.236 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:22:35.396 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:22:35.396 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/100) 2023-06-22T11:22:36.044 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:22:36.056 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:22:36.057 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:22:36.060 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:22:36.060 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:23:01.337 INFO:teuthology.orchestra.run.smithi040.stdout:generic/100 25s 2023-06-22T11:23:01.350 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/100 2023-06-22T11:23:01.351 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:23:01.356 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:23:02.271 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:23:02.272 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/101) 2023-06-22T11:23:02.770 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:23:02.782 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:23:02.783 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:23:02.785 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:23:02.786 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:23:03.324 INFO:teuthology.orchestra.run.smithi040.stdout:generic/101 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-06-22T11:23:03.334 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/101 2023-06-22T11:23:03.334 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/101 2023-06-22T11:23:03.334 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:23:03.340 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:23:03.373 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:23:03.374 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/102) 2023-06-22T11:23:03.822 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:23:03.834 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:23:03.835 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:23:03.838 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:23:03.838 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:23:03.947 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:23:03.952 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:23:04.429 INFO:teuthology.orchestra.run.smithi040.stdout:generic/102 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-22T11:23:04.439 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/102 2023-06-22T11:23:04.440 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/102 2023-06-22T11:23:04.440 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:23:04.445 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:23:04.478 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:23:04.478 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/103) 2023-06-22T11:23:04.930 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:23:04.942 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:23:04.943 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:23:04.946 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:23:04.946 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:23:05.481 INFO:teuthology.orchestra.run.smithi040.stdout:generic/103 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-22T11:23:05.492 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/103 2023-06-22T11:23:05.492 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/103 2023-06-22T11:23:05.493 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:23:05.498 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:23:05.673 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:23:05.674 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/104) 2023-06-22T11:23:06.306 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:23:06.318 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:23:06.319 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:23:06.321 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:23:06.322 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:23:06.866 INFO:teuthology.orchestra.run.smithi040.stdout:generic/104 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-06-22T11:23:06.876 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/104 2023-06-22T11:23:06.877 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/104 2023-06-22T11:23:06.877 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:23:06.882 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:23:06.923 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:23:06.924 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/105) 2023-06-22T11:23:07.392 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:23:07.404 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:23:07.406 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:23:07.408 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:23:07.408 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:23:08.418 INFO:teuthology.orchestra.run.smithi040.stdout:generic/105 1s 2023-06-22T11:23:08.516 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/105 2023-06-22T11:23:08.516 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:23:08.528 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:23:08.569 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:23:08.570 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/106) 2023-06-22T11:23:09.048 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:23:09.060 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:23:09.061 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:23:09.063 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:23:09.064 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:23:09.619 INFO:teuthology.orchestra.run.smithi040.stdout:generic/106 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-06-22T11:23:09.629 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/106 2023-06-22T11:23:09.629 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/106 2023-06-22T11:23:09.629 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:23:09.636 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:23:09.677 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:23:09.678 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/107) 2023-06-22T11:23:10.131 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:23:10.142 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:23:10.143 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:23:10.145 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:23:10.146 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:23:10.685 INFO:teuthology.orchestra.run.smithi040.stdout:generic/107 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-06-22T11:23:10.694 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/107 2023-06-22T11:23:10.695 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/107 2023-06-22T11:23:10.695 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:23:10.700 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:23:10.742 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:23:10.742 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/108) 2023-06-22T11:23:11.193 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:23:11.205 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:23:11.206 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:23:11.209 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:23:11.209 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:23:11.865 INFO:teuthology.orchestra.run.smithi040.stdout:generic/108 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-06-22T11:23:11.875 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/108 2023-06-22T11:23:11.875 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/108 2023-06-22T11:23:11.876 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:23:11.881 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:23:11.918 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:23:11.919 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/109) 2023-06-22T11:23:12.372 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:23:12.385 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:23:12.386 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:23:12.388 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:23:12.388 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:23:22.237 INFO:teuthology.orchestra.run.smithi040.stdout:generic/109 10s 2023-06-22T11:23:22.252 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/109 2023-06-22T11:23:22.252 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:23:22.258 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:23:22.279 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:23:22.280 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/110) 2023-06-22T11:23:23.129 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:23:23.142 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:23:23.143 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:23:23.145 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:23:23.145 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:23:34.735 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:23:34.739 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:23:45.704 INFO:teuthology.orchestra.run.smithi040.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph 2023-06-22T11:23:45.715 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/110 2023-06-22T11:23:45.715 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/110 2023-06-22T11:23:45.715 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:23:45.730 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:23:45.933 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:23:45.934 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/111) 2023-06-22T11:23:46.646 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:23:46.658 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:23:46.659 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:23:46.662 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:23:46.662 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:23:47.223 INFO:teuthology.orchestra.run.smithi040.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph 2023-06-22T11:23:47.233 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/111 2023-06-22T11:23:47.233 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/111 2023-06-22T11:23:47.233 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:23:47.239 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:23:47.383 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:23:47.384 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/112) 2023-06-22T11:23:48.065 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:23:48.077 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:23:48.078 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:23:48.081 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:23:48.081 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:24:04.842 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:24:04.848 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:24:06.393 INFO:teuthology.orchestra.run.smithi040.stdout:generic/112 18s 2023-06-22T11:24:06.406 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/112 2023-06-22T11:24:06.406 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:24:06.412 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:24:06.566 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:24:06.566 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/113) 2023-06-22T11:24:07.218 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:24:07.230 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:24:07.231 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:24:07.233 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:24:07.233 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:24:24.597 INFO:teuthology.orchestra.run.smithi040.stdout:generic/113 17s 2023-06-22T11:24:24.621 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/113 2023-06-22T11:24:24.621 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:24:24.627 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:24:24.731 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:24:24.732 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/114) 2023-06-22T11:24:25.519 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:24:25.531 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:24:25.532 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:24:25.535 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:24:25.535 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:24:26.124 INFO:teuthology.orchestra.run.smithi040.stdout:generic/114 [not run] device block size: 4096 greater than 512 2023-06-22T11:24:26.134 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/114 2023-06-22T11:24:26.134 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/114 2023-06-22T11:24:26.134 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:24:26.140 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:24:26.186 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:24:26.186 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/115) 2023-06-22T11:24:26.648 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:24:26.660 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:24:26.661 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:24:26.664 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:24:26.664 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:24:27.232 INFO:teuthology.orchestra.run.smithi040.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph 2023-06-22T11:24:27.243 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/115 2023-06-22T11:24:27.244 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/115 2023-06-22T11:24:27.244 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:24:27.250 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:24:27.395 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:24:27.396 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/116) 2023-06-22T11:24:28.066 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:24:28.078 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:24:28.079 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:24:28.082 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:24:28.083 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:24:28.643 INFO:teuthology.orchestra.run.smithi040.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph 2023-06-22T11:24:28.653 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/116 2023-06-22T11:24:28.653 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/116 2023-06-22T11:24:28.654 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:24:28.659 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:24:28.818 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:24:28.819 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/117) 2023-06-22T11:24:29.466 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:24:29.478 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:24:29.480 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:24:29.482 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:24:29.482 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:24:35.939 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:24:35.944 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:24:45.038 INFO:teuthology.orchestra.run.smithi040.stdout:generic/117 16s 2023-06-22T11:24:45.051 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/117 2023-06-22T11:24:45.051 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:24:45.057 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:24:45.087 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:24:45.088 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/118) 2023-06-22T11:24:45.591 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:24:45.603 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:24:45.604 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:24:45.607 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:24:45.607 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:24:46.614 INFO:teuthology.orchestra.run.smithi040.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph 2023-06-22T11:24:46.624 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/118 2023-06-22T11:24:46.624 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/118 2023-06-22T11:24:46.624 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:24:46.630 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:24:46.803 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:24:46.804 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/119) 2023-06-22T11:24:47.535 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:24:47.548 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:24:47.549 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:24:47.551 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:24:47.551 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:24:48.103 INFO:teuthology.orchestra.run.smithi040.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph 2023-06-22T11:24:48.113 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/119 2023-06-22T11:24:48.113 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/119 2023-06-22T11:24:48.113 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:24:48.118 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:24:48.259 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:24:48.260 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/120) 2023-06-22T11:24:48.917 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:24:48.929 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:24:48.930 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:24:48.933 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:24:48.933 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:24:49.446 INFO:teuthology.orchestra.run.smithi040.stdout:generic/120 [not run] atime not maintained by ceph 2023-06-22T11:24:49.455 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/120 2023-06-22T11:24:49.456 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/120 2023-06-22T11:24:49.456 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:24:49.462 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:24:49.498 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:24:49.499 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/121) 2023-06-22T11:24:49.952 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:24:49.965 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:24:49.965 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:24:49.968 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:24:49.969 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:24:50.533 INFO:teuthology.orchestra.run.smithi040.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph 2023-06-22T11:24:50.544 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/121 2023-06-22T11:24:50.544 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/121 2023-06-22T11:24:50.544 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:24:50.549 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:24:50.657 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:24:50.658 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/122) 2023-06-22T11:24:51.351 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:24:51.364 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:24:51.365 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:24:51.367 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:24:51.367 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:24:51.938 INFO:teuthology.orchestra.run.smithi040.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph 2023-06-22T11:24:51.948 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/122 2023-06-22T11:24:51.949 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/122 2023-06-22T11:24:51.949 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:24:51.954 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:24:52.086 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:24:52.087 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/123) 2023-06-22T11:24:52.757 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:24:52.770 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:24:52.771 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:24:52.773 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:24:52.774 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:24:53.766 INFO:teuthology.orchestra.run.smithi040.stdout:generic/123 1s 2023-06-22T11:24:53.779 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/123 2023-06-22T11:24:53.779 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:24:53.785 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:24:53.910 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:24:53.911 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/124) 2023-06-22T11:24:54.601 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:24:54.614 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:24:54.615 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:24:54.617 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:24:54.617 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:24:58.693 INFO:teuthology.orchestra.run.smithi040.stdout:generic/124 4s 2023-06-22T11:24:58.740 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/124 2023-06-22T11:24:58.740 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:24:58.753 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:24:58.930 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:24:58.931 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/125) 2023-06-22T11:24:59.768 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:24:59.780 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:24:59.782 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:24:59.784 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:24:59.784 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:25:06.276 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:25:06.282 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:25:36.403 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:25:36.409 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:26:01.634 INFO:teuthology.orchestra.run.smithi040.stdout:generic/125 61s 2023-06-22T11:26:01.647 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/125 2023-06-22T11:26:01.647 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:26:01.654 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:26:01.765 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:26:01.766 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/126) 2023-06-22T11:26:02.434 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:26:02.446 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:26:02.447 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:26:02.450 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:26:02.450 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:26:03.256 INFO:teuthology.orchestra.run.smithi040.stdout:generic/126 1s 2023-06-22T11:26:03.268 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/126 2023-06-22T11:26:03.269 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:26:03.274 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:26:03.445 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:26:03.446 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/127) 2023-06-22T11:26:04.117 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:26:04.129 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:26:04.130 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:26:04.133 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:26:04.133 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:26:06.515 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:26:06.520 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:26:36.654 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:26:36.659 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:27:06.781 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:27:06.785 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:27:36.898 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:27:36.903 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:28:07.018 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:28:07.023 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:28:37.134 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:28:37.139 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:29:07.251 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:29:07.256 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:29:37.353 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:29:37.359 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:30:08.594 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:30:08.599 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:30:38.732 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:30:38.738 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:31:08.873 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:31:08.878 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:31:38.986 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:31:38.991 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:32:09.102 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:32:09.108 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:32:39.216 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:32:39.222 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:33:09.329 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:33:09.334 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:33:39.437 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:33:39.441 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:34:09.542 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:34:09.548 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:34:39.963 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:34:39.969 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:35:10.085 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:35:10.091 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:35:40.202 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:35:40.208 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:35:44.713 INFO:teuthology.orchestra.run.smithi040.stdout:generic/127 580s 2023-06-22T11:35:44.725 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/127 2023-06-22T11:35:44.726 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:35:44.732 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:35:44.890 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:35:44.891 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/128) 2023-06-22T11:35:45.622 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:35:45.634 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:35:45.635 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:35:45.637 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:35:45.638 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:35:47.176 INFO:teuthology.orchestra.run.smithi040.stdout:generic/128 2s 2023-06-22T11:35:47.188 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/128 2023-06-22T11:35:47.188 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:35:47.194 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:35:47.215 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:35:47.215 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/129) 2023-06-22T11:35:47.676 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:35:47.688 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:35:47.689 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:35:47.691 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:35:47.691 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:36:10.321 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:36:10.336 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:36:41.776 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:36:41.793 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:37:11.967 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:37:11.990 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:37:43.039 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:37:43.048 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:38:13.236 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:38:13.241 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:38:45.976 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:38:45.982 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:38:46.224 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-06-22T11:38:46.220+0000 7f3aaaff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 269452) UID: 0 2023-06-22T11:38:46.224 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-06-22T11:38:46.220+0000 7f1c345f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 269452) UID: 0 2023-06-22T11:38:46.231 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-06-22T11:38:46.219+0000 7f7e30ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 269452) UID: 0 2023-06-22T11:38:46.232 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-06-22T11:38:46.230+0000 7fe9b49f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 269452) UID: 0 2023-06-22T11:42:42.473 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:42:42.478 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:42:42.745 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T11:42:42.743+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119514) UID: 0 2023-06-22T11:42:42.746 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T11:42:42.743+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119514) UID: 0 2023-06-22T11:42:42.746 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T11:42:42.743+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119514) UID: 0 2023-06-22T11:42:42.746 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T11:42:42.744+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119514) UID: 0 2023-06-22T11:51:10.187 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:51:10.203 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:51:10.380 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-06-22T11:51:10.378+0000 7f7e30ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 269622) UID: 0 2023-06-22T11:51:10.387 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-06-22T11:51:10.378+0000 7fe9b49f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 269622) UID: 0 2023-06-22T11:51:10.387 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-06-22T11:51:10.378+0000 7f3aaaff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 269622) UID: 0 2023-06-22T11:51:10.403 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-06-22T11:51:10.396+0000 7f1c345f9700 -1 Fail to open '/proc/269622/cmdline' error = (2) No such file or directory 2023-06-22T11:51:10.404 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-06-22T11:51:10.396+0000 7f1c345f9700 -1 received signal: Hangup from (PID: 269622) UID: 0 2023-06-22T11:51:10.461 INFO:tasks.ceph.mds.d.smithi045.stderr:2023-06-22T11:51:10.459+0000 7ff7841f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 119613) UID: 0 2023-06-22T11:51:10.462 INFO:tasks.ceph.mds.b.smithi045.stderr:2023-06-22T11:51:10.459+0000 7f23f61f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 119613) UID: 0 2023-06-22T11:54:50.454 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T11:54:50.449+0000 7f79a43f9700 -1 received signal: Hangup from (PID: 119649) UID: 0 2023-06-22T11:54:50.456 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T11:54:50.450+0000 7f85b7df9700 -1 received signal: Hangup from (PID: 119649) UID: 0 2023-06-22T11:54:50.459 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T11:54:50.449+0000 7fc2fe3f9700 -1 received signal: Hangup from (PID: 119649) UID: 0 2023-06-22T11:54:50.473 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T11:54:50.449+0000 7f81021f9700 -1 received signal: Hangup from (PID: 119649) UID: 0 2023-06-22T11:57:07.748 INFO:teuthology.orchestra.run.smithi040.stdout:generic/129 1279s 2023-06-22T11:57:07.805 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/129 2023-06-22T11:57:07.806 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:57:07.811 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:57:07.833 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:57:07.833 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/130) 2023-06-22T11:57:08.777 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:57:08.789 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:57:08.790 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:57:08.793 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:57:08.793 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:57:24.754 INFO:teuthology.orchestra.run.smithi040.stdout:generic/130 15s 2023-06-22T11:57:24.858 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/130 2023-06-22T11:57:24.858 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:57:24.874 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:57:24.908 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:57:24.909 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/131) 2023-06-22T11:57:25.383 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:57:25.396 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:57:25.397 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:57:25.399 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:57:25.400 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:57:27.518 INFO:teuthology.orchestra.run.smithi040.stdout:generic/131 2s 2023-06-22T11:57:27.538 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/131 2023-06-22T11:57:27.539 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:57:27.549 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:57:27.744 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:57:27.745 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/132) 2023-06-22T11:57:28.743 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:57:28.761 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:57:28.763 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:57:28.768 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:57:28.768 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:57:44.383 INFO:teuthology.orchestra.run.smithi040.stdout:generic/132 15s 2023-06-22T11:57:44.397 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/132 2023-06-22T11:57:44.397 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T11:57:44.403 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:57:44.423 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T11:57:44.424 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/133) 2023-06-22T11:57:44.933 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T11:57:44.945 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T11:57:44.946 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T11:57:44.949 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T11:57:44.950 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T11:59:12.113 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:59:12.118 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T11:59:12.237 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T11:59:12.235+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119797) UID: 0 2023-06-22T11:59:12.237 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T11:59:12.235+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119797) UID: 0 2023-06-22T11:59:12.238 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T11:59:12.235+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119797) UID: 0 2023-06-22T11:59:12.238 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T11:59:12.235+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119797) UID: 0 2023-06-22T12:02:01.790 INFO:teuthology.orchestra.run.smithi040.stdout:generic/133 256s 2023-06-22T12:02:01.803 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/133 2023-06-22T12:02:01.803 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:02:01.809 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:01.936 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:02:01.937 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/134) 2023-06-22T12:02:02.710 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:02:02.729 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:02:02.730 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:02:02.734 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:02:02.734 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:03.352 INFO:teuthology.orchestra.run.smithi040.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph 2023-06-22T12:02:03.362 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/134 2023-06-22T12:02:03.362 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/134 2023-06-22T12:02:03.362 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:02:03.368 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:03.497 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:02:03.498 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/135) 2023-06-22T12:02:04.209 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:02:04.221 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:02:04.222 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:02:04.225 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:02:04.225 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:05.546 INFO:teuthology.orchestra.run.smithi040.stdout:generic/135 1s 2023-06-22T12:02:05.559 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/135 2023-06-22T12:02:05.559 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:02:05.566 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:05.586 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:02:05.587 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/136) 2023-06-22T12:02:06.037 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:02:06.050 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:02:06.050 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:02:06.053 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:02:06.054 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:06.628 INFO:teuthology.orchestra.run.smithi040.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph 2023-06-22T12:02:06.638 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/136 2023-06-22T12:02:06.639 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/136 2023-06-22T12:02:06.639 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:02:06.644 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:06.814 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:02:06.815 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/137) 2023-06-22T12:02:07.462 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:02:07.474 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:02:07.475 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:02:07.478 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:02:07.478 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:08.037 INFO:teuthology.orchestra.run.smithi040.stdout:generic/137 [not run] Reflink not supported by test filesystem type: ceph 2023-06-22T12:02:08.046 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/137 2023-06-22T12:02:08.047 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/137 2023-06-22T12:02:08.047 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:02:08.052 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:08.205 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:02:08.206 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/138) 2023-06-22T12:02:08.888 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:02:08.900 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:02:08.901 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:02:08.903 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:02:08.904 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:09.461 INFO:teuthology.orchestra.run.smithi040.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph 2023-06-22T12:02:09.471 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/138 2023-06-22T12:02:09.471 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/138 2023-06-22T12:02:09.472 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:02:09.477 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:09.635 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:02:09.636 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/139) 2023-06-22T12:02:10.286 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:02:10.299 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:02:10.300 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:02:10.303 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:02:10.303 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:10.866 INFO:teuthology.orchestra.run.smithi040.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph 2023-06-22T12:02:10.876 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/139 2023-06-22T12:02:10.876 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/139 2023-06-22T12:02:10.876 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:02:10.882 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:11.024 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:02:11.025 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/140) 2023-06-22T12:02:11.701 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:02:11.713 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:02:11.714 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:02:11.717 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:02:11.717 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:12.282 INFO:teuthology.orchestra.run.smithi040.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph 2023-06-22T12:02:12.292 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/140 2023-06-22T12:02:12.293 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/140 2023-06-22T12:02:12.293 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:02:12.298 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:12.450 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:02:12.451 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/141) 2023-06-22T12:02:13.122 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:02:13.135 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:02:13.136 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:02:13.138 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:02:13.138 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:13.919 INFO:teuthology.orchestra.run.smithi040.stdout:generic/141 0s 2023-06-22T12:02:13.932 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/141 2023-06-22T12:02:13.932 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:02:13.938 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:13.959 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:02:13.960 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/142) 2023-06-22T12:02:14.416 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:02:14.427 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:02:14.428 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:02:14.430 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:02:14.431 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:14.980 INFO:teuthology.orchestra.run.smithi040.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph 2023-06-22T12:02:14.990 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/142 2023-06-22T12:02:14.990 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/142 2023-06-22T12:02:14.990 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:02:14.996 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:15.150 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:02:15.151 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/143) 2023-06-22T12:02:15.832 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:02:15.844 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:02:15.845 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:02:15.848 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:02:15.848 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:16.412 INFO:teuthology.orchestra.run.smithi040.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph 2023-06-22T12:02:16.422 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/143 2023-06-22T12:02:16.423 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/143 2023-06-22T12:02:16.423 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:02:16.428 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:16.569 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:02:16.570 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/144) 2023-06-22T12:02:17.251 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:02:17.264 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:02:17.265 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:02:17.267 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:02:17.267 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:17.834 INFO:teuthology.orchestra.run.smithi040.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph 2023-06-22T12:02:17.844 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/144 2023-06-22T12:02:17.844 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/144 2023-06-22T12:02:17.844 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:02:17.850 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:17.986 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:02:17.987 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/145) 2023-06-22T12:02:18.688 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:02:18.701 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:02:18.702 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:02:18.704 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:02:18.704 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:19.276 INFO:teuthology.orchestra.run.smithi040.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph 2023-06-22T12:02:19.286 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/145 2023-06-22T12:02:19.287 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/145 2023-06-22T12:02:19.287 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:02:19.293 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:19.426 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:02:19.427 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/146) 2023-06-22T12:02:20.140 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:02:20.153 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:02:20.154 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:02:20.156 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:02:20.157 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:20.733 INFO:teuthology.orchestra.run.smithi040.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph 2023-06-22T12:02:20.743 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/146 2023-06-22T12:02:20.744 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/146 2023-06-22T12:02:20.744 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:02:20.749 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:20.863 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:02:20.864 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/147) 2023-06-22T12:02:21.572 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:02:21.584 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:02:21.585 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:02:21.588 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:02:21.589 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:21.869 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:02:21.873 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:02:22.148 INFO:teuthology.orchestra.run.smithi040.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph 2023-06-22T12:02:22.158 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/147 2023-06-22T12:02:22.158 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/147 2023-06-22T12:02:22.159 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:02:22.165 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:22.312 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:02:22.313 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/148) 2023-06-22T12:02:22.988 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:02:23.001 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:02:23.001 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:02:23.004 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:02:23.004 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:23.568 INFO:teuthology.orchestra.run.smithi040.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph 2023-06-22T12:02:23.577 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/148 2023-06-22T12:02:23.578 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/148 2023-06-22T12:02:23.578 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:02:23.583 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:23.732 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:02:23.734 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/149) 2023-06-22T12:02:24.402 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:02:24.421 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:02:24.421 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:02:24.422 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:02:24.422 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:24.977 INFO:teuthology.orchestra.run.smithi040.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph 2023-06-22T12:02:24.989 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/149 2023-06-22T12:02:24.990 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/149 2023-06-22T12:02:24.990 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:02:24.993 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:25.177 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:02:25.178 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/150) 2023-06-22T12:02:25.803 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:02:25.816 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:02:25.817 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:02:25.819 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:02:25.820 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:26.391 INFO:teuthology.orchestra.run.smithi040.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph 2023-06-22T12:02:26.401 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/150 2023-06-22T12:02:26.401 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/150 2023-06-22T12:02:26.401 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:02:26.407 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:26.552 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:02:26.553 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/151) 2023-06-22T12:02:27.211 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:02:27.223 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:02:27.225 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:02:27.227 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:02:27.228 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:27.788 INFO:teuthology.orchestra.run.smithi040.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph 2023-06-22T12:02:27.796 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/151 2023-06-22T12:02:27.797 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/151 2023-06-22T12:02:27.797 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:02:27.802 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:27.954 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:02:27.955 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/152) 2023-06-22T12:02:28.629 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:02:28.638 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:02:28.639 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:02:28.642 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:02:28.642 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:29.200 INFO:teuthology.orchestra.run.smithi040.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph 2023-06-22T12:02:29.210 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/152 2023-06-22T12:02:29.211 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/152 2023-06-22T12:02:29.211 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:02:29.217 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:29.346 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:02:29.346 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/153) 2023-06-22T12:02:30.049 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:02:30.062 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:02:30.063 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:02:30.066 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:02:30.066 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:30.632 INFO:teuthology.orchestra.run.smithi040.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph 2023-06-22T12:02:30.640 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/153 2023-06-22T12:02:30.640 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/153 2023-06-22T12:02:30.640 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:02:30.651 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:30.809 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:02:30.810 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/154) 2023-06-22T12:02:31.466 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:02:31.478 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:02:31.479 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:02:31.481 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:02:31.482 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:32.052 INFO:teuthology.orchestra.run.smithi040.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph 2023-06-22T12:02:32.062 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/154 2023-06-22T12:02:32.062 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/154 2023-06-22T12:02:32.062 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:02:32.068 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:32.227 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:02:32.228 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/155) 2023-06-22T12:02:32.905 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:02:32.917 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:02:32.918 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:02:32.920 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:02:32.921 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:33.481 INFO:teuthology.orchestra.run.smithi040.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph 2023-06-22T12:02:33.491 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/155 2023-06-22T12:02:33.491 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/155 2023-06-22T12:02:33.492 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:02:33.497 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:33.643 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:02:33.643 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/156) 2023-06-22T12:02:34.307 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:02:34.319 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:02:34.320 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:02:34.323 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:02:34.323 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:34.884 INFO:teuthology.orchestra.run.smithi040.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph 2023-06-22T12:02:34.895 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/156 2023-06-22T12:02:34.896 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/156 2023-06-22T12:02:34.896 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:02:34.901 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:35.032 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:02:35.033 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/157) 2023-06-22T12:02:35.728 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:02:35.742 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:02:35.742 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:02:35.744 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:02:35.745 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:36.316 INFO:teuthology.orchestra.run.smithi040.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph 2023-06-22T12:02:36.326 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/157 2023-06-22T12:02:36.326 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/157 2023-06-22T12:02:36.326 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:02:36.332 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:36.469 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:02:36.470 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/158) 2023-06-22T12:02:37.147 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:02:37.160 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:02:37.161 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:02:37.163 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:02:37.163 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:37.734 INFO:teuthology.orchestra.run.smithi040.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph 2023-06-22T12:02:37.745 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/158 2023-06-22T12:02:37.745 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/158 2023-06-22T12:02:37.746 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:02:37.752 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:37.869 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:02:37.870 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/159) 2023-06-22T12:02:38.572 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:02:38.584 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:02:38.585 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:02:38.588 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:02:38.588 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:39.142 INFO:teuthology.orchestra.run.smithi040.stdout:generic/159 [not run] file system doesn't support chattr +i 2023-06-22T12:02:39.152 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/159 2023-06-22T12:02:39.152 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/159 2023-06-22T12:02:39.152 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:02:39.158 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:39.209 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:02:39.209 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/160) 2023-06-22T12:02:39.659 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:02:39.671 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:02:39.672 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:02:39.675 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:02:39.675 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:40.204 INFO:teuthology.orchestra.run.smithi040.stdout:generic/160 [not run] file system doesn't support chattr +i 2023-06-22T12:02:40.211 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/160 2023-06-22T12:02:40.213 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/160 2023-06-22T12:02:40.213 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:02:40.219 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:40.267 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:02:40.268 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/161) 2023-06-22T12:02:40.719 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:02:40.731 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:02:40.732 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:02:40.735 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:02:40.735 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:41.637 INFO:teuthology.orchestra.run.smithi040.stdout:generic/161 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:02:41.668 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/161 2023-06-22T12:02:41.668 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/161 2023-06-22T12:02:41.669 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:02:41.676 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:41.868 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:02:41.869 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/162) 2023-06-22T12:02:42.341 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:02:42.353 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:02:42.354 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:02:42.357 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:02:42.357 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:43.080 INFO:teuthology.orchestra.run.smithi040.stdout:generic/162 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-06-22T12:02:43.207 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/162 2023-06-22T12:02:43.207 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/162 2023-06-22T12:02:43.207 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:02:43.227 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:43.502 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:02:43.503 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/163) 2023-06-22T12:02:43.971 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:02:43.983 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:02:43.984 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:02:43.987 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:02:43.987 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:44.707 INFO:teuthology.orchestra.run.smithi040.stdout:generic/163 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-06-22T12:02:44.810 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/163 2023-06-22T12:02:44.812 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/163 2023-06-22T12:02:44.813 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:02:44.818 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:45.141 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:02:45.142 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/164) 2023-06-22T12:02:45.598 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:02:45.611 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:02:45.613 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:02:45.614 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:02:45.615 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:46.538 INFO:teuthology.orchestra.run.smithi040.stdout:generic/164 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:02:46.575 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/164 2023-06-22T12:02:46.575 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/164 2023-06-22T12:02:46.576 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:02:46.599 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:46.782 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:02:46.782 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/165) 2023-06-22T12:02:47.244 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:02:47.252 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:02:47.253 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:02:47.256 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:02:47.256 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:48.115 INFO:teuthology.orchestra.run.smithi040.stdout:generic/165 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:02:48.159 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/165 2023-06-22T12:02:48.159 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/165 2023-06-22T12:02:48.159 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:02:48.172 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:48.350 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:02:48.350 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/166) 2023-06-22T12:02:48.839 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:02:48.851 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:02:48.852 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:02:48.855 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:02:48.855 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:49.716 INFO:teuthology.orchestra.run.smithi040.stdout:generic/166 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:02:49.747 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/166 2023-06-22T12:02:49.747 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/166 2023-06-22T12:02:49.747 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:02:49.778 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:49.945 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:02:49.947 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/167) 2023-06-22T12:02:50.418 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:02:50.430 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:02:50.431 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:02:50.434 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:02:50.434 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:51.323 INFO:teuthology.orchestra.run.smithi040.stdout:generic/167 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:02:51.386 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/167 2023-06-22T12:02:51.387 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/167 2023-06-22T12:02:51.387 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:02:51.395 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:51.574 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:02:51.575 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/168) 2023-06-22T12:02:51.981 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:02:51.987 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:02:52.042 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:02:52.054 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:02:52.055 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:02:52.058 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:02:52.058 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:52.983 INFO:teuthology.orchestra.run.smithi040.stdout:generic/168 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:02:53.000 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/168 2023-06-22T12:02:53.001 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/168 2023-06-22T12:02:53.001 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:02:53.016 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:53.230 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:02:53.231 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/169) 2023-06-22T12:02:53.718 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:02:53.730 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:02:53.731 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:02:53.733 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:02:53.734 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:54.740 INFO:teuthology.orchestra.run.smithi040.stdout:generic/169 1s 2023-06-22T12:02:54.753 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/169 2023-06-22T12:02:54.753 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:02:54.760 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:54.779 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:02:54.780 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/170) 2023-06-22T12:02:55.237 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:02:55.249 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:02:55.251 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:02:55.253 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:02:55.253 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:56.074 INFO:teuthology.orchestra.run.smithi040.stdout:generic/170 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:02:56.100 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/170 2023-06-22T12:02:56.100 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/170 2023-06-22T12:02:56.101 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:02:56.118 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:56.323 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:02:56.323 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/171) 2023-06-22T12:02:56.811 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:02:56.823 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:02:56.824 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:02:56.827 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:02:56.827 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:57.738 INFO:teuthology.orchestra.run.smithi040.stdout:generic/171 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:02:57.767 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/171 2023-06-22T12:02:57.768 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/171 2023-06-22T12:02:57.768 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:02:57.783 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:57.969 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:02:57.970 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/172) 2023-06-22T12:02:58.436 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:02:58.448 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:02:58.449 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:02:58.452 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:02:58.452 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:59.355 INFO:teuthology.orchestra.run.smithi040.stdout:generic/172 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:02:59.382 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/172 2023-06-22T12:02:59.382 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/172 2023-06-22T12:02:59.382 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:02:59.395 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:02:59.581 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:02:59.582 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/173) 2023-06-22T12:03:00.036 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:03:00.049 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:03:00.049 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:03:00.052 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:03:00.052 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:00.924 INFO:teuthology.orchestra.run.smithi040.stdout:generic/173 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:03:00.983 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/173 2023-06-22T12:03:00.983 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/173 2023-06-22T12:03:00.983 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:03:00.991 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:01.142 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:03:01.143 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/174) 2023-06-22T12:03:01.625 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:03:01.638 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:03:01.639 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:03:01.642 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:03:01.643 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:02.494 INFO:teuthology.orchestra.run.smithi040.stdout:generic/174 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:03:02.565 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/174 2023-06-22T12:03:02.565 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/174 2023-06-22T12:03:02.566 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:03:02.591 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:02.757 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:03:02.758 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/175) 2023-06-22T12:03:03.224 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:03:03.236 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:03:03.237 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:03:03.240 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:03:03.240 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:04.128 INFO:teuthology.orchestra.run.smithi040.stdout:generic/175 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:03:04.154 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/175 2023-06-22T12:03:04.154 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/175 2023-06-22T12:03:04.154 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:03:04.165 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:04.371 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:03:04.372 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/176) 2023-06-22T12:03:04.823 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:03:04.835 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:03:04.836 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:03:04.839 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:03:04.839 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:05.754 INFO:teuthology.orchestra.run.smithi040.stdout:generic/176 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:03:05.812 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/176 2023-06-22T12:03:05.812 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/176 2023-06-22T12:03:05.813 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:03:05.842 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:05.980 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:03:05.980 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/177) 2023-06-22T12:03:06.436 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:03:06.448 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:03:06.449 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:03:06.451 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:03:06.452 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:07.217 INFO:teuthology.orchestra.run.smithi040.stdout:generic/177 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-22T12:03:07.227 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/177 2023-06-22T12:03:07.227 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/177 2023-06-22T12:03:07.227 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:03:07.233 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:07.368 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:03:07.369 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/178) 2023-06-22T12:03:08.055 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:03:08.067 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:03:08.068 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:03:08.071 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:03:08.071 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:08.636 INFO:teuthology.orchestra.run.smithi040.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph 2023-06-22T12:03:08.646 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/178 2023-06-22T12:03:08.646 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/178 2023-06-22T12:03:08.646 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:03:08.652 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:08.808 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:03:08.809 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/179) 2023-06-22T12:03:09.467 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:03:09.479 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:03:09.480 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:03:09.483 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:03:09.483 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:10.068 INFO:teuthology.orchestra.run.smithi040.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph 2023-06-22T12:03:10.078 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/179 2023-06-22T12:03:10.078 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/179 2023-06-22T12:03:10.078 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:03:10.084 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:10.219 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:03:10.219 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/180) 2023-06-22T12:03:10.897 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:03:10.909 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:03:10.910 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:03:10.913 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:03:10.914 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:11.481 INFO:teuthology.orchestra.run.smithi040.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph 2023-06-22T12:03:11.491 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/180 2023-06-22T12:03:11.492 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/180 2023-06-22T12:03:11.492 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:03:11.502 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:11.649 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:03:11.650 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/181) 2023-06-22T12:03:12.323 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:03:12.336 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:03:12.337 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:03:12.339 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:03:12.339 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:12.894 INFO:teuthology.orchestra.run.smithi040.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph 2023-06-22T12:03:12.904 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/181 2023-06-22T12:03:12.904 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/181 2023-06-22T12:03:12.905 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:03:12.910 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:13.044 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:03:13.045 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/182) 2023-06-22T12:03:13.715 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:03:13.727 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:03:13.728 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:03:13.731 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:03:13.732 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:14.295 INFO:teuthology.orchestra.run.smithi040.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph 2023-06-22T12:03:14.305 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/182 2023-06-22T12:03:14.306 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/182 2023-06-22T12:03:14.306 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:03:14.311 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:14.446 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:03:14.447 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/183) 2023-06-22T12:03:15.131 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:03:15.143 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:03:15.145 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:03:15.147 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:03:15.147 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:16.028 INFO:teuthology.orchestra.run.smithi040.stdout:generic/183 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:03:16.074 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/183 2023-06-22T12:03:16.074 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/183 2023-06-22T12:03:16.074 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:03:16.082 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:16.259 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:03:16.260 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/184) 2023-06-22T12:03:16.719 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:03:16.731 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:03:16.734 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:03:16.735 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:03:16.735 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:17.311 INFO:teuthology.orchestra.run.smithi040.stdout:generic/184 1s 2023-06-22T12:03:17.324 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/184 2023-06-22T12:03:17.324 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:03:17.330 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:17.369 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:03:17.369 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/185) 2023-06-22T12:03:17.828 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:03:17.840 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:03:17.841 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:03:17.844 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:03:17.844 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:18.761 INFO:teuthology.orchestra.run.smithi040.stdout:generic/185 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:03:18.795 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/185 2023-06-22T12:03:18.795 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/185 2023-06-22T12:03:18.796 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:03:18.833 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:18.977 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:03:18.978 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/186) 2023-06-22T12:03:19.431 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:03:19.443 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:03:19.444 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:03:19.447 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:03:19.447 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:20.302 INFO:teuthology.orchestra.run.smithi040.stdout:generic/186 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:03:20.351 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/186 2023-06-22T12:03:20.352 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/186 2023-06-22T12:03:20.352 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:03:20.370 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:20.594 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:03:20.595 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/187) 2023-06-22T12:03:21.045 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:03:21.057 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:03:21.058 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:03:21.061 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:03:21.061 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:21.918 INFO:teuthology.orchestra.run.smithi040.stdout:generic/187 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:03:21.935 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/187 2023-06-22T12:03:21.936 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/187 2023-06-22T12:03:21.936 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:03:21.947 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:22.161 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:03:22.162 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/188) 2023-06-22T12:03:22.362 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:03:22.367 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:03:22.656 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:03:22.668 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:03:22.669 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:03:22.672 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:03:22.672 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:23.546 INFO:teuthology.orchestra.run.smithi040.stdout:generic/188 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:03:23.585 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/188 2023-06-22T12:03:23.585 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/188 2023-06-22T12:03:23.596 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:03:23.611 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:23.807 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:03:23.808 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/189) 2023-06-22T12:03:24.272 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:03:24.285 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:03:24.286 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:03:24.288 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:03:24.289 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:25.141 INFO:teuthology.orchestra.run.smithi040.stdout:generic/189 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:03:25.186 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/189 2023-06-22T12:03:25.187 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/189 2023-06-22T12:03:25.187 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:03:25.203 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:25.417 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:03:25.418 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/190) 2023-06-22T12:03:25.877 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:03:25.890 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:03:25.891 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:03:25.893 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:03:25.894 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:26.730 INFO:teuthology.orchestra.run.smithi040.stdout:generic/190 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:03:26.768 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/190 2023-06-22T12:03:26.768 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/190 2023-06-22T12:03:26.768 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:03:26.788 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:27.001 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:03:27.002 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/191) 2023-06-22T12:03:27.463 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:03:27.475 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:03:27.476 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:03:27.478 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:03:27.479 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:28.335 INFO:teuthology.orchestra.run.smithi040.stdout:generic/191 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:03:28.391 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/191 2023-06-22T12:03:28.391 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/191 2023-06-22T12:03:28.391 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:03:28.408 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:28.609 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:03:28.610 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/192) 2023-06-22T12:03:29.069 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:03:29.080 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:03:29.081 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:03:29.084 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:03:29.084 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:29.597 INFO:teuthology.orchestra.run.smithi040.stdout:generic/192 [not run] atime not maintained by ceph 2023-06-22T12:03:29.607 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/192 2023-06-22T12:03:29.608 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/192 2023-06-22T12:03:29.608 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:03:29.614 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:29.660 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:03:29.661 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/193) 2023-06-22T12:03:30.117 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:03:30.130 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:03:30.131 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:03:30.133 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:03:30.134 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:31.864 INFO:teuthology.orchestra.run.smithi040.stdout:generic/193 1s 2023-06-22T12:03:31.876 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/193 2023-06-22T12:03:31.877 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:03:31.882 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:32.042 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:03:32.043 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/194) 2023-06-22T12:03:32.730 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:03:32.742 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:03:32.743 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:03:32.746 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:03:32.746 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:33.622 INFO:teuthology.orchestra.run.smithi040.stdout:generic/194 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:03:33.672 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/194 2023-06-22T12:03:33.672 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/194 2023-06-22T12:03:33.672 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:03:33.690 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:33.841 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:03:33.841 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/195) 2023-06-22T12:03:34.312 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:03:34.324 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:03:34.325 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:03:34.328 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:03:34.328 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:35.185 INFO:teuthology.orchestra.run.smithi040.stdout:generic/195 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:03:35.218 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/195 2023-06-22T12:03:35.218 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/195 2023-06-22T12:03:35.218 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:03:35.236 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:35.455 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:03:35.456 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/196) 2023-06-22T12:03:35.913 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:03:35.925 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:03:35.926 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:03:35.929 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:03:35.929 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:36.849 INFO:teuthology.orchestra.run.smithi040.stdout:generic/196 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:03:36.882 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/196 2023-06-22T12:03:36.883 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/196 2023-06-22T12:03:36.883 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:03:36.906 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:37.083 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:03:37.084 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/197) 2023-06-22T12:03:37.541 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:03:37.553 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:03:37.554 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:03:37.557 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:03:37.558 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:38.439 INFO:teuthology.orchestra.run.smithi040.stdout:generic/197 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:03:38.493 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/197 2023-06-22T12:03:38.494 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/197 2023-06-22T12:03:38.494 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:03:38.502 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:38.665 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:03:38.666 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/198) 2023-06-22T12:03:39.137 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:03:39.149 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:03:39.150 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:03:39.153 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:03:39.153 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:40.419 INFO:teuthology.orchestra.run.smithi040.stdout:generic/198 1s 2023-06-22T12:03:40.433 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/198 2023-06-22T12:03:40.433 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:03:40.439 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:40.644 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:03:40.645 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/199) 2023-06-22T12:03:41.355 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:03:41.368 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:03:41.369 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:03:41.373 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:03:41.373 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:42.206 INFO:teuthology.orchestra.run.smithi040.stdout:generic/199 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:03:42.240 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/199 2023-06-22T12:03:42.240 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/199 2023-06-22T12:03:42.240 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:03:42.281 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:42.467 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:03:42.468 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/200) 2023-06-22T12:03:42.944 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:03:42.958 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:03:42.958 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:03:42.960 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:03:42.961 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:43.805 INFO:teuthology.orchestra.run.smithi040.stdout:generic/200 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:03:43.853 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/200 2023-06-22T12:03:43.853 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/200 2023-06-22T12:03:43.853 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:03:43.871 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:44.072 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:03:44.073 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/201) 2023-06-22T12:03:44.539 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:03:44.551 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:03:44.553 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:03:44.555 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:03:44.555 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:45.409 INFO:teuthology.orchestra.run.smithi040.stdout:generic/201 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:03:45.452 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/201 2023-06-22T12:03:45.452 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/201 2023-06-22T12:03:45.452 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:03:45.466 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:45.632 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:03:45.633 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/202) 2023-06-22T12:03:46.135 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:03:46.148 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:03:46.148 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:03:46.151 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:03:46.151 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:47.015 INFO:teuthology.orchestra.run.smithi040.stdout:generic/202 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:03:47.064 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/202 2023-06-22T12:03:47.064 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/202 2023-06-22T12:03:47.065 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:03:47.091 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:47.282 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:03:47.283 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/203) 2023-06-22T12:03:47.738 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:03:47.750 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:03:47.751 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:03:47.753 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:03:47.754 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:48.632 INFO:teuthology.orchestra.run.smithi040.stdout:generic/203 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:03:48.675 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/203 2023-06-22T12:03:48.675 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/203 2023-06-22T12:03:48.675 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:03:48.699 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:48.896 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:03:48.897 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/204) 2023-06-22T12:03:49.357 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:03:49.370 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:03:49.371 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:03:49.374 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:03:49.374 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:50.757 INFO:teuthology.orchestra.run.smithi040.stdout:generic/204 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-22T12:03:50.768 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/204 2023-06-22T12:03:50.768 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/204 2023-06-22T12:03:50.768 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:03:50.775 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:50.812 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:03:50.813 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/205) 2023-06-22T12:03:51.268 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:03:51.280 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:03:51.281 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:03:51.284 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:03:51.285 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:52.139 INFO:teuthology.orchestra.run.smithi040.stdout:generic/205 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:03:52.181 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/205 2023-06-22T12:03:52.182 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/205 2023-06-22T12:03:52.182 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:03:52.212 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:52.384 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:03:52.385 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/206) 2023-06-22T12:03:52.465 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:03:52.470 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:03:52.853 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:03:52.865 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:03:52.866 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:03:52.869 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:03:52.869 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:53.724 INFO:teuthology.orchestra.run.smithi040.stdout:generic/206 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:03:53.772 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/206 2023-06-22T12:03:53.773 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/206 2023-06-22T12:03:53.773 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:03:53.786 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:03:53.959 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:03:53.959 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/207) 2023-06-22T12:03:54.445 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:03:54.457 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:03:54.458 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:03:54.460 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:03:54.461 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:04:03.482 INFO:teuthology.orchestra.run.smithi040.stdout:generic/207 9s 2023-06-22T12:04:03.495 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/207 2023-06-22T12:04:03.496 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:04:03.503 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:04:03.625 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:04:03.626 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/208) 2023-06-22T12:04:04.321 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:04:04.334 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:04:04.335 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:04:04.342 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:04:04.342 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:04:22.596 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:04:22.615 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:04:23.396 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-06-22T12:04:23.394+0000 7fe9b49f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 311141) UID: 0 2023-06-22T12:04:23.397 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-06-22T12:04:23.394+0000 7f7e30ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 311141) UID: 0 2023-06-22T12:04:23.398 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-06-22T12:04:23.394+0000 7f3aaaff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 311141) UID: 0 2023-06-22T12:04:23.398 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-06-22T12:04:23.394+0000 7f1c345f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 311141) UID: 0 2023-06-22T12:07:25.044 INFO:teuthology.orchestra.run.smithi040.stdout:generic/208 201s 2023-06-22T12:07:25.058 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/208 2023-06-22T12:07:25.058 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:07:25.063 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:07:25.196 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:07:25.197 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/209) 2023-06-22T12:07:25.976 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:07:25.988 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:07:25.989 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:07:25.992 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:07:25.992 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:07:55.819 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:07:55.824 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:07:55.919 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-06-22T12:07:55.918+0000 7fe9b49f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 311933) UID: 0 2023-06-22T12:07:55.921 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-06-22T12:07:55.918+0000 7f7e30ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 311933) UID: 0 2023-06-22T12:07:55.921 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-06-22T12:07:55.918+0000 7f3aaaff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 311933) UID: 0 2023-06-22T12:07:55.921 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-06-22T12:07:55.918+0000 7f1c345f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 311933) UID: 0 2023-06-22T12:08:02.501 INFO:teuthology.orchestra.run.smithi040.stdout:generic/209 36s 2023-06-22T12:08:02.515 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/209 2023-06-22T12:08:02.515 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:08:02.522 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:08:02.636 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:08:02.637 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/210) 2023-06-22T12:08:03.393 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:08:03.405 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:08:03.406 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:08:03.409 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:08:03.409 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:08:04.059 INFO:teuthology.orchestra.run.smithi040.stdout:generic/210 1s 2023-06-22T12:08:04.073 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/210 2023-06-22T12:08:04.073 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:08:04.080 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:08:04.204 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:08:04.204 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/211) 2023-06-22T12:08:04.975 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:08:04.987 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:08:04.988 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:08:04.991 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:08:04.991 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:08:06.242 INFO:teuthology.orchestra.run.smithi040.stdout:generic/211 1s 2023-06-22T12:08:06.256 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/211 2023-06-22T12:08:06.256 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:08:06.261 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:08:06.314 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:08:06.315 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/212) 2023-06-22T12:08:06.792 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:08:06.805 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:08:06.807 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:08:06.809 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:08:06.809 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:08:07.440 INFO:teuthology.orchestra.run.smithi040.stdout:generic/212 0s 2023-06-22T12:08:07.453 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/212 2023-06-22T12:08:07.454 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:08:07.459 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:08:07.499 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:08:07.500 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/213) 2023-06-22T12:08:07.965 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:08:07.977 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:08:07.978 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:08:07.981 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:08:07.981 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:08:08.518 INFO:teuthology.orchestra.run.smithi040.stdout:generic/213 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-22T12:08:08.527 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/213 2023-06-22T12:08:08.528 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/213 2023-06-22T12:08:08.528 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:08:08.535 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:08:08.568 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:08:08.569 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/214) 2023-06-22T12:08:09.037 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:08:09.049 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:08:09.050 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:08:09.053 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:08:09.053 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:08:09.593 INFO:teuthology.orchestra.run.smithi040.stdout:generic/214 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-22T12:08:09.603 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/214 2023-06-22T12:08:09.603 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/214 2023-06-22T12:08:09.604 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:08:09.609 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:08:09.646 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:08:09.647 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/215) 2023-06-22T12:08:10.108 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:08:10.121 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:08:10.122 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:08:10.124 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:08:10.124 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:08:12.773 INFO:teuthology.orchestra.run.smithi040.stdout:generic/215 2s 2023-06-22T12:08:12.789 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/215 2023-06-22T12:08:12.789 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:08:12.794 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:08:12.862 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:08:12.863 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/216) 2023-06-22T12:08:13.325 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:08:13.337 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:08:13.338 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:08:13.340 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:08:13.341 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:08:14.206 INFO:teuthology.orchestra.run.smithi040.stdout:generic/216 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:08:14.231 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/216 2023-06-22T12:08:14.231 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/216 2023-06-22T12:08:14.231 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:08:14.251 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:08:14.501 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:08:14.502 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/217) 2023-06-22T12:08:14.974 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:08:14.987 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:08:14.988 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:08:14.990 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:08:14.990 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:08:15.882 INFO:teuthology.orchestra.run.smithi040.stdout:generic/217 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:08:15.924 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/217 2023-06-22T12:08:15.924 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/217 2023-06-22T12:08:15.924 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:08:15.933 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:08:16.096 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:08:16.097 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/218) 2023-06-22T12:08:16.603 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:08:16.615 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:08:16.615 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:08:16.618 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:08:16.618 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:08:17.520 INFO:teuthology.orchestra.run.smithi040.stdout:generic/218 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:08:17.562 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/218 2023-06-22T12:08:17.562 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/218 2023-06-22T12:08:17.563 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:08:17.590 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:08:17.731 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:08:17.731 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/219) 2023-06-22T12:08:18.282 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:08:18.295 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:08:18.296 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:08:18.298 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:08:18.298 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:08:18.818 INFO:teuthology.orchestra.run.smithi040.stdout:generic/219 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-22T12:08:18.829 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/219 2023-06-22T12:08:18.830 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/219 2023-06-22T12:08:18.830 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:08:18.836 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:08:18.879 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:08:18.880 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/220) 2023-06-22T12:08:19.340 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:08:19.352 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:08:19.353 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:08:19.356 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:08:19.356 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:08:20.271 INFO:teuthology.orchestra.run.smithi040.stdout:generic/220 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:08:20.286 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/220 2023-06-22T12:08:20.289 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/220 2023-06-22T12:08:20.289 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:08:20.297 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:08:20.514 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:08:20.514 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/221) 2023-06-22T12:08:21.028 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:08:21.041 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:08:21.042 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:08:21.044 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:08:21.045 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:08:22.623 INFO:teuthology.orchestra.run.smithi040.stdout:generic/221 1s 2023-06-22T12:08:22.636 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/221 2023-06-22T12:08:22.636 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:08:22.644 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:08:22.685 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:08:22.685 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/222) 2023-06-22T12:08:23.147 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:08:23.159 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:08:23.160 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:08:23.163 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:08:23.163 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:08:24.030 INFO:teuthology.orchestra.run.smithi040.stdout:generic/222 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:08:24.076 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/222 2023-06-22T12:08:24.077 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/222 2023-06-22T12:08:24.077 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:08:24.082 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:08:24.221 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:08:24.221 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/223) 2023-06-22T12:08:24.761 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:08:24.773 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:08:24.774 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:08:24.777 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:08:24.777 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:08:25.301 INFO:teuthology.orchestra.run.smithi040.stdout:generic/223 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-22T12:08:25.310 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/223 2023-06-22T12:08:25.311 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/223 2023-06-22T12:08:25.311 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:08:25.317 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:08:25.359 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:08:25.360 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/224) 2023-06-22T12:08:25.816 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:08:25.829 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:08:25.830 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:08:25.833 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:08:25.833 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:08:26.329 INFO:teuthology.orchestra.run.smithi040.stdout:generic/224 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-22T12:08:26.339 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/224 2023-06-22T12:08:26.340 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/224 2023-06-22T12:08:26.340 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:08:26.345 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:08:26.381 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:08:26.381 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/225) 2023-06-22T12:08:26.843 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:08:26.855 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:08:26.856 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:08:26.859 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:08:26.859 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:08:27.447 INFO:teuthology.orchestra.run.smithi040.stdout:generic/225 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-22T12:08:27.457 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/225 2023-06-22T12:08:27.458 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/225 2023-06-22T12:08:27.458 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:08:27.463 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:08:27.590 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:08:27.591 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/226) 2023-06-22T12:08:28.352 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:08:28.362 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:08:28.363 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:08:28.365 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:08:28.366 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:08:28.919 INFO:teuthology.orchestra.run.smithi040.stdout:generic/226 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-22T12:08:28.929 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/226 2023-06-22T12:08:28.930 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/226 2023-06-22T12:08:28.930 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:08:28.935 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:08:28.982 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:08:28.983 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/227) 2023-06-22T12:08:29.446 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:08:29.458 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:08:29.459 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:08:29.462 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:08:29.462 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:08:30.302 INFO:teuthology.orchestra.run.smithi040.stdout:generic/227 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:08:30.336 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/227 2023-06-22T12:08:30.337 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/227 2023-06-22T12:08:30.337 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:08:30.342 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:08:30.574 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:08:30.575 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/228) 2023-06-22T12:08:31.124 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:08:31.137 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:08:31.137 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:08:31.140 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:08:31.140 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:08:32.361 INFO:teuthology.orchestra.run.smithi040.stdout:generic/228 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-22T12:08:32.372 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/228 2023-06-22T12:08:32.372 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/228 2023-06-22T12:08:32.372 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:08:32.381 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:08:32.417 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:08:32.418 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/229) 2023-06-22T12:08:32.888 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:08:32.900 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:08:32.901 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:08:32.904 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:08:32.904 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:08:33.753 INFO:teuthology.orchestra.run.smithi040.stdout:generic/229 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:08:33.791 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/229 2023-06-22T12:08:33.791 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/229 2023-06-22T12:08:33.791 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:08:33.802 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:08:34.041 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:08:34.041 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/230) 2023-06-22T12:08:34.537 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:08:34.550 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:08:34.551 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:08:34.554 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:08:34.554 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:08:35.064 INFO:teuthology.orchestra.run.smithi040.stdout:generic/230 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-22T12:08:35.075 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/230 2023-06-22T12:08:35.075 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/230 2023-06-22T12:08:35.075 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:08:35.080 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:08:35.119 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:08:35.120 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/231) 2023-06-22T12:08:35.579 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:08:35.591 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:08:35.592 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:08:35.595 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:08:35.595 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:08:36.119 INFO:teuthology.orchestra.run.smithi040.stdout:generic/231 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-22T12:08:36.130 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/231 2023-06-22T12:08:36.130 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/231 2023-06-22T12:08:36.130 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:08:36.135 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:08:36.170 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:08:36.171 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/232) 2023-06-22T12:08:36.630 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:08:36.643 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:08:36.643 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:08:36.646 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:08:36.646 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:08:37.161 INFO:teuthology.orchestra.run.smithi040.stdout:generic/232 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-22T12:08:37.171 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/232 2023-06-22T12:08:37.172 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/232 2023-06-22T12:08:37.172 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:08:37.177 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:08:37.217 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:08:37.217 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/233) 2023-06-22T12:08:37.712 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:08:37.724 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:08:37.726 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:08:37.728 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:08:37.729 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:08:38.229 INFO:teuthology.orchestra.run.smithi040.stdout:generic/233 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-22T12:08:38.239 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/233 2023-06-22T12:08:38.240 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/233 2023-06-22T12:08:38.240 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:08:38.245 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:08:38.279 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:08:38.280 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/234) 2023-06-22T12:08:38.738 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:08:38.751 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:08:38.752 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:08:38.755 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:08:38.755 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:08:39.261 INFO:teuthology.orchestra.run.smithi040.stdout:generic/234 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-22T12:08:39.271 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/234 2023-06-22T12:08:39.271 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/234 2023-06-22T12:08:39.271 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:08:39.277 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:08:39.319 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:08:39.319 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/235) 2023-06-22T12:08:39.780 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:08:39.792 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:08:39.793 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:08:39.796 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:08:39.796 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:08:40.298 INFO:teuthology.orchestra.run.smithi040.stdout:generic/235 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-22T12:08:40.308 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/235 2023-06-22T12:08:40.308 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/235 2023-06-22T12:08:40.309 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:08:40.315 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:08:40.350 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:08:40.351 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/236) 2023-06-22T12:08:40.819 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:08:40.831 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:08:40.832 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:08:40.835 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:08:40.835 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:08:42.459 INFO:teuthology.orchestra.run.smithi040.stdout:generic/236 1s 2023-06-22T12:08:42.472 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/236 2023-06-22T12:08:42.473 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:08:42.478 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:08:42.610 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:08:42.610 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/237) 2023-06-22T12:08:43.341 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:08:43.353 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:08:43.354 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:08:43.357 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:08:43.357 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:08:44.055 INFO:teuthology.orchestra.run.smithi040.stdout:generic/237 1s 2023-06-22T12:08:44.068 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/237 2023-06-22T12:08:44.068 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:08:44.074 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:08:44.225 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:08:44.225 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/238) 2023-06-22T12:08:44.968 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:08:44.981 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:08:44.982 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:08:44.984 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:08:44.985 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:08:45.825 INFO:teuthology.orchestra.run.smithi040.stdout:generic/238 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:08:45.863 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/238 2023-06-22T12:08:45.864 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/238 2023-06-22T12:08:45.864 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:08:45.870 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:08:46.080 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:08:46.081 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/239) 2023-06-22T12:08:46.608 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:08:46.620 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:08:46.621 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:08:46.623 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:08:46.623 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:10:53.126 INFO:teuthology.orchestra.run.smithi040.stdout:generic/239 127s 2023-06-22T12:10:53.140 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/239 2023-06-22T12:10:53.141 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:10:53.148 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:10:53.293 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:10:53.294 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/240) 2023-06-22T12:10:54.013 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:10:54.025 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:10:54.026 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:10:54.029 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:10:54.029 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:10:55.102 INFO:teuthology.orchestra.run.smithi040.stdout:generic/240 1s 2023-06-22T12:10:55.834 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/240 2023-06-22T12:10:55.835 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:10:55.841 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:10:56.042 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:10:56.043 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/241) 2023-06-22T12:10:56.762 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:10:56.774 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:10:56.775 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:10:56.777 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:10:56.778 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:11:57.133 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:11:57.141 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:11:57.329 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T12:11:57.327+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120471) UID: 0 2023-06-22T12:11:57.330 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T12:11:57.327+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120471) UID: 0 2023-06-22T12:11:57.330 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T12:11:57.327+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120471) UID: 0 2023-06-22T12:11:57.330 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T12:11:57.327+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120471) UID: 0 2023-06-22T12:12:10.154 INFO:teuthology.orchestra.run.smithi040.stdout:generic/241 74s 2023-06-22T12:12:10.167 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/241 2023-06-22T12:12:10.167 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:12:10.173 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:12:13.412 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:12:13.413 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/242) 2023-06-22T12:12:14.010 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:12:14.022 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:12:14.023 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:12:14.025 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:12:14.026 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:12:15.847 INFO:teuthology.orchestra.run.smithi040.stdout:generic/242 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:12:15.901 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/242 2023-06-22T12:12:15.901 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/242 2023-06-22T12:12:15.902 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:12:15.917 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:12:16.241 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:12:16.241 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/243) 2023-06-22T12:12:16.756 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:12:16.768 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:12:16.769 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:12:16.772 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:12:16.772 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:12:17.655 INFO:teuthology.orchestra.run.smithi040.stdout:generic/243 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:12:17.687 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/243 2023-06-22T12:12:17.687 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/243 2023-06-22T12:12:17.687 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:12:17.711 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:12:17.934 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:12:17.935 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/244) 2023-06-22T12:12:18.397 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:12:18.409 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:12:18.410 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:12:18.412 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:12:18.412 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:12:18.915 INFO:teuthology.orchestra.run.smithi040.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-22T12:12:18.924 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/244 2023-06-22T12:12:18.925 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/244 2023-06-22T12:12:18.925 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:12:18.930 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:12:18.969 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:12:18.969 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/245) 2023-06-22T12:12:19.424 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:12:19.436 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:12:19.437 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:12:19.440 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:12:19.440 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:12:20.036 INFO:teuthology.orchestra.run.smithi040.stdout:generic/245 1s 2023-06-22T12:12:20.049 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/245 2023-06-22T12:12:20.050 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:12:20.055 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:12:20.209 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:12:20.210 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/246) 2023-06-22T12:12:20.870 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:12:20.882 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:12:20.883 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:12:20.886 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:12:20.886 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:12:21.463 INFO:teuthology.orchestra.run.smithi040.stdout:generic/246 0s 2023-06-22T12:12:21.476 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/246 2023-06-22T12:12:21.476 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:12:21.482 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:12:21.638 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:12:21.638 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/247) 2023-06-22T12:12:22.308 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:12:22.320 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:12:22.321 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:12:22.324 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:12:22.324 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:12:32.284 INFO:teuthology.orchestra.run.smithi040.stdout:generic/247 10s 2023-06-22T12:12:32.297 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/247 2023-06-22T12:12:32.297 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:12:32.303 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:12:32.323 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:12:32.324 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/248) 2023-06-22T12:12:32.785 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:12:32.797 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:12:32.799 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:12:32.801 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:12:32.801 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:12:33.360 INFO:teuthology.orchestra.run.smithi040.stdout:generic/248 0s 2023-06-22T12:12:33.373 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/248 2023-06-22T12:12:33.373 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:12:33.379 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:12:33.421 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:12:33.422 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/249) 2023-06-22T12:12:33.876 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:12:33.888 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:12:33.889 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:12:33.892 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:12:33.892 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:12:34.784 INFO:teuthology.orchestra.run.smithi040.stdout:generic/249 0s 2023-06-22T12:12:34.797 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/249 2023-06-22T12:12:34.797 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:12:34.803 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:12:34.925 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:12:34.926 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/250) 2023-06-22T12:12:35.660 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:12:35.672 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:12:35.673 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:12:35.676 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:12:35.676 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:12:36.240 INFO:teuthology.orchestra.run.smithi040.stdout:generic/250 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-06-22T12:12:36.249 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/250 2023-06-22T12:12:36.250 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/250 2023-06-22T12:12:36.250 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:12:36.255 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:12:36.297 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:12:36.298 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/251) 2023-06-22T12:12:36.753 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:12:36.766 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:12:36.767 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:12:36.769 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:12:36.769 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:12:37.454 INFO:teuthology.orchestra.run.smithi040.stdout:generic/251 [not run] FITRIM not supported on /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:12:37.481 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/251 2023-06-22T12:12:37.481 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/251 2023-06-22T12:12:37.481 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:12:37.487 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:12:37.524 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:12:37.525 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/252) 2023-06-22T12:12:37.978 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:12:37.991 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:12:37.992 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:12:37.994 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:12:37.995 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:12:38.528 INFO:teuthology.orchestra.run.smithi040.stdout:generic/252 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-06-22T12:12:38.538 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/252 2023-06-22T12:12:38.538 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/252 2023-06-22T12:12:38.538 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:12:38.544 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:12:38.583 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:12:38.584 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/253) 2023-06-22T12:12:39.034 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:12:39.047 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:12:39.048 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:12:39.050 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:12:39.050 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:12:39.871 INFO:teuthology.orchestra.run.smithi040.stdout:generic/253 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:12:39.922 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/253 2023-06-22T12:12:39.922 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/253 2023-06-22T12:12:39.922 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:12:39.926 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:12:40.207 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:12:40.208 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/254) 2023-06-22T12:12:40.660 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:12:40.672 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:12:40.673 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:12:40.676 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:12:40.676 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:12:41.541 INFO:teuthology.orchestra.run.smithi040.stdout:generic/254 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:12:41.612 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/254 2023-06-22T12:12:41.612 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/254 2023-06-22T12:12:41.613 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:12:41.638 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:12:41.788 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:12:41.788 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/255) 2023-06-22T12:12:42.256 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:12:42.268 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:12:42.269 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:12:42.272 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:12:42.272 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:12:42.973 INFO:teuthology.orchestra.run.smithi040.stdout:generic/255 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-22T12:12:42.983 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/255 2023-06-22T12:12:42.983 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/255 2023-06-22T12:12:42.984 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:12:42.990 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:12:43.153 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:12:43.154 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/256) 2023-06-22T12:12:43.825 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:12:43.837 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:12:43.838 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:12:43.841 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:12:43.841 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:12:44.801 INFO:teuthology.orchestra.run.smithi040.stdout:generic/256 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-22T12:12:44.810 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/256 2023-06-22T12:12:44.811 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/256 2023-06-22T12:12:44.811 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:12:44.817 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:12:44.868 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:12:44.869 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/257) 2023-06-22T12:12:45.336 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:12:45.348 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:12:45.349 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:12:45.352 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:12:45.352 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:12:46.550 INFO:teuthology.orchestra.run.smithi040.stdout:generic/257 1s 2023-06-22T12:12:46.562 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/257 2023-06-22T12:12:46.563 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:12:46.569 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:12:46.824 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:12:46.824 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/258) 2023-06-22T12:12:47.488 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:12:47.500 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:12:47.501 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:12:47.504 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:12:47.504 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:12:48.005 INFO:teuthology.orchestra.run.smithi040.stdout:generic/258 [not run] ceph does not support negative timestamps 2023-06-22T12:12:48.015 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/258 2023-06-22T12:12:48.015 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/258 2023-06-22T12:12:48.015 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:12:48.021 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:12:48.060 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:12:48.061 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/259) 2023-06-22T12:12:48.514 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:12:48.526 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:12:48.527 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:12:48.530 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:12:48.530 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:12:49.397 INFO:teuthology.orchestra.run.smithi040.stdout:generic/259 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:12:49.427 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/259 2023-06-22T12:12:49.428 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/259 2023-06-22T12:12:49.428 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:12:49.437 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:12:49.669 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:12:49.669 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/260) 2023-06-22T12:12:50.125 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:12:50.137 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:12:50.138 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:12:50.140 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:12:50.141 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:12:50.821 INFO:teuthology.orchestra.run.smithi040.stdout:generic/260 [not run] FITRIM not supported on /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:12:50.849 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/260 2023-06-22T12:12:50.849 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/260 2023-06-22T12:12:50.849 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:12:50.854 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:12:50.890 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:12:50.890 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/261) 2023-06-22T12:12:51.353 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:12:51.366 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:12:51.367 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:12:51.370 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:12:51.370 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:12:52.233 INFO:teuthology.orchestra.run.smithi040.stdout:generic/261 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:12:52.289 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/261 2023-06-22T12:12:52.289 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/261 2023-06-22T12:12:52.290 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:12:52.317 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:12:52.501 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:12:52.501 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/262) 2023-06-22T12:12:52.960 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:12:52.973 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:12:52.974 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:12:52.976 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:12:52.977 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:12:53.846 INFO:teuthology.orchestra.run.smithi040.stdout:generic/262 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:12:53.889 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/262 2023-06-22T12:12:53.889 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/262 2023-06-22T12:12:53.889 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:12:53.909 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:12:54.144 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:12:54.145 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/263) 2023-06-22T12:12:54.599 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:12:54.611 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:12:54.612 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:12:54.615 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:12:54.615 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:13:38.370 INFO:teuthology.orchestra.run.smithi040.stdout:generic/263 44s 2023-06-22T12:13:38.382 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/263 2023-06-22T12:13:38.383 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:13:38.388 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:13:38.533 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:13:38.533 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/264) 2023-06-22T12:13:39.211 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:13:39.224 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:13:39.225 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:13:39.227 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:13:39.227 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:13:40.100 INFO:teuthology.orchestra.run.smithi040.stdout:generic/264 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:13:40.133 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/264 2023-06-22T12:13:40.133 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/264 2023-06-22T12:13:40.133 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:13:40.149 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:13:40.379 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:13:40.379 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/265) 2023-06-22T12:13:40.832 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:13:40.845 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:13:40.846 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:13:40.848 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:13:40.849 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:13:41.839 INFO:teuthology.orchestra.run.smithi040.stdout:generic/265 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:13:41.867 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/265 2023-06-22T12:13:41.867 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/265 2023-06-22T12:13:41.867 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:13:41.883 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:13:42.024 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:13:42.025 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/266) 2023-06-22T12:13:42.483 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:13:42.496 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:13:42.497 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:13:42.499 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:13:42.500 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:13:43.453 INFO:teuthology.orchestra.run.smithi040.stdout:generic/266 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:13:43.488 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/266 2023-06-22T12:13:43.489 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/266 2023-06-22T12:13:43.489 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:13:43.511 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:13:43.676 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:13:43.677 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/267) 2023-06-22T12:13:44.129 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:13:44.141 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:13:44.142 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:13:44.145 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:13:44.145 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:13:45.101 INFO:teuthology.orchestra.run.smithi040.stdout:generic/267 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:13:45.132 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/267 2023-06-22T12:13:45.132 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/267 2023-06-22T12:13:45.133 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:13:45.140 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:13:45.322 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:13:45.323 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/268) 2023-06-22T12:13:45.785 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:13:45.797 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:13:45.798 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:13:45.801 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:13:45.801 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:13:46.712 INFO:teuthology.orchestra.run.smithi040.stdout:generic/268 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:13:46.765 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/268 2023-06-22T12:13:46.765 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/268 2023-06-22T12:13:46.765 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:13:46.781 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:13:46.959 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:13:46.960 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/269) 2023-06-22T12:13:47.413 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:13:47.425 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:13:47.426 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:13:47.429 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:13:47.429 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:13:47.943 INFO:teuthology.orchestra.run.smithi040.stdout:generic/269 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-22T12:13:47.952 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/269 2023-06-22T12:13:47.952 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/269 2023-06-22T12:13:47.953 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:13:47.958 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:13:48.001 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:13:48.001 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/270) 2023-06-22T12:13:48.458 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:13:48.470 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:13:48.471 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:13:48.473 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:13:48.474 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:13:48.983 INFO:teuthology.orchestra.run.smithi040.stdout:generic/270 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-22T12:13:48.993 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/270 2023-06-22T12:13:48.993 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/270 2023-06-22T12:13:48.993 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:13:48.999 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:13:49.041 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:13:49.041 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/271) 2023-06-22T12:13:49.496 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:13:49.509 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:13:49.510 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:13:49.512 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:13:49.513 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:13:50.454 INFO:teuthology.orchestra.run.smithi040.stdout:generic/271 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:13:50.506 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/271 2023-06-22T12:13:50.507 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/271 2023-06-22T12:13:50.507 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:13:50.515 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:13:50.657 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:13:50.658 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/272) 2023-06-22T12:13:51.113 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:13:51.126 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:13:51.127 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:13:51.129 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:13:51.130 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:13:52.066 INFO:teuthology.orchestra.run.smithi040.stdout:generic/272 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:13:52.109 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/272 2023-06-22T12:13:52.109 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/272 2023-06-22T12:13:52.109 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:13:52.127 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:13:52.296 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:13:52.296 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/273) 2023-06-22T12:13:52.753 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:13:52.765 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:13:52.766 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:13:52.769 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:13:52.769 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:13:53.303 INFO:teuthology.orchestra.run.smithi040.stdout:generic/273 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-22T12:13:53.313 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/273 2023-06-22T12:13:53.313 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/273 2023-06-22T12:13:53.314 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:13:53.320 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:13:53.358 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:13:53.359 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/274) 2023-06-22T12:13:53.812 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:13:53.824 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:13:53.825 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:13:53.828 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:13:53.828 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:13:54.359 INFO:teuthology.orchestra.run.smithi040.stdout:generic/274 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-06-22T12:13:54.369 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/274 2023-06-22T12:13:54.369 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/274 2023-06-22T12:13:54.369 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:13:54.375 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:13:54.418 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:13:54.418 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/275) 2023-06-22T12:13:54.877 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:13:54.889 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:13:54.890 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:13:54.893 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:13:54.893 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:13:55.423 INFO:teuthology.orchestra.run.smithi040.stdout:generic/275 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-22T12:13:55.433 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/275 2023-06-22T12:13:55.433 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/275 2023-06-22T12:13:55.433 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:13:55.438 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:13:55.486 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:13:55.487 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/276) 2023-06-22T12:13:55.942 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:13:55.955 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:13:55.956 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:13:55.958 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:13:55.958 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:13:56.934 INFO:teuthology.orchestra.run.smithi040.stdout:generic/276 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:13:56.964 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/276 2023-06-22T12:13:56.964 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/276 2023-06-22T12:13:56.964 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:13:56.986 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:13:57.112 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:13:57.112 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/277) 2023-06-22T12:13:57.578 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:13:57.590 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:13:57.591 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:13:57.594 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:13:57.594 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:13:58.187 INFO:teuthology.orchestra.run.smithi040.stdout:generic/277 [not run] file system doesn't support chattr +A 2023-06-22T12:13:58.197 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/277 2023-06-22T12:13:58.197 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/277 2023-06-22T12:13:58.197 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:13:58.203 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:13:58.248 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:13:58.249 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/278) 2023-06-22T12:13:58.709 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:13:58.721 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:13:58.722 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:13:58.725 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:13:58.725 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:13:59.695 INFO:teuthology.orchestra.run.smithi040.stdout:generic/278 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:13:59.730 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/278 2023-06-22T12:13:59.730 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/278 2023-06-22T12:13:59.730 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:13:59.740 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:13:59.882 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:13:59.882 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/279) 2023-06-22T12:14:00.341 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:14:00.354 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:14:00.355 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:14:00.357 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:14:00.357 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:14:01.332 INFO:teuthology.orchestra.run.smithi040.stdout:generic/279 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:14:01.356 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/279 2023-06-22T12:14:01.356 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/279 2023-06-22T12:14:01.356 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:14:01.367 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:14:01.540 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:14:01.541 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/280) 2023-06-22T12:14:01.991 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:14:02.003 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:14:02.005 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:14:02.007 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:14:02.007 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:14:02.533 INFO:teuthology.orchestra.run.smithi040.stdout:generic/280 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-22T12:14:02.542 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/280 2023-06-22T12:14:02.543 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/280 2023-06-22T12:14:02.543 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:14:02.549 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:14:02.588 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:14:02.589 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/281) 2023-06-22T12:14:03.049 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:14:03.061 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:14:03.062 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:14:03.065 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:14:03.065 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:14:04.051 INFO:teuthology.orchestra.run.smithi040.stdout:generic/281 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:14:04.096 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/281 2023-06-22T12:14:04.097 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/281 2023-06-22T12:14:04.097 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:14:04.114 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:14:04.233 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:14:04.233 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/282) 2023-06-22T12:14:04.691 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:14:04.703 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:14:04.704 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:14:04.707 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:14:04.707 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:14:05.675 INFO:teuthology.orchestra.run.smithi040.stdout:generic/282 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:14:05.716 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/282 2023-06-22T12:14:05.716 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/282 2023-06-22T12:14:05.717 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:14:05.720 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:14:05.866 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:14:05.866 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/283) 2023-06-22T12:14:06.337 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:14:06.349 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:14:06.350 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:14:06.353 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:14:06.353 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:14:07.311 INFO:teuthology.orchestra.run.smithi040.stdout:generic/283 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:14:07.343 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/283 2023-06-22T12:14:07.343 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/283 2023-06-22T12:14:07.343 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:14:07.367 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:14:07.535 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:14:07.535 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/284) 2023-06-22T12:14:07.989 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:14:08.001 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:14:08.002 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:14:08.005 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:14:08.005 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:14:08.930 INFO:teuthology.orchestra.run.smithi040.stdout:generic/284 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:14:08.959 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/284 2023-06-22T12:14:08.960 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/284 2023-06-22T12:14:08.960 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:14:08.980 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:14:09.167 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:14:09.168 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/285) 2023-06-22T12:14:09.621 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:14:09.633 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:14:09.635 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:14:09.637 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:14:09.637 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:14:11.657 INFO:teuthology.orchestra.run.smithi040.stdout:generic/285 2s 2023-06-22T12:14:11.669 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/285 2023-06-22T12:14:11.669 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:14:11.675 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:14:12.326 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:14:12.327 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/286) 2023-06-22T12:14:13.045 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:14:13.057 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:14:13.058 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:14:13.061 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:14:13.061 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:14:13.891 INFO:teuthology.orchestra.run.smithi040.stdout:generic/286 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-22T12:14:13.906 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/286 2023-06-22T12:14:13.907 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/286 2023-06-22T12:14:13.907 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:14:13.918 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:14:13.993 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:14:13.994 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/287) 2023-06-22T12:14:14.702 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:14:14.720 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:14:14.722 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:14:14.725 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:14:14.725 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:14:15.953 INFO:teuthology.orchestra.run.smithi040.stdout:generic/287 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:14:15.985 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/287 2023-06-22T12:14:15.985 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/287 2023-06-22T12:14:15.985 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:14:15.998 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:14:16.249 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:14:16.250 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/288) 2023-06-22T12:14:16.946 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:14:16.965 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:14:16.968 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:14:16.972 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:14:16.972 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:14:17.969 INFO:teuthology.orchestra.run.smithi040.stdout:generic/288 [not run] FITRIM not supported on /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:14:18.002 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/288 2023-06-22T12:14:18.002 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/288 2023-06-22T12:14:18.002 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:14:18.008 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:14:18.045 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:14:18.046 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/289) 2023-06-22T12:14:18.509 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:14:18.521 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:14:18.522 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:14:18.525 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:14:18.525 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:14:19.382 INFO:teuthology.orchestra.run.smithi040.stdout:generic/289 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:14:19.413 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/289 2023-06-22T12:14:19.413 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/289 2023-06-22T12:14:19.413 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:14:19.425 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:14:19.688 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:14:19.688 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/290) 2023-06-22T12:14:20.143 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:14:20.155 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:14:20.156 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:14:20.159 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:14:20.159 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:14:21.043 INFO:teuthology.orchestra.run.smithi040.stdout:generic/290 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:14:21.076 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/290 2023-06-22T12:14:21.076 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/290 2023-06-22T12:14:21.076 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:14:21.087 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:14:21.369 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:14:21.369 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/291) 2023-06-22T12:14:21.846 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:14:21.859 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:14:21.860 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:14:21.862 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:14:21.862 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:14:22.730 INFO:teuthology.orchestra.run.smithi040.stdout:generic/291 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:14:22.788 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/291 2023-06-22T12:14:22.789 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/291 2023-06-22T12:14:22.789 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:14:22.814 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:14:23.032 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:14:23.032 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/292) 2023-06-22T12:14:23.488 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:14:23.500 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:14:23.501 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:14:23.504 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:14:23.504 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:14:24.400 INFO:teuthology.orchestra.run.smithi040.stdout:generic/292 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:14:24.449 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/292 2023-06-22T12:14:24.449 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/292 2023-06-22T12:14:24.449 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:14:24.458 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:14:24.679 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:14:24.679 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/293) 2023-06-22T12:14:25.138 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:14:25.150 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:14:25.151 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:14:25.154 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:14:25.154 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:14:26.053 INFO:teuthology.orchestra.run.smithi040.stdout:generic/293 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:14:26.102 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/293 2023-06-22T12:14:26.102 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/293 2023-06-22T12:14:26.102 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:14:26.109 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:14:26.326 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:14:26.326 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/294) 2023-06-22T12:14:26.783 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:14:26.795 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:14:26.797 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:14:26.799 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:14:26.799 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:14:27.819 INFO:teuthology.orchestra.run.smithi040.stdout:generic/294 0s 2023-06-22T12:14:27.877 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/294 2023-06-22T12:14:27.877 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:14:27.885 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:14:27.934 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:14:27.935 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/295) 2023-06-22T12:14:28.511 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:14:28.523 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:14:28.524 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:14:28.527 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:14:28.527 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:14:29.399 INFO:teuthology.orchestra.run.smithi040.stdout:generic/295 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:14:29.451 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/295 2023-06-22T12:14:29.452 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/295 2023-06-22T12:14:29.452 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:14:29.475 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:14:29.705 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:14:29.706 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/296) 2023-06-22T12:14:30.158 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:14:30.171 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:14:30.172 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:14:30.174 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:14:30.175 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:14:31.096 INFO:teuthology.orchestra.run.smithi040.stdout:generic/296 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:14:31.128 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/296 2023-06-22T12:14:31.128 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/296 2023-06-22T12:14:31.129 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:14:31.145 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:14:31.335 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:14:31.335 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/297) 2023-06-22T12:14:31.794 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:14:31.806 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:14:31.807 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:14:31.810 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:14:31.810 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:14:32.678 INFO:teuthology.orchestra.run.smithi040.stdout:generic/297 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:14:32.717 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/297 2023-06-22T12:14:32.718 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/297 2023-06-22T12:14:32.718 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:14:32.726 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:14:32.981 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:14:32.982 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/298) 2023-06-22T12:14:33.446 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:14:33.458 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:14:33.459 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:14:33.462 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:14:33.462 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:14:34.373 INFO:teuthology.orchestra.run.smithi040.stdout:generic/298 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:14:34.438 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/298 2023-06-22T12:14:34.438 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/298 2023-06-22T12:14:34.438 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:14:34.450 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:14:34.622 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:14:34.623 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/299) 2023-06-22T12:14:35.081 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:14:35.094 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:14:35.095 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:14:35.097 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:14:35.098 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:14:35.712 INFO:teuthology.orchestra.run.smithi040.stdout:generic/299 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-06-22T12:14:35.722 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/299 2023-06-22T12:14:35.722 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/299 2023-06-22T12:14:35.723 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:14:35.728 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:14:35.779 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:14:35.780 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/300) 2023-06-22T12:14:36.244 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:14:36.253 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:14:36.254 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:14:36.257 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:14:36.257 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:14:36.829 INFO:teuthology.orchestra.run.smithi040.stdout:generic/300 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-06-22T12:14:36.839 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/300 2023-06-22T12:14:36.839 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/300 2023-06-22T12:14:36.839 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:14:36.845 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:14:36.890 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:14:36.891 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/301) 2023-06-22T12:14:37.351 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:14:37.364 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:14:37.365 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:14:37.368 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:14:37.368 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:14:38.266 INFO:teuthology.orchestra.run.smithi040.stdout:generic/301 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:14:38.297 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/301 2023-06-22T12:14:38.298 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/301 2023-06-22T12:14:38.298 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:14:38.335 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:14:38.549 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:14:38.550 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/302) 2023-06-22T12:14:39.006 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:14:39.019 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:14:39.020 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:14:39.022 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:14:39.023 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:14:39.892 INFO:teuthology.orchestra.run.smithi040.stdout:generic/302 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:14:39.917 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/302 2023-06-22T12:14:39.925 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/302 2023-06-22T12:14:39.925 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:14:39.964 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:14:40.178 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:14:40.179 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/303) 2023-06-22T12:14:40.640 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:14:40.653 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:14:40.654 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:14:40.656 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:14:40.656 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:14:41.252 INFO:teuthology.orchestra.run.smithi040.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph 2023-06-22T12:14:41.262 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/303 2023-06-22T12:14:41.262 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/303 2023-06-22T12:14:41.262 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:14:41.268 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:14:41.436 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:14:41.437 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/304) 2023-06-22T12:14:42.100 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:14:42.112 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:14:42.113 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:14:42.116 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:14:42.116 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:14:42.708 INFO:teuthology.orchestra.run.smithi040.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph 2023-06-22T12:14:42.718 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/304 2023-06-22T12:14:42.718 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/304 2023-06-22T12:14:42.718 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:14:42.724 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:14:42.898 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:14:42.898 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/305) 2023-06-22T12:14:43.559 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:14:43.571 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:14:43.573 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:14:43.575 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:14:43.575 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:14:44.461 INFO:teuthology.orchestra.run.smithi040.stdout:generic/305 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:14:44.513 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/305 2023-06-22T12:14:44.513 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/305 2023-06-22T12:14:44.513 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:14:44.542 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:14:44.737 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:14:44.738 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/306) 2023-06-22T12:14:45.196 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:14:45.208 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:14:45.209 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:14:45.212 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:14:45.212 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:14:46.392 INFO:teuthology.orchestra.run.smithi040.stdout:generic/306 1s 2023-06-22T12:14:46.454 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/306 2023-06-22T12:14:46.461 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:14:46.476 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:14:46.742 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:14:46.742 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/307) 2023-06-22T12:14:47.415 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:14:47.427 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:14:47.428 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:14:47.430 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:14:47.431 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:14:49.496 INFO:teuthology.orchestra.run.smithi040.stdout:generic/307 2s 2023-06-22T12:14:49.509 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/307 2023-06-22T12:14:49.509 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:14:49.515 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:14:49.535 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:14:49.536 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/308) 2023-06-22T12:14:49.987 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:14:49.999 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:14:50.000 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:14:50.003 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:14:50.003 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:14:50.580 INFO:teuthology.orchestra.run.smithi040.stdout:generic/308 0s 2023-06-22T12:14:50.593 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/308 2023-06-22T12:14:50.593 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:14:50.599 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:14:50.653 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:14:50.654 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/309) 2023-06-22T12:14:51.110 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:14:51.122 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:14:51.123 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:14:51.126 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:14:51.126 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:14:52.736 INFO:teuthology.orchestra.run.smithi040.stdout:generic/309 1s 2023-06-22T12:14:52.749 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/309 2023-06-22T12:14:52.750 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:14:52.756 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:14:52.945 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:14:52.946 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/310) 2023-06-22T12:14:53.607 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:14:53.619 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:14:53.620 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:14:53.623 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:14:53.623 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:15:09.658 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:15:09.664 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:15:39.813 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:15:39.818 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:16:09.918 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:16:09.923 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:16:12.220 INFO:teuthology.orchestra.run.smithi040.stdout:generic/310 79s 2023-06-22T12:16:12.233 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/310 2023-06-22T12:16:12.233 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:16:12.239 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:16:12.425 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:16:12.426 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/311) 2023-06-22T12:16:13.057 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:16:13.070 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:16:13.071 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:16:13.073 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:16:13.074 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:16:13.656 INFO:teuthology.orchestra.run.smithi040.stdout:generic/311 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-06-22T12:16:13.666 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/311 2023-06-22T12:16:13.666 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/311 2023-06-22T12:16:13.666 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:16:13.672 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:16:13.719 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:16:13.720 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/312) 2023-06-22T12:16:14.176 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:16:14.188 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:16:14.190 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:16:14.192 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:16:14.192 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:16:14.720 INFO:teuthology.orchestra.run.smithi040.stdout:generic/312 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-22T12:16:14.730 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/312 2023-06-22T12:16:14.730 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/312 2023-06-22T12:16:14.730 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:16:14.736 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:16:14.784 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:16:14.785 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/313) 2023-06-22T12:16:15.241 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:16:15.253 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:16:15.254 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:16:15.257 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:16:15.257 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:16:19.855 INFO:teuthology.orchestra.run.smithi040.stdout:generic/313 4s 2023-06-22T12:16:19.869 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/313 2023-06-22T12:16:19.869 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:16:19.876 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:16:19.936 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:16:19.937 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/314) 2023-06-22T12:16:20.395 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:16:20.408 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:16:20.409 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:16:20.412 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:16:20.412 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:16:21.263 INFO:teuthology.orchestra.run.smithi040.stdout:generic/314 1s 2023-06-22T12:16:21.276 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/314 2023-06-22T12:16:21.276 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:16:21.282 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:16:21.337 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:16:21.337 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/315) 2023-06-22T12:16:21.794 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:16:21.806 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:16:21.808 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:16:21.810 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:16:21.810 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:16:22.352 INFO:teuthology.orchestra.run.smithi040.stdout:generic/315 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-06-22T12:16:22.363 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/315 2023-06-22T12:16:22.363 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/315 2023-06-22T12:16:22.363 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:16:22.368 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:16:22.416 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:16:22.416 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/316) 2023-06-22T12:16:22.882 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:16:22.894 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:16:22.895 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:16:22.898 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:16:22.898 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:16:23.616 INFO:teuthology.orchestra.run.smithi040.stdout:generic/316 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-22T12:16:23.625 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/316 2023-06-22T12:16:23.626 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/316 2023-06-22T12:16:23.626 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:16:23.632 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:16:23.776 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:16:23.777 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/317) 2023-06-22T12:16:24.466 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:16:24.478 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:16:24.479 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:16:24.482 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:16:24.482 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:16:25.779 INFO:teuthology.orchestra.run.smithi040.stdout:generic/317 1s 2023-06-22T12:16:25.792 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/317 2023-06-22T12:16:25.792 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:16:25.798 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:16:25.818 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:16:25.819 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/318) 2023-06-22T12:16:26.277 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:16:26.289 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:16:26.291 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:16:26.293 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:16:26.293 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:16:27.410 INFO:teuthology.orchestra.run.smithi040.stdout:generic/318 1s 2023-06-22T12:16:27.422 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/318 2023-06-22T12:16:27.423 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:16:27.429 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:16:27.449 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:16:27.449 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/319) 2023-06-22T12:16:27.911 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:16:27.923 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:16:27.924 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:16:27.927 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:16:27.927 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:16:28.790 INFO:teuthology.orchestra.run.smithi040.stdout:generic/319 0s 2023-06-22T12:16:28.803 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/319 2023-06-22T12:16:28.803 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:16:28.809 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:16:28.831 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:16:28.832 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/320) 2023-06-22T12:16:29.283 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:16:29.295 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:16:29.297 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:16:29.299 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:16:29.299 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:16:29.839 INFO:teuthology.orchestra.run.smithi040.stdout:generic/320 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-22T12:16:29.848 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/320 2023-06-22T12:16:29.849 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/320 2023-06-22T12:16:29.849 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:16:29.854 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:16:29.905 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:16:29.905 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/321) 2023-06-22T12:16:30.361 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:16:30.374 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:16:30.375 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:16:30.377 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:16:30.378 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:16:30.916 INFO:teuthology.orchestra.run.smithi040.stdout:generic/321 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-06-22T12:16:30.926 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/321 2023-06-22T12:16:30.926 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/321 2023-06-22T12:16:30.927 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:16:30.932 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:16:30.971 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:16:30.971 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/322) 2023-06-22T12:16:31.426 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:16:31.438 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:16:31.439 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:16:31.442 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:16:31.442 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:16:31.973 INFO:teuthology.orchestra.run.smithi040.stdout:generic/322 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-06-22T12:16:31.983 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/322 2023-06-22T12:16:31.983 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/322 2023-06-22T12:16:31.984 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:16:31.989 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:16:32.025 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:16:32.025 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/323) 2023-06-22T12:16:32.478 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:16:32.490 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:16:32.491 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:16:32.494 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:16:32.494 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:16:40.048 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:16:40.053 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:17:10.190 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:17:10.195 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:17:41.422 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:17:41.427 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:18:11.552 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:18:11.557 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:18:11.674 INFO:tasks.ceph.osd.1.smithi040.stderr:2023-06-22T12:18:11.672+0000 7f7e30ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 376391) UID: 0 2023-06-22T12:18:11.675 INFO:tasks.ceph.osd.2.smithi040.stderr:2023-06-22T12:18:11.672+0000 7f3aaaff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 376391) UID: 0 2023-06-22T12:18:11.675 INFO:tasks.ceph.osd.3.smithi040.stderr:2023-06-22T12:18:11.672+0000 7f1c345f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 376391) UID: 0 2023-06-22T12:18:11.675 INFO:tasks.ceph.osd.0.smithi040.stderr:2023-06-22T12:18:11.672+0000 7fe9b49f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 376391) UID: 0 2023-06-22T12:18:33.799 INFO:teuthology.orchestra.run.smithi040.stdout:generic/323 121s 2023-06-22T12:18:33.812 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/323 2023-06-22T12:18:33.812 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:18:33.817 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:18:33.953 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:18:33.953 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/324) 2023-06-22T12:18:34.691 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:18:34.703 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:18:34.704 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:18:34.706 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:18:34.706 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:18:35.220 INFO:teuthology.orchestra.run.smithi040.stdout:generic/324 [not run] defragmentation not supported for fstype "ceph" 2023-06-22T12:18:35.229 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/324 2023-06-22T12:18:35.230 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/324 2023-06-22T12:18:35.230 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:18:35.236 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:18:35.284 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:18:35.285 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/325) 2023-06-22T12:18:35.751 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:18:35.765 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:18:35.766 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:18:35.769 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:18:35.769 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:18:36.311 INFO:teuthology.orchestra.run.smithi040.stdout:generic/325 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-06-22T12:18:36.322 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/325 2023-06-22T12:18:36.322 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/325 2023-06-22T12:18:36.322 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:18:36.329 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:18:36.369 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:18:36.370 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/326) 2023-06-22T12:18:36.827 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:18:36.840 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:18:36.841 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:18:36.843 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:18:36.843 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:18:37.781 INFO:teuthology.orchestra.run.smithi040.stdout:generic/326 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:18:37.825 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/326 2023-06-22T12:18:37.825 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/326 2023-06-22T12:18:37.825 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:18:37.836 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:18:38.110 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:18:38.110 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/327) 2023-06-22T12:18:38.569 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:18:38.582 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:18:38.583 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:18:38.586 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:18:38.586 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:18:39.493 INFO:teuthology.orchestra.run.smithi040.stdout:generic/327 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:18:39.549 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/327 2023-06-22T12:18:39.549 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/327 2023-06-22T12:18:39.549 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:18:39.562 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:18:39.859 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:18:39.860 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/328) 2023-06-22T12:18:40.337 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:18:40.349 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:18:40.350 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:18:40.353 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:18:40.353 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:18:41.277 INFO:teuthology.orchestra.run.smithi040.stdout:generic/328 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:18:41.337 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/328 2023-06-22T12:18:41.337 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/328 2023-06-22T12:18:41.338 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:18:41.371 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:18:41.642 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:18:41.642 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/329) 2023-06-22T12:18:42.117 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:18:42.130 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:18:42.131 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:18:42.133 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:18:42.133 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:18:43.147 INFO:teuthology.orchestra.run.smithi040.stdout:generic/329 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:18:43.213 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/329 2023-06-22T12:18:43.213 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/329 2023-06-22T12:18:43.213 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:18:43.232 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:18:43.467 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:18:43.468 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/330) 2023-06-22T12:18:43.956 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:18:43.969 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:18:43.970 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:18:43.972 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:18:43.972 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:18:45.260 INFO:teuthology.orchestra.run.smithi040.stdout:generic/330 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:18:45.283 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/330 2023-06-22T12:18:45.283 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/330 2023-06-22T12:18:45.284 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:18:45.297 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:18:45.615 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:18:45.616 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/331) 2023-06-22T12:18:46.090 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:18:46.103 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:18:46.104 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:18:46.106 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:18:46.106 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:18:47.228 INFO:teuthology.orchestra.run.smithi040.stdout:generic/331 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:18:47.287 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/331 2023-06-22T12:18:47.287 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/331 2023-06-22T12:18:47.287 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:18:47.295 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:18:47.454 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:18:47.454 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/332) 2023-06-22T12:18:47.913 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:18:47.925 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:18:47.926 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:18:47.929 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:18:47.929 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:18:48.850 INFO:teuthology.orchestra.run.smithi040.stdout:generic/332 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:18:48.890 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/332 2023-06-22T12:18:48.891 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/332 2023-06-22T12:18:48.891 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:18:48.919 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:18:49.214 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:18:49.215 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/333) 2023-06-22T12:18:49.681 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:18:49.693 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:18:49.694 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:18:49.696 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:18:49.697 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:18:51.019 INFO:teuthology.orchestra.run.smithi040.stdout:generic/333 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:18:51.060 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/333 2023-06-22T12:18:51.061 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/333 2023-06-22T12:18:51.061 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:18:51.075 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:18:51.366 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:18:51.367 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/334) 2023-06-22T12:18:51.851 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:18:51.863 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:18:51.864 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:18:51.867 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:18:51.867 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:18:52.846 INFO:teuthology.orchestra.run.smithi040.stdout:generic/334 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:18:52.892 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/334 2023-06-22T12:18:52.892 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/334 2023-06-22T12:18:52.892 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:18:52.901 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:18:53.140 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:18:53.141 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/335) 2023-06-22T12:18:53.608 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:18:53.621 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:18:53.622 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:18:53.625 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:18:53.625 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:18:54.171 INFO:teuthology.orchestra.run.smithi040.stdout:generic/335 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-06-22T12:18:54.181 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/335 2023-06-22T12:18:54.181 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/335 2023-06-22T12:18:54.181 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:18:54.187 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:18:54.227 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:18:54.228 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/336) 2023-06-22T12:18:54.705 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:18:54.718 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:18:54.719 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:18:54.721 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:18:54.722 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:18:55.277 INFO:teuthology.orchestra.run.smithi040.stdout:generic/336 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-06-22T12:18:55.287 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/336 2023-06-22T12:18:55.287 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/336 2023-06-22T12:18:55.287 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:18:55.293 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:18:55.344 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:18:55.345 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/337) 2023-06-22T12:18:55.804 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:18:55.817 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:18:55.818 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:18:55.820 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:18:55.820 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:18:56.819 INFO:teuthology.orchestra.run.smithi040.stdout:generic/337 0s 2023-06-22T12:18:57.002 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/337 2023-06-22T12:18:57.002 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:18:57.008 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:18:57.029 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:18:57.029 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/338) 2023-06-22T12:18:57.488 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:18:57.500 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:18:57.501 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:18:57.503 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:18:57.504 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:18:58.063 INFO:teuthology.orchestra.run.smithi040.stdout:generic/338 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-06-22T12:18:58.073 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/338 2023-06-22T12:18:58.074 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/338 2023-06-22T12:18:58.074 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:18:58.080 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:18:58.124 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:18:58.125 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/339) 2023-06-22T12:18:58.616 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:18:58.629 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:18:58.630 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:18:58.633 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:18:58.633 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:19:57.182 INFO:teuthology.orchestra.run.smithi040.stdout:generic/339 59s 2023-06-22T12:19:57.196 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/339 2023-06-22T12:19:57.196 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:19:57.202 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:19:57.223 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:19:57.223 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/340) 2023-06-22T12:19:57.866 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:19:57.878 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:19:57.879 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:19:57.882 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:19:57.882 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:20:03.349 INFO:teuthology.orchestra.run.smithi040.stdout:generic/340 5s 2023-06-22T12:20:03.413 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/340 2023-06-22T12:20:03.413 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:20:03.435 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:20:03.520 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:20:03.521 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/341) 2023-06-22T12:20:04.641 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:20:04.654 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:20:04.655 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:20:04.658 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:20:04.658 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:20:05.220 INFO:teuthology.orchestra.run.smithi040.stdout:generic/341 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-06-22T12:20:05.230 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/341 2023-06-22T12:20:05.230 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/341 2023-06-22T12:20:05.231 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:20:05.237 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:20:05.278 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:20:05.278 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/342) 2023-06-22T12:20:05.738 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:20:05.750 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:20:05.751 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:20:05.754 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:20:05.754 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:20:06.285 INFO:teuthology.orchestra.run.smithi040.stdout:generic/342 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-06-22T12:20:06.294 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/342 2023-06-22T12:20:06.295 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/342 2023-06-22T12:20:06.295 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:20:06.301 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:20:06.345 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:20:06.345 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/343) 2023-06-22T12:20:06.803 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:20:06.816 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:20:06.817 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:20:06.819 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:20:06.820 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:20:07.377 INFO:teuthology.orchestra.run.smithi040.stdout:generic/343 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-06-22T12:20:07.386 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/343 2023-06-22T12:20:07.387 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/343 2023-06-22T12:20:07.387 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:20:07.392 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:20:07.443 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:20:07.444 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/344) 2023-06-22T12:20:07.904 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:20:07.916 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:20:07.917 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:20:07.920 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:20:07.920 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:20:17.931 INFO:teuthology.orchestra.run.smithi040.stdout:generic/344 9s 2023-06-22T12:20:17.991 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/344 2023-06-22T12:20:17.991 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:20:18.011 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:20:18.083 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:20:18.083 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/345) 2023-06-22T12:20:18.661 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:20:18.683 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:20:18.685 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:20:18.689 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:20:18.689 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:20:30.031 INFO:teuthology.orchestra.run.smithi040.stdout:generic/345 11s 2023-06-22T12:20:30.069 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/345 2023-06-22T12:20:30.069 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:20:30.077 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:20:30.124 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:20:30.124 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/346) 2023-06-22T12:20:30.927 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:20:30.964 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:20:30.966 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:20:30.969 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:20:30.970 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:20:34.973 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:20:34.990 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:20:36.063 INFO:teuthology.orchestra.run.smithi040.stdout:generic/346 5s 2023-06-22T12:20:36.127 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/346 2023-06-22T12:20:36.127 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:20:36.162 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:20:36.241 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:20:36.242 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/347) 2023-06-22T12:20:37.005 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:20:37.023 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:20:37.024 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:20:37.028 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:20:37.028 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:20:37.677 INFO:teuthology.orchestra.run.smithi040.stdout:generic/347 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-06-22T12:20:37.686 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/347 2023-06-22T12:20:37.687 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/347 2023-06-22T12:20:37.687 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:20:37.692 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:20:37.732 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:20:37.733 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/348) 2023-06-22T12:20:38.196 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:20:38.208 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:20:38.209 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:20:38.212 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:20:38.212 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:20:38.779 INFO:teuthology.orchestra.run.smithi040.stdout:generic/348 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-06-22T12:20:38.789 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/348 2023-06-22T12:20:38.789 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/348 2023-06-22T12:20:38.790 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:20:38.796 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:20:38.840 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:20:38.841 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/349) 2023-06-22T12:20:39.297 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:20:39.309 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:20:39.310 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:20:39.313 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:20:39.313 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:20:39.999 INFO:teuthology.orchestra.run.smithi040.stdout:generic/349 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-06-22T12:20:40.009 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/349 2023-06-22T12:20:40.009 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/349 2023-06-22T12:20:40.009 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:20:40.015 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:20:40.063 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:20:40.064 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/350) 2023-06-22T12:20:40.514 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:20:40.526 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:20:40.527 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:20:40.530 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:20:40.530 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:20:41.806 INFO:teuthology.orchestra.run.smithi040.stdout:generic/350 1s 2023-06-22T12:20:41.819 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/350 2023-06-22T12:20:41.819 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:20:41.825 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:20:41.845 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:20:41.846 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/351) 2023-06-22T12:20:42.300 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:20:42.313 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:20:42.314 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:20:42.316 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:20:42.316 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:20:42.875 INFO:teuthology.orchestra.run.smithi040.stdout:generic/351 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-22T12:20:42.885 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/351 2023-06-22T12:20:42.885 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/351 2023-06-22T12:20:42.885 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:20:42.891 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:20:42.932 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:20:42.933 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/352) 2023-06-22T12:20:43.396 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:20:43.408 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:20:43.409 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:20:43.412 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:20:43.412 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:20:44.309 INFO:teuthology.orchestra.run.smithi040.stdout:generic/352 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:20:44.364 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/352 2023-06-22T12:20:44.364 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/352 2023-06-22T12:20:44.364 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:20:44.379 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:20:44.551 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:20:44.552 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/353) 2023-06-22T12:20:45.033 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:20:45.046 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:20:45.047 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:20:45.049 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:20:45.049 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:20:45.927 INFO:teuthology.orchestra.run.smithi040.stdout:generic/353 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:20:45.967 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/353 2023-06-22T12:20:45.968 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/353 2023-06-22T12:20:45.968 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:20:45.998 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:20:46.193 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:20:46.194 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/354) 2023-06-22T12:20:46.667 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:20:46.679 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:20:46.680 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:20:46.683 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:20:46.683 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:20:57.676 INFO:teuthology.orchestra.run.smithi040.stdout:generic/354 11s 2023-06-22T12:20:57.726 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/354 2023-06-22T12:20:57.726 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:20:57.733 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:20:57.785 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:20:57.786 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/355) 2023-06-22T12:20:58.610 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:20:58.649 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:20:58.650 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:20:58.654 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:20:58.654 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:20:59.726 INFO:teuthology.orchestra.run.smithi040.stdout:generic/355 1s 2023-06-22T12:20:59.739 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/355 2023-06-22T12:20:59.740 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:20:59.745 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:20:59.887 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:20:59.888 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/356) 2023-06-22T12:21:00.593 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:21:00.606 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:21:00.607 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:21:00.609 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:21:00.609 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:01.393 INFO:teuthology.orchestra.run.smithi040.stdout:generic/356 [not run] swapfiles are not supported 2023-06-22T12:21:01.403 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/356 2023-06-22T12:21:01.403 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/356 2023-06-22T12:21:01.403 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:21:01.409 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:01.457 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:21:01.457 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/357) 2023-06-22T12:21:01.919 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:21:01.931 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:21:01.932 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:21:01.935 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:21:01.935 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:02.712 INFO:teuthology.orchestra.run.smithi040.stdout:generic/357 [not run] swapfiles are not supported 2023-06-22T12:21:02.721 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/357 2023-06-22T12:21:02.722 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/357 2023-06-22T12:21:02.722 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:21:02.728 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:02.773 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:21:02.773 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/358) 2023-06-22T12:21:03.234 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:21:03.246 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:21:03.247 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:21:03.250 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:21:03.250 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:04.154 INFO:teuthology.orchestra.run.smithi040.stdout:generic/358 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:21:04.194 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/358 2023-06-22T12:21:04.194 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/358 2023-06-22T12:21:04.194 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:21:04.199 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:04.381 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:21:04.382 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/359) 2023-06-22T12:21:04.870 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:21:04.882 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:21:04.883 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:21:04.886 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:21:04.886 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:05.257 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:21:05.262 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:21:05.772 INFO:teuthology.orchestra.run.smithi040.stdout:generic/359 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:21:05.794 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/359 2023-06-22T12:21:05.795 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/359 2023-06-22T12:21:05.795 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:21:05.806 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:06.026 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:21:06.026 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/360) 2023-06-22T12:21:06.493 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:21:06.505 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:21:06.506 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:21:06.509 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:21:06.509 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:07.109 INFO:teuthology.orchestra.run.smithi040.stdout:generic/360 1s 2023-06-22T12:21:07.124 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/360 2023-06-22T12:21:07.124 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:21:07.130 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:07.179 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:21:07.180 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/361) 2023-06-22T12:21:07.642 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:21:07.654 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:21:07.655 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:21:07.658 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:21:07.658 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:08.180 INFO:teuthology.orchestra.run.smithi040.stdout:generic/361 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-06-22T12:21:08.190 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/361 2023-06-22T12:21:08.190 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/361 2023-06-22T12:21:08.190 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:21:08.196 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:08.236 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:21:08.237 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/362) 2023-06-22T12:21:08.705 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:21:08.717 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:21:08.718 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:21:08.721 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:21:08.721 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:09.225 INFO:teuthology.orchestra.run.smithi040.stdout:generic/362 [not run] this test requires richacl support on $SCRATCH_DEV 2023-06-22T12:21:09.235 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/362 2023-06-22T12:21:09.235 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/362 2023-06-22T12:21:09.235 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:21:09.241 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:09.279 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:21:09.279 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/363) 2023-06-22T12:21:09.743 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:21:09.757 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:21:09.758 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:21:09.760 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:21:09.760 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:10.261 INFO:teuthology.orchestra.run.smithi040.stdout:generic/363 [not run] this test requires richacl support on $SCRATCH_DEV 2023-06-22T12:21:10.270 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/363 2023-06-22T12:21:10.271 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/363 2023-06-22T12:21:10.271 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:21:10.276 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:10.322 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:21:10.323 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/364) 2023-06-22T12:21:10.782 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:21:10.794 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:21:10.795 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:21:10.798 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:21:10.798 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:11.296 INFO:teuthology.orchestra.run.smithi040.stdout:generic/364 [not run] this test requires richacl support on $SCRATCH_DEV 2023-06-22T12:21:11.306 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/364 2023-06-22T12:21:11.307 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/364 2023-06-22T12:21:11.307 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:21:11.312 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:11.349 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:21:11.350 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/365) 2023-06-22T12:21:11.813 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:21:11.825 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:21:11.826 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:21:11.828 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:21:11.829 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:12.340 INFO:teuthology.orchestra.run.smithi040.stdout:generic/365 [not run] this test requires richacl support on $SCRATCH_DEV 2023-06-22T12:21:12.349 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/365 2023-06-22T12:21:12.350 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/365 2023-06-22T12:21:12.350 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:21:12.356 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:12.402 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:21:12.403 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/366) 2023-06-22T12:21:12.860 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:21:12.872 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:21:12.873 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:21:12.875 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:21:12.876 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:13.385 INFO:teuthology.orchestra.run.smithi040.stdout:generic/366 [not run] this test requires richacl support on $SCRATCH_DEV 2023-06-22T12:21:13.397 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/366 2023-06-22T12:21:13.397 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/366 2023-06-22T12:21:13.398 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:21:13.401 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:13.447 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:21:13.448 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/367) 2023-06-22T12:21:13.906 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:21:13.918 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:21:13.919 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:21:13.922 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:21:13.922 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:14.434 INFO:teuthology.orchestra.run.smithi040.stdout:generic/367 [not run] this test requires richacl support on $SCRATCH_DEV 2023-06-22T12:21:14.444 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/367 2023-06-22T12:21:14.444 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/367 2023-06-22T12:21:14.444 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:21:14.450 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:14.490 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:21:14.491 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/368) 2023-06-22T12:21:14.941 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:21:14.954 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:21:14.955 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:21:14.957 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:21:14.957 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:15.459 INFO:teuthology.orchestra.run.smithi040.stdout:generic/368 [not run] this test requires richacl support on $SCRATCH_DEV 2023-06-22T12:21:15.469 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/368 2023-06-22T12:21:15.469 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/368 2023-06-22T12:21:15.469 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:21:15.475 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:15.514 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:21:15.514 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/369) 2023-06-22T12:21:15.974 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:21:15.986 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:21:15.987 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:21:15.989 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:21:15.990 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:16.493 INFO:teuthology.orchestra.run.smithi040.stdout:generic/369 [not run] this test requires richacl support on $SCRATCH_DEV 2023-06-22T12:21:16.503 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/369 2023-06-22T12:21:16.503 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/369 2023-06-22T12:21:16.504 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:21:16.510 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:16.554 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:21:16.555 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/370) 2023-06-22T12:21:17.008 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:21:17.020 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:21:17.021 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:21:17.024 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:21:17.024 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:17.534 INFO:teuthology.orchestra.run.smithi040.stdout:generic/370 [not run] this test requires richacl support on $SCRATCH_DEV 2023-06-22T12:21:17.544 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/370 2023-06-22T12:21:17.544 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/370 2023-06-22T12:21:17.544 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:21:17.550 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:17.590 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:21:17.591 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/371) 2023-06-22T12:21:18.051 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:21:18.064 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:21:18.065 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:21:18.068 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:21:18.068 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:18.604 INFO:teuthology.orchestra.run.smithi040.stdout:generic/371 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-22T12:21:18.614 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/371 2023-06-22T12:21:18.614 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/371 2023-06-22T12:21:18.614 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:21:18.620 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:18.669 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:21:18.669 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/372) 2023-06-22T12:21:19.124 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:21:19.136 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:21:19.137 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:21:19.140 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:21:19.140 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:20.004 INFO:teuthology.orchestra.run.smithi040.stdout:generic/372 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:21:20.044 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/372 2023-06-22T12:21:20.044 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/372 2023-06-22T12:21:20.044 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:21:20.060 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:20.274 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:21:20.275 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/373) 2023-06-22T12:21:20.740 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:21:20.753 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:21:20.754 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:21:20.756 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:21:20.756 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:21.648 INFO:teuthology.orchestra.run.smithi040.stdout:generic/373 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:21:21.681 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/373 2023-06-22T12:21:21.681 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/373 2023-06-22T12:21:21.681 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:21:21.708 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:21.902 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:21:21.903 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/374) 2023-06-22T12:21:22.375 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:21:22.388 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:21:22.389 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:21:22.392 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:21:22.392 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:23.135 INFO:teuthology.orchestra.run.smithi040.stdout:generic/374 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-06-22T12:21:23.285 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/374 2023-06-22T12:21:23.285 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/374 2023-06-22T12:21:23.285 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:21:23.304 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:23.568 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:21:23.568 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/375) 2023-06-22T12:21:24.037 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:21:24.049 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:21:24.050 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:21:24.053 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:21:24.053 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:24.719 INFO:teuthology.orchestra.run.smithi040.stdout:generic/375 0s 2023-06-22T12:21:24.732 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/375 2023-06-22T12:21:24.733 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:21:24.738 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:24.883 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:21:24.883 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/376) 2023-06-22T12:21:25.568 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:21:25.581 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:21:25.582 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:21:25.584 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:21:25.585 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:26.119 INFO:teuthology.orchestra.run.smithi040.stdout:generic/376 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-06-22T12:21:26.129 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/376 2023-06-22T12:21:26.129 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/376 2023-06-22T12:21:26.129 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:21:26.135 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:26.183 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:21:26.183 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/377) 2023-06-22T12:21:26.634 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:21:26.647 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:21:26.648 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:21:26.650 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:21:26.651 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:27.480 INFO:teuthology.orchestra.run.smithi040.stdout:generic/377 1s 2023-06-22T12:21:27.493 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/377 2023-06-22T12:21:27.493 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:21:27.499 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:27.519 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:21:27.520 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/378) 2023-06-22T12:21:27.982 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:21:27.994 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:21:27.995 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:21:27.998 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:21:27.998 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:28.859 INFO:teuthology.orchestra.run.smithi040.stdout:generic/378 0s 2023-06-22T12:21:28.872 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/378 2023-06-22T12:21:28.872 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:21:28.877 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:29.025 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:21:29.025 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/379) 2023-06-22T12:21:29.718 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:21:29.731 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:21:29.732 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:21:29.734 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:21:29.734 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:30.258 INFO:teuthology.orchestra.run.smithi040.stdout:generic/379 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-22T12:21:30.268 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/379 2023-06-22T12:21:30.268 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/379 2023-06-22T12:21:30.268 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:21:30.274 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:30.308 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:21:30.309 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/380) 2023-06-22T12:21:30.767 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:21:30.779 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:21:30.780 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:21:30.783 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:21:30.783 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:31.288 INFO:teuthology.orchestra.run.smithi040.stdout:generic/380 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-22T12:21:31.298 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/380 2023-06-22T12:21:31.299 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/380 2023-06-22T12:21:31.299 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:21:31.304 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:31.342 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:21:31.342 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/381) 2023-06-22T12:21:31.796 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:21:31.808 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:21:31.809 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:21:31.812 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:21:31.812 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:32.319 INFO:teuthology.orchestra.run.smithi040.stdout:generic/381 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-22T12:21:32.329 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/381 2023-06-22T12:21:32.329 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/381 2023-06-22T12:21:32.329 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:21:32.335 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:32.374 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:21:32.375 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/382) 2023-06-22T12:21:32.829 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:21:32.841 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:21:32.842 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:21:32.845 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:21:32.845 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:33.349 INFO:teuthology.orchestra.run.smithi040.stdout:generic/382 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-22T12:21:33.359 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/382 2023-06-22T12:21:33.359 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/382 2023-06-22T12:21:33.359 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:21:33.365 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:33.409 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:21:33.409 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/383) 2023-06-22T12:21:33.869 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:21:33.881 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:21:33.882 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:21:33.885 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:21:33.885 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:34.401 INFO:teuthology.orchestra.run.smithi040.stdout:generic/383 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-22T12:21:34.410 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/383 2023-06-22T12:21:34.411 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/383 2023-06-22T12:21:34.411 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:21:34.416 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:34.457 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:21:34.458 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/384) 2023-06-22T12:21:34.918 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:21:34.930 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:21:34.931 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:21:34.934 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:21:34.934 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:35.363 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:21:35.367 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:21:35.464 INFO:teuthology.orchestra.run.smithi040.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-22T12:21:35.474 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/384 2023-06-22T12:21:35.474 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/384 2023-06-22T12:21:35.475 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:21:35.481 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:35.518 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:21:35.519 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/385) 2023-06-22T12:21:36.017 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:21:36.029 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:21:36.030 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:21:36.033 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:21:36.033 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:36.547 INFO:teuthology.orchestra.run.smithi040.stdout:generic/385 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-22T12:21:36.557 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/385 2023-06-22T12:21:36.557 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/385 2023-06-22T12:21:36.557 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:21:36.563 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:36.606 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:21:36.606 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/386) 2023-06-22T12:21:37.066 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:21:37.078 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:21:37.079 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:21:37.082 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:21:37.082 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:37.592 INFO:teuthology.orchestra.run.smithi040.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-22T12:21:37.601 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/386 2023-06-22T12:21:37.601 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/386 2023-06-22T12:21:37.602 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:21:37.607 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:37.646 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:21:37.647 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/387) 2023-06-22T12:21:38.099 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:21:38.111 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:21:38.112 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:21:38.115 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:21:38.115 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:39.020 INFO:teuthology.orchestra.run.smithi040.stdout:generic/387 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:21:39.053 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/387 2023-06-22T12:21:39.054 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/387 2023-06-22T12:21:39.054 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:21:39.062 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:39.286 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:21:39.286 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/388) 2023-06-22T12:21:39.749 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:21:39.761 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:21:39.762 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:21:39.765 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:21:39.765 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:40.323 INFO:teuthology.orchestra.run.smithi040.stdout:generic/388 [not run] require 172.21.15.40:6789:/scratch to be local device 2023-06-22T12:21:40.333 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/388 2023-06-22T12:21:40.333 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/388 2023-06-22T12:21:40.333 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:21:40.339 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:40.379 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:21:40.380 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/389) 2023-06-22T12:21:40.835 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:21:40.848 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:21:40.849 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:21:40.851 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:21:40.852 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:41.381 INFO:teuthology.orchestra.run.smithi040.stdout:generic/389 [not run] O_TMPFILE is not supported 2023-06-22T12:21:41.391 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/389 2023-06-22T12:21:41.391 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/389 2023-06-22T12:21:41.391 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:21:41.397 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:41.435 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:21:41.436 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/390) 2023-06-22T12:21:41.897 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:21:41.909 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:21:41.910 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:21:41.913 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:21:41.913 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:42.461 INFO:teuthology.orchestra.run.smithi040.stdout:generic/390 [not run] ceph does not support freezing 2023-06-22T12:21:42.470 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/390 2023-06-22T12:21:42.471 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/390 2023-06-22T12:21:42.471 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:21:42.477 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:42.523 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:21:42.524 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/391) 2023-06-22T12:21:42.979 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:21:42.991 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:21:42.992 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:21:42.995 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:21:42.995 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:43.532 INFO:teuthology.orchestra.run.smithi040.stdout:generic/391 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-22T12:21:43.542 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/391 2023-06-22T12:21:43.542 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/391 2023-06-22T12:21:43.542 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:21:43.549 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:43.597 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:21:43.597 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/392) 2023-06-22T12:21:44.047 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:21:44.060 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:21:44.061 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:21:44.063 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:21:44.063 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:44.737 INFO:teuthology.orchestra.run.smithi040.stdout:generic/392 [not run] ceph does not support shutdown 2023-06-22T12:21:44.765 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/392 2023-06-22T12:21:44.765 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/392 2023-06-22T12:21:44.766 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:21:44.771 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:44.810 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:21:44.811 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/393) 2023-06-22T12:21:45.267 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:21:45.279 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:21:45.280 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:21:45.282 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:21:45.283 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:46.649 INFO:teuthology.orchestra.run.smithi040.stdout:generic/393 1s 2023-06-22T12:21:46.662 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/393 2023-06-22T12:21:46.662 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:21:46.668 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:46.689 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:21:46.689 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/394) 2023-06-22T12:21:47.155 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:21:47.167 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:21:47.168 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:21:47.171 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:21:47.171 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:47.766 INFO:teuthology.orchestra.run.smithi040.stdout:generic/394 0s 2023-06-22T12:21:47.778 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/394 2023-06-22T12:21:47.779 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:21:47.784 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:47.970 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:21:47.970 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/395) 2023-06-22T12:21:48.645 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:21:48.670 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:21:48.671 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:21:48.674 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:21:48.675 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:50.890 INFO:teuthology.orchestra.run.smithi040.stdout:generic/395 2s 2023-06-22T12:21:50.944 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/395 2023-06-22T12:21:50.944 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:21:50.955 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:51.019 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:21:51.020 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/396) 2023-06-22T12:21:51.561 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:21:51.573 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:21:51.574 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:21:51.577 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:21:51.577 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:52.796 INFO:teuthology.orchestra.run.smithi040.stdout:generic/396 1s 2023-06-22T12:21:52.809 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/396 2023-06-22T12:21:52.809 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:21:52.815 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:52.835 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:21:52.836 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/397) 2023-06-22T12:21:53.292 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:21:53.304 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:21:53.305 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:21:53.308 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:21:53.308 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:55.411 INFO:teuthology.orchestra.run.smithi040.stdout:generic/397 2s 2023-06-22T12:21:55.424 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/397 2023-06-22T12:21:55.424 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:21:55.430 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:55.450 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:21:55.451 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/398) 2023-06-22T12:21:55.910 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:21:55.923 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:21:55.924 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:21:55.926 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:21:55.926 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:56.847 INFO:teuthology.orchestra.run.smithi040.stdout:generic/398 [not run] kernel doesn't support renameat2 syscall 2023-06-22T12:21:56.857 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/398 2023-06-22T12:21:56.858 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/398 2023-06-22T12:21:56.858 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:21:56.864 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:56.986 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:21:56.986 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/399) 2023-06-22T12:21:57.695 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:21:57.707 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:21:57.708 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:21:57.711 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:21:57.711 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:58.579 INFO:teuthology.orchestra.run.smithi040.stdout:generic/399 [not run] Filesystem ceph not supported in _scratch_mkfs_sized_encrypted 2023-06-22T12:21:58.589 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/399 2023-06-22T12:21:58.589 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/399 2023-06-22T12:21:58.589 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:21:58.595 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:58.634 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:21:58.634 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/400) 2023-06-22T12:21:59.089 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:21:59.102 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:21:59.103 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:21:59.105 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:21:59.105 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:59.608 INFO:teuthology.orchestra.run.smithi040.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-22T12:21:59.617 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/400 2023-06-22T12:21:59.618 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/400 2023-06-22T12:21:59.618 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:21:59.624 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:21:59.661 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:21:59.661 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/401) 2023-06-22T12:22:00.121 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:22:00.134 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:22:00.135 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:22:00.137 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:22:00.137 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:22:01.151 INFO:teuthology.orchestra.run.smithi040.stdout:generic/401 1s 2023-06-22T12:22:01.217 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/401 2023-06-22T12:22:01.217 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:22:01.239 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:22:01.300 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:22:01.301 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/402) 2023-06-22T12:22:01.840 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:22:01.852 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:22:01.853 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:22:01.856 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:22:01.856 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:22:02.591 INFO:teuthology.orchestra.run.smithi040.stdout:generic/402 [not run] filesystem ceph timestamp bounds are unknown 2023-06-22T12:22:02.617 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/402 2023-06-22T12:22:02.617 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/402 2023-06-22T12:22:02.617 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:22:02.623 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:22:02.673 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:22:02.674 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/403) 2023-06-22T12:22:03.131 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:22:03.144 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:22:03.145 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:22:03.148 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:22:03.148 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:22:04.342 INFO:teuthology.orchestra.run.smithi040.stdout:generic/403 1s 2023-06-22T12:22:04.355 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/403 2023-06-22T12:22:04.355 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:22:04.361 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:22:04.381 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:22:04.382 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/404) 2023-06-22T12:22:04.836 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:22:04.848 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:22:04.849 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:22:04.852 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:22:04.852 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:22:05.394 INFO:teuthology.orchestra.run.smithi040.stdout:generic/404 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-22T12:22:05.404 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/404 2023-06-22T12:22:05.404 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/404 2023-06-22T12:22:05.405 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:22:05.410 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:22:05.455 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:22:05.456 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/405) 2023-06-22T12:22:05.473 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:22:05.509 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:22:05.925 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:22:05.937 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:22:05.938 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:22:05.940 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:22:05.941 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:22:06.560 INFO:teuthology.orchestra.run.smithi040.stdout:generic/405 [not run] require 172.21.15.40:6789:/scratch to be valid block disk 2023-06-22T12:22:06.570 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/405 2023-06-22T12:22:06.570 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/405 2023-06-22T12:22:06.570 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:22:06.576 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:22:06.617 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:22:06.618 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/406) 2023-06-22T12:22:07.074 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:22:07.086 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:22:07.087 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:22:07.089 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:22:07.090 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:22:09.428 INFO:teuthology.orchestra.run.smithi040.stdout:generic/406 2s 2023-06-22T12:22:09.441 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/406 2023-06-22T12:22:09.442 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:22:09.447 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:22:09.467 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:22:09.468 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/407) 2023-06-22T12:22:09.923 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:22:09.936 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:22:09.937 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:22:09.939 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:22:09.940 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:22:10.549 INFO:teuthology.orchestra.run.smithi040.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph 2023-06-22T12:22:10.559 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/407 2023-06-22T12:22:10.559 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/407 2023-06-22T12:22:10.559 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:22:10.565 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:22:10.722 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:22:10.723 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/408) 2023-06-22T12:22:11.470 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:22:11.482 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:22:11.483 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:22:11.486 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:22:11.486 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:22:12.075 INFO:teuthology.orchestra.run.smithi040.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph 2023-06-22T12:22:12.084 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/408 2023-06-22T12:22:12.085 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/408 2023-06-22T12:22:12.085 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:22:12.091 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:22:12.221 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:22:12.222 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/409) 2023-06-22T12:22:12.916 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:22:12.928 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:22:12.929 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:22:12.932 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:22:12.932 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:22:13.451 INFO:teuthology.orchestra.run.smithi040.stdout:generic/409 [not run] require 172.21.15.40:6789:/scratch to be local device 2023-06-22T12:22:13.461 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/409 2023-06-22T12:22:13.461 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/409 2023-06-22T12:22:13.462 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:22:13.467 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:22:13.504 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:22:13.505 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/410) 2023-06-22T12:22:13.968 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:22:13.980 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:22:13.981 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:22:13.984 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:22:13.984 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:22:14.509 INFO:teuthology.orchestra.run.smithi040.stdout:generic/410 [not run] require 172.21.15.40:6789:/scratch to be local device 2023-06-22T12:22:14.519 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/410 2023-06-22T12:22:14.520 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/410 2023-06-22T12:22:14.520 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:22:14.526 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:22:14.566 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:22:14.567 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/411) 2023-06-22T12:22:15.022 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:22:15.034 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:22:15.035 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:22:15.038 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:22:15.038 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:22:15.565 INFO:teuthology.orchestra.run.smithi040.stdout:generic/411 [not run] require 172.21.15.40:6789:/scratch to be local device 2023-06-22T12:22:15.575 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/411 2023-06-22T12:22:15.575 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/411 2023-06-22T12:22:15.575 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:22:15.581 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:22:15.625 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:22:15.626 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/412) 2023-06-22T12:22:16.080 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:22:16.092 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:22:16.093 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:22:16.096 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:22:16.096 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:22:17.070 INFO:teuthology.orchestra.run.smithi040.stdout:generic/412 1s 2023-06-22T12:22:17.083 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/412 2023-06-22T12:22:17.083 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:22:17.089 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:22:17.109 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:22:17.110 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/413) 2023-06-22T12:22:17.564 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:22:17.578 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:22:17.578 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:22:17.580 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:22:17.581 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:22:18.245 INFO:teuthology.orchestra.run.smithi040.stdout:generic/413 [not run] mount 172.21.15.40:6789:/scratch with dax failed 2023-06-22T12:22:18.255 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/413 2023-06-22T12:22:18.255 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/413 2023-06-22T12:22:18.255 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:22:18.261 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:22:18.298 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:22:18.299 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/414) 2023-06-22T12:22:18.757 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:22:18.769 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:22:18.770 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:22:18.772 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:22:18.773 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:22:19.660 INFO:teuthology.orchestra.run.smithi040.stdout:generic/414 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:22:19.691 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/414 2023-06-22T12:22:19.691 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/414 2023-06-22T12:22:19.691 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:22:19.720 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:22:19.924 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:22:19.927 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/415) 2023-06-22T12:22:20.391 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:22:20.403 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:22:20.404 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:22:20.407 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:22:20.407 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:22:21.318 INFO:teuthology.orchestra.run.smithi040.stdout:generic/415 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-22T12:22:21.362 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/415 2023-06-22T12:22:21.362 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/415 2023-06-22T12:22:21.362 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:22:21.370 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:22:21.552 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:22:21.553 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/416) 2023-06-22T12:22:22.023 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:22:22.035 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:22:22.036 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:22:22.038 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:22:22.039 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:22:22.554 INFO:teuthology.orchestra.run.smithi040.stdout:generic/416 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-22T12:22:22.564 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/416 2023-06-22T12:22:22.564 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/416 2023-06-22T12:22:22.564 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:22:22.570 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:22:22.612 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:22:22.613 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/417) 2023-06-22T12:22:23.067 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:22:23.079 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:22:23.080 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:22:23.083 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:22:23.083 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:22:23.758 INFO:teuthology.orchestra.run.smithi040.stdout:generic/417 [not run] ceph does not support shutdown 2023-06-22T12:22:23.803 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/417 2023-06-22T12:22:23.803 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/417 2023-06-22T12:22:23.803 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:22:23.809 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:22:23.848 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:22:23.849 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/418) 2023-06-22T12:22:24.305 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:22:24.317 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:22:24.318 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:22:24.321 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:22:24.321 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:22:24.880 INFO:teuthology.orchestra.run.smithi040.stdout:generic/418 [not run] require 172.21.15.40:6789:/test to be valid block disk 2023-06-22T12:22:24.890 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/418 2023-06-22T12:22:24.891 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/418 2023-06-22T12:22:24.891 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:22:24.896 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:22:24.950 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:22:24.951 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/419) 2023-06-22T12:22:25.401 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:22:25.413 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:22:25.414 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:22:25.417 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:22:25.417 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:22:26.297 INFO:teuthology.orchestra.run.smithi040.stdout:generic/419 [not run] kernel doesn't support renameat2 syscall 2023-06-22T12:22:26.307 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/419 2023-06-22T12:22:26.307 INFO:teuthology.orchestra.run.smithi040.stdout:Not run: generic/419 2023-06-22T12:22:26.307 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:22:26.313 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:22:26.481 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:22:26.482 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/420) 2023-06-22T12:22:27.157 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:22:27.169 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:22:27.170 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:22:27.173 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:22:27.173 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:22:27.887 INFO:teuthology.orchestra.run.smithi040.stdout:generic/420 0s 2023-06-22T12:22:27.899 INFO:teuthology.orchestra.run.smithi040.stdout:Ran: generic/420 2023-06-22T12:22:27.900 INFO:teuthology.orchestra.run.smithi040.stdout:Passed all 1 tests 2023-06-22T12:22:27.906 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:22:28.046 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-22T12:22:28.046 DEBUG:teuthology.orchestra.run.smithi040:> (cd /tmp/tmp.a4ZvvHFGMPxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/421) 2023-06-22T12:22:28.744 INFO:teuthology.orchestra.run.smithi040.stdout:FSTYP -- ceph 2023-06-22T12:22:28.756 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM -- Linux/x86_64 smithi040 6.4.0-rc5-g1c622d92b6f1 #1 SMP PREEMPT_DYNAMIC Mon Jun 19 23:15:00 UTC 2023 2023-06-22T12:22:28.757 INFO:teuthology.orchestra.run.smithi040.stdout:MKFS_OPTIONS -- 172.21.15.40:6789:/scratch 2023-06-22T12:22:28.759 INFO:teuthology.orchestra.run.smithi040.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDrJ5Rk/3yPCBAAE+1uOT/GGBgK2rHQurkBOg== -o context=system_u:object_r:root_t:s0 172.21.15.40:6789:/scratch /tmp/tmp.6nIBYnNpfBscratch 2023-06-22T12:22:28.759 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-06-22T12:22:35.627 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:22:35.632 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:23:05.757 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:23:05.766 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:23:35.878 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:23:35.883 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:24:05.995 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:24:05.999 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:24:06.105 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T12:24:06.102+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121174) UID: 0 2023-06-22T12:24:06.105 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T12:24:06.103+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121174) UID: 0 2023-06-22T12:24:06.105 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T12:24:06.103+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121174) UID: 0 2023-06-22T12:24:06.106 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T12:24:06.103+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121174) UID: 0 2023-06-22T12:27:38.157 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:27:38.163 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:27:38.353 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T12:27:38.351+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121227) UID: 0 2023-06-22T12:27:38.354 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T12:27:38.351+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121227) UID: 0 2023-06-22T12:27:38.354 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T12:27:38.351+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121227) UID: 0 2023-06-22T12:27:38.354 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T12:27:38.351+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121227) UID: 0 2023-06-22T12:30:13.014 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:30:13.019 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:30:43.834 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:30:43.840 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:30:43.934 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T12:30:43.931+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121305) UID: 0 2023-06-22T12:30:43.935 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T12:30:43.931+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121305) UID: 0 2023-06-22T12:30:43.935 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T12:30:43.931+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121305) UID: 0 2023-06-22T12:30:43.935 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T12:30:43.931+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121305) UID: 0 2023-06-22T12:33:05.511 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:33:05.516 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:33:35.623 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:33:35.628 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:34:07.214 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:34:07.220 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:34:07.318 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T12:34:07.315+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121414) UID: 0 2023-06-22T12:34:07.319 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T12:34:07.316+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121414) UID: 0 2023-06-22T12:34:07.319 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T12:34:07.316+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121414) UID: 0 2023-06-22T12:34:07.319 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T12:34:07.316+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121414) UID: 0 2023-06-22T12:36:37.812 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:36:37.817 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:37:08.476 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:37:08.481 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:37:08.572 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T12:37:08.569+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121491) UID: 0 2023-06-22T12:37:08.572 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T12:37:08.569+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121491) UID: 0 2023-06-22T12:37:08.573 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T12:37:08.569+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121491) UID: 0 2023-06-22T12:37:08.573 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T12:37:08.569+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121491) UID: 0 2023-06-22T12:39:25.701 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:39:25.706 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:39:55.819 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:39:55.824 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:40:25.936 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:40:25.941 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:40:26.040 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T12:40:26.037+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121593) UID: 0 2023-06-22T12:40:26.040 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T12:40:26.038+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121593) UID: 0 2023-06-22T12:40:26.041 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T12:40:26.038+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121593) UID: 0 2023-06-22T12:40:26.041 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T12:40:26.038+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121593) UID: 0 2023-06-22T12:42:52.786 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:42:52.792 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:43:22.907 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:43:22.912 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:43:23.010 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T12:43:23.008+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121671) UID: 0 2023-06-22T12:43:23.010 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T12:43:23.008+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121671) UID: 0 2023-06-22T12:43:23.011 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T12:43:23.008+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121671) UID: 0 2023-06-22T12:43:23.011 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T12:43:23.008+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121671) UID: 0 2023-06-22T12:45:37.681 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:45:37.686 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:46:07.793 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:46:07.798 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:46:39.093 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:46:39.098 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:46:39.190 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T12:46:39.188+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121771) UID: 0 2023-06-22T12:46:39.191 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T12:46:39.188+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121771) UID: 0 2023-06-22T12:46:39.191 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T12:46:39.188+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121771) UID: 0 2023-06-22T12:46:39.192 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T12:46:39.188+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121771) UID: 0 2023-06-22T12:49:06.718 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:49:06.723 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:49:36.846 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:49:36.850 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:49:36.946 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T12:49:36.943+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121846) UID: 0 2023-06-22T12:49:36.946 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T12:49:36.944+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121846) UID: 0 2023-06-22T12:49:36.946 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T12:49:36.944+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121846) UID: 0 2023-06-22T12:49:36.947 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T12:49:36.944+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121846) UID: 0 2023-06-22T12:51:51.206 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:51:51.210 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:52:21.311 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:52:21.315 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:52:52.324 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:52:52.330 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:52:52.422 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T12:52:52.420+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121957) UID: 0 2023-06-22T12:52:52.423 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T12:52:52.420+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121957) UID: 0 2023-06-22T12:52:52.423 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T12:52:52.420+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121957) UID: 0 2023-06-22T12:52:52.424 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T12:52:52.420+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121957) UID: 0 2023-06-22T12:55:17.208 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:55:17.213 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:55:47.331 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:55:47.336 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:56:17.452 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:56:17.457 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:56:17.551 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T12:56:17.548+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122056) UID: 0 2023-06-22T12:56:17.551 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T12:56:17.548+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122056) UID: 0 2023-06-22T12:56:17.552 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T12:56:17.548+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122056) UID: 0 2023-06-22T12:56:17.552 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T12:56:17.548+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122056) UID: 0 2023-06-22T12:58:46.948 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:58:46.954 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:59:17.066 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:59:17.071 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T12:59:17.166 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T12:59:17.163+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122133) UID: 0 2023-06-22T12:59:17.166 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T12:59:17.163+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122133) UID: 0 2023-06-22T12:59:17.167 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T12:59:17.164+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122133) UID: 0 2023-06-22T12:59:17.167 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T12:59:17.164+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122133) UID: 0 2023-06-22T13:01:33.800 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:01:33.805 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:02:03.921 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:02:03.926 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:02:35.627 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:02:35.632 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:02:35.727 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T13:02:35.723+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122247) UID: 0 2023-06-22T13:02:35.727 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T13:02:35.723+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122247) UID: 0 2023-06-22T13:02:35.728 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T13:02:35.723+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122247) UID: 0 2023-06-22T13:02:35.728 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T13:02:35.723+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122247) UID: 0 2023-06-22T13:05:05.418 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:05:05.423 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:05:35.532 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:05:35.537 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:05:35.629 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T13:05:35.626+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122323) UID: 0 2023-06-22T13:05:35.630 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T13:05:35.626+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122323) UID: 0 2023-06-22T13:05:35.630 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T13:05:35.626+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122323) UID: 0 2023-06-22T13:05:35.631 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T13:05:35.626+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122323) UID: 0 2023-06-22T13:07:52.415 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:07:52.420 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:08:22.530 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:08:22.534 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:08:52.654 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:08:52.659 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:08:52.756 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T13:08:52.754+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122430) UID: 0 2023-06-22T13:08:52.757 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T13:08:52.754+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122430) UID: 0 2023-06-22T13:08:52.757 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T13:08:52.754+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122430) UID: 0 2023-06-22T13:08:52.758 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T13:08:52.754+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122430) UID: 0 2023-06-22T13:11:18.561 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:11:18.567 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:11:48.681 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:11:48.687 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:11:48.788 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T13:11:48.785+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122511) UID: 0 2023-06-22T13:11:48.789 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T13:11:48.785+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122511) UID: 0 2023-06-22T13:11:48.789 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T13:11:48.785+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122511) UID: 0 2023-06-22T13:11:48.789 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T13:11:48.786+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122511) UID: 0 2023-06-22T13:14:05.160 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:14:05.165 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:14:35.291 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:14:35.296 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:15:05.434 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:15:05.439 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:15:05.534 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T13:15:05.532+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122610) UID: 0 2023-06-22T13:15:05.535 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T13:15:05.532+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122610) UID: 0 2023-06-22T13:15:05.536 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T13:15:05.532+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122610) UID: 0 2023-06-22T13:15:05.537 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T13:15:05.532+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122610) UID: 0 2023-06-22T13:17:29.918 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:17:29.928 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:18:03.131 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:18:03.136 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:18:03.233 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T13:18:03.231+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122687) UID: 0 2023-06-22T13:18:03.234 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T13:18:03.231+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122687) UID: 0 2023-06-22T13:18:03.234 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T13:18:03.231+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122687) UID: 0 2023-06-22T13:18:03.235 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T13:18:03.231+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122687) UID: 0 2023-06-22T13:20:21.516 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:20:21.520 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:20:51.637 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:20:51.642 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:21:23.018 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:21:23.023 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:21:23.114 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T13:21:23.112+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122790) UID: 0 2023-06-22T13:21:23.115 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T13:21:23.112+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122790) UID: 0 2023-06-22T13:21:23.115 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T13:21:23.112+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122790) UID: 0 2023-06-22T13:21:23.116 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T13:21:23.112+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122790) UID: 0 2023-06-22T13:23:50.267 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:23:50.272 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:24:20.397 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:24:20.402 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:24:20.492 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T13:24:20.489+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122866) UID: 0 2023-06-22T13:24:20.492 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T13:24:20.489+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122866) UID: 0 2023-06-22T13:24:20.493 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T13:24:20.490+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122866) UID: 0 2023-06-22T13:24:20.493 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T13:24:20.490+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122866) UID: 0 2023-06-22T13:26:36.655 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:26:36.661 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:27:06.776 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:27:06.781 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:27:36.895 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:27:36.899 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:27:36.990 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T13:27:36.988+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122965) UID: 0 2023-06-22T13:27:36.991 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T13:27:36.988+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122965) UID: 0 2023-06-22T13:27:36.991 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T13:27:36.988+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122965) UID: 0 2023-06-22T13:27:36.991 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T13:27:36.988+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122965) UID: 0 2023-06-22T13:30:04.481 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:30:04.487 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:30:38.115 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:30:38.120 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:30:38.217 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T13:30:38.214+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123046) UID: 0 2023-06-22T13:30:38.217 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T13:30:38.214+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123046) UID: 0 2023-06-22T13:30:38.218 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T13:30:38.214+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123046) UID: 0 2023-06-22T13:30:38.218 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T13:30:38.214+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123046) UID: 0 2023-06-22T13:32:55.704 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:32:55.713 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:33:25.930 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:33:25.934 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:33:57.574 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:33:57.578 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:33:57.673 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T13:33:57.670+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123153) UID: 0 2023-06-22T13:33:57.674 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T13:33:57.670+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123153) UID: 0 2023-06-22T13:33:57.674 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T13:33:57.670+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123153) UID: 0 2023-06-22T13:33:57.675 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T13:33:57.670+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123153) UID: 0 2023-06-22T13:36:31.189 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:36:31.194 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:37:01.295 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:37:01.299 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:37:01.394 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T13:37:01.392+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123230) UID: 0 2023-06-22T13:37:01.395 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T13:37:01.392+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123230) UID: 0 2023-06-22T13:37:01.395 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T13:37:01.392+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123230) UID: 0 2023-06-22T13:37:01.396 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T13:37:01.392+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123230) UID: 0 2023-06-22T13:39:18.029 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:39:18.034 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:39:48.140 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:39:48.145 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:40:19.856 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:40:19.861 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:40:19.955 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T13:40:19.953+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123331) UID: 0 2023-06-22T13:40:19.956 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T13:40:19.953+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123331) UID: 0 2023-06-22T13:40:19.957 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T13:40:19.953+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123331) UID: 0 2023-06-22T13:40:19.957 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T13:40:19.953+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123331) UID: 0 2023-06-22T13:42:49.588 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:42:49.605 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:43:19.739 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:43:19.744 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:43:19.841 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T13:43:19.838+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123408) UID: 0 2023-06-22T13:43:19.841 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T13:43:19.838+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123408) UID: 0 2023-06-22T13:43:19.841 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T13:43:19.839+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123408) UID: 0 2023-06-22T13:43:19.842 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T13:43:19.839+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123408) UID: 0 2023-06-22T13:45:37.962 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:45:37.967 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:46:08.099 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:46:08.104 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:46:38.250 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:46:38.255 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:46:38.354 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T13:46:38.352+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123510) UID: 0 2023-06-22T13:46:38.355 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T13:46:38.352+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123510) UID: 0 2023-06-22T13:46:38.355 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T13:46:38.352+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123510) UID: 0 2023-06-22T13:46:38.356 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T13:46:38.352+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123510) UID: 0 2023-06-22T13:49:06.688 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:49:06.695 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:49:36.797 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:49:36.801 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:49:36.898 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T13:49:36.896+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123585) UID: 0 2023-06-22T13:49:36.898 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T13:49:36.896+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123585) UID: 0 2023-06-22T13:49:36.899 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T13:49:36.896+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123585) UID: 0 2023-06-22T13:49:36.899 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T13:49:36.896+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123585) UID: 0 2023-06-22T13:51:50.636 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:51:50.641 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:52:20.766 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:52:20.771 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:52:51.881 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:52:51.887 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:52:51.980 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T13:52:51.978+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123697) UID: 0 2023-06-22T13:52:51.981 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T13:52:51.978+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123697) UID: 0 2023-06-22T13:52:51.981 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T13:52:51.978+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123697) UID: 0 2023-06-22T13:52:51.981 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T13:52:51.978+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123697) UID: 0 2023-06-22T13:55:18.941 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:55:18.946 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:55:49.061 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:55:49.066 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:55:49.161 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T13:55:49.159+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123774) UID: 0 2023-06-22T13:55:49.161 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T13:55:49.159+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123774) UID: 0 2023-06-22T13:55:49.162 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T13:55:49.159+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123774) UID: 0 2023-06-22T13:55:49.162 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T13:55:49.159+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123774) UID: 0 2023-06-22T13:58:04.545 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:58:04.550 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:58:34.667 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:58:34.672 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:59:04.790 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:59:04.794 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T13:59:04.889 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T13:59:04.887+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123873) UID: 0 2023-06-22T13:59:04.889 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T13:59:04.887+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123873) UID: 0 2023-06-22T13:59:04.890 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T13:59:04.887+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123873) UID: 0 2023-06-22T13:59:04.890 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T13:59:04.887+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123873) UID: 0 2023-06-22T14:01:29.883 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:01:29.889 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:02:00.003 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:02:00.008 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:02:00.106 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T14:02:00.103+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123961) UID: 0 2023-06-22T14:02:00.106 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T14:02:00.103+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123961) UID: 0 2023-06-22T14:02:00.107 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T14:02:00.103+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123961) UID: 0 2023-06-22T14:02:00.107 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T14:02:00.103+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123961) UID: 0 2023-06-22T14:04:13.198 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:04:13.202 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:04:43.321 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:04:43.326 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:05:14.558 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:05:14.564 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:05:14.662 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T14:05:14.660+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124061) UID: 0 2023-06-22T14:05:14.662 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T14:05:14.660+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124061) UID: 0 2023-06-22T14:05:14.663 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T14:05:14.660+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124061) UID: 0 2023-06-22T14:05:14.663 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T14:05:14.660+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124061) UID: 0 2023-06-22T14:07:40.632 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:07:40.637 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:08:10.821 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:08:10.826 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:08:10.925 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T14:08:10.923+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124136) UID: 0 2023-06-22T14:08:10.926 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T14:08:10.923+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124136) UID: 0 2023-06-22T14:08:10.927 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T14:08:10.923+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124136) UID: 0 2023-06-22T14:08:10.927 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T14:08:10.924+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124136) UID: 0 2023-06-22T14:10:29.557 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:10:29.564 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:10:59.696 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:10:59.704 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:11:31.244 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:11:31.253 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:11:31.350 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T14:11:31.347+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124242) UID: 0 2023-06-22T14:11:31.350 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T14:11:31.347+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124242) UID: 0 2023-06-22T14:11:31.351 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T14:11:31.347+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124242) UID: 0 2023-06-22T14:11:31.351 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T14:11:31.347+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124242) UID: 0 2023-06-22T14:13:58.811 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:13:58.816 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:14:28.933 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:14:28.938 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:14:29.032 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T14:14:29.030+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124318) UID: 0 2023-06-22T14:14:29.032 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T14:14:29.030+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124318) UID: 0 2023-06-22T14:14:29.033 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T14:14:29.030+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124318) UID: 0 2023-06-22T14:14:29.033 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T14:14:29.030+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124318) UID: 0 2023-06-22T14:16:43.460 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:16:43.465 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:17:13.582 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:17:13.587 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:17:44.831 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:17:44.836 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:17:44.929 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T14:17:44.928+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124418) UID: 0 2023-06-22T14:17:44.930 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T14:17:44.928+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124418) UID: 0 2023-06-22T14:17:44.930 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T14:17:44.928+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124418) UID: 0 2023-06-22T14:17:44.931 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T14:17:44.928+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124418) UID: 0 2023-06-22T14:20:09.565 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:20:09.570 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:20:39.694 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:20:39.698 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:20:39.796 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T14:20:39.794+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124498) UID: 0 2023-06-22T14:20:39.796 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T14:20:39.794+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124498) UID: 0 2023-06-22T14:20:39.797 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T14:20:39.794+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124498) UID: 0 2023-06-22T14:20:39.797 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T14:20:39.794+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124498) UID: 0 2023-06-22T14:22:53.398 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:22:53.403 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:23:23.510 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:23:23.549 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:23:53.910 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:23:53.915 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:23:54.018 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T14:23:54.016+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124607) UID: 0 2023-06-22T14:23:54.018 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T14:23:54.016+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124607) UID: 0 2023-06-22T14:23:54.019 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T14:23:54.016+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124607) UID: 0 2023-06-22T14:23:54.019 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T14:23:54.016+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124607) UID: 0 2023-06-22T14:26:18.886 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:26:18.891 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:26:48.998 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:26:49.004 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:27:19.121 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:27:19.127 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:27:19.227 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T14:27:19.224+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124707) UID: 0 2023-06-22T14:27:19.227 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T14:27:19.224+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124707) UID: 0 2023-06-22T14:27:19.228 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T14:27:19.224+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124707) UID: 0 2023-06-22T14:27:19.228 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T14:27:19.224+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124707) UID: 0 2023-06-22T14:29:50.957 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:29:50.962 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:30:26.587 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:30:26.592 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:30:26.689 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T14:30:26.686+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124785) UID: 0 2023-06-22T14:30:26.690 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T14:30:26.687+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124785) UID: 0 2023-06-22T14:30:26.690 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T14:30:26.687+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124785) UID: 0 2023-06-22T14:30:26.691 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T14:30:26.687+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124785) UID: 0 2023-06-22T14:32:47.314 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:32:47.322 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:33:17.435 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:33:17.440 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:33:49.070 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:33:49.076 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:33:49.174 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T14:33:49.173+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124887) UID: 0 2023-06-22T14:33:49.175 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T14:33:49.173+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124887) UID: 0 2023-06-22T14:33:49.175 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T14:33:49.173+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124887) UID: 0 2023-06-22T14:33:49.176 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T14:33:49.173+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124887) UID: 0 2023-06-22T14:36:18.735 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:36:18.740 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:36:48.848 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:36:48.859 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:36:48.960 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T14:36:48.958+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124964) UID: 0 2023-06-22T14:36:48.961 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T14:36:48.958+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124964) UID: 0 2023-06-22T14:36:48.961 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T14:36:48.958+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124964) UID: 0 2023-06-22T14:36:48.962 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T14:36:48.958+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 124964) UID: 0 2023-06-22T14:39:03.701 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:39:03.706 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:39:33.824 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:39:33.828 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:40:03.962 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:40:03.968 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:40:04.062 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T14:40:04.059+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125072) UID: 0 2023-06-22T14:40:04.062 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T14:40:04.059+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125072) UID: 0 2023-06-22T14:40:04.063 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T14:40:04.059+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125072) UID: 0 2023-06-22T14:40:04.063 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T14:40:04.059+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125072) UID: 0 2023-06-22T14:42:30.249 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:42:30.254 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:43:00.362 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:43:00.367 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:43:00.460 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T14:43:00.458+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125150) UID: 0 2023-06-22T14:43:00.461 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T14:43:00.458+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125150) UID: 0 2023-06-22T14:43:00.461 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T14:43:00.458+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125150) UID: 0 2023-06-22T14:43:00.461 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T14:43:00.458+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125150) UID: 0 2023-06-22T14:45:14.395 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:45:14.400 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:45:44.519 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:45:44.524 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:46:16.251 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:46:16.256 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:46:16.346 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T14:46:16.344+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125251) UID: 0 2023-06-22T14:46:16.346 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T14:46:16.344+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125251) UID: 0 2023-06-22T14:46:16.347 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T14:46:16.344+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125251) UID: 0 2023-06-22T14:46:16.347 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T14:46:16.344+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125251) UID: 0 2023-06-22T14:48:41.519 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:48:41.530 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:49:11.633 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:49:11.640 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:49:11.742 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T14:49:11.739+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125326) UID: 0 2023-06-22T14:49:11.742 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T14:49:11.740+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125326) UID: 0 2023-06-22T14:49:11.743 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T14:49:11.740+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125326) UID: 0 2023-06-22T14:49:11.743 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T14:49:11.740+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125326) UID: 0 2023-06-22T14:51:25.089 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:51:25.094 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:51:55.217 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:51:55.222 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:52:26.398 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:52:26.403 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:52:26.497 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T14:52:26.495+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125430) UID: 0 2023-06-22T14:52:26.498 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T14:52:26.495+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125430) UID: 0 2023-06-22T14:52:26.498 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T14:52:26.495+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125430) UID: 0 2023-06-22T14:52:26.498 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T14:52:26.495+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125430) UID: 0 2023-06-22T14:54:53.559 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:54:53.568 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:55:23.670 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:55:23.676 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:55:23.773 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T14:55:23.771+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125508) UID: 0 2023-06-22T14:55:23.774 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T14:55:23.771+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125508) UID: 0 2023-06-22T14:55:23.774 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T14:55:23.771+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125508) UID: 0 2023-06-22T14:55:23.775 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T14:55:23.771+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125508) UID: 0 2023-06-22T14:57:37.485 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:57:37.492 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:58:07.614 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:58:07.619 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:58:37.729 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:58:37.734 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T14:58:37.831 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T14:58:37.829+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125607) UID: 0 2023-06-22T14:58:37.832 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T14:58:37.829+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125607) UID: 0 2023-06-22T14:58:37.832 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T14:58:37.829+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125607) UID: 0 2023-06-22T14:58:37.833 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T14:58:37.829+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125607) UID: 0 2023-06-22T15:01:03.941 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:01:03.946 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:01:34.071 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:01:34.076 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:01:34.176 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T15:01:34.173+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125699) UID: 0 2023-06-22T15:01:34.176 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T15:01:34.173+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125699) UID: 0 2023-06-22T15:01:34.177 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T15:01:34.174+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125699) UID: 0 2023-06-22T15:01:34.177 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T15:01:34.174+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125699) UID: 0 2023-06-22T15:03:50.374 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:03:50.379 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:04:20.498 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:04:20.503 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:04:51.932 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:04:51.937 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:04:52.034 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T15:04:52.032+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125806) UID: 0 2023-06-22T15:04:52.035 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T15:04:52.032+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125806) UID: 0 2023-06-22T15:04:52.036 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T15:04:52.032+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125806) UID: 0 2023-06-22T15:04:52.036 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T15:04:52.032+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125806) UID: 0 2023-06-22T15:07:19.507 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:07:19.512 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:07:50.302 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:07:50.307 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:07:50.411 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T15:07:50.409+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125874) UID: 0 2023-06-22T15:07:50.412 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T15:07:50.409+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125874) UID: 0 2023-06-22T15:07:50.412 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T15:07:50.409+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125874) UID: 0 2023-06-22T15:07:50.412 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T15:07:50.409+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125874) UID: 0 2023-06-22T15:10:07.150 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:10:07.155 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:10:37.287 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:10:37.292 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:11:08.137 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:11:08.141 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:11:08.238 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T15:11:08.235+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125985) UID: 0 2023-06-22T15:11:08.238 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T15:11:08.235+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125985) UID: 0 2023-06-22T15:11:08.239 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T15:11:08.235+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125985) UID: 0 2023-06-22T15:11:08.239 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T15:11:08.235+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125985) UID: 0 2023-06-22T15:13:35.917 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:13:35.923 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:14:06.028 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:14:06.039 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:14:06.130 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T15:14:06.127+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126061) UID: 0 2023-06-22T15:14:06.131 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T15:14:06.127+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126061) UID: 0 2023-06-22T15:14:06.131 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T15:14:06.127+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126061) UID: 0 2023-06-22T15:14:06.132 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T15:14:06.127+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126061) UID: 0 2023-06-22T15:16:22.599 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:16:22.608 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:16:52.720 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:16:52.728 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:17:23.568 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:17:23.579 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:17:23.680 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T15:17:23.677+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126161) UID: 0 2023-06-22T15:17:23.680 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T15:17:23.677+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126161) UID: 0 2023-06-22T15:17:23.681 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T15:17:23.677+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126161) UID: 0 2023-06-22T15:17:23.681 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T15:17:23.677+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126161) UID: 0 2023-06-22T15:19:49.938 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:19:49.943 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:20:20.057 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:20:20.062 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:20:20.162 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T15:20:20.158+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126237) UID: 0 2023-06-22T15:20:20.162 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T15:20:20.158+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126237) UID: 0 2023-06-22T15:20:20.162 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T15:20:20.158+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126237) UID: 0 2023-06-22T15:20:20.163 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T15:20:20.159+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126237) UID: 0 2023-06-22T15:22:33.515 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:22:33.520 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:23:03.624 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:23:03.629 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:23:34.810 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:23:34.814 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:23:34.906 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T15:23:34.902+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126340) UID: 0 2023-06-22T15:23:34.906 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T15:23:34.902+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126340) UID: 0 2023-06-22T15:23:34.907 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T15:23:34.903+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126340) UID: 0 2023-06-22T15:23:34.907 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T15:23:34.903+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126340) UID: 0 2023-06-22T15:25:59.655 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:25:59.662 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:26:29.769 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:26:29.777 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:27:01.493 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:27:01.500 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:27:01.596 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T15:27:01.593+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126449) UID: 0 2023-06-22T15:27:01.597 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T15:27:01.593+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126449) UID: 0 2023-06-22T15:27:01.597 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T15:27:01.593+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126449) UID: 0 2023-06-22T15:27:01.597 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T15:27:01.593+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126449) UID: 0 2023-06-22T15:29:32.119 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:29:32.131 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:30:02.233 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:30:02.239 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:30:02.350 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T15:30:02.346+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126526) UID: 0 2023-06-22T15:30:02.351 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T15:30:02.347+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126526) UID: 0 2023-06-22T15:30:02.351 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T15:30:02.347+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126526) UID: 0 2023-06-22T15:30:02.352 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T15:30:02.347+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126526) UID: 0 2023-06-22T15:32:20.164 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:32:20.169 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:32:50.268 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:32:50.273 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:33:22.957 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:33:22.961 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:33:23.057 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T15:33:23.053+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126631) UID: 0 2023-06-22T15:33:23.058 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T15:33:23.053+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126631) UID: 0 2023-06-22T15:33:23.058 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T15:33:23.054+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126631) UID: 0 2023-06-22T15:33:23.058 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T15:33:23.054+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126631) UID: 0 2023-06-22T15:35:52.138 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:35:52.143 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:36:22.251 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:36:22.256 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:36:22.352 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T15:36:22.349+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126706) UID: 0 2023-06-22T15:36:22.353 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T15:36:22.349+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126706) UID: 0 2023-06-22T15:36:22.353 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T15:36:22.349+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126706) UID: 0 2023-06-22T15:36:22.353 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T15:36:22.349+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126706) UID: 0 2023-06-22T15:38:39.313 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:38:39.318 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:39:09.527 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:39:09.532 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:39:40.518 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:39:40.523 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:39:40.618 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T15:39:40.613+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126806) UID: 0 2023-06-22T15:39:40.618 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T15:39:40.613+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126806) UID: 0 2023-06-22T15:39:40.619 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T15:39:40.613+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126806) UID: 0 2023-06-22T15:39:40.619 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T15:39:40.613+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126806) UID: 0 2023-06-22T15:42:06.497 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:42:06.502 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:42:36.613 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:42:36.618 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:42:36.717 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T15:42:36.713+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126885) UID: 0 2023-06-22T15:42:36.717 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T15:42:36.713+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126885) UID: 0 2023-06-22T15:42:36.718 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T15:42:36.713+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126885) UID: 0 2023-06-22T15:42:36.718 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T15:42:36.713+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126885) UID: 0 2023-06-22T15:44:52.605 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:44:52.611 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:45:22.736 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:45:22.741 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:45:54.043 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:45:54.048 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:45:54.143 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T15:45:54.139+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126993) UID: 0 2023-06-22T15:45:54.143 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T15:45:54.139+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126993) UID: 0 2023-06-22T15:45:54.144 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T15:45:54.139+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126993) UID: 0 2023-06-22T15:45:54.144 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T15:45:54.139+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126993) UID: 0 2023-06-22T15:48:20.263 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:48:20.268 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:48:50.368 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:48:50.372 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:48:50.471 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T15:48:50.466+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127062) UID: 0 2023-06-22T15:48:50.472 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T15:48:50.466+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127062) UID: 0 2023-06-22T15:48:50.472 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T15:48:50.466+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127062) UID: 0 2023-06-22T15:48:50.473 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T15:48:50.466+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127062) UID: 0 2023-06-22T15:51:06.630 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:51:06.636 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:51:36.743 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:51:36.749 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:52:06.867 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:52:06.873 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:52:06.972 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T15:52:06.968+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127174) UID: 0 2023-06-22T15:52:06.973 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T15:52:06.968+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127174) UID: 0 2023-06-22T15:52:06.973 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T15:52:06.968+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127174) UID: 0 2023-06-22T15:52:06.973 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T15:52:06.968+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127174) UID: 0 2023-06-22T15:54:34.681 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:54:34.687 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:55:05.010 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:55:05.015 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:55:05.107 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T15:55:05.102+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127249) UID: 0 2023-06-22T15:55:05.107 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T15:55:05.102+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127249) UID: 0 2023-06-22T15:55:05.108 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T15:55:05.102+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127249) UID: 0 2023-06-22T15:55:05.108 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T15:55:05.103+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127249) UID: 0 2023-06-22T15:57:20.873 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:57:20.878 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:57:50.986 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:57:50.990 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:58:22.168 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:58:22.173 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T15:58:22.267 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T15:58:22.263+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127349) UID: 0 2023-06-22T15:58:22.268 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T15:58:22.263+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127349) UID: 0 2023-06-22T15:58:22.268 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T15:58:22.263+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127349) UID: 0 2023-06-22T15:58:22.269 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T15:58:22.263+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127349) UID: 0 2023-06-22T16:00:49.057 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:00:49.062 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:01:19.778 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:01:19.783 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:01:19.882 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T16:01:19.878+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127439) UID: 0 2023-06-22T16:01:19.883 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T16:01:19.878+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127439) UID: 0 2023-06-22T16:01:19.883 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T16:01:19.878+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127439) UID: 0 2023-06-22T16:01:19.884 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T16:01:19.878+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127439) UID: 0 2023-06-22T16:03:38.384 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:03:38.394 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:04:08.493 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:04:08.503 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:04:40.062 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:04:40.067 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:04:40.163 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T16:04:40.159+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127539) UID: 0 2023-06-22T16:04:40.164 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T16:04:40.159+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127539) UID: 0 2023-06-22T16:04:40.164 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T16:04:40.159+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127539) UID: 0 2023-06-22T16:04:40.165 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T16:04:40.159+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127539) UID: 0 2023-06-22T16:07:06.167 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:07:06.173 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:07:37.072 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:07:37.077 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:07:37.177 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T16:07:37.172+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127616) UID: 0 2023-06-22T16:07:37.178 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T16:07:37.172+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127616) UID: 0 2023-06-22T16:07:37.178 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T16:07:37.172+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127616) UID: 0 2023-06-22T16:07:37.179 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T16:07:37.172+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127616) UID: 0 2023-06-22T16:09:52.503 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:09:52.514 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:10:22.624 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:10:22.629 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:10:52.746 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:10:52.751 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:10:52.847 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T16:10:52.842+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127719) UID: 0 2023-06-22T16:10:52.847 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T16:10:52.842+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127719) UID: 0 2023-06-22T16:10:52.848 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T16:10:52.842+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127719) UID: 0 2023-06-22T16:10:52.848 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T16:10:52.842+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127719) UID: 0 2023-06-22T16:13:17.620 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:13:17.630 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:13:47.787 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:13:47.792 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:14:19.339 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:14:19.344 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:14:19.443 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T16:14:19.438+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127827) UID: 0 2023-06-22T16:14:19.443 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T16:14:19.438+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127827) UID: 0 2023-06-22T16:14:19.444 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T16:14:19.438+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127827) UID: 0 2023-06-22T16:14:19.444 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T16:14:19.438+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127827) UID: 0 2023-06-22T16:16:50.812 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:16:50.818 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:17:21.558 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:17:21.563 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:17:21.660 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T16:17:21.656+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127902) UID: 0 2023-06-22T16:17:21.660 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T16:17:21.656+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127902) UID: 0 2023-06-22T16:17:21.661 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T16:17:21.656+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127902) UID: 0 2023-06-22T16:17:21.661 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T16:17:21.656+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127902) UID: 0 2023-06-22T16:19:40.153 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:19:40.159 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:20:10.266 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:20:10.271 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:20:41.391 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:20:41.398 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:20:41.493 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T16:20:41.490+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128007) UID: 0 2023-06-22T16:20:41.494 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T16:20:41.490+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128007) UID: 0 2023-06-22T16:20:41.494 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T16:20:41.490+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128007) UID: 0 2023-06-22T16:20:41.495 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T16:20:41.490+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128007) UID: 0 2023-06-22T16:23:08.254 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:23:08.260 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:23:38.367 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:23:38.372 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:23:38.471 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T16:23:38.468+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128082) UID: 0 2023-06-22T16:23:38.472 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T16:23:38.468+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128082) UID: 0 2023-06-22T16:23:38.472 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T16:23:38.468+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128082) UID: 0 2023-06-22T16:23:38.472 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T16:23:38.468+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128082) UID: 0 2023-06-22T16:25:53.479 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:25:53.484 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:26:23.602 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:26:23.607 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:26:54.716 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:26:54.721 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:26:54.814 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T16:26:54.811+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128191) UID: 0 2023-06-22T16:26:54.814 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T16:26:54.811+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128191) UID: 0 2023-06-22T16:26:54.815 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T16:26:54.811+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128191) UID: 0 2023-06-22T16:26:54.815 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T16:26:54.811+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128191) UID: 0 2023-06-22T16:29:21.948 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:29:21.953 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:29:52.193 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:29:52.199 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:29:52.297 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T16:29:52.294+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128258) UID: 0 2023-06-22T16:29:52.297 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T16:29:52.294+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128258) UID: 0 2023-06-22T16:29:52.298 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T16:29:52.294+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128258) UID: 0 2023-06-22T16:29:52.298 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T16:29:52.295+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128258) UID: 0 2023-06-22T16:32:10.430 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:32:10.434 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:32:40.552 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:32:40.560 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:33:11.444 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:33:11.453 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:33:11.553 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T16:33:11.551+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128369) UID: 0 2023-06-22T16:33:11.553 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T16:33:11.551+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128369) UID: 0 2023-06-22T16:33:11.554 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T16:33:11.551+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128369) UID: 0 2023-06-22T16:33:11.554 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T16:33:11.551+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128369) UID: 0 2023-06-22T16:35:41.405 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:35:41.410 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:36:11.509 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:36:11.514 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:36:11.611 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T16:36:11.609+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128445) UID: 0 2023-06-22T16:36:11.611 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T16:36:11.609+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128445) UID: 0 2023-06-22T16:36:11.612 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T16:36:11.609+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128445) UID: 0 2023-06-22T16:36:11.612 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T16:36:11.609+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128445) UID: 0 2023-06-22T16:38:29.115 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:38:29.120 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:38:59.221 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:38:59.226 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:39:30.342 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:39:30.347 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:39:30.448 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T16:39:30.446+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128547) UID: 0 2023-06-22T16:39:30.448 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T16:39:30.446+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128547) UID: 0 2023-06-22T16:39:30.449 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T16:39:30.446+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128547) UID: 0 2023-06-22T16:39:30.449 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T16:39:30.446+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128547) UID: 0 2023-06-22T16:41:57.749 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:41:57.754 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:42:27.861 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:42:27.866 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:42:27.964 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T16:42:27.963+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128627) UID: 0 2023-06-22T16:42:27.965 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T16:42:27.963+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128627) UID: 0 2023-06-22T16:42:27.965 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T16:42:27.963+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128627) UID: 0 2023-06-22T16:42:27.966 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T16:42:27.963+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128627) UID: 0 2023-06-22T16:44:39.132 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:44:39.138 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:45:10.305 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:45:10.310 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:45:40.419 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:45:40.425 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:45:40.528 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T16:45:40.527+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128728) UID: 0 2023-06-22T16:45:40.529 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T16:45:40.527+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128728) UID: 0 2023-06-22T16:45:40.529 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T16:45:40.527+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128728) UID: 0 2023-06-22T16:45:40.530 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T16:45:40.527+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128728) UID: 0 2023-06-22T16:48:06.440 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:48:06.451 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:48:36.571 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:48:36.577 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:48:36.669 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T16:48:36.668+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128804) UID: 0 2023-06-22T16:48:36.670 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T16:48:36.668+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128804) UID: 0 2023-06-22T16:48:36.670 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T16:48:36.668+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128804) UID: 0 2023-06-22T16:48:36.671 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T16:48:36.668+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128804) UID: 0 2023-06-22T16:50:54.067 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:50:54.072 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:51:24.163 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:51:24.168 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:51:55.436 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:51:55.445 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:51:55.548 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T16:51:55.546+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128915) UID: 0 2023-06-22T16:51:55.548 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T16:51:55.547+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128915) UID: 0 2023-06-22T16:51:55.549 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T16:51:55.547+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128915) UID: 0 2023-06-22T16:51:55.549 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T16:51:55.547+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128915) UID: 0 2023-06-22T16:54:23.067 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:54:23.073 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:54:53.179 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:54:53.185 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:54:53.277 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T16:54:53.276+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128984) UID: 0 2023-06-22T16:54:53.278 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T16:54:53.276+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128984) UID: 0 2023-06-22T16:54:53.278 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T16:54:53.276+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128984) UID: 0 2023-06-22T16:54:53.278 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T16:54:53.276+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128984) UID: 0 2023-06-22T16:57:08.764 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:57:08.769 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:57:38.874 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:57:38.879 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:58:10.446 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:58:10.452 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T16:58:10.544 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T16:58:10.543+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129091) UID: 0 2023-06-22T16:58:10.545 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T16:58:10.543+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129091) UID: 0 2023-06-22T16:58:10.545 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T16:58:10.543+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129091) UID: 0 2023-06-22T16:58:10.545 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T16:58:10.544+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129091) UID: 0 2023-06-22T17:00:38.651 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:00:38.657 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:01:08.764 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:01:08.769 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:01:08.869 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T17:01:08.868+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129183) UID: 0 2023-06-22T17:01:08.870 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T17:01:08.868+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129183) UID: 0 2023-06-22T17:01:08.870 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T17:01:08.868+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129183) UID: 0 2023-06-22T17:01:08.871 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T17:01:08.868+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129183) UID: 0 2023-06-22T17:03:24.742 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:03:24.747 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:03:54.864 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:03:54.869 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:04:24.989 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:04:24.995 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:04:25.088 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T17:04:25.087+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129282) UID: 0 2023-06-22T17:04:25.089 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T17:04:25.087+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129282) UID: 0 2023-06-22T17:04:25.089 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T17:04:25.087+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129282) UID: 0 2023-06-22T17:04:25.089 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T17:04:25.087+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129282) UID: 0 2023-06-22T17:06:52.533 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:06:52.537 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:07:22.645 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:07:22.649 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:07:22.749 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T17:07:22.748+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129358) UID: 0 2023-06-22T17:07:22.749 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T17:07:22.748+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129358) UID: 0 2023-06-22T17:07:22.750 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T17:07:22.748+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129358) UID: 0 2023-06-22T17:07:22.750 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T17:07:22.748+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129358) UID: 0 2023-06-22T17:09:36.551 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:09:36.556 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:10:06.672 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:10:06.678 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:10:42.579 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:10:42.584 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:10:42.681 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T17:10:42.681+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129462) UID: 0 2023-06-22T17:10:42.682 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T17:10:42.681+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129462) UID: 0 2023-06-22T17:10:42.682 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T17:10:42.681+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129462) UID: 0 2023-06-22T17:10:42.683 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T17:10:42.681+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129462) UID: 0 2023-06-22T17:13:10.681 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:13:10.685 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:13:40.786 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:13:40.792 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:13:41.053 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T17:13:41.052+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129538) UID: 0 2023-06-22T17:13:41.054 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T17:13:41.052+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129538) UID: 0 2023-06-22T17:13:41.054 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T17:13:41.052+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129538) UID: 0 2023-06-22T17:13:41.054 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T17:13:41.052+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129538) UID: 0 2023-06-22T17:15:56.973 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:15:56.978 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:16:27.088 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:16:27.093 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:16:58.328 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:16:58.333 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:16:58.433 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T17:16:58.431+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129646) UID: 0 2023-06-22T17:16:58.433 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T17:16:58.431+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129646) UID: 0 2023-06-22T17:16:58.434 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T17:16:58.431+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129646) UID: 0 2023-06-22T17:16:58.434 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T17:16:58.431+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129646) UID: 0 2023-06-22T17:19:23.982 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:19:23.993 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:19:55.169 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:19:55.181 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:19:55.284 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T17:19:55.282+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129723) UID: 0 2023-06-22T17:19:55.284 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T17:19:55.282+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129723) UID: 0 2023-06-22T17:19:55.285 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T17:19:55.282+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129723) UID: 0 2023-06-22T17:19:55.285 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T17:19:55.282+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129723) UID: 0 2023-06-22T17:22:10.092 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:22:10.097 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:22:40.213 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:22:40.218 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:23:10.337 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:23:10.342 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:23:10.444 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T17:23:10.441+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129828) UID: 0 2023-06-22T17:23:10.444 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T17:23:10.441+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129828) UID: 0 2023-06-22T17:23:10.445 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T17:23:10.442+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129828) UID: 0 2023-06-22T17:23:10.445 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T17:23:10.442+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129828) UID: 0 2023-06-22T17:25:36.558 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:25:36.563 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:26:07.340 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:26:07.344 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:26:07.438 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T17:26:07.436+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129904) UID: 0 2023-06-22T17:26:07.439 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T17:26:07.436+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129904) UID: 0 2023-06-22T17:26:07.439 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T17:26:07.436+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129904) UID: 0 2023-06-22T17:26:07.439 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T17:26:07.437+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129904) UID: 0 2023-06-22T17:28:29.381 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:28:29.386 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:28:59.485 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:28:59.491 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:29:30.600 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:29:30.605 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:29:30.707 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T17:29:30.703+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130003) UID: 0 2023-06-22T17:29:30.707 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T17:29:30.703+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130003) UID: 0 2023-06-22T17:29:30.707 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T17:29:30.704+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130003) UID: 0 2023-06-22T17:29:30.708 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T17:29:30.704+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130003) UID: 0 2023-06-22T17:31:59.576 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:31:59.586 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:32:29.713 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:32:29.719 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:32:29.819 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T17:32:29.814+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130083) UID: 0 2023-06-22T17:32:29.819 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T17:32:29.815+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130083) UID: 0 2023-06-22T17:32:29.820 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T17:32:29.815+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130083) UID: 0 2023-06-22T17:32:29.820 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T17:32:29.815+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130083) UID: 0 2023-06-22T17:34:48.539 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:34:48.545 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:35:18.652 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:35:18.657 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:35:50.149 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:35:50.155 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:35:50.254 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T17:35:50.249+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130182) UID: 0 2023-06-22T17:35:50.255 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T17:35:50.249+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130182) UID: 0 2023-06-22T17:35:50.255 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T17:35:50.249+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130182) UID: 0 2023-06-22T17:35:50.256 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T17:35:50.249+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130182) UID: 0 2023-06-22T17:38:16.610 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:38:16.615 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:38:46.731 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:38:46.735 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:38:46.830 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T17:38:46.826+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130258) UID: 0 2023-06-22T17:38:46.830 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T17:38:46.826+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130258) UID: 0 2023-06-22T17:38:46.831 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T17:38:46.826+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130258) UID: 0 2023-06-22T17:38:46.831 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T17:38:46.826+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130258) UID: 0 2023-06-22T17:41:04.192 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:41:04.200 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:41:34.305 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:41:34.313 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:42:04.428 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:42:04.433 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:42:04.529 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T17:42:04.525+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130370) UID: 0 2023-06-22T17:42:04.530 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T17:42:04.525+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130370) UID: 0 2023-06-22T17:42:04.530 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T17:42:04.525+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130370) UID: 0 2023-06-22T17:42:04.531 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T17:42:04.526+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130370) UID: 0 2023-06-22T17:44:31.302 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:44:31.307 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:45:01.425 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:45:01.429 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:45:01.521 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T17:45:01.516+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130447) UID: 0 2023-06-22T17:45:01.521 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T17:45:01.516+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130447) UID: 0 2023-06-22T17:45:01.522 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T17:45:01.516+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130447) UID: 0 2023-06-22T17:45:01.522 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T17:45:01.517+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130447) UID: 0 2023-06-22T17:47:14.487 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:47:14.491 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:47:44.615 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:47:44.620 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:48:14.730 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:48:14.735 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:48:14.831 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T17:48:14.827+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130547) UID: 0 2023-06-22T17:48:14.831 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T17:48:14.827+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130547) UID: 0 2023-06-22T17:48:14.832 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T17:48:14.827+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130547) UID: 0 2023-06-22T17:48:14.832 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T17:48:14.827+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130547) UID: 0 2023-06-22T17:50:38.172 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:50:38.177 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:51:08.293 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:51:08.298 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:51:39.967 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:51:39.972 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:51:40.066 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T17:51:40.062+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130650) UID: 0 2023-06-22T17:51:40.067 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T17:51:40.062+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130650) UID: 0 2023-06-22T17:51:40.067 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T17:51:40.062+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130650) UID: 0 2023-06-22T17:51:40.068 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T17:51:40.062+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130650) UID: 0 2023-06-22T17:54:08.016 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:54:08.021 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:54:38.137 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:54:38.141 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:54:38.251 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T17:54:38.247+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130727) UID: 0 2023-06-22T17:54:38.252 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T17:54:38.247+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130727) UID: 0 2023-06-22T17:54:38.252 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T17:54:38.247+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130727) UID: 0 2023-06-22T17:54:38.253 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T17:54:38.247+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130727) UID: 0 2023-06-22T17:56:53.672 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:56:53.680 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:57:23.789 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:57:23.794 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:57:53.916 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:57:53.921 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T17:57:54.018 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T17:57:54.014+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130826) UID: 0 2023-06-22T17:57:54.019 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T17:57:54.014+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130826) UID: 0 2023-06-22T17:57:54.019 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T17:57:54.014+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130826) UID: 0 2023-06-22T17:57:54.019 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T17:57:54.014+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130826) UID: 0 2023-06-22T18:00:22.398 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:00:22.402 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:00:52.520 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:00:52.525 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:00:52.623 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T18:00:52.619+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130907) UID: 0 2023-06-22T18:00:52.624 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T18:00:52.619+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130907) UID: 0 2023-06-22T18:00:52.624 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T18:00:52.619+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130907) UID: 0 2023-06-22T18:00:52.624 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T18:00:52.619+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130907) UID: 0 2023-06-22T18:03:12.386 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:03:12.391 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:03:42.507 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:03:42.512 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:04:13.940 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:04:13.944 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:04:14.043 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T18:04:14.039+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 131026) UID: 0 2023-06-22T18:04:14.043 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T18:04:14.039+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 131026) UID: 0 2023-06-22T18:04:14.044 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T18:04:14.039+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 131026) UID: 0 2023-06-22T18:04:14.044 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T18:04:14.039+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 131026) UID: 0 2023-06-22T18:06:41.374 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:06:41.379 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:07:11.495 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:07:11.500 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:07:11.596 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T18:07:11.593+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 131102) UID: 0 2023-06-22T18:07:11.597 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T18:07:11.593+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 131102) UID: 0 2023-06-22T18:07:11.597 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T18:07:11.593+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 131102) UID: 0 2023-06-22T18:07:11.598 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T18:07:11.593+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 131102) UID: 0 2023-06-22T18:09:26.563 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:09:26.569 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:09:56.670 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:09:56.675 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:10:27.841 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:10:27.846 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:10:27.954 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T18:10:27.951+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 131202) UID: 0 2023-06-22T18:10:27.955 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T18:10:27.951+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 131202) UID: 0 2023-06-22T18:10:27.956 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T18:10:27.951+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 131202) UID: 0 2023-06-22T18:10:27.956 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T18:10:27.951+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 131202) UID: 0 2023-06-22T18:12:54.326 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:12:54.332 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:13:24.439 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:13:24.444 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:13:24.551 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T18:13:24.547+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 131281) UID: 0 2023-06-22T18:13:24.552 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T18:13:24.547+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 131281) UID: 0 2023-06-22T18:13:24.553 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T18:13:24.547+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 131281) UID: 0 2023-06-22T18:13:24.553 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T18:13:24.547+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 131281) UID: 0 2023-06-22T18:15:43.131 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:15:43.136 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:16:13.236 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:16:13.241 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:16:44.842 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:16:44.847 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:16:44.942 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T18:16:44.939+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 131380) UID: 0 2023-06-22T18:16:44.942 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T18:16:44.939+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 131380) UID: 0 2023-06-22T18:16:44.943 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T18:16:44.939+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 131380) UID: 0 2023-06-22T18:16:44.943 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T18:16:44.939+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 131380) UID: 0 2023-06-22T18:19:14.517 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:19:14.523 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:19:44.630 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:19:44.635 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:19:44.735 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T18:19:44.732+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 131457) UID: 0 2023-06-22T18:19:44.735 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T18:19:44.732+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 131457) UID: 0 2023-06-22T18:19:44.736 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T18:19:44.732+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 131457) UID: 0 2023-06-22T18:19:44.736 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T18:19:44.733+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 131457) UID: 0 2023-06-22T18:22:03.949 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:22:03.954 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:22:34.063 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:22:34.067 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:23:05.493 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:23:05.498 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:23:05.594 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T18:23:05.591+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 131568) UID: 0 2023-06-22T18:23:05.595 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T18:23:05.591+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 131568) UID: 0 2023-06-22T18:23:05.595 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T18:23:05.592+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 131568) UID: 0 2023-06-22T18:23:05.596 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T18:23:05.592+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 131568) UID: 0 2023-06-22T18:25:34.502 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:25:34.507 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:26:04.615 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:26:04.619 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:26:04.720 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T18:26:04.717+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 131644) UID: 0 2023-06-22T18:26:04.721 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T18:26:04.717+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 131644) UID: 0 2023-06-22T18:26:04.721 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T18:26:04.718+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 131644) UID: 0 2023-06-22T18:26:04.721 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T18:26:04.718+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 131644) UID: 0 2023-06-22T18:28:23.076 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:28:23.081 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:28:53.188 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:28:53.192 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:29:24.410 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:29:24.415 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:29:24.511 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T18:29:24.509+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 131743) UID: 0 2023-06-22T18:29:24.512 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T18:29:24.509+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 131743) UID: 0 2023-06-22T18:29:24.512 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T18:29:24.509+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 131743) UID: 0 2023-06-22T18:29:24.513 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T18:29:24.509+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 131743) UID: 0 2023-06-22T18:31:52.770 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:31:52.775 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:32:22.894 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:32:22.899 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:32:22.991 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T18:32:22.989+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 131823) UID: 0 2023-06-22T18:32:22.992 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T18:32:22.989+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 131823) UID: 0 2023-06-22T18:32:22.992 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T18:32:22.989+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 131823) UID: 0 2023-06-22T18:32:22.993 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T18:32:22.989+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 131823) UID: 0 2023-06-22T18:34:41.409 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:34:41.414 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:35:11.519 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:35:11.524 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:35:42.383 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:35:42.388 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:35:42.486 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T18:35:42.483+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 131923) UID: 0 2023-06-22T18:35:42.486 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T18:35:42.483+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 131923) UID: 0 2023-06-22T18:35:42.487 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T18:35:42.483+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 131923) UID: 0 2023-06-22T18:35:42.487 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T18:35:42.484+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 131923) UID: 0 2023-06-22T18:38:10.549 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:38:10.554 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:38:40.670 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:38:40.676 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:38:40.777 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T18:38:40.775+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 131998) UID: 0 2023-06-22T18:38:40.778 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T18:38:40.775+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 131998) UID: 0 2023-06-22T18:38:40.778 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T18:38:40.775+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 131998) UID: 0 2023-06-22T18:38:40.778 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T18:38:40.775+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 131998) UID: 0 2023-06-22T18:40:57.339 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:40:57.344 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:41:27.453 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:41:27.458 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:41:58.754 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:41:58.759 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:41:58.855 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T18:41:58.853+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132111) UID: 0 2023-06-22T18:41:58.856 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T18:41:58.853+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132111) UID: 0 2023-06-22T18:41:58.856 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T18:41:58.853+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132111) UID: 0 2023-06-22T18:41:58.857 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T18:41:58.853+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132111) UID: 0 2023-06-22T18:44:25.304 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:44:25.308 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:44:55.423 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:44:55.428 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:44:55.526 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T18:44:55.524+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132179) UID: 0 2023-06-22T18:44:55.527 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T18:44:55.524+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132179) UID: 0 2023-06-22T18:44:55.527 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T18:44:55.524+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132179) UID: 0 2023-06-22T18:44:55.527 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T18:44:55.524+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132179) UID: 0 2023-06-22T18:47:10.324 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:47:10.329 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:47:40.447 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:47:40.452 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:48:11.620 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:48:11.625 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:48:11.719 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T18:48:11.717+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132287) UID: 0 2023-06-22T18:48:11.719 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T18:48:11.717+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132287) UID: 0 2023-06-22T18:48:11.720 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T18:48:11.717+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132287) UID: 0 2023-06-22T18:48:11.720 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T18:48:11.717+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132287) UID: 0 2023-06-22T18:50:38.986 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:50:38.993 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:51:09.117 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:51:09.121 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:51:09.218 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T18:51:09.215+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132367) UID: 0 2023-06-22T18:51:09.218 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T18:51:09.216+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132367) UID: 0 2023-06-22T18:51:09.218 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T18:51:09.215+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132367) UID: 0 2023-06-22T18:51:09.219 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T18:51:09.216+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132367) UID: 0 2023-06-22T18:53:28.909 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:53:28.914 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:53:59.027 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:53:59.031 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:54:29.146 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:54:29.150 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:54:29.253 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T18:54:29.251+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132468) UID: 0 2023-06-22T18:54:29.254 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T18:54:29.251+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132468) UID: 0 2023-06-22T18:54:29.255 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T18:54:29.251+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132468) UID: 0 2023-06-22T18:54:29.255 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T18:54:29.251+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132468) UID: 0 2023-06-22T18:56:58.540 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:56:58.545 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:57:28.654 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:57:28.659 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:57:28.760 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T18:57:28.758+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132545) UID: 0 2023-06-22T18:57:28.761 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T18:57:28.758+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132545) UID: 0 2023-06-22T18:57:28.761 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T18:57:28.758+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132545) UID: 0 2023-06-22T18:57:28.761 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T18:57:28.758+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132545) UID: 0 2023-06-22T18:59:48.229 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T18:59:48.234 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:00:18.344 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:00:18.349 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:00:49.609 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:00:49.614 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:00:49.713 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T19:00:49.710+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132648) UID: 0 2023-06-22T19:00:49.713 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T19:00:49.710+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132648) UID: 0 2023-06-22T19:00:49.714 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T19:00:49.710+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132648) UID: 0 2023-06-22T19:00:49.714 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T19:00:49.710+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132648) UID: 0 2023-06-22T19:03:15.743 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:03:15.753 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:03:45.890 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:03:45.896 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:03:45.994 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T19:03:45.992+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132734) UID: 0 2023-06-22T19:03:45.995 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T19:03:45.992+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132734) UID: 0 2023-06-22T19:03:45.995 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T19:03:45.992+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132734) UID: 0 2023-06-22T19:03:45.996 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T19:03:45.992+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132734) UID: 0 2023-06-22T19:06:00.209 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:06:00.220 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:06:30.324 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:06:30.329 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:07:01.745 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:07:01.752 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:07:01.851 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T19:07:01.849+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132841) UID: 0 2023-06-22T19:07:01.851 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T19:07:01.849+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132841) UID: 0 2023-06-22T19:07:01.852 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T19:07:01.849+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132841) UID: 0 2023-06-22T19:07:01.852 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T19:07:01.849+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132841) UID: 0 2023-06-22T19:09:26.988 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:09:26.993 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:09:57.102 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:09:57.107 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:09:57.206 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T19:09:57.204+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132910) UID: 0 2023-06-22T19:09:57.206 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T19:09:57.204+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132910) UID: 0 2023-06-22T19:09:57.207 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T19:09:57.204+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132910) UID: 0 2023-06-22T19:09:57.207 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T19:09:57.204+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 132910) UID: 0 2023-06-22T19:12:10.014 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:12:10.020 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:12:40.118 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:12:40.124 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:13:12.964 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:13:12.970 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:13:13.073 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T19:13:13.071+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133020) UID: 0 2023-06-22T19:13:13.074 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T19:13:13.071+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133020) UID: 0 2023-06-22T19:13:13.074 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T19:13:13.071+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133020) UID: 0 2023-06-22T19:13:13.075 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T19:13:13.072+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133020) UID: 0 2023-06-22T19:15:39.400 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:15:39.407 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:16:09.522 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:16:09.528 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:16:09.628 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T19:16:09.625+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133097) UID: 0 2023-06-22T19:16:09.629 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T19:16:09.626+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133097) UID: 0 2023-06-22T19:16:09.629 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T19:16:09.626+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133097) UID: 0 2023-06-22T19:16:09.630 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T19:16:09.626+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133097) UID: 0 2023-06-22T19:18:24.658 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:18:24.663 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:18:54.796 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:18:54.801 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:19:27.786 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:19:27.791 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:19:27.882 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T19:19:27.880+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133197) UID: 0 2023-06-22T19:19:27.883 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T19:19:27.880+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133197) UID: 0 2023-06-22T19:19:27.883 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T19:19:27.880+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133197) UID: 0 2023-06-22T19:19:27.884 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T19:19:27.880+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133197) UID: 0 2023-06-22T19:21:54.596 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:21:54.601 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:22:24.705 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:22:24.710 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:22:24.806 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T19:22:24.804+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133277) UID: 0 2023-06-22T19:22:24.807 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T19:22:24.804+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133277) UID: 0 2023-06-22T19:22:24.807 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T19:22:24.804+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133277) UID: 0 2023-06-22T19:22:24.807 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T19:22:24.804+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133277) UID: 0 2023-06-22T19:24:39.183 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:24:39.191 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:25:09.296 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:25:09.301 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:25:40.435 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:25:40.441 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:25:40.617 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T19:25:40.614+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133377) UID: 0 2023-06-22T19:25:40.618 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T19:25:40.615+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133377) UID: 0 2023-06-22T19:25:40.618 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T19:25:40.615+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133377) UID: 0 2023-06-22T19:25:40.619 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T19:25:40.615+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133377) UID: 0 2023-06-22T19:28:06.234 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:28:06.240 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:28:36.890 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:28:36.897 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:28:36.999 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T19:28:36.996+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133452) UID: 0 2023-06-22T19:28:36.999 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T19:28:36.996+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133452) UID: 0 2023-06-22T19:28:37.000 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T19:28:36.996+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133452) UID: 0 2023-06-22T19:28:37.000 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T19:28:36.997+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133452) UID: 0 2023-06-22T19:30:51.307 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:30:51.312 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:31:21.422 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:31:21.426 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:31:52.619 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:31:52.624 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:31:52.726 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T19:31:52.724+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133556) UID: 0 2023-06-22T19:31:52.727 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T19:31:52.724+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133556) UID: 0 2023-06-22T19:31:52.727 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T19:31:52.724+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133556) UID: 0 2023-06-22T19:31:52.728 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T19:31:52.724+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133556) UID: 0 2023-06-22T19:34:18.679 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:34:18.684 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:34:48.800 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:34:48.805 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:34:48.902 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T19:34:48.900+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133632) UID: 0 2023-06-22T19:34:48.902 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T19:34:48.900+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133632) UID: 0 2023-06-22T19:34:48.903 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T19:34:48.900+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133632) UID: 0 2023-06-22T19:34:48.903 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T19:34:48.900+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133632) UID: 0 2023-06-22T19:37:08.417 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:37:08.423 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:37:38.531 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:37:38.536 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:38:09.653 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:38:09.658 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:38:09.755 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T19:38:09.753+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133740) UID: 0 2023-06-22T19:38:09.756 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T19:38:09.753+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133740) UID: 0 2023-06-22T19:38:09.756 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T19:38:09.753+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133740) UID: 0 2023-06-22T19:38:09.756 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T19:38:09.753+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133740) UID: 0 2023-06-22T19:40:38.398 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:40:38.404 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:41:09.261 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:41:09.265 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:41:09.364 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T19:41:09.361+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133820) UID: 0 2023-06-22T19:41:09.365 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T19:41:09.361+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133820) UID: 0 2023-06-22T19:41:09.365 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T19:41:09.361+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133820) UID: 0 2023-06-22T19:41:09.366 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T19:41:09.361+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133820) UID: 0 2023-06-22T19:43:31.029 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:43:31.033 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:44:01.133 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:44:01.137 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:44:32.398 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:44:32.403 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:44:32.501 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T19:44:32.498+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133920) UID: 0 2023-06-22T19:44:32.502 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T19:44:32.498+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133920) UID: 0 2023-06-22T19:44:32.502 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T19:44:32.498+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133920) UID: 0 2023-06-22T19:44:32.502 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T19:44:32.498+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133920) UID: 0 2023-06-22T19:47:02.140 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:47:02.145 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:47:32.254 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:47:32.258 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:47:32.357 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T19:47:32.354+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133996) UID: 0 2023-06-22T19:47:32.357 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T19:47:32.354+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133996) UID: 0 2023-06-22T19:47:32.358 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T19:47:32.354+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133996) UID: 0 2023-06-22T19:47:32.358 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T19:47:32.355+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 133996) UID: 0 2023-06-22T19:49:49.597 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:49:49.602 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:50:19.705 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:50:19.710 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:50:50.942 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:50:50.947 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:50:51.046 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T19:50:51.044+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134099) UID: 0 2023-06-22T19:50:51.047 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T19:50:51.044+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134099) UID: 0 2023-06-22T19:50:51.047 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T19:50:51.044+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134099) UID: 0 2023-06-22T19:50:51.047 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T19:50:51.044+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134099) UID: 0 2023-06-22T19:53:21.800 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:53:21.809 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:53:51.928 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:53:51.934 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:53:52.338 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T19:53:52.336+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134174) UID: 0 2023-06-22T19:53:52.339 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T19:53:52.336+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134174) UID: 0 2023-06-22T19:53:52.339 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T19:53:52.336+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134174) UID: 0 2023-06-22T19:53:52.340 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T19:53:52.337+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134174) UID: 0 2023-06-22T19:56:14.289 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:56:14.294 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:56:44.411 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:56:44.416 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:57:14.526 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:57:14.531 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:57:14.627 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T19:57:14.625+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134283) UID: 0 2023-06-22T19:57:14.628 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T19:57:14.625+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134283) UID: 0 2023-06-22T19:57:14.629 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T19:57:14.626+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134283) UID: 0 2023-06-22T19:57:14.629 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T19:57:14.626+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134283) UID: 0 2023-06-22T19:59:43.561 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T19:59:43.567 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:00:13.674 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:00:13.679 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:00:14.127 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T20:00:14.125+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134363) UID: 0 2023-06-22T20:00:14.128 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T20:00:14.125+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134363) UID: 0 2023-06-22T20:00:14.129 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T20:00:14.125+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134363) UID: 0 2023-06-22T20:00:14.129 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T20:00:14.125+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134363) UID: 0 2023-06-22T20:02:27.581 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:02:27.586 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:02:58.478 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:02:58.482 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:03:28.608 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:03:28.613 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:03:29.084 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T20:03:29.082+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134476) UID: 0 2023-06-22T20:03:29.085 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T20:03:29.082+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134476) UID: 0 2023-06-22T20:03:29.085 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T20:03:29.082+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134476) UID: 0 2023-06-22T20:03:29.086 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T20:03:29.082+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134476) UID: 0 2023-06-22T20:05:57.007 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:05:57.013 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:06:27.987 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:06:27.993 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:06:28.091 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T20:06:28.089+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134554) UID: 0 2023-06-22T20:06:28.091 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T20:06:28.089+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134554) UID: 0 2023-06-22T20:06:28.092 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T20:06:28.089+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134554) UID: 0 2023-06-22T20:06:28.092 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T20:06:28.089+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134554) UID: 0 2023-06-22T20:08:43.575 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:08:43.581 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:09:13.699 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:09:13.705 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:09:44.995 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:09:45.002 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:09:45.100 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T20:09:45.097+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134653) UID: 0 2023-06-22T20:09:45.100 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T20:09:45.098+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134653) UID: 0 2023-06-22T20:09:45.101 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T20:09:45.098+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134653) UID: 0 2023-06-22T20:09:45.101 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T20:09:45.098+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134653) UID: 0 2023-06-22T20:12:10.580 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:12:10.586 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:12:40.709 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:12:40.714 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:12:41.140 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T20:12:41.137+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134735) UID: 0 2023-06-22T20:12:41.140 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T20:12:41.137+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134735) UID: 0 2023-06-22T20:12:41.141 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T20:12:41.137+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134735) UID: 0 2023-06-22T20:12:41.141 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T20:12:41.138+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134735) UID: 0 2023-06-22T20:14:55.983 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:14:55.988 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:15:26.224 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:15:26.228 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:15:57.381 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:15:57.386 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:15:57.490 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T20:15:57.488+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134834) UID: 0 2023-06-22T20:15:57.491 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T20:15:57.488+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134834) UID: 0 2023-06-22T20:15:57.491 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T20:15:57.488+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134834) UID: 0 2023-06-22T20:15:57.491 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T20:15:57.488+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134834) UID: 0 2023-06-22T20:18:23.206 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:18:23.211 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:18:53.325 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:18:53.330 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:18:53.786 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T20:18:53.783+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134912) UID: 0 2023-06-22T20:18:53.787 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T20:18:53.784+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134912) UID: 0 2023-06-22T20:18:53.787 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T20:18:53.784+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134912) UID: 0 2023-06-22T20:18:53.788 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T20:18:53.784+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 134912) UID: 0 2023-06-22T20:21:13.402 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:21:13.407 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:21:43.516 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:21:43.521 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:22:13.631 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:22:13.635 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:22:13.735 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T20:22:13.733+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135024) UID: 0 2023-06-22T20:22:13.736 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T20:22:13.733+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135024) UID: 0 2023-06-22T20:22:13.736 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T20:22:13.733+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135024) UID: 0 2023-06-22T20:22:13.737 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T20:22:13.733+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135024) UID: 0 2023-06-22T20:24:42.188 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:24:42.195 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:25:12.309 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:25:12.314 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:25:12.413 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T20:25:12.410+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135099) UID: 0 2023-06-22T20:25:12.413 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T20:25:12.410+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135099) UID: 0 2023-06-22T20:25:12.414 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T20:25:12.410+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135099) UID: 0 2023-06-22T20:25:12.414 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T20:25:12.411+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135099) UID: 0 2023-06-22T20:27:29.366 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:27:29.371 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:27:59.482 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:27:59.486 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:28:30.573 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:28:30.577 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:28:30.675 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T20:28:30.673+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135199) UID: 0 2023-06-22T20:28:30.675 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T20:28:30.673+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135199) UID: 0 2023-06-22T20:28:30.676 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T20:28:30.673+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135199) UID: 0 2023-06-22T20:28:30.676 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T20:28:30.673+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135199) UID: 0 2023-06-22T20:31:04.689 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:31:04.698 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:31:34.812 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:31:34.817 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:31:35.284 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T20:31:35.282+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135278) UID: 0 2023-06-22T20:31:35.285 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T20:31:35.282+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135278) UID: 0 2023-06-22T20:31:35.285 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T20:31:35.282+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135278) UID: 0 2023-06-22T20:31:35.285 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T20:31:35.283+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135278) UID: 0 2023-06-22T20:33:57.244 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:33:57.249 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:34:27.359 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:34:27.364 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:34:58.631 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:34:58.637 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:34:58.737 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T20:34:58.735+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135379) UID: 0 2023-06-22T20:34:58.738 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T20:34:58.735+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135379) UID: 0 2023-06-22T20:34:58.738 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T20:34:58.735+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135379) UID: 0 2023-06-22T20:34:58.739 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T20:34:58.735+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135379) UID: 0 2023-06-22T20:37:26.929 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:37:26.934 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:37:57.061 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:37:57.066 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:37:57.157 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T20:37:57.155+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135454) UID: 0 2023-06-22T20:37:57.159 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T20:37:57.155+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135454) UID: 0 2023-06-22T20:37:57.159 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T20:37:57.155+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135454) UID: 0 2023-06-22T20:37:57.160 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T20:37:57.155+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135454) UID: 0 2023-06-22T20:40:19.322 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:40:19.329 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:40:49.450 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:40:49.456 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:41:19.578 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:41:19.588 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:41:19.690 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T20:41:19.687+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135567) UID: 0 2023-06-22T20:41:19.690 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T20:41:19.688+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135567) UID: 0 2023-06-22T20:41:19.691 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T20:41:19.687+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135567) UID: 0 2023-06-22T20:41:19.691 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T20:41:19.688+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135567) UID: 0 2023-06-22T20:43:49.133 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:43:49.149 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:44:19.253 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:44:19.258 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:44:19.665 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T20:44:19.663+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135642) UID: 0 2023-06-22T20:44:19.666 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T20:44:19.663+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135642) UID: 0 2023-06-22T20:44:19.666 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T20:44:19.663+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135642) UID: 0 2023-06-22T20:44:19.667 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T20:44:19.663+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135642) UID: 0 2023-06-22T20:46:34.239 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:46:34.243 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:47:04.351 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:47:04.356 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:47:34.465 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:47:34.470 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:47:34.565 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T20:47:34.563+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135742) UID: 0 2023-06-22T20:47:34.565 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T20:47:34.563+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135742) UID: 0 2023-06-22T20:47:34.566 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T20:47:34.563+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135742) UID: 0 2023-06-22T20:47:34.566 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T20:47:34.563+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135742) UID: 0 2023-06-22T20:50:04.700 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:50:04.705 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:50:34.846 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:50:34.851 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:50:35.166 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T20:50:35.162+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135822) UID: 0 2023-06-22T20:50:35.167 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T20:50:35.162+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135822) UID: 0 2023-06-22T20:50:35.167 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T20:50:35.163+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135822) UID: 0 2023-06-22T20:50:35.167 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T20:50:35.163+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135822) UID: 0 2023-06-22T20:52:50.530 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:52:50.535 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:53:20.645 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:53:20.649 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:53:50.767 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:53:50.772 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:53:50.880 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T20:53:50.877+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135922) UID: 0 2023-06-22T20:53:50.880 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T20:53:50.877+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135922) UID: 0 2023-06-22T20:53:50.880 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T20:53:50.877+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135922) UID: 0 2023-06-22T20:53:50.881 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T20:53:50.877+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135922) UID: 0 2023-06-22T20:56:16.628 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:56:16.634 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:56:46.741 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:56:46.745 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:56:46.839 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T20:56:46.837+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135998) UID: 0 2023-06-22T20:56:46.839 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T20:56:46.837+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135998) UID: 0 2023-06-22T20:56:46.839 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T20:56:46.837+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135998) UID: 0 2023-06-22T20:56:46.840 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T20:56:46.837+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135998) UID: 0 2023-06-22T20:59:03.773 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:59:03.779 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:59:33.889 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T20:59:33.894 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:00:05.086 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:00:05.091 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:00:05.196 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T21:00:05.194+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136106) UID: 0 2023-06-22T21:00:05.196 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T21:00:05.194+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136106) UID: 0 2023-06-22T21:00:05.197 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T21:00:05.194+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136106) UID: 0 2023-06-22T21:00:05.197 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T21:00:05.194+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136106) UID: 0 2023-06-22T21:02:31.724 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:02:31.730 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:03:01.848 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:03:01.853 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:03:01.957 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T21:03:01.955+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136188) UID: 0 2023-06-22T21:03:01.958 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T21:03:01.955+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136188) UID: 0 2023-06-22T21:03:01.958 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T21:03:01.955+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136188) UID: 0 2023-06-22T21:03:01.959 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T21:03:01.955+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136188) UID: 0 2023-06-22T21:05:15.501 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:05:15.506 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:05:45.621 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:05:45.625 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:06:15.736 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:06:15.741 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:06:15.841 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T21:06:15.839+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136295) UID: 0 2023-06-22T21:06:15.841 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T21:06:15.839+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136295) UID: 0 2023-06-22T21:06:15.841 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T21:06:15.839+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136295) UID: 0 2023-06-22T21:06:15.842 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T21:06:15.839+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136295) UID: 0 2023-06-22T21:08:41.543 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:08:41.548 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:09:11.672 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:09:11.677 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:09:41.812 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:09:41.816 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:09:41.909 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T21:09:41.906+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136395) UID: 0 2023-06-22T21:09:41.910 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T21:09:41.906+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136395) UID: 0 2023-06-22T21:09:41.910 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T21:09:41.906+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136395) UID: 0 2023-06-22T21:09:41.910 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T21:09:41.906+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136395) UID: 0 2023-06-22T21:12:18.128 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:12:18.133 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:12:48.245 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:12:48.250 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:12:48.348 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T21:12:48.345+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136475) UID: 0 2023-06-22T21:12:48.349 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T21:12:48.345+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136475) UID: 0 2023-06-22T21:12:48.349 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T21:12:48.345+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136475) UID: 0 2023-06-22T21:12:48.349 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T21:12:48.346+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136475) UID: 0 2023-06-22T21:15:08.458 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:15:08.463 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:15:38.572 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:15:38.577 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:16:09.714 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:16:09.725 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:16:09.822 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T21:16:09.820+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136585) UID: 0 2023-06-22T21:16:09.823 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T21:16:09.820+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136585) UID: 0 2023-06-22T21:16:09.823 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T21:16:09.821+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136585) UID: 0 2023-06-22T21:16:09.823 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T21:16:09.821+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136585) UID: 0 2023-06-22T21:18:37.794 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:18:37.800 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:19:08.816 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:19:08.821 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:19:09.135 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T21:19:09.132+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136662) UID: 0 2023-06-22T21:19:09.135 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T21:19:09.132+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136662) UID: 0 2023-06-22T21:19:09.136 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T21:19:09.132+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136662) UID: 0 2023-06-22T21:19:09.136 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T21:19:09.132+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136662) UID: 0 2023-06-22T21:21:28.025 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:21:28.036 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:21:58.147 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:21:58.152 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:22:29.543 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:22:29.547 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:22:29.650 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T21:22:29.648+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136765) UID: 0 2023-06-22T21:22:29.650 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T21:22:29.648+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136765) UID: 0 2023-06-22T21:22:29.651 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T21:22:29.648+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136765) UID: 0 2023-06-22T21:22:29.651 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T21:22:29.648+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136765) UID: 0 2023-06-22T21:24:56.485 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:24:56.490 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:25:27.248 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:25:27.254 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:25:27.353 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T21:25:27.351+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136841) UID: 0 2023-06-22T21:25:27.354 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T21:25:27.351+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136841) UID: 0 2023-06-22T21:25:27.354 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T21:25:27.351+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136841) UID: 0 2023-06-22T21:25:27.354 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T21:25:27.352+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136841) UID: 0 2023-06-22T21:27:05.781 INFO:teuthology.orchestra.run.smithi045.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-osd.5.log.1: 2023-06-22T21:27:05.782 INFO:teuthology.orchestra.run.smithi045.stderr:gzip: stdin: file size changed while zipping 2023-06-22T21:27:42.530 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:27:42.540 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:28:12.661 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:28:12.666 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:28:43.860 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:28:43.865 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:28:43.958 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T21:28:43.956+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136940) UID: 0 2023-06-22T21:28:43.958 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T21:28:43.956+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136940) UID: 0 2023-06-22T21:28:43.959 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T21:28:43.956+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136940) UID: 0 2023-06-22T21:28:43.959 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T21:28:43.956+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136940) UID: 0 2023-06-22T21:31:11.750 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:31:11.755 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:31:41.867 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:31:41.871 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:31:41.978 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T21:31:41.976+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 137019) UID: 0 2023-06-22T21:31:41.978 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T21:31:41.976+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 137019) UID: 0 2023-06-22T21:31:41.979 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T21:31:41.976+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 137019) UID: 0 2023-06-22T21:31:41.979 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T21:31:41.976+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 137019) UID: 0 2023-06-22T21:33:57.596 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:33:57.601 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:34:27.711 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:34:27.716 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:34:58.983 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:34:58.987 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:34:59.083 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T21:34:59.081+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 137119) UID: 0 2023-06-22T21:34:59.084 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T21:34:59.082+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 137119) UID: 0 2023-06-22T21:34:59.084 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T21:34:59.082+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 137119) UID: 0 2023-06-22T21:34:59.085 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T21:34:59.082+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 137119) UID: 0 2023-06-22T21:37:29.598 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:37:29.603 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:37:59.703 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:37:59.708 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:38:00.058 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T21:38:00.056+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 137194) UID: 0 2023-06-22T21:38:00.059 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T21:38:00.056+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 137194) UID: 0 2023-06-22T21:38:00.059 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T21:38:00.057+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 137194) UID: 0 2023-06-22T21:38:00.059 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T21:38:00.057+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 137194) UID: 0 2023-06-22T21:40:22.296 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:40:22.303 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:40:52.417 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:40:52.426 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:41:23.732 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:41:23.739 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:41:23.835 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T21:41:23.833+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 137306) UID: 0 2023-06-22T21:41:23.835 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T21:41:23.833+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 137306) UID: 0 2023-06-22T21:41:23.836 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T21:41:23.833+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 137306) UID: 0 2023-06-22T21:41:23.836 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T21:41:23.833+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 137306) UID: 0 2023-06-22T21:43:51.598 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:43:51.604 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:44:22.458 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:44:22.463 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:44:22.560 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T21:44:22.557+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 137381) UID: 0 2023-06-22T21:44:22.561 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T21:44:22.557+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 137381) UID: 0 2023-06-22T21:44:22.561 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T21:44:22.557+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 137381) UID: 0 2023-06-22T21:44:22.561 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T21:44:22.557+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 137381) UID: 0 2023-06-22T21:46:43.654 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:46:43.664 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:47:13.781 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:47:13.786 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:47:45.108 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:47:45.114 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:47:45.216 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T21:47:45.213+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 137482) UID: 0 2023-06-22T21:47:45.217 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T21:47:45.214+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 137482) UID: 0 2023-06-22T21:47:45.218 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T21:47:45.214+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 137482) UID: 0 2023-06-22T21:47:45.218 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T21:47:45.214+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 137482) UID: 0 2023-06-22T21:50:13.818 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:50:13.823 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:50:43.973 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:50:43.988 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:50:44.086 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T21:50:44.084+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 137563) UID: 0 2023-06-22T21:50:44.086 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T21:50:44.084+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 137563) UID: 0 2023-06-22T21:50:44.087 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T21:50:44.084+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 137563) UID: 0 2023-06-22T21:50:44.087 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T21:50:44.084+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 137563) UID: 0 2023-06-22T21:52:59.640 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:52:59.663 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:53:29.779 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:53:29.784 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:53:59.885 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:53:59.890 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:53:59.984 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T21:53:59.982+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 137663) UID: 0 2023-06-22T21:53:59.985 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T21:53:59.982+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 137663) UID: 0 2023-06-22T21:53:59.985 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T21:53:59.982+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 137663) UID: 0 2023-06-22T21:53:59.986 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T21:53:59.982+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 137663) UID: 0 2023-06-22T21:56:26.661 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:56:26.668 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:56:56.773 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:56:56.778 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:56:57.131 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T21:56:57.127+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 137739) UID: 0 2023-06-22T21:56:57.131 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T21:56:57.128+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 137739) UID: 0 2023-06-22T21:56:57.132 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T21:56:57.128+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 137739) UID: 0 2023-06-22T21:56:57.133 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T21:56:57.128+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 137739) UID: 0 2023-06-22T21:59:13.673 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:59:13.680 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:59:43.787 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T21:59:43.793 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T22:00:15.084 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T22:00:15.089 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T22:00:15.186 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T22:00:15.184+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 137847) UID: 0 2023-06-22T22:00:15.187 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T22:00:15.184+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 137847) UID: 0 2023-06-22T22:00:15.187 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T22:00:15.184+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 137847) UID: 0 2023-06-22T22:00:15.187 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T22:00:15.184+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 137847) UID: 0 2023-06-22T22:02:40.951 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T22:02:40.974 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T22:03:11.082 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T22:03:11.088 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T22:03:11.519 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T22:03:11.516+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 137936) UID: 0 2023-06-22T22:03:11.520 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T22:03:11.516+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 137936) UID: 0 2023-06-22T22:03:11.520 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T22:03:11.517+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 137936) UID: 0 2023-06-22T22:03:11.520 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T22:03:11.517+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 137936) UID: 0 2023-06-22T22:05:22.490 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T22:05:22.495 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T22:05:54.028 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T22:05:54.033 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T22:06:24.143 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T22:06:24.147 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T22:06:24.558 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T22:06:24.556+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 138036) UID: 0 2023-06-22T22:06:24.558 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T22:06:24.556+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 138036) UID: 0 2023-06-22T22:06:24.559 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T22:06:24.556+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 138036) UID: 0 2023-06-22T22:06:24.559 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T22:06:24.557+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 138036) UID: 0 2023-06-22T22:08:47.335 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T22:08:47.339 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T22:09:17.448 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T22:09:17.453 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T22:09:47.564 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T22:09:47.569 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T22:09:47.666 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T22:09:47.665+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 138136) UID: 0 2023-06-22T22:09:47.667 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T22:09:47.665+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 138136) UID: 0 2023-06-22T22:09:47.667 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T22:09:47.665+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 138136) UID: 0 2023-06-22T22:09:47.668 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T22:09:47.665+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 138136) UID: 0 2023-06-22T22:12:20.191 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T22:12:20.197 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T22:12:50.327 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T22:12:50.337 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T22:12:50.741 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T22:12:50.739+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 138216) UID: 0 2023-06-22T22:12:50.742 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T22:12:50.739+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 138216) UID: 0 2023-06-22T22:12:50.742 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T22:12:50.739+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 138216) UID: 0 2023-06-22T22:12:50.742 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T22:12:50.739+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 138216) UID: 0 2023-06-22T22:15:08.076 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T22:15:08.081 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T22:15:38.198 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T22:15:38.203 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T22:16:14.428 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T22:16:14.433 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T22:16:14.530 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T22:16:14.529+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 138325) UID: 0 2023-06-22T22:16:14.531 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T22:16:14.529+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 138325) UID: 0 2023-06-22T22:16:14.532 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T22:16:14.529+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 138325) UID: 0 2023-06-22T22:16:14.532 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T22:16:14.529+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 138325) UID: 0 2023-06-22T22:18:43.659 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T22:18:43.664 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T22:19:13.773 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T22:19:13.779 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T22:19:13.873 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T22:19:13.871+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 138401) UID: 0 2023-06-22T22:19:13.873 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T22:19:13.871+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 138401) UID: 0 2023-06-22T22:19:13.874 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T22:19:13.871+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 138401) UID: 0 2023-06-22T22:19:13.874 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T22:19:13.871+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 138401) UID: 0 2023-06-22T22:21:29.558 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T22:21:29.565 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T22:21:59.680 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T22:21:59.685 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T22:22:30.986 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T22:22:30.991 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T22:22:31.086 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T22:22:31.085+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 138506) UID: 0 2023-06-22T22:22:31.087 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T22:22:31.085+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 138506) UID: 0 2023-06-22T22:22:31.088 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T22:22:31.085+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 138506) UID: 0 2023-06-22T22:22:31.088 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T22:22:31.085+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 138506) UID: 0 2023-06-22T22:24:56.710 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T22:24:56.715 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T22:25:26.850 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T22:25:26.856 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T22:25:57.172 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T22:25:57.176 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T22:25:57.274 INFO:tasks.ceph.osd.4.smithi045.stderr:2023-06-22T22:25:57.272+0000 7f81021f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 138608) UID: 0 2023-06-22T22:25:57.275 INFO:tasks.ceph.osd.6.smithi045.stderr:2023-06-22T22:25:57.273+0000 7f79a43f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 138608) UID: 0 2023-06-22T22:25:57.276 INFO:tasks.ceph.osd.5.smithi045.stderr:2023-06-22T22:25:57.273+0000 7fc2fe3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 138608) UID: 0 2023-06-22T22:25:57.276 INFO:tasks.ceph.osd.7.smithi045.stderr:2023-06-22T22:25:57.273+0000 7f85b7df9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 138608) UID: 0 2023-06-22T22:28:27.779 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T22:28:27.784 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-22T22:28:39.425 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-06-22T22:28:39.426 DEBUG:teuthology.task.console_log:Killing console logger for smithi040 2023-06-22T22:28:39.427 DEBUG:teuthology.task.console_log:Killing console logger for smithi045 2023-06-22T22:28:39.427 DEBUG:teuthology.exit:Finished running handlers